Successful demonstration of AI-based camera and radar cross-validation with 77 GHz Automotive Safety Radar

March 20, 2018 | Lawrence, Kansas

Accurate perception of the surroundings is critical for ADAS and L4/L5 autonomous vehicles. To ensure the safety of pedestrians as well as passengers, the vehicle sensor system must perform in all weather and lighting conditions, including rain, snow, darkness, fog/smog, dirt and more. Camera Radar Sensor Fusion is considered the pivotal means to achieve this goal and is often implemented along with other perception technologies such as LiDAR and ultra-sound to provide the redundancy and accuracy required for road safety.

The following demonstration is conducted using the long-range and midrange configurations of Ainstein’s K-77 radar along with a camera through our Radar and Camera Sensor Fusion Platform.

Pairs of radar data and images are taken nearly simultaneously. The radar generates SNR, range, velocity, and azimuth angle data for each detected target. The convolutional neural network (CNN) identifies objects within the camera images. The two data sets are cross-validated using the radar’s azimuth angle and the relative position of the CNN identified objects within the image. The platform is able to cross-validate to correct the missed or false detection by any sensor, while offering the rich information of the detected objects, including object type, distance, and velocity.

Ainstein’s Camera Radar Sensor Fusion Platform is designed for enhanced performance of Blind Spot Detection and Automatic Cruise Control as well as L4/L5 self-driving functions. We’re excited to bring these technologies to more vehicles.

Latest Posts

Mid-Altitude Long Endurance Drone

LR-D1 in Mid-Altitude Long Endurance Drones

Agrodrone

US-D1 in Altimetry & Terrain-Following for Precision in Autonomous Crop Spraying

commercial UAV expo 2023 drone

Highlights of Commercial UAV Expo 2023

Fire fighting drone for forestry & wildfire management

US-D1 in Drones for Forestry Management: Wildfire Surveillance & Suppression

Ready to Start a Conversation?

See what Ainstein can do for you — Just reach out to us with the form below, and we’ll get back to you as soon as possible.

You May Also Like...

Mid-Altitude Long Endurance Drone

LR-D1 in Mid-Altitude Long Endurance Drones

Agrodrone

US-D1 in Altimetry & Terrain-Following for Precision in Autonomous Crop Spraying

commercial UAV expo 2023 drone

Highlights of Commercial UAV Expo 2023