Radar-Based Top View Image Generation for Vehicle Surroundings

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current automotive systems for determining objects around a vehicle, such as digital imaging devices and camera systems, face challenges with distortion artifacts and high computational costs, making them expensive and difficult to interpret effectively for drivers.

Innovation Solution

A device using a radar sensor unit with a processing unit to generate a top-view image of the vehicle's surroundings, combined with data from other sensors and algorithms for image enhancement, provides a user-friendly representation of objects around the vehicle, including doppler data and machine learning for improved accuracy and visual quality.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If camera systems with multiple sensors and complex projection algorithms are used to generate top view images, then the visual quality and information content of the displayed image is improved, but the device cost and processing complexity increase significantly

Engineering Contradiction:
Improvevisual quality and information contentVSAvoiddevice cost and processing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent replaces complex optical-mechanical camera projection systems with a radar-based detection system. Instead of using multiple camera sensors and complex projective geometry algorithms to generate top views, the system uses radar sensors to directly obtain distance and position data of surrounding objects, which is then processed into a simplified top view representation. This substitution eliminates the need for expensive camera arrays and complex image projection computations while maintaining the essential function of providing a top-down environmental overview.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Device complexity

If simple ultrasonic sensors are used to show obstacles as distance rings, then the device cost is reduced, but the interpretability and visual appeal of the representation deteriorates

Engineering Contradiction:
Improvedevice costVSAvoidinterpretability and visual appeal
Core Design Contradiction:
Device complexityVSEase of operation

Solution Approach 1:

The patent changes the representation parameters from simple radial distance rings to a top view coordinate system that maps object positions onto a 2D plane resembling a bird's-eye view. This transformation uses the radar-derived distance and angle data to plot objects at their correct relative positions in a top-down layout, making the display more intuitive and visually appealing while keeping the underlying radar sensor technology simple and cost-effective.

Inventive Principle:
Principle #35Parameter changes

3Device complexity

If projection algorithms assume a flat world to transform camera images to the road surface, then the processing complexity is reduced, but distortion artifacts appear in the generated image

Engineering Contradiction:
Improveprocessing complexityVSAvoidimage accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent avoids the flat-world projection assumption by replacing camera-based image projection with radar-based point cloud generation. Radar sensors directly provide accurate distance measurements to objects regardless of their height or position in 3D space. The processing unit uses these direct distance measurements to plot objects at their true relative positions in the top view, eliminating the need for complex 3D-to-2D projection transformations that cause distortion artifacts when objects are above the ground plane.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The solution offers a cost-effective, accurate, and user-friendly method for displaying objects around a vehicle, enhancing safety by providing clear top-view images that can be displayed on a dashboard or portable device, while also enabling autonomous driving functions.

Implementation Method 1

The device comprises a sensor unit which comprises at least one radar sensor. The radar sensor is adapted to obtain radar image data of the external surroundings of the vehicle

Methodology Applied
Scientific EffectRadar: Radar

Implementation Method 2

The device further comprises a processing unit, which is adapted to process the obtained radar image data to generate a top view image of the external surroundings of the vehicle indicating the relative position of the vehicle with respect to the determined objects

Methodology Applied
Scientific EffectImage processing and coordinate transformation:

Data Source

PatentEP4194883A1Device and method for determining objects around a vehicle
Publication Date: 2023.06.14 APTIV TECHNOLOGIES AG
  • EP4194883A1 patent drawingFigure 1
  • EP4194883A1 patent drawingFigure 2
  • EP4194883A1 patent drawingFigure 3

AI summary

Device for determining objects around a vehicle, comprising a sensor unit comprising at least one radar sensor arranged and adapted to obtain radar image data of the external surroundings of the vehicle to deter-mine objects around the vehicle and a processing unit adapted to process the radar image data to obtain generate an top view image of the external surroundings of the vehicle indicating the relative position of the vehicle with respect to the determined objects, wherein the generated top view image is displayed on a display unit.