Stacked Radar-Image Sensor for ADAS Data Alignment
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing advanced driver-assistance systems (ADAS) face alignment errors due to differences in field of view and sampling rates between camera and radar sensors, leading to misaligned data when combined.
Innovation Solution
A multi-modality sensor integrating a radio detection and ranging (radar) sensor with an image sensor on a single chip, with controlled correspondence in sampling rates, allowing for time-synchronized data combination and alignment of image and radar data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If camera and radar sensors are used separately in ADAS, then each sensor can capture its own data independently, but alignment errors occur due to differences in field of view and sampling rates
Solution Approach 1:
The patent combines camera sensor and radar sensor into a single integrated sensor unit with a shared substrate. The image sensor and RFIC are stacked together, allowing both sensors to operate simultaneously while maintaining precise spatial and temporal alignment through their integrated architecture, thereby eliminating field of view and sampling rate mismatches
Solution Approach 2:
The integrated sensor unit performs multiple functions simultaneously - both optical imaging (camera function) and electromagnetic wave detection (radar function) are achieved within a single device. This multi-functional design allows the system to capture both visual and radar data with synchronized timing and aligned fields of view
2Adaptability or versatility
If multi-modality sensing is implemented with separate sensors, then comprehensive object detection is achieved, but alignment errors reduce detection precision
Solution Approach 1:
The integrated sensor unit merges camera and radar detection capabilities into a single synchronized system. The shared substrate and coordinated operation ensure that image and radar data are perfectly aligned in both space and time, enabling precise object detection that combines the complementary strengths of both sensing modalities without alignment errors
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The integrated sensor system reduces alignment errors, enhances data synchronization, and improves perception and detection of objects by providing synchronized and aligned image and radar information, while potentially reducing form factor and cost.
Implementation Method 1
Radar sensors use electromagnetic radiated waves instead of a laser used by the LiDAR sensor. A radar sensor may radiate an electromagnetic wave and measure distance, speed, and direction information of an object based on a received reflection of the electromagnetic wave off of the object.
Implementation Method 2
Camera sensors or infrared sensors may be respectively arranged around a vehicle to capture visual information in a driving direction or other surrounding environments of the vehicle.
Data Source
AI summary
A method, apparatus, and system with multi-modality sensing are provided. A multi-modality sensor includes a radio detection and ranging (radar) sensor including a radio-frequency integrated circuit (RFIC), and an image sensor, including a sensor array, stacked on a portion of the radar sensor, with at least a circuitry portion of the image.