Multi-Spectral Camera Lidar Fusion for Vehicle Distance Measurement
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Modern cars equipped with dash cams capture environmental views but lack effective means to provide accurate distance information to drivers or driving-assisting systems about objects in their vicinity, limiting the utility of this data for real-time decision-making.
Innovation Solution
A system combining a multi-spectral camera and a Lidar device to capture and associate environmental images with distance data, allowing for the display of object distances and generating commands for vehicle systems, such as braking or acceleration, based on detected objects and their proximity.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a multi-spectral camera and Lidar device are combined to provide distance information, then measurement precision is improved, but device complexity increases
Solution Approach 1:
The patent combines a multi-spectral camera and a Lidar device into a single integrated system. The camera captures images in multiple spectral bands including the Lidar wavelength, allowing spatial and spectral information to be merged with distance data from the Lidar. This merging enables accurate distance measurement while utilizing the camera's existing imaging capability, thus improving measurement precision without proportionally increasing device complexity.
Solution Approach 2:
The multi-spectral camera serves multiple functions: it captures visible light images for standard viewing, detects Lidar wavelength reflections for distance measurement, and provides spectral information for material identification. By making the camera multi-functional, the system achieves accurate distance information without requiring a dedicated distance-sensing component, thereby managing device complexity while improving measurement capability.
2Loss of information
If distance information is fused with image data, then information completeness is improved, but processing complexity increases
Solution Approach 1:
The patent uses the multi-spectral camera as an intermediary that captures both visual image data and Lidar wavelength reflections. By detecting reflections of the Lidar wavelength in the captured images, the system creates a bridge between the Lidar distance measurements and the visual scene. This intermediary approach allows distance information to be fused with image data through spectral analysis rather than complex coordinate transformation, reducing processing complexity while maintaining information completeness.
3Speed
If real-time distance measurement is implemented, then response speed is improved, but energy consumption increases
Solution Approach 1:
The system uses the Lidar wavelength reflections that are already present in the environment to provide distance information. The multi-spectral camera passively detects these reflections without requiring additional active illumination or power-intensive sensors. By making the system self-service through passive detection of existing Lidar signals, real-time distance measurement is achieved with minimal additional energy consumption beyond what is already required for standard camera operation.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enhances the driver's view by providing accurate distance information to objects, enabling improved decision-making and automating vehicle operations by integrating fused data into driving-assisting systems.
Implementation Method 1
receiving one or more distance readings related to the environment from a Lidar device emitting light in a predetermined wavelength
Implementation Method 2
a multi spectra camera, the multi spectra camera being sensitive at least to visible light and to the predetermined wavelength
Implementation Method 3
the multi spectra camera being sensitive at least to visible light and to the predetermined wavelength
Implementation Method 4
identifying within the image points or areas having the predetermined wavelength; identifying correspondence between one or more of the light points or areas and one of the readings
Data Source
AI summary
A method, apparatus and computer program product for fusing information, to be performed by a device comprising a processor and a memory device, the method comprising: receiving one or more distance readings related to the environment from a Lidar device emitting light in a predetermined wavelength; receiving an image captured by a multi spectra camera, the multi spectra camera being sensitive at least to visible light and to the predetermined wavelength; identifying within the image points or areas having the predetermined wavelength; identifying one or more objects within the image; identifying correspondence between each of the light points or areas and one of the readings; associating the object with a distance, based on the reading and points or areas within the object; and outputting indication of the object and the distance associated with the at least one object.