Multispectral Thermal Stereo Detection for Low-Cost Vehicle Ranging
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Autonomous and semi-autonomous driving systems face challenges with high costs and resource-intensive data processing due to the use of LIDAR systems for object detection, making them unaffordable for some vehicle classes, while camera-based systems are prone to false positives and noise.
Innovation Solution
Implementing a multispectral object-detection system that combines an illumination system and a binary stereo camera system, utilizing thermal imaging and near-infrared (NIR) cameras to detect objects, reducing processor and memory usage while ensuring accurate object detection.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If LIDAR systems are used for object detection, then measurement precision and reliability are improved, but device complexity and cost increase
Solution Approach 1:
The patent combines multiple camera systems (visible light camera, NIR camera, thermal camera) into an integrated perception system. These cameras work together to provide complementary information for object detection, replacing the need for complex LIDAR systems while maintaining detection accuracy through multi-spectral imaging fusion.
Solution Approach 2:
The perception system uses cameras that serve multiple functions: visible light cameras provide daytime imaging, NIR cameras enhance nighttime and low-light detection, and thermal cameras detect heat signatures. This multi-functional approach replaces the specialized LIDAR system with a versatile camera-based solution that handles various operating conditions.
2Measurement precision
If LIDAR systems are used for object detection, then measurement precision is improved, but cost increases
Solution Approach 1:
The patent replaces expensive LIDAR systems with relatively cheaper camera components. Cameras are mass-produced consumer electronics with lower cost compared to LIDAR systems, making the perception system more affordable while maintaining effective object detection capabilities through multi-spectral imaging.
Solution Approach 2:
The system changes the detection parameter from active laser ranging (LIDAR) to passive and active multi-spectral imaging. By utilizing different wavelengths (visible, NIR, thermal) and processing techniques, the system achieves comparable detection precision with lower-cost camera-based technology.
3Ease of manufacture
If camera-based systems are used for object detection, then cost is reduced, but reliability deteriorates due to false positives and noise
Solution Approach 1:
The patent merges data from multiple camera types (visible light, NIR, thermal) to improve detection reliability. By fusing information from different spectral bands, the system cross-validates detections and reduces false positives that would occur with single-camera systems, thereby enhancing overall reliability.
Solution Approach 2:
The perception system incorporates feedback mechanisms where detection results from one camera type inform the processing of data from other camera types. This multi-camera feedback loop allows the system to verify detections across different spectral bands, reducing false positives and improving detection reliability.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The system provides reliable and efficient object detection and ranging calculations, reducing costs and increasing the affordability of safety features in vehicles, allowing for safe and efficient navigation without the need for expensive LIDAR systems.
Implementation Method 1
a thermal sensor configured to detect thermal radiation emitted from an object in a field-of-view (FOV) of the thermal sensor and from a background around the object
Implementation Method 2
The illumination system can both provide illumination for the stereo camera system and serve as a range-finder... emitters on the NIR cameras illuminate the FOV with NIR radiation
Implementation Method 3
the NIR emitter/detector system can determine the distances to the detected objects using time-of-flight or stereo-ranging techniques
Data Source
AI summary
This document describes techniques, apparatuses, and systems for enabling multispectral object-detection with thermal imaging. A thermal sensor, a multispectral stereo camera system, and an illumination system are used in combination to provide a multispectral object-detection system for use with safety or driving systems for autonomous and semi-autonomous vehicles. The illumination system can provide illumination for the stereo camera system and serve as a range-finder that can determine a distance between the stereo camera system and an object in the system's field-of-view. The stereo camera system can include one or more of various camera or sensor technologies, including infrared or near-infrared, thermal imaging, or visible light. The system can be used to detect objects in the field-of-view, determine a distance to the object, and estimate the object's size and relative motion. The system can reduce costs and resource usage while enabling accurate, high-quality object-detections for safety and autonomous or semi-autonomous control.