Stereo Camera Depth Imaging in Low Light via RGB-IR Fusion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Stereo camera systems face difficulties in recognizing images and generating depth images under low light levels, which limits their ability to function effectively.
Innovation Solution
An image processing system that includes a camera unit capable of obtaining both RGB and IR images, with IR emission units to enhance image capture in low light conditions, and processing units to synchronize and generate depth images from these inputs, allowing for accurate depth image generation even in low illumination.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a stereo camera system is used to obtain depth images, then depth information can be generated through stereo matching, but the system fails to recognize images and generate depth images under low light levels
Solution Approach 1:
The patent combines RGB camera data and IR camera data into a unified image processing system. The RGB sensor captures color information while the IR sensor captures infrared radiation, and both data streams are processed together through stereo matching to generate depth images that work effectively in low light conditions.
Solution Approach 2:
The IR camera acts as an intermediary that provides additional information about the scene in low light conditions. The IR data serves as a mediator that enables depth perception when visible light is insufficient, complementing the RGB camera's limitations.
2Reliability
If only RGB images are captured, then color information is obtained, but depth image generation fails under low light conditions
Solution Approach 1:
The system changes the operational parameters by introducing IR sensitivity to the camera system. The IR sensor operates in a different spectral band (infrared) compared to the RGB sensor (visible light), allowing the system to capture images reliably across different illumination conditions by utilizing a different parameter space.
3Productivity
If stereo matching is performed with RGB images only, then color 3D images can be generated, but the process fails in low illumination environments
Solution Approach 1:
The imaging system achieves multi-functionality by integrating both RGB and IR sensing capabilities into a single stereo camera system. This universal system can operate effectively in both well-lit and low-light conditions, generating depth images and 3D reconstructions across varying illumination environments.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The system enables accurate depth image generation and 3D image processing under low light levels by simultaneously obtaining RGB and IR images through IR emission, and can detect low light levels while operating normally, ensuring reliable image capture.
Implementation Method 1
at least one emission unit configured to emit an IR
Implementation Method 2
a first sensor unit configured to obtain a left RGB image and an IR image, a second sensor unit configured to obtain a right RGB image and an IR image
Data Source
AI summary
An image processing system is provided, the image processing system according to an exemplary embodiment of the present disclosure being configured to generate an accurate depth image even in a low light level by obtaining RGB images and/or IR images.