Multi-Camera Blind Spot Image Combination Using Stereo Vision
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image processing systems struggle to combine images from cameras with blind spots using three-dimensional information, especially when vehicles approach closely, as they fail to accurately obtain and utilize three-dimensional data from areas outside the cameras' direct stereo vision.
Innovation Solution
An image processing apparatus with multiple cameras (first, second, and third cameras) that uses stereo vision to obtain three-dimensional information of a rear vehicle, storing shape information when the vehicle is within range and applying coordinate transformations to combine images from blind spots effectively, even when the vehicle is close.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If stereo vision is used to obtain three-dimensional information of the rear vehicle, then the image combination accuracy is improved, but the coverage area is reduced due to blind spots
Solution Approach 1:
The patent combines images from multiple cameras (first camera with blind spot and second camera imaging the blind spot area) to create a comprehensive view. By merging the imaging ranges of different cameras, the system achieves both accurate three-dimensional information where available and complete coverage where individual cameras have limitations.
Solution Approach 2:
The patent introduces a third camera as an intermediary to capture areas that are blind spots for the first camera. This third camera acts as a mediator to fill the coverage gap, allowing the system to maintain both precision in measurable areas and completeness in overall coverage.
2Loss of information
If the rear vehicle approaches very closely, then the detail information is improved, but the three-dimensional information cannot be obtained due to entering blind spot
Solution Approach 1:
The patent segments the imaging task across multiple cameras with different fields of view. The first camera captures detailed information of close objects within its imaging range, while the third camera specifically captures areas that become blind spots when vehicles approach closely. This segmentation allows the system to maintain both detail information and three-dimensional measurement capability.
Solution Approach 2:
The patent adds another dimension to the imaging system by introducing a third camera that provides a different viewing angle. This dimensional addition allows the system to obtain three-dimensional information of approaching vehicles even when they enter the blind spot area of the first camera, maintaining measurement precision across all distances.
3Device complexity
If only two cameras are used for stereo vision, then the device complexity is reduced, but the three-dimensional information coverage is insufficient
Solution Approach 1:
The patent makes the third camera multi-functional: it serves both as a filler for blind spot coverage and as a participant in stereo vision for three-dimensional measurement. This universal camera design allows the system to achieve comprehensive coverage without proportionally increasing complexity, as the third camera performs multiple functions simultaneously.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables accurate and seamless combination of images from first and second cameras, providing a see-through view by determining and using three-dimensional information for areas outside the direct stereo vision, thus overcoming the limitations of existing systems.
Implementation Method 1
a three-dimensional information obtaining unit configured to obtain three-dimensional information representing a shape of a rear vehicle with stereo vision of the second camera and the third camera
Data Source
Figure 1
Figure 2(A)~2(C)
Figure 3(A)~3(C)
AI summary
An image processing apparatus includes an image obtaining unit configured to obtain an image taken by a first camera, an image taken by a second camera, and an image taken by a third camera, a combining unit configured to combine a blind spot image taken by the second camera with the image taken by the first camera on an area of a blind spot of the image taken by the first camera, a three-dimensional information obtaining unit configured to obtain three-dimensional information of a rear vehicle with stereo vision of the second camera and the third camera, and a storing unit configured to store vehicle shape information of the rear vehicle when an entirety of the rear vehicle is within a range of the stereo vision, and determines three-dimensional information corresponding to a portion of the rear vehicle using the three-dimensional information obtained by the three-dimensional information obtaining unit and the vehicle shape information stored by the storing unit when the portion of the rear vehicle is outside the range of the stereo vision, and combines images.