Merging Partial Images for Low-Distortion Surround View
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing driver assistance systems face challenges in presenting undistorted images of a vehicle's environment, particularly in the region of seam lines, making it difficult to estimate distances and replace traditional mirrors effectively.
Innovation Solution
A method involving multiple environmental sensors, including 2D and stereo cameras, captures partial images and uses virtual sensors arranged perpendicular to seam lines to merge images with minimal distortion, allowing for the generation of low-distortion three-dimensional images that can replace traditional mirrors.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of stationary object
If multiple cameras are used to capture environmental images, then the coverage of blind spots is improved, but distortions appear at seam lines where images are merged
Solution Approach 1:
The environmental monitoring task is divided into multiple partial regions, each captured by a separate camera. The image processing system then merges these segmented partial images into a complete environmental view, resolving the contradiction between coverage area and distortion by handling each segment independently before integration.
Solution Approach 2:
A virtual camera model acts as an intermediary between the physical cameras and the final merged image. This virtual model calculates transformation parameters that compensate for perspective differences and distortion at seam lines, enabling seamless merging of multiple camera views without direct geometric conflicts.
2Object-affected harmful factors
If traditional mirrors are replaced by camera images, then wind resistance is reduced, but distance estimation becomes difficult
Solution Approach 1:
The mechanical mirror system is replaced with an optical-electronic image capture and display system. Multiple cameras capture environmental images that are processed and merged to create a comprehensive view, eliminating the need for physical mirrors and reducing wind resistance while maintaining monitoring capability.
Solution Approach 2:
The system transitions from two-dimensional mirror reflection to three-dimensional image capture and processing. By capturing images from multiple angles and depths using multiple cameras, the system creates a volumetric understanding of the environment that enables accurate distance estimation while eliminating the need for traditional mirrors.
3Area of stationary object
If cameras are positioned to capture maximum environmental area, then blind spots are reduced, but image distortion at seam lines increases
Solution Approach 1:
The system dynamically adjusts the virtual camera positions and transformation parameters based on the actual content and geometry of the captured images. This dynamic optimization allows the system to maintain maximum environmental coverage while minimizing distortion at seam lines through adaptive parameter adjustment during image processing.
Data Source
AI summary
A driver assistance system and a method for merging partial images to form an image of a contiguous surrounding region of a mode of transport are provided. The method includes the following steps: detecting a first partial region of the surrounding region by a first environmental sensor; detecting a second partial region of the surrounding region by a second environmental sensor; generating a first partial image of the first partial region on the basis of a signal from the first environmental sensor; generating a second partial image of the second partial region on the basis of a signal of the second environmental sensor and a multiplicity of virtual sensors for detecting the second partial region; and merging the first partial image and the second partial image along a straight first joining line, wherein the virtual sensors are arranged at positions substantially on a perpendicular to the joining line.