Vehicle Camera Visibility Extension via Cumulative Virtual Image
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing visual reversing aid systems using cameras on vehicles face challenges in reconstructing obstacles at low speeds due to short stereoscopic base, requiring high precision sensors and costly calculation power, and can only reconstruct objects within the camera's field of view during two successive image acquisitions.
Innovation Solution
A method that generates a basic virtual image correlated with real images, characterizes points of interest, and builds a cumulative virtual image by superimposing new images on previous ones, with transparency adjustments based on color differences, allowing for extended visibility area without the need for high precision sensors.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If a single image acquisition apparatus is used for visual reversing aid, then the system complexity is reduced, but the measurement precision of obstacle distance deteriorates
Solution Approach 1:
The patent divides the obstacle detection task into two independent stages: (1) generating a basic virtual image from a single real image through pixel correlation with a planar surface model, and (2) extending visibility by superimposing multiple basic virtual images to form a cumulative virtual image. This segmentation allows each stage to be optimized independently, achieving extended visibility without requiring complex multi-camera systems.
Solution Approach 2:
The patent transforms the 3D obstacle detection problem into a 2D virtual image generation problem by correlating pixels with a planar surface model. This dimensionality change simplifies the measurement process while maintaining accuracy, as the planar surface assumption provides sufficient constraints for distance calculation from a single image.
2Speed
If the vehicle moves at low speed during maneuver, then the stereoscopic base becomes very short, but the three-dimensional image reconstruction becomes difficult
Solution Approach 1:
The patent pre-establishes a planar surface model of the ground before image acquisition. This preliminary action provides a reference framework that allows accurate virtual image generation even when vehicle displacement between images is minimal, eliminating the need for large stereoscopic base that would otherwise be required.
Solution Approach 2:
The patent creates a basic virtual image that is a correlated copy of the real image, transformed according to the planar surface model. This copying process generates a top-down view that preserves distance information without requiring physical camera displacement, enabling accurate reconstruction at low speeds.
3Measurement precision
If successive image acquisitions are used for stereoscopic view, then obstacle distance can be determined, but the visibility area is limited to the camera field of view
Solution Approach 1:
The patent merges multiple basic virtual images into a single cumulative virtual image through superimposition. This combining process extends the visibility area beyond the original camera field of view, as each new basic virtual image adds previously unseen areas while overlapping regions provide redundant distance measurements.
Solution Approach 2:
The patent continuously accumulates virtual images as the vehicle moves, maintaining an ever-expanding cumulative virtual image. This continuous accumulation ensures that the visibility area grows with vehicle displacement, providing extended coverage without requiring the camera to pan or tilt.
4Measurement precision
If high precision sensors are used for obstacle detection, then the reconstruction accuracy is improved, but the device complexity and cost increase
Solution Approach 1:
The patent replaces expensive high-precision sensors with a standard camera and computational algorithms. By using a single image acquisition apparatus with a planar surface model, the system achieves accurate obstacle detection without requiring costly specialized sensors, making the solution more economically viable.
Solution Approach 2:
The patent substitutes mechanical sensor precision requirements with computational image processing. Instead of relying on high-precision hardware sensors, the system uses pixel correlation algorithms and planar surface modeling to extract accurate distance measurements from standard camera images.
Data Source
AI summary
In order to extend a visibility area of a camera mounted on a vehicle, the method of the invention comprises a step of generating a basic virtual image (I2v) in which a set of pixels of the basic virtual image is correlated with a set of pixels of a real image (I1R) captured by the camera while taking into account that the set of pixels of the real image reproduces a planar surface of the real world, and a step of building a virtual cumulative image (I3v) in which at least a portion of the basic virtual image (I2v) is superimposed on at least a portion of the cumulative virtual image (I3v) while coinciding the points of interest of the basic virtual image (I2v) with the points of interest of the cumulative virtual image (I3v).


