Virtual Bottom View Rendering for Hidden Vehicle Underside Hazards
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing vehicle camera systems do not provide a live view of the road surface beneath the vehicle, limiting the driver's ability to see potential hazards and objects, and two-dimensional images fail to convey depth or size of objects in the vehicle's surroundings.
Innovation Solution
A system utilizing Structure from Motion (SfM) and movement sensors to generate a three-dimensional view of objects, synthesizing this with real-time camera views to create a virtual bottom view on the vehicle display, enabling the driver to see beneath the vehicle during parking events.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If a camera system is positioned to capture images of the road surface beneath the vehicle, then the driver can see potential hazards and objects beneath the vehicle, but the camera cannot be positioned to capture this view due to the vehicle blocking the camera's field of view
Solution Approach 1:
The system captures images of the road surface beneath the vehicle in advance, before the vehicle moves to block the view. By taking pictures when the area is still visible and then using image processing to reconstruct the view, the system preserves information that would otherwise be lost when the vehicle blocks the camera's field of view.
Solution Approach 2:
The system creates a virtual copy of the road surface view through image processing and rendering techniques. By processing captured images to generate a synthetic view of the area beneath the vehicle, the system provides visibility without requiring a physical camera positioned in an impossible location.
2Device complexity
If two-dimensional camera images are used to display the vehicle's surroundings, then the system is simple to implement, but the driver cannot perceive the depth or size of objects accurately
Solution Approach 1:
The system transforms two-dimensional camera images into a three-dimensional virtual view by processing multiple images from different angles and reconstructing the spatial relationships of objects. This dimensional transformation allows the driver to perceive depth and size accurately while maintaining relative system simplicity through software-based processing.
3Speed
If a live view of the area beneath the vehicle is captured continuously, then the driver can monitor hazards in real-time, but no camera can be positioned to capture this view directly
Solution Approach 1:
The system creates a virtual live view of the road surface beneath the vehicle by processing images captured from visible areas and rendering them in real-time. This virtual copying approach provides continuous monitoring capability without requiring a physical camera positioned where none can exist.
Solution Approach 2:
The system uses image processing algorithms as an intermediary to translate visible area images into a view of the hidden area beneath the vehicle. This computational mediator enables real-time visualization of the obscured region without requiring direct optical access.
Data Source
AI summary
Methods and systems for generating and displaying a virtual bottom view associated with a vehicle. Cameras generate images of a parking zone. A processor is programmed to generate image data associated with a first region of the parking zone that includes an object. Movement sensors generate movement data associated with movement of the vehicle during the time in which the image data is generated. A Structure from Motion (SfM) model generates a three-dimensional view associated with the object. Subsequently, when the object is out of view of the cameras, a synthesis model is executed to synthesize the current live view with the three-dimensional view. A virtual bottom view is displayed on a vehicle display during a parking event based on the synthesis, enabling a user to see a three-dimensional virtual view of the object when the object is not in the current field of view during the parking event.