Deformed 3D Projection Surface for Vehicle Environment Visualization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing 3D graphics systems for in-vehicle information systems often inaccurately render the physical environment around a vehicle due to the composition of 2D pictures from cameras, lacking realistic depth perception, which can distort the representation of objects such as mailboxes and buildings.
Innovation Solution
A method and system that generate a three-dimensional virtual environment by using cameras to capture photographs from multiple directions, sensors to determine object shape, distance, and direction, and a processor to deform a default projection surface based on sensor data, projecting the photographs onto the deformed surface for a more accurate and realistic display.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If a uniform 3D projection surface (fishbowl hemispherical surface) is used to composite multiple photographs, then the 3D environment can be generated efficiently, but the depth perception and realism of objects at different distances are distorted
Solution Approach 1:
The patent applies local quality by dividing the uniform projection surface into multiple regions, each with its own distortion characteristics. Different portions of the projection surface are adjusted independently based on the distance and position of objects, allowing accurate depth representation for near objects (like mailboxes) while maintaining the overall 3D environment structure.
Solution Approach 2:
The patent implements dynamics by making the projection surface deformable rather than static. The projection surface dynamically adjusts its geometry based on object distance information, allowing it to transform from a uniform fishbowl shape to a distorted shape that compensates for depth perception issues at different ranges.
2Device complexity
If multiple photographs are composited onto a uniform projection surface, then the system complexity is reduced, but the representation accuracy of objects at varying distances deteriorates
Solution Approach 1:
The patent applies local quality by assigning different projection parameters to different regions of the projection surface. Each region is optimized for representing objects at specific distance ranges, with near-field regions using different distortion corrections than far-field regions, thereby improving overall measurement precision without requiring a completely complex system.
3Productivity
If a default uniform projection surface is used, then the rendering process is simplified and faster, but the realism and spatial relationship accuracy of the 3D environment is compromised
Solution Approach 1:
The patent implements dynamics by creating a dynamic projection surface that adapts its geometry based on scene content. The system starts with a default uniform surface for fast rendering, then dynamically deforms it based on detected object positions and distances, achieving both speed and accuracy by combining the benefits of simple and complex approaches.
Solution Approach 2:
The patent applies preliminary action by pre-calculating projection surface deformations based on object distance information before final rendering. The system prepares distortion correction data in advance, allowing the actual rendering process to proceed efficiently while still achieving accurate spatial relationships.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A method for graphics in a three-dimensional virtual environment corresponding to a physical environment around a vehicle includes photographs in a plurality of directions extending outward from the vehicle, generating sensor data corresponding to a relative distance from the vehicle and a direction from the vehicle of an object in the physical environment, generating a default three-dimensional projection surface centered around a virtual representation of the vehicle in a virtual environment, deforming the three-dimensional projection surface at relative locations and distances corresponding to the sensor data, projecting the plurality of photographs onto the deformed three-dimensional projection surface, and displaying graphics corresponding to the deformed three-dimensional projection surface with the plurality of projected photographs with a display device.