Vehicle Surroundings Display With 3D Projection for Hidden Areas
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing vehicle surroundings display methods lack the ability to provide a comprehensive and realistic view of the environment, especially during parking maneuvers, due to hidden areas caused by obstructing objects.
Innovation Solution
A method utilizing multiple cameras with wide-angle optical systems mounted on a vehicle to capture continuous sequences of images, combined with position detection and distance determination using sensors, generates a three-dimensional surroundings model with deformable projection surfaces that integrate current and stored images, and incorporates texture projection and object recognition to enhance visibility of hidden areas.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If multiple cameras with wide-angle optical systems are used to capture continuous image sequences, then the completeness of surroundings view is improved, but the device complexity increases
Solution Approach 1:
The surroundings view is divided into multiple sections, each captured by a separate camera. At least four cameras are mounted on the vehicle with different directions of view (forward, rearward, right, left) to capture different sections of the vehicle surroundings. The sections captured may overlap to some extent, ensuring complete coverage while distributing the capture task across multiple independent camera units.
Solution Approach 2:
The patent transitions from two-dimensional flat displays to three-dimensional deformation of projection surfaces. The close-range projection surface is deformed three-dimensionally as a function of determined distances, creating an enveloping surface around the background and objects in the vicinity of the vehicle. This 3D representation provides more complete spatial information about the surroundings.
2Manufacturing precision
If three-dimensional deformation of projection surface is performed based on determined distances, then the realism of surroundings model is improved, but the computational requirements increase
Solution Approach 1:
Distance measurements are performed continuously and stored in association with corresponding image sequences before the actual 3D projection is generated. The electronic control unit stores determined distances and uses them when generating the close-range projection surface, allowing preprocessing of spatial data that reduces real-time computational burden during display generation.
Solution Approach 2:
The close-range projection surface is dynamically deformed three-dimensionally as a function of determined distances, creating an enveloping surface around the background and objects. This dynamic deformation adapts the projection surface to the actual spatial layout of objects, enhancing realism while using efficient algorithms that update the 3D model based on pre-captured distance data.
3Loss of information
If stored camera images are used to fill hidden areas, then the visibility of obstructed regions is improved, but the time delay in displaying accurate surroundings increases
Solution Approach 1:
Camera images are captured continuously and stored in an electronic memory for a predetermined period of time. Each captured camera image is assigned the detected position of the vehicle at the moment the image was captured. This preliminary capture and storage of image data ensures that images are ready for immediate retrieval and projection when needed to fill hidden areas.
Solution Approach 2:
Stored camera images are used as textures to project onto the close-range projection surface, creating a visual copy of previously captured scenes. This allows hidden areas to be filled with realistic visual information from stored images, providing a complete surroundings model even when direct camera views are blocked by obstructing objects.
4Area of stationary object
If at least four cameras with different directions of view are mounted on the vehicle, then the coverage of vehicle surroundings is improved, but the device complexity and cost increase
Solution Approach 1:
The surroundings capture task is segmented across at least four cameras mounted on the vehicle, each with a specific direction of view (forward, rearward, right, left). Each camera captures a specific section of the vehicle surroundings, and the sections may overlap to some extent, providing comprehensive coverage while distributing the functional load across multiple simple camera units rather than requiring a single complex system.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The method provides a more complete and realistic view of the vehicle's surroundings, allowing users to perceive hidden areas and potential dangers, even when obstructed by other vehicles, with reduced computational requirements.
Implementation Method 1
at least one sequence of camera images of at least one section of the area surrounding the vehicle is captured with the aid of at least one camera
Implementation Method 2
the vehicle position is detected continuously, so that the present position of the vehicle and previous positions of the vehicle are known. The position is detected utilizing at least one position sensor, preferably utilizing a position sensor for a global navigation satellite system.
Implementation Method 3
distances between the vehicle and objects in the area surrounding the vehicle are determined. Advantageously, the distances are determined three-dimensionally, e.g., by the use of at least one ultrasonic sensor
Implementation Method 4
distances between the vehicle and objects in the area surrounding the vehicle are determined. Advantageously, the distances are determined three-dimensionally, e.g., by the use of at least one ultrasonic sensor, a stereo camera, a radar sensor
Implementation Method 5
distances between the vehicle and objects in the area surrounding the vehicle are determined. Advantageously, the distances are determined three-dimensionally, e.g., by the use of at least one ultrasonic sensor, a stereo camera, a radar sensor and/or a lidar sensor
Data Source
AI summary
A method for displaying a surroundings model of a vehicle. The method includes: capturing at least one sequence of camera images of at least one section of the surroundings of the vehicle with the aid of at least one camera; detecting a position of the vehicle; storing at least one camera image of the surroundings of the vehicle, each stored camera image being assigned the detected position of the vehicle) at the moment the stored camera image was captured; determining distances between the vehicle and objects in the surroundings; generating at least one close-range projection surface which represents the close range around the vehicle, the close-range projection surface being deformed three-dimensionally depending on the determined distances; and displaying the surroundings model as a function of the generated close-range projection surface, at least one current camera image, a stored camera image and the present vehicle position.