Vehicle Display 3D Object Reconstruction from Sensor Data
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional surround view systems for vehicles struggle to provide a realistic display of objects, especially when they are partially obscured by other objects or viewed from a single side, leading to impaired visibility and safety during driving maneuvers.
Innovation Solution
A method that uses vehicle sensors to detect objects, classify them, and generate three-dimensional data models, which can be supplemented with data from remote databases or other vehicles via wireless interfaces, ensuring that objects are displayed from all sides and in real-time, even if partially obscured.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If a single vehicle sensor is used to capture objects, then the device complexity is reduced, but the measurement precision and completeness of object representation deteriorates
Solution Approach 1:
The patent combines data from multiple vehicle sensors (cameras, radar, LIDAR) to create a unified three-dimensional representation of objects. By merging sensor data from different positions and types, the system achieves complete object representation without requiring each individual sensor to capture the entire object, thus resolving the contradiction between device complexity and measurement precision.
Solution Approach 2:
The patent transitions from two-dimensional sensor images to three-dimensional object representations by integrating data from multiple sensors positioned at different locations. This dimensional transformation allows the system to reconstruct complete objects even when individual sensors only capture partial views, effectively resolving the limitation of single-sensor perspectives.
2Loss of information
If only visible objects are displayed, then the loss of information is minimized, but the reliability of the display deteriorates when objects are obscured
Solution Approach 1:
The patent introduces an intermediary processing system that receives data from multiple sensors and reconstructs obscured objects using information from different sensing positions. This intermediary layer allows the system to infer and display complete object representations even when some sensors have obscured views, thereby maintaining both information accuracy and display reliability.
Solution Approach 2:
The patent performs preliminary data fusion and object reconstruction by combining sensor data before final display generation. By pre-integrating information from multiple sensors and reconstructing complete object models in advance, the system ensures that obscured objects are accurately represented in the final display, preventing information loss and maintaining reliability.
3Productivity
If three-dimensional display images are generated in real-time, then the productivity of decision-making is improved, but the computing load increases
Solution Approach 1:
The patent performs preliminary processing of sensor data to extract key object features and parameters before generating three-dimensional display images. By pre-processing sensor inputs and preparing object data structures in advance, the system reduces the computational burden during real-time display generation, enabling fast decision-making without excessive computing load.
Solution Approach 2:
The patent applies different processing qualities to different objects based on their relevance and complexity. Critical objects receive more detailed three-dimensional processing, while less important objects use simplified representations. This localized quality adjustment optimizes computing resource allocation, maintaining high decision-making productivity while controlling overall computing load.
Data Source
Figure 1
Figure 2~3
Figure 4~5
AI summary
The invention relates to a method for displaying objects on a vehicle display of a vehicle (F), comprising the following steps: (a) providing (S1) sensed environment images (UB) that have objects (O) that are located in the environment of the vehicle (F); (b) classifying (S2) the objects (O) on the basis of object features in order to detect an object type (O-TYP) of the particular object (O); (c) inserting (S3) a three-dimensional data model (3D-DM) corresponding to the detected object type (O-TYP) of the object (O) in order to generate a 3-D scene that shows the environment of the vehicle (F); and (d) displaying (S4) the generated 3-D scene on the vehicle display.