Vehicle Image Output Device Using 3D Building Models for AR Guidance
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current image output devices in vehicles struggle to effectively guide occupants to points of interest, especially in real-world scenarios where buildings may be obscured or in adverse weather conditions, and they lack efficient methods for implementing augmented reality by precisely matching virtual and real-world objects.
Innovation Solution
An image output device that uses 3D modeling based on 2D map data to generate 3D outline information for buildings, allowing for the creation of graphic objects that can be overlaid on real-world images from a vehicle's camera, providing intuitive guidance and augmented reality even when buildings are obscured, by converting coordinate systems and adjusting graphic object shapes and sizes according to vehicle position and direction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If traditional 2D map display methods are used to guide occupants to points of interest, then the system is simple and easy to implement, but the guidance effectiveness is poor especially when buildings are obscured or in adverse weather conditions
Solution Approach 1:
The patent transforms 2D map data into 3D building models by introducing a height dimension. The processor extracts building footprints from 2D map data and generates 3D wireframe models by extruding these footprints with calculated building heights, enabling realistic rendering that maintains visibility under various weather conditions while preserving system simplicity
Solution Approach 2:
The patent creates virtual copies of real-world buildings by generating 3D wireframe models from 2D map data. These virtual building representations are then overlaid on the camera feed to provide guidance, avoiding the need for complex real-time 3D scanning while achieving effective visual guidance
2Measurement precision
If 3D modeling based on 2D map data is implemented to generate graphic objects for augmented reality, then the guidance precision and intuitiveness are improved, but the computational complexity and processing time increase
Solution Approach 1:
The patent performs preliminary processing by extracting building footprints and calculating building heights from 2D map data before runtime. The 3D wireframe models are pre-generated with vertex coordinates and edge definitions, so that during actual operation, the system only needs to retrieve and overlay these pre-computed models, significantly reducing real-time processing requirements
Solution Approach 2:
The patent segments the building representation into essential geometric components - footprints, vertical edges, and roof lines - represented as wireframe structures with vertices and edges. This segmentation captures the essential visual characteristics of buildings while minimizing computational complexity compared to full 3D surface modeling
3Measurement precision
If coordinate system conversion and graphic object adjustment are performed to match virtual buildings with real-world images, then the augmented reality alignment accuracy is improved, but the device complexity increases
Solution Approach 1:
The patent implements a universal coordinate transformation system that handles multiple reference frames (camera coordinate system, map coordinate system, and display coordinate system) through a unified transformation pipeline. The processor automatically performs coordinate conversions and graphic object adjustments based on camera parameters and vehicle position, providing accurate alignment without requiring separate specialized processing for each coordinate system
Solution Approach 2:
The patent enables the graphic objects to self-adjust to the camera feed by automatically transforming coordinates and positioning virtual buildings to match real-world locations. The system uses camera intrinsic parameters and extrinsic parameters to automatically calculate transformation matrices, eliminating the need for manual calibration or complex user intervention
Data Source
AI summary
The present invention relates to an image output device provided in a vehicle. The image output device includes: an image output unit; and a processor obtaining a plurality of coordinate values constituting a certain building from a map, generating a graphic object, which overlaps at least a portion of the building, using the coordinate values when the building is searched from within a predetermined range with respect to the vehicle, and outputting the generated graphic object through the image output unit.