AR Head-Up Display Registration Using Map Reference Points
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current augmented reality head-up display systems for vehicles struggle to accurately register virtual information in the driver's real field of vision, especially due to the dynamic orientation of the vehicle and the complexity of road surfaces, which can be partially obscured by traffic.
Innovation Solution
The method involves determining the pose of the vehicle relative to a map, extracting reference points from the map that correspond to the driver's field of vision, transforming these points into vehicle coordinates, and generating virtual objects that are adapted to these coordinates to create the illusion that they are located on the real environment.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If virtual information is displayed in the driver's field of vision using augmented reality, then the intuitiveness and ease of interpretation is improved, but the accuracy of registration with the real environment deteriorates due to dynamic vehicle orientation and complex road surfaces
Solution Approach 1:
The system pre-calculates geometric abstractions of topography and stores them in map data before the vehicle reaches the location. This allows the reference points to be ready in advance, enabling accurate registration despite dynamic vehicle conditions. The preliminary preparation of spatial information resolves the contradiction by having accurate reference data available before the display moment.
Solution Approach 2:
The patent introduces map data containing pre-calculated geometric abstractions as an intermediary between the vehicle's sensor system and the augmented reality display. This intermediary provides stable reference points that are not affected by dynamic vehicle orientation or obscured road surfaces, thereby maintaining registration accuracy while enabling intuitive contact-analog display.
2Loss of time
If reference points are extracted from a basic map area, then the processing time is reduced, but the accuracy of virtual object placement deteriorates due to extended areas dependent on vehicle speed
Solution Approach 1:
The system dynamically adjusts the map area for reference point extraction based on vehicle speed. At higher speeds, a larger extended area is used to ensure accurate placement of virtual objects that need to be visible further ahead. This dynamic adaptation resolves the contradiction by optimizing the balance between processing time and placement accuracy according to actual driving conditions.
Solution Approach 2:
The patent applies different levels of detail and processing to different areas of the map. The basic area receives full processing for immediate accuracy, while the extended area uses speed-dependent extraction to balance processing load with the need for accurate virtual object placement at distance. This local differentiation resolves the time-accuracy trade-off.
3Ease of operation
If contact-analog display is used to present information directly in the driver's field of vision, then the cognitive load is reduced, but the complexity of the display system increases due to pose determination and coordinate transformation
Solution Approach 1:
The patent extracts and separates the complex computational tasks (pose determination, coordinate transformation) from the real-time display system and places them in pre-calculated map data. This extraction allows the in-vehicle system to focus on simple rendering while the heavy computational work is done beforehand, resolving the contradiction between cognitive ease and system complexity.
Solution Approach 2:
The system uses copied and transformed reference point data from map data to generate virtual objects, rather than performing complex real-time calculations. This copying approach maintains the benefits of contact-analog display for reducing cognitive load while minimizing the actual computational complexity required in the vehicle's display system.
Data Source
Figure 1~2
Figure 3~4
Figure 5~6
AI summary
The invention relates to a method, a device and a computer-readable storage medium, with instructions for controlling a display of an augmented-reality head-up display device for a motor vehicle. In a first step, a position of the motor vehicle is determined (10) in relation to a map . At least one reference point is then extracted from the map (11), the at least one reference point being obtained from an area within a visual range of a driver of the motor vehicle. Following a transformation (12) of the at least one reference point into vehicle coordinates, a virtual object is generated (13) for display by the augmented-reality head-up display device, taking into account the at least one transformed reference point. Finally, the virtual object is output for display by the augmented-reality head-up display device (14).