AR Navigation Superimposition Using Height-Aware 3D Projection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current navigation systems with augmented reality (AR) functions fail to accurately superimpose virtual guiding indications on reality images, particularly in complex environments, leading to obscured obstacles, incorrect direction guidance, and inconsistent 3D representations due to neglecting height variations and proportional relationships with the image pixels.
Innovation Solution
A device comprising an image capturing unit, processor, and GPU that captures real-time scenes, processes height variation data, and performs inverse and perspective projection transformations to generate a bird's-eye view image, ensuring accurate superimposition of virtual guiding indications on the reality image, maintaining correct pixel proportions and avoiding erroneous displays.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If virtual guiding indications are superimposed on reality image without considering height variation, then navigation guidance is provided, but the guiding indication may look like guiding to the sky or below the ground, causing inaccurate 3D representation
Solution Approach 1:
The patent applies parameter changes by updating the transformation matrix with height variation information (altitude data) to adjust the projection parameters. This ensures that the virtual guiding indication is transformed according to the actual height differences between the vehicle and the road, making the guidance appear at the correct 3D position rather than floating in the sky or below ground.
Solution Approach 2:
The patent introduces the height dimension (altitude) into the traditional 2D image transformation process. By obtaining altitude information and incorporating it into the transformation matrix, the system performs 3D spatial transformation that accounts for height variations, ensuring accurate placement of virtual guiding indications in three-dimensional space.
2Ease of operation
If virtual guiding indication is superimposed on reality image without identifying drivable areas, then navigation guidance is provided, but the guidance direction may be incorrect in complex road environments such as multi-lane roads or three-dimensional roads
Solution Approach 1:
The patent applies local quality by performing inverse perspective projection transformation to generate a bird's-eye view image that clearly identifies drivable areas and road structure. This transformed view provides accurate local information about where vehicles can travel, allowing the system to provide correct guidance directions for complex road environments such as multi-lane roads or three-dimensional roads.
3Ease of operation
If guiding indication is superimposed without considering proportional relationship with pixels, then navigation guidance is displayed, but the guiding indication does not accurately represent correct three-dimensional guiding directions
Solution Approach 1:
The patent applies parameter changes by using the updated transformation matrix (which includes height variation parameters) to perform perspective projection transformation. This ensures that the proportional relationship between the virtual guiding indication and the reality image pixels is maintained, allowing accurate representation of three-dimensional guiding directions.
Data Source
AI summary
A superimposition device of virtual guiding indication and reality image includes at least an image capturing device, a processor, a graphic processing unit (GPU), and a display device. The image capturing device captures reality image including instant scene. The processor receives the reality image and obtains height variation information. The GPU performs image correction processing on the reality image to obtain corrected image, generates updated transformation matrix according to the height variation information, and performs inverse perspective projection transformation by using the updated transformation matrix to generate bird's-eye view image of the corrected image and superimposes virtual guiding indication on the bird's-eye view image and performs perspective projection transformation on the bird's-eye view image to transform the bird's-eye view image into three-dimensional (3D) navigation image which includes the guiding indication. The display device displays the 3D navigation image which superimposes the virtual guiding indication into the reality image.