AR Device Aligning GNSS and Vision Frames for Position Accuracy
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing VR and AR technologies face challenges in accurately integrating high-accuracy GNSS data, leading to discrepancies between vision-based and satellite-based position information, which affects the accuracy of displayed augmented reality images.
Innovation Solution
The method involves maintaining two separate frames, a vision-based AR frame and a satellite-based geospatial frame, which are periodically aligned by shifting and rotating one or both frames to synchronize GNSS and camera position data, ensuring accurate superimposition of model images onto camera images.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If vision-based position information is used for AR image display, then the system can operate in environments with intermittent satellite visibility or poor lighting conditions, but the accuracy of position information deteriorates
Solution Approach 1:
The patent merges vision-based positioning (from cameras) and satellite-based positioning (from GNSS receiver) into a unified AR frame of reference. The system combines data from both sources and uses transformation matrices to align them, creating a hybrid positioning system that leverages the strengths of both approaches while mitigating their individual weaknesses.
Solution Approach 2:
The patent introduces an intermediary transformation matrix that maps coordinates between the GNSS frame of reference and the AR frame of reference. This intermediary enables seamless integration of satellite-based position data with vision-based AR display coordinates, resolving the contradiction between accuracy and reliability by allowing the system to switch between data sources based on environmental conditions.
2Measurement precision
If satellite-based GNSS data is used for high-accuracy positioning, then position accuracy is improved, but the system becomes vulnerable to intermittent satellite visibility and signal interference
Solution Approach 1:
The patent changes the parameter of frame of reference by maintaining both a GNSS frame and an AR frame with their respective coordinate systems. By transforming position data between these frames using calculated transformation matrices, the system can adapt to varying operational conditions and maintain both accuracy and reliability through parameter transformation rather than relying on a single fixed reference frame.
3Reliability
If vision-based positioning is used for AR display, then operational reliability in diverse environments is improved, but position accuracy deteriorates compared to satellite-based systems
Solution Approach 1:
The patent segments the positioning system into distinct components: a GNSS receiver for satellite-based positioning, cameras for vision-based positioning, and a processing system that integrates both. By segmenting the system and maintaining separate frame of references for each positioning method, the system can optimize each component for its specific strengths while combining them to achieve overall superior performance.
4Measurement precision
If separate frames for GNSS and AR data are maintained, then data alignment accuracy is improved, but system complexity increases
Solution Approach 1:
The patent performs preliminary actions by pre-calculating transformation matrices that map between the GNSS frame and AR frame. These matrices are computed in advance and stored, allowing the system to quickly apply transformations during operation without complex real-time calculations. This preliminary preparation reduces the computational complexity during actual AR operations while maintaining high alignment accuracy.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A method for displaying images using an AR device. GNSS position data is received based on wireless signals received from a GNSS satellite. Based on the GNSS position data, a first GNSS point within a geospatial frame is determined within a first time range and a second GNSS point within the geospatial frame is determined within a second time range. Based on camera POS data, a first AR point within an AR frame is determined within the first time range and a second AR point within the AR frame is determined within the second time range. One of the frames is shifted such that the second GNSS point is aligned with the second AR point. An angle formed by the GNSS points and the AR points is calculated. One of the frames is rotated by the angle.