AR Image Occlusion via GNSS and EDM Sensor Fusion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current VR and AR technologies face challenges in accurately integrating high-accuracy GNSS data, which is essential for precise geospatial positioning and augmented reality applications.
Innovation Solution
A method and system that utilize a portable electronic device equipped with a camera, an electronic distance measuring (EDM) device, and a GNSS receiver to calculate the geospatial position of a point of interest by combining distance measurements, orientation detection, and GNSS position data, allowing for accurate positioning and occlusion of virtual content in real-world environments.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If VR and AR systems present digital image information without transparency to other actual real-world visual input, then virtual content can be displayed clearly, but the user loses awareness of the real-world environment and spatial relationships
Solution Approach 1:
The patent combines VR and AR capabilities into a single head-mounted display system that can switch between immersive virtual reality mode and augmented reality mode, allowing users to merge digital content with real-world visualization when needed for spatial awareness and safety
Solution Approach 2:
The system dynamically adjusts the transparency and blending of real-world visual input with digital content based on user needs, environmental conditions, and application requirements, allowing seamless transition between fully immersive VR and transparent AR modes
2Measurement precision
If AR systems integrate GNSS data for geospatial positioning, then positioning accuracy improves, but system complexity and difficulty of integration increase
Solution Approach 1:
The head-mounted display system integrates multiple functions including GNSS receiver, camera, display, and processing capabilities into a single universal platform that can perform geospatial positioning, augmented reality rendering, and real-time content adjustment without requiring separate specialized devices
Solution Approach 2:
The system uses an intermediary processing unit that receives raw GNSS data and camera input, then coordinates between these different data sources to generate synchronized augmented reality content, simplifying the integration complexity by providing a centralized mediation layer
3Measurement precision
If AR systems use multiple sensors (camera, EDM device, GNSS receiver) for accurate positioning, then positioning precision improves, but device complexity and cost increase
Solution Approach 1:
The patent merges multiple sensing capabilities (camera for visual input, EDM device for distance measurement, GNSS receiver for geospatial positioning) into a single integrated sensor platform mounted on the head-mounted display, allowing coordinated operation to achieve high-precision positioning and augmented reality rendering
Solution Approach 2:
The system employs self-calibration and self-synchronization mechanisms where the integrated sensors automatically coordinate their data streams and timing without external intervention, reducing operational complexity while maintaining high measurement precision across all sensor types
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables precise geospatial calculations and effective occlusion of virtual content in AR applications, enhancing the accuracy and reliability of VR and AR systems by integrating high-accuracy GNSS data for improved positioning and visualization.
Implementation Method 1
capturing, by an electronic distance measuring (EDM) device of the portable electronic device, a distance to the point of interest
Implementation Method 2
Global navigation satellite systems (GNSS) use wireless signals that are transmitted from medium Earth orbit (MEO) satellites to GNSS receivers to determine position and velocity information
Data Source
AI summary
Techniques for occluding displayable content on a portable electronic device. An EDM device of the portable electronic device may capture a world distance map comprising a plurality of distances to a plurality of points. A camera of the portable electronic device may capture a camera image containing the plurality of points. A geospatial position of a GNSS receiver may be detected. A geospatial position of the camera may be calculated based on the geospatial position of the GNSS receiver. An angle sensor may detect an orientation of the camera. A model image may be generated based on a 3D model, the orientation of the camera, and the geospatial position of the camera. The model image and/or the camera image may be occluded based on the world distance map and the 3D model. A superimposed image comprising the camera image and the model image may be generated and displayed.