AR Device Pose Tracking via VSLAM Reference Switching
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Augmented Reality (AR) devices in metrology, geodesy, and civil engineering face inaccuracies and interruptions in user experiences due to loss of line-of-sight to identification features in environments with multiple reference systems.
Innovation Solution
The implementation of a Visual Localisation and Mapping (VSLAM) process in AR devices, which uses visual sensors, computer processing, and position and orientation sensors to maintain a referenced status even when identification features are not visible, by determining the device's pose relative to reference systems and generating transformation parameters for interrelating multiple reference systems.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If image-based pose determination is used to establish reference status, then initial referencing accuracy is improved, but reliability deteriorates when identification features are lost
Solution Approach 1:
The system performs preliminary actions by establishing and storing multiple reference systems with their identification features before the user needs them. When the current reference system is lost, the system can quickly switch to a previously established reference system without requiring time-consuming re-acquisition procedures, thus maintaining reliability while preserving initial referencing accuracy.
Solution Approach 2:
The patent introduces intermediate reference systems that act as mediators between the lost reference system and the environment. These intermediate reference systems provide continuous referencing capability, allowing the AR device to maintain its referenced status even when direct visual contact with the original identification features is lost.
2Adaptability or versatility
If multiple reference systems are used to cover complex environments, then adaptability is improved, but device complexity increases
Solution Approach 1:
The AR device is designed with universal functionality to handle multiple reference systems simultaneously. The system can automatically detect, acquire, and switch between different reference systems based on environmental conditions, providing adaptability to complex environments while managing complexity through automated multi-functionality rather than manual configuration.
Solution Approach 2:
The system performs self-service by automatically managing multiple reference systems without requiring user intervention. The AR device autonomously acquires identification features, establishes reference systems, determines pose relationships, and switches between reference systems based on visual sensor input, thereby improving adaptability while keeping the user interface simple.
3Measurement precision
If continuous referencing procedures are performed to maintain accuracy, then measurement precision is improved, but loss of time increases
Solution Approach 1:
Reference systems are established in advance during setup or initial exploration phases. The identification features and their spatial relationships are pre-acquired and stored. When the user needs AR-data overlay, the system can quickly match the current view with pre-established reference systems without performing time-consuming continuous referencing procedures, thus maintaining precision while reducing time loss.
Solution Approach 2:
The system dynamically adjusts the referencing frequency based on environmental conditions and user needs. Instead of performing continuous referencing procedures at fixed intervals, the system performs pose determination only when necessary - such as when switching between reference systems or when accuracy is required - thereby maintaining measurement precision while minimizing time loss through adaptive, dynamic operation.
Data Source
AI summary
An Augmented Reality (AR)-device, including a visual sensor for capturing an environment of the AR-device, a display providing a real view of the environment, and overlays onto the real view according to AR-data including at least one of design data and measured data, a computer for reading and controlling the visual sensor, at least one of receiving, generating and storing the AR-data, and identification features which are assigned to each of a plurality of reference systems, generating the overlays, establishing a referenced status of the AR-device relative to each of the reference systems by identifying a reference system based on at least one identification feature captured by the visual sensor, determining a pose of the AR-device relative to the identified reference system, and maintaining the referenced status in case of loss of visual contact between the visual sensor and the identification feature, based on a Visual Localisation and Mapping (VSLAM)-process.