AR Pose Tracking via Electromagnetic Field and Depth Sensor Fusion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current augmented reality systems face challenges in accurately localizing the position and orientation of objects, particularly due to high latency and low precision in head-tracking and object detection, which can lead to motion sickness and unstable virtual object placement.
Innovation Solution
An augmented reality display system utilizing an electromagnetic field emitter and sensor, combined with depth sensors and additional localization resources like WiFi transceivers or LIDAR, to determine the pose information of objects relative to a known coordinate system, enabling precise and low-latency tracking of head and hand movements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If conventional head-tracking and object detection methods are used in augmented reality systems, then the system complexity is reduced, but the measurement precision and latency of head pose and object position are degraded
Solution Approach 1:
The patent introduces electromagnetic field emitters and sensors as intermediary components to enable precise head pose and object position detection. The electromagnetic field serves as a mediator between the physical objects (head, objects) and the digital representation, allowing accurate tracking without direct mechanical or optical contact. This resolves the contradiction by providing high measurement precision through electromagnetic field interaction while keeping the overall system architecture manageable.
Solution Approach 2:
The patent replaces conventional mechanical or optical tracking systems with an electromagnetic field-based detection system. Instead of using mechanical encoders, optical markers, or complex camera-based tracking, the system uses electromagnetic field emitters and sensors to detect head pose and object positions. This substitution achieves superior measurement precision and lower latency while reducing mechanical complexity.
2Loss of time
If conventional tracking systems are used, then the device complexity is low, but the latency in updating virtual content position is high causing motion sickness
Solution Approach 1:
The patent replaces mechanical and optical tracking systems with electromagnetic field-based detection to achieve lower latency. Electromagnetic field detection occurs nearly instantaneously compared to mechanical encoders or optical processing, significantly reducing the time delay between head movement and virtual content update. This resolves the latency issue while maintaining acceptable system complexity through the use of standardized electromagnetic components.
Solution Approach 2:
The electromagnetic field acts as a real-time intermediary that continuously provides updated position and orientation data without the inertia or processing delays associated with mechanical systems. This enables the system to track head pose and object positions with minimal latency, preventing the mismatch between visual and vestibular signals that causes motion sickness.
3Reliability
If simple object detection methods are used, then the device complexity is reduced, but the reliability of virtual object placement is degraded
Solution Approach 1:
The patent uses electromagnetic field emitters and sensors as intermediaries to establish reliable spatial relationships between physical objects and virtual content. The electromagnetic field provides a consistent reference frame that enables accurate and stable object localization, ensuring that virtual objects remain correctly positioned relative to physical objects even during user movement. This enhances placement reliability while keeping the system architecture manageable.
Solution Approach 2:
The electromagnetic field-based localization system serves multiple functions simultaneously: it tracks head pose, detects object positions, and provides spatial reference for virtual object placement. This multi-functionality achieves high reliability across different tracking and localization tasks while avoiding the need for separate specialized systems, thereby controlling overall device complexity.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This solution provides highly accurate and low-latency tracking, improving the stability and realism of virtual content placement in augmented reality environments, reducing the likelihood of motion sickness and enhancing user interaction.
Implementation Method 1
an electromagnetic field emitter to emit a known magnetic field in a known coordinate system
Implementation Method 2
an electromagnetic sensor to measure a parameter related to a magnetic flux at the electromagnetic sensor resulting from the known magnetic field
Implementation Method 3
a depth sensor to measure a distance in the known coordinate system
Data Source
AI summary
An augmented reality display system includes an electromagnetic field emitter to emit a known magnetic field in a known coordinate system. The system also includes an electromagnetic sensor to measure a parameter related to a magnetic flux at the electromagnetic sensor resulting from the known magnetic field. The system further includes a depth sensor to measure a distance in the known coordinate system. Moreover, the system includes a controller to determine pose information of the electromagnetic sensor relative to the electromagnetic field emitter in the known coordinate system based at least in part on the parameter related to the magnetic flux measured by the electromagnetic sensor and the distance measured by the depth sensor. In addition, the system includes a display system to display virtual content to a user based at least in part on the pose information of the electromagnetic sensor relative to the electromagnetic field emitter.