Augmented Reality Pose Tracking with Electromagnetic Field Sensing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality (AR) systems face challenges in accurately detecting and localizing head and hand poses with high precision and low latency, leading to potential motion sickness and disrupted user experiences due to high system latency and inaccurate rendering of virtual content relative to real-world objects.
Innovation Solution
An AR display system utilizing an electromagnetic field emitter and sensor to determine pose information, combined with SLAM analysis and additional localization resources like GPS receivers and beacons, to accurately track the position and orientation of mobile components such as hand-held or head-mounted devices, enabling precise rendering of virtual content.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If conventional localization methods are used to track head and hand pose, then device complexity is reduced, but measurement precision and tracking accuracy deteriorate
Solution Approach 1:
The system divides the localization function into multiple independent components: electromagnetic field emitters placed in the environment, electromagnetic sensors in the mobile device, SLAM processing unit, and supplemental localization resources (GPS, beacons). Each component performs a specific function, and their outputs are integrated to achieve high-precision pose tracking without requiring a single complex localization system
Solution Approach 2:
The patent introduces electromagnetic fields as an intermediary medium between the mobile device and the environment. Electromagnetic emitters create reference fields, and sensors detect these fields to determine position and orientation. This intermediary field-based approach enables precise tracking without direct mechanical or optical contact, resolving the contradiction between accuracy and complexity
2Measurement precision
If high-precision tracking systems are implemented, then measurement precision improves, but system latency increases
Solution Approach 1:
The system performs SLAM (Simultaneous Localization and Mapping) processing in advance to pre-compute the environment map and establish reference frames. Electromagnetic emitters are pre-positioned in the environment with known coordinates. When the user moves, the system only needs to detect the electromagnetic field signature and quickly resolve the pose against the pre-computed map, significantly reducing real-time processing latency while maintaining high precision
Solution Approach 2:
The patent replaces complex mechanical or optical tracking systems with electromagnetic field-based detection. Electromagnetic field detection occurs at the speed of light and requires minimal processing, whereas mechanical encoders or optical cameras require complex signal processing and have higher latency. This substitution achieves both high precision and low latency
3Speed
If electromagnetic tracking systems are used, then measurement precision and tracking speed improve, but device complexity and power consumption increase
Solution Approach 1:
Instead of placing electromagnetic sensors in the environment and emitters in the mobile device (which would increase device complexity), the patent inverts the arrangement: emitters are placed in the environment (in walls, furniture, or fixed structures), and only lightweight electromagnetic sensors are placed in the mobile device. This inversion transfers the complexity to the infrastructure rather than the device, enabling high-speed tracking with minimal device complexity
Solution Approach 2:
The electromagnetic emitters in the environment serve multiple functions: they provide reference fields for localization, define the coordinate system, and can potentially serve other purposes such as communication or environmental sensing. This multi-functionality reduces the need for separate systems, thereby reducing overall system complexity while maintaining high tracking speed
4Measurement precision
If accurate head pose detection is implemented, then virtual content rendering accuracy improves, but motion sickness increases due to latency
Solution Approach 1:
The system continuously monitors head pose through electromagnetic sensors and provides real-time feedback by updating the virtual content rendering accordingly. The low-latency electromagnetic tracking ensures that the feedback loop operates at high speed, keeping the rendered virtual content synchronized with the user's actual head movements. This prevents the sensory conflict that causes motion sickness while maintaining high rendering accuracy
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The system achieves high-precision, low-latency tracking of head and hand poses, enhancing the realism and interactivity of AR experiences by ensuring accurate placement of virtual content relative to real-world objects, reducing the risk of motion sickness.
Implementation Method 1
an electromagnetic field emitter to emit a known magnetic field
Implementation Method 2
an electromagnetic sensor to measure a parameter related to a magnetic flux measured at the electromagnetic sensor as a result of the emitted known magnetic field
Data Source
AI summary
Configurations are disclosed for presenting virtual reality and augmented reality experiences to users. An augmented reality display system comprises a handheld component housing an electromagnetic field emitter, the electromagnetic field emitter emitting a known magnetic field, the head mounted component coupled to one or more electromagnetic sensors that detect the magnetic field emitted by the electromagnetic field emitter housed in the handheld component, wherein a head pose is known, and a controller communicatively coupled to the handheld component and the head mounted component, the controller receiving magnetic field data from the handheld component, and receiving sensor data from the head mounted component, wherein the controller determining a hand pose based at least in part on the received magnetic field data and the received sensor data.