AR Pose Tracking via Electromagnetic Field and Depth Sensor Fusion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current augmented reality systems face challenges in accurately localizing the position and orientation of objects, particularly due to high latency and low precision in head-tracking and object detection, which can lead to motion sickness and unstable virtual object placement.
Innovation Solution
An augmented reality display system utilizing an electromagnetic field emitter and sensor, combined with depth sensors and additional localization resources like WiFi transceivers or beacons, to determine the pose information of the electromagnetic sensor relative to the emitter, enabling accurate and low-latency tracking of head and hand movements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If conventional head-tracking and object detection methods are used in augmented reality systems, then the system complexity is reduced, but the measurement precision and latency are insufficient leading to unstable virtual object placement
Solution Approach 1:
The patent combines multiple localization resources (electromagnetic field emitter, depth sensors, WiFi transceivers, beacons, cameras) into an integrated system that works together to determine pose information. This merging of different sensing modalities achieves high precision positioning and orientation tracking while managing system complexity through coordinated operation of components.
Solution Approach 2:
The system employs multi-functional components that serve multiple purposes. For example, the electromagnetic sensor array not only tracks head position but also determines orientation. The depth sensors and additional localization resources contribute to both positioning and tracking functions, reducing overall system complexity while maintaining high measurement precision.
2Loss of time
If conventional tracking methods are used, then the device complexity is low, but the latency is high causing motion sickness
Solution Approach 1:
The system continuously tracks head position and orientation in advance of when virtual objects need to be rendered. By maintaining real-time pose information through the electromagnetic sensor array and additional localization resources, the system prepares positioning data before it is needed for display updates, reducing perceived latency and preventing motion sickness.
Solution Approach 2:
The patent replaces conventional mechanical or optical tracking systems with an electromagnetic field-based sensing approach. The electromagnetic sensor array detects changes in the electromagnetic field caused by head movement, providing high-speed, low-latency tracking data without the mechanical inertia or optical processing delays of traditional systems.
3Measurement precision
If electromagnetic sensor array with additional localization resources is deployed, then the measurement precision and tracking accuracy are improved, but the device complexity increases
Solution Approach 1:
The system divides the localization function into separate modular components: electromagnetic field emitter, electromagnetic sensor array, depth sensors, WiFi transceivers, and beacons. Each component performs a specific sensing function, and their outputs are integrated to determine pose information. This segmentation allows high precision measurement while managing complexity through modular design and independent optimization of each subsystem.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This solution provides highly accurate and low-latency tracking, enhancing the stability and realism of virtual content placement in augmented reality experiences by accurately determining the position and orientation of objects in real-time.
Implementation Method 1
an electromagnetic field emitter to emit a known magnetic field in a known coordinate system
Implementation Method 2
an electromagnetic sensor to measure a parameter related to a magnetic flux at the electromagnetic sensor resulting from the known magnetic field
Implementation Method 3
a depth sensor to measure a distance in the known coordinate system
Data Source
AI summary
An augmented reality display system includes an electromagnetic field emitter to emit a known magnetic field in a known coordinate system. The system also includes an electromagnetic sensor to measure a parameter related to a magnetic flux at the electromagnetic sensor resulting from the known magnetic field. The system further includes a depth sensor to measure a distance in the known coordinate system. Moreover, the system includes a controller to determine pose information of the electromagnetic sensor relative to the electromagnetic field emitter in the known coordinate system based at least in part on the parameter related to the magnetic flux measured by the electromagnetic sensor and the distance measured by the depth sensor. In addition, the system includes a display system to display virtual content to a user based at least in part on the pose information of the electromagnetic sensor relative to the electromagnetic field emitter.