Head Mounted Display Object Tracking via Forward Prediction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In augmented and virtual reality environments, the tracking of handheld electronic devices can lead to discrepancies between their actual position and rendering in the virtual environment due to delayed updates, causing hindered user interaction.
Innovation Solution
Implementing a forward-prediction function that uses sensor data from the device and historical movement patterns to accurately render the handheld device's position, even when timely updates are not available, by assuming it remains fixed until a new measurement is taken, and synchronizing sensors to improve precision.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If traditional tracking methods are used to update handheld device position, then the system structure remains simple, but rendering lag increases and positioning accuracy deteriorates
Solution Approach 1:
The system performs preliminary actions by predicting the future position of the handheld device based on historical movement data before the actual position update is available. This allows the virtual environment to be rendered in advance at the predicted position, reducing perceived lag while maintaining accuracy through subsequent correction when real position data arrives.
2Loss of time
If forward-prediction functions are implemented to reduce rendering lag, then positioning accuracy improves, but device complexity increases
Solution Approach 1:
The system introduces an intermediary prediction mechanism that acts as a mediator between the actual device position and the virtual rendering. This prediction layer processes historical data and generates intermediate position estimates, allowing the system to bridge the time gap without requiring complex real-time processing infrastructure.
3Measurement precision
If frequent position updates are performed to maintain accuracy, then positioning precision improves, but energy consumption increases
Solution Approach 1:
The system implements periodic action by updating the device position at optimized intervals rather than continuously. Historical movement data is collected over periods and processed batch-wise, allowing the system to maintain positioning accuracy through periodic corrections while avoiding the excessive energy consumption of continuous real-time tracking.
Data Source
Figure 1
Figure 2A~2B
Figure 3
AI summary
A system for tracking an object in an ambient environment with respect to a head mounted reference frame may allow the ambient object to be rendered in a virtual display, at a virtual position corresponding to its position in the ambient environment, in response to head movement. The system may detect a position of a head mounted device with respect to a fixed frame of reference in the ambient environment, and may detect a position of the ambient object with respect to the fixed frame of reference in the ambient environment. The system may then translate the detected position of the ambient object to the frame of reference of the head mounted device, or to the head mounted reference frame, to determine a position of the ambient object relative to the head mounted device. This newly determined position may be rendered in the virtual display generated by the head mounted device.