Dynamic Virtual Image Tracking via User-Relative Reference Point
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In augmented reality and mixed reality technologies, virtual images displayed using real-world or display coordinate systems become inconvenient when users move, as they either remain fixed in space or move away from the user's line of sight when the user turns their head.
Innovation Solution
A method and computing device that dynamically adjust the position and orientation of virtual images by defining a reference point based on the user's position, moving it within a threshold distance to maintain alignment with the user's movement and line of sight, using a positioning module and processor to continuously update the display position and orientation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Stability of the object's composition
If the virtual image is fixed at a position in the real-world space, then the position is stable in the real-world coordinate system, but the virtual image does not move with the user when the user is moving, making it inconvenient to view
Solution Approach 1:
The patent applies the dynamics principle by transitioning from a static real-world coordinate system to a dynamic user-relative coordinate system. The virtual image position is no longer fixed in real-world space but dynamically adjusted relative to the user's current position and orientation. This allows the virtual image to automatically track and move with the user, maintaining viewing convenience while preserving positional stability through continuous coordinate transformation based on user movement data.
2Stability of the object's composition
If the virtual image is fixed at a position in the display coordinate system and the position is not in front of the user, then the display position is stable, but when the user turns their head, the head-mounted display turns with the user's head, moving the virtual image further away from where the user was trying to look at
Solution Approach 1:
The patent implements feedback by continuously monitoring the user's head position and orientation through sensors in the head-mounted display. This feedback information is used to dynamically adjust the virtual image position and orientation in the display coordinate system, ensuring the virtual image remains aligned with the user's line of sight despite head movements. The system constantly compares the desired virtual image position with the actual display position and makes real-time corrections.
Solution Approach 2:
The patent applies dynamics by making the virtual image position and orientation dynamic rather than static in the display coordinate system. The virtual image automatically adjusts its position and rotation based on the user's real-time head movements, ensuring it remains in front of the user and aligned with their line of sight, thereby maintaining both display stability and line of sight alignment.
3Ease of operation
If the virtual image follows the user's movement dynamically, then the viewing convenience is improved, but the computational complexity and processing requirements increase
Solution Approach 1:
The patent applies preliminary action by pre-establishing the coordinate transformation relationships and projection models before rendering. The system pre-calculates transformation matrices and projection parameters based on the user's position and orientation, allowing for efficient real-time rendering without complex computations during the actual image display. This preparation work reduces the computational burden during dynamic updates.
Solution Approach 2:
The patent implements a dynamic rendering system that updates the virtual image position and orientation based on real-time user movement data. By using efficient coordinate transformation algorithms and leveraging the user's motion data from sensors, the system achieves smooth dynamic tracking of the user's position and orientation without requiring excessive computational resources, thus improving viewing convenience while managing device complexity.
Data Source
AI summary
A method for displaying a virtual image to a user is implemented by a computing device. The method includes to first obtain an initial position of the user, and define a reference point at the initial position of the user. Then, the computing device obtains a user position of the user, and determines whether a distance between a position of the reference point and the user position is greater than a threshold. If the distance is greater than the threshold, the computing device moves the position of the reference point to a reference position that is at most the threshold away from the user position. Finally, the computing device obtains a display position as a relative position based on the position of the reference point, and displays the virtual image at the display position.