AR Virtual Object Movement Consistency via Posture Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Augmented reality (AR) technologies face challenges in maintaining the fidelity and user experience of virtual object movements within a real environment, as these movements change relative to the terminal device's posture, leading to inconsistent and less immersive experiences.
Innovation Solution
An image display method and apparatus that captures a terminal device's posture and determines a dynamic movement track for virtual objects within a virtual world, ensuring the movement remains consistent relative to the real environment, regardless of the device's posture, by using sensors and coordinate systems to adjust the movement track accordingly.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If the virtual object movement track is fixed relative to the terminal device, then the device complexity is reduced, but the AR fidelity deteriorates because the movement track changes relative to the real environment when posture changes
Solution Approach 1:
The movement track is transformed from a static definition relative to the device to a dynamic definition relative to the real environment. The system continuously adjusts the virtual object's movement track based on real-time posture information, making the track adaptive to environmental changes while maintaining AR fidelity
Solution Approach 2:
Posture information serves as an intermediary that bridges the device coordinate system and the environment coordinate system. By introducing this intermediate parameter, the system can translate movement tracks between different reference frames, resolving the contradiction between device-relative simplicity and environment-relative fidelity
2Reliability
If the movement track changes relative to the terminal device when posture changes, then the AR fidelity is improved, but the ease of operation deteriorates due to inconsistent virtual object positions
Solution Approach 1:
The system changes the reference parameter for defining movement tracks from device-relative coordinates to environment-relative coordinates. This parameter transformation ensures that virtual object positions remain consistent with the real environment, improving both AR fidelity and user experience by making the virtual world appear stable regardless of device orientation
3Manufacturing precision
If a standard posture is defined and posture offset is calculated, then the manufacturing precision of the AR experience is improved, but the device complexity increases due to additional coordinate system transformations
Solution Approach 1:
A standard posture is pre-defined as a reference state, and the system performs preliminary calculations to establish the relationship between device coordinates and environment coordinates. This preliminary setup enables subsequent real-time posture offset calculations to be more efficient, balancing precision requirements with computational complexity
Data Source
AI summary
Embodiments of this application provide an image display method performed at a terminal device. The method includes: capturing, by the terminal device, a first image; obtaining, by the terminal device, information about a first posture, the first posture being a posture of the terminal device when the terminal device captures the first image; determining, by the terminal device, a first movement track for a virtual object to move from a first position to a second position in a virtual world according to the information about the first posture; and presenting, by the terminal device, the first image as a background image of the virtual world, and dynamically rendering the virtual object to move along the first movement track in the first image, so that the virtual object moves vertically to the horizontal plane in the real world regardless of the first posture of the terminal device. Therefore, fidelity of the AR technology is improved, and user experience is improved.