3D Virtual Object Pose Alignment in Augmented Reality
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current augmented reality technologies struggle to seamlessly integrate 3D virtual objects into real-world environments, as these objects do not naturally adapt to changes in the user's line of sight, leading to a sense of disconnection from the actual environment.
Innovation Solution
A method and program that utilize a computing device and server to transmit and receive image and pose data, allowing for the rendering of 3D virtual objects with the same pose as target objects, thereby creating a more harmonious integration of virtual elements into the actual environment by estimating and updating pose data in real-time.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a 3D virtual object is added to the actual environment in augmented reality, then the user can see the virtual object in three dimensions, but the virtual object does not naturally change in response to changes in the user's eyeline, creating a sense of disconnection from the actual environment
Solution Approach 1:
The patent applies dynamics by making the 3D virtual object's pose change dynamically in response to eyeline changes. The system estimates the user's eyeline direction and adjusts the virtual object's orientation and position accordingly, allowing the object to adapt naturally as the user moves their gaze, thereby resolving the contradiction between 3D visualization and environmental connection.
Solution Approach 2:
The patent implements feedback mechanisms where the system continuously monitors the user's eyeline changes and uses this information to adjust the virtual object's pose. This closed-loop feedback ensures the virtual object remains properly aligned with the user's perspective, maintaining a sense of connection to the actual environment while preserving 3D visual fidelity.
2Shape
If a 3D virtual object is displayed in augmented reality, then the object has three-dimensional form, but it does not immediately and naturally change pose in response to eyeline changes, making the object feel foreign to the environment
Solution Approach 1:
The patent makes the 3D virtual object dynamic by continuously adjusting its pose based on real-time eyeline estimation. The system calculates the relationship between the camera position and the target object to determine the appropriate virtual object orientation, ensuring the 3D form remains visually accurate while adapting naturally to user perspective changes.
3Adaptability or versatility
If pose data is estimated and updated in real-time to align virtual objects with target objects, then the integration becomes more harmonious, but the system complexity increases due to continuous data transmission and processing
Solution Approach 1:
The patent applies preliminary action by pre-establishing the coordinate system relationships and pose estimation algorithms before actual augmented reality rendering. The system pre-processes target object data and sets up the mathematical frameworks needed for rapid pose calculation, reducing the complexity of real-time processing while maintaining harmonious virtual object integration.
Data Source
AI summary
A method of displaying 3-dimensional (3D) augmented reality includes transmitting a first image generated by photographing a target object at a first time point, and storing first view data at the first time point; receiving first relative pose data of the target object; estimating pose data of the target object, based on the first view data and the first relative pose data of the target object; generating a second image by photographing the target object at a second time point, and generating second view data at the second time point; estimating second relative pose data of the target object, based on the pose data of the target object and the second view data; rendering a 3D image of a virtual object, based on the second relative pose data of the target object; and generating an augmented image by augmenting the 3D image of the virtual object on the second image.