Augmented Reality Object Placement via 3D Motion Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing virtual rendering systems face challenges in maintaining the illusion of virtual objects in real-world environments due to environmental conditions, user actions, and unanticipated visual interruptions.
Innovation Solution
The system dynamically adjusts the placement, positioning, and movement of virtual objects relative to real-world objects in a video by tracking the 3D movement of individuals using a 3D reference point, ensuring that virtual objects appear to exist within the real-world scene.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If virtual objects are rendered in real-world environments, then engaging and entertaining augmented reality experiences are created, but environmental conditions and visual interruptions cause the virtual objects to disappear or behave erratically
Solution Approach 1:
The patent introduces a camera as an intermediary reference frame to bridge the virtual object and the real-world environment. By tracking the camera's position and orientation, the system mediates between the virtual rendering space and the physical environment, allowing virtual objects to maintain stable positions relative to the camera view even when environmental conditions change or visual interruptions occur.
Solution Approach 2:
The system continuously tracks the camera's movement and uses this feedback to dynamically adjust the virtual object's position and orientation in real-time. This closed-loop feedback mechanism ensures that virtual objects remain stable and consistent relative to the camera's perspective, compensating for environmental changes and maintaining the augmented reality illusion.
2Device complexity
If virtual objects are placed in fixed positions, then rendering is simple, but the illusion of virtual objects existing in the real-world is broken when camera or user moves
Solution Approach 1:
The patent transforms the virtual object's position from a static fixed coordinate to a dynamic position that updates continuously based on camera movement. The virtual object's location is calculated relative to the camera's current position and orientation, allowing it to maintain its apparent position in the real-world environment as the camera moves, thereby preserving the augmented reality illusion.
3Reliability
If tracking systems are used to maintain virtual object position, then the illusion is maintained, but tracking failures occur due to environmental conditions and visual interruptions
Solution Approach 1:
The patent uses the camera for multiple functions: it serves as both the primary reference frame for positioning virtual objects and as the source of tracking data. By leveraging the camera's inherent movement data for both rendering reference and position tracking, the system reduces the need for separate complex tracking hardware while maintaining reliable illusion consistency.
Data Source
AI summary
Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: receiving a video that depicts a person; tracking three-dimensional (3D) movement of the person within the video using a 3D reference point; computing a 3D position for placement of an augmented reality item relative to the 3D reference point; causing to be displayed the augmented reality item within the video at the 3D position; and updating the 3D position of the augmented reality item in the video as the 3D reference point changes based on the 3D movement of the person.