Virtual Surface Modification with 6DoF and 3DoF Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Virtual rendering systems face challenges in consistently presenting virtual objects in real-world environments due to environmental conditions, user actions, and unanticipated visual interruptions, leading to erratic behavior and disruption of the illusion.
Innovation Solution
The system employs a redundant tracking mechanism combining multiple tracking approaches (6DoF and 3DoF) and a surface-aware lens to maintain consistent rendering of virtual modifications by seamlessly transitioning between tracking systems and anchoring objects to a reference surface, ensuring uninterrupted 3D experiences.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If a single tracking system is used to present virtual objects, then the device complexity is reduced, but the reliability of consistent virtual object presentation deteriorates due to environmental conditions and visual interruptions
Solution Approach 1:
The patent combines multiple tracking systems (6DoF tracking and 3DoF tracking) into a unified virtual rendering system. The 6DoF tracking provides six degrees of freedom for precise object positioning, while the 3DoF tracking provides three degrees of freedom as a complementary system. These systems are merged to work together, allowing the system to maintain reliable virtual object presentation by switching between or combining data from both tracking systems, thereby resolving the contradiction between reliability and complexity.
Solution Approach 2:
The system performs preliminary action by pre-establishing multiple tracking systems (6DoF and 3DoF) before virtual object presentation begins. This ensures that redundant tracking capabilities are already in place and calibrated, allowing the system to immediately handle environmental conditions and visual interruptions without delay, thus improving reliability while managing complexity through advance preparation.
2Reliability
If multiple tracking systems are combined to improve reliability, then the consistent rendering of virtual objects is maintained, but the device complexity increases
Solution Approach 1:
The patent implements universality by designing the virtual rendering system to handle multiple tracking systems (6DoF and 3DoF) through a unified architecture. The system is configured to process data from both tracking systems and perform seamless transitions between them, making the tracking subsystem multi-functional. This universal approach allows the system to maintain reliability across different tracking modes while managing complexity through standardized processing routines and a cohesive system design.
3Stability of the object's composition
If virtual objects are anchored to a reference surface, then the stability of virtual object position is improved, but the adaptability to different surface types is reduced
Solution Approach 1:
The patent applies parameter changes by allowing the reference surface parameters to be dynamically adjusted based on the detected surface type. The system can modify anchoring parameters such as attachment strength, orientation constraints, and position offsets to accommodate different surface characteristics (e.g., flat surfaces, inclined surfaces, curved surfaces). This enables the system to maintain stable virtual object positioning while adapting to various surface types, resolving the contradiction between stability and adaptability.
Data Source
AI summary
Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and a method for rendering virtual modifications to real-world environments depicted in image content. A reference surface is detected in a three-dimensional (3D) space captured within a camera feed produced by a camera of a computing device. An image mask is applied to the reference surface within the 3D space captured within the camera feed. A visual effect is applied to the image mask corresponding to the reference surface in the 3D space. The application of the visual effect to the image mask causes a modified surface to be rendered in presenting the camera feed on a display of the computing device.