Surface-Aware Virtual Modification With Redundant AR Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Virtual rendering systems often fail to consistently present virtual objects in real-world environments due to environmental conditions and user actions, leading to erratic behavior and disruption of the illusion of virtual objects in augmented reality experiences.
Innovation Solution
A virtual rendering system that employs multiple redundant tracking systems, including Natural Feature Tracking (NFT), Simultaneous Localization And Mapping (SLAM), and gyroscopic tracking, to seamlessly transition between 6 Degrees of Freedom (DoF) and 3 DoF tracking, ensuring consistent rendering of virtual modifications by dynamically adjusting to environmental changes and user movements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If a single tracking system is used for virtual rendering, then the device complexity is low, but the reliability of virtual object presentation deteriorates due to environmental conditions and user actions causing tracking disruptions
Solution Approach 1:
The patent combines multiple redundant tracking systems (Natural Feature Tracking, SLAM, and gyroscopic tracking) into a unified virtual rendering system. This merging allows the system to maintain reliable virtual object presentation by switching between different tracking methods when environmental conditions or user actions cause disruptions to any single tracking system.
Solution Approach 2:
The system implements beforehand cushioning by having redundant tracking systems ready in advance. When the primary tracking system experiences disruptions due to environmental conditions or user actions, the system can seamlessly transition to alternative tracking methods, preventing tracking failures and maintaining consistent virtual object presentation without interruption.
2Reliability
If multiple redundant tracking systems are implemented, then the reliability of virtual object presentation improves, but the device complexity increases
Solution Approach 1:
The system implements dynamic tracking by allowing the virtual rendering system to adaptively switch between different tracking methods (Natural_feature Tracking, SLAM, gyroscopic tracking) based on real-time environmental conditions and user actions. This dynamic approach maintains reliable tracking consistency without requiring all tracking systems to operate simultaneously, thereby managing system architecture complexity.
3Adaptability or versatility
If natural feature tracking is used in dynamic environments, then the adaptability to environmental changes improves, but the stability of tracking deteriorates when visual features are occluded or disrupted
Solution Approach 1:
The system uses gyroscopic tracking as an intermediary when visual features become occluded or disrupted. The gyroscopic data provides stable orientation and position information that mediates between the occluded visual features and the virtual object rendering, maintaining tracking stability during transient visual disruptions while preserving adaptability to environmental changes.
Data Source
AI summary
Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and a method for rendering virtual modifications to real-world environments depicted in image content. A reference surface is detected in a three-dimensional (3D) space captured within a camera feed produced by a camera of a computing device. An image mask is applied to the reference surface within the 3D space captured within the camera feed. A visual effect is applied to the image mask corresponding to the reference surface in the 3D space. The application of the visual effect to the image mask causes a modified surface to be rendered in presenting the camera feed on a display of the computing device.