Dynamic AR Tracking Algorithm Switching
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Augmented Reality (AR) applications face challenges in dynamically adjusting tracking algorithms to optimize performance based on device capabilities and real-time environment conditions, leading to suboptimal results due to the one-size-fits-all approach and variability in object characteristics.
Innovation Solution
Implement a method that dynamically switches between tracking algorithms, starting with high-quality algorithms and downgrading to less computationally expensive ones based on confidence scores and device resources, and further utilizes gyroscope data when necessary, ensuring optimal AR effects by selecting the most appropriate algorithm for real-time performance.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a high-quality tracking algorithm is implemented to achieve optimal AR effects, then tracking accuracy and performance are improved, but computational resource requirements increase and device compatibility deteriorates
Solution Approach 1:
The patent implements dynamic algorithm selection where the tracking algorithm is chosen based on real-time device capability assessment. The system transitions from static one-size-fits-all algorithm deployment to dynamic adaptation, selecting between high-accuracy algorithms (when device capabilities permit) and computationally lighter alternatives (when resources are constrained), thereby resolving the contradiction between tracking accuracy and computational requirements
Solution Approach 2:
The system changes the parameter of algorithm complexity based on device capabilities. By assessing device computational resources and adjusting the tracking algorithm accordingly, the system optimizes the balance between accuracy and computational cost, allowing high accuracy on capable devices while maintaining compatibility with less powerful devices
2Device complexity
If a single tracking algorithm is implemented to simplify the system, then device complexity is reduced, but adaptability to different object characteristics and environmental conditions deteriorates
Solution Approach 1:
The patent implements a universal tracking system that can handle multiple object characteristics and environmental conditions through a single framework. Instead of requiring separate specialized algorithms for different scenarios, the system maintains a library of algorithms and selects the appropriate one dynamically, achieving both simplicity (through unified architecture) and versatility (through multi-scenario capability)
3Reliability
If a robust tracking algorithm is implemented to handle various environmental conditions, then reliability is improved, but tracking accuracy deteriorates in situations where more precise algorithms are available
Solution Approach 1:
The system dynamically adjusts the tracking algorithm based on environmental conditions and device capabilities. When robustness is needed (e.g., in challenging lighting or occlusion conditions), the system selects algorithms known for their reliability. When conditions are favorable, it switches to more precise algorithms, thereby optimizing both reliability and accuracy as needed rather than compromising one for the other
Data Source
Figure 1
Figure 2
Figure 3
AI summary
In one embodiment, a method includes generating, by a device, first tracking data using a first tracking algorithm, based on first video frames associated with a scene. An augmented-reality (AR) effect may be displayed based on the first tracking data. The device may generate a first confidence score associated with the first tracking data and determine that the first confidence score is above a threshold. The device may generate, based on second video frames subsequent to the first video frames, second tracking data using the first tracking algorithm. The device may determine that an associated second confidence score is below a threshold. In response, the device may generate, based on third video frames subsequent to the second video frames, third tracking data using a second tracking algorithm different from the first. The device may then display the AR effect based on the third tracking data.