Redundant AR Tracking System Seamless 6DoF to 3DoF Transition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Traditional object tracking systems in augmented reality (AR) frequently fail due to environmental conditions and user actions, leading to disruptions in the presentation of objects in a three-dimensional space, as they rely on single approaches like Natural Feature Tracking (NFT) or Gyroscopic tracking, which have limitations in tracking degrees of freedom and accuracy.

Innovation Solution

A redundant tracking system that combines multiple tracking sub-systems, enabling seamless transitions between them to maintain consistent object tracking with six degrees of freedom (6DoF) or three degrees of freedom (3DoF) based on the availability of tracking indicia, using a hybrid tracking matrix that includes translation and rotation data from various sources like NFT and gyroscopic systems.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a single tracking system (NFT or Gyroscopic) is used, then the device complexity is reduced, but the reliability of object tracking deteriorates due to frequent tracking failures

Engineering Contradiction:
Improvetracking reliabilityVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent combines multiple tracking subsystems (NFT and Gyroscopic tracking) into a unified tracking system. The system integrates natural feature tracking with gyroscopic data fusion to create a redundant tracking architecture that maintains object position and orientation more reliably than either system alone, directly resolving the contradiction between reliability and complexity.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system dynamically changes tracking parameters by switching between 6DoF and 3DoF modes based on the availability and quality of tracking indicia. When NFT provides sufficient features, the system uses full 6DoF tracking; when features are scarce, it transitions to 3DoF gyroscopic tracking, optimizing reliability across varying environmental conditions.

Inventive Principle:
Principle #35Parameter changes

2Reliability

If redundant tracking subsystems are combined, then the reliability of tracking is improved, but the device complexity increases

Engineering Contradiction:
Improvetracking continuityVSAvoidtracking system architecture
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The tracking system employs dynamic switching between different tracking modes (6DoF and 3DoF) and between NFT and Gyroscopic subsystems based on real-time assessment of tracking indicia availability. This dynamic adaptation allows the system to maintain reliability while managing complexity through intelligent mode selection rather than permanently activating all subsystems at full capacity.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The unified tracking system serves multiple functions by integrating both NFT and Gyroscopic tracking capabilities into a single architecture that can operate in various modes (6DoF, 3DoF, transitional states). This multi-functionality allows the system to handle diverse tracking scenarios with a single integrated solution rather than requiring separate dedicated systems.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Measurement precision

If 6DoF tracking is maintained continuously, then the measurement precision of object position is improved, but the system becomes vulnerable to tracking interruptions when indicia are unavailable

Engineering Contradiction:
Improveposition accuracyVSAvoidtracking stability
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The system prepares for potential tracking failures by maintaining gyroscopic tracking as a standby subsystem that can immediately take over when NFT tracking indicia become unavailable. This prior cushioning ensures that tracking stability is preserved by having a fallback mechanism ready before actual tracking interruptions occur.

Inventive Principle:
Principle #11Beforehand cushioning (Prior cushioning)

Solution Approach 2:

The system continuously monitors the availability and quality of tracking indicia and provides feedback to dynamically adjust the tracking mode. When indicia quality degrades below a threshold, the system receives feedback to transition from 6DoF to 3DoF mode, maintaining measurement precision within the capabilities of available data while preventing tracking failures.

Inventive Principle:
Principle #23Feedback

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach ensures uninterrupted AR experiences by smoothly transitioning between tracking systems, maintaining accurate object positioning even when single tracking systems fail, thereby enhancing the perceived quality of the three-dimensional experience.

Implementation Method 1

tracking the object with three degrees of freedom (3DoF) based on rotation and acceleration of the client device measured by an inertial measurement unit (IMU)

Methodology Applied
Scientific EffectGyroscopic tracking: Gyroscope

Data Source

PatentUS20240404208A1Redundant tracking system
Publication Date: 2024.12.05 SNAP INC
  • US20240404208A1 patent drawing
  • US20240404208A1 patent drawing
  • US20240404208A1 patent drawing

AI summary

A redundant tracking system comprising multiple redundant tracking sub-systems, enabling seamless transitions between such tracking sub-systems, provides a solution to this problem by merging multiple tracking approaches into a single tracking system. This system is able to combine tracking objects with six degrees of freedom (6DoF) and 3DoF through combining and transitioning between multiple tracking systems based on the availability of tracking indicia tracked by the tracking systems. Thus, as the indicia tracked by any one tracking system becomes unavailable, the redundant tracking system seamlessly switches between tracking in 6DoF and 3DoF thereby providing the user with an uninterrupted experience.