Feedback Engine for 3D Object Pose Tracking Accuracy

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current 3D object tracking technologies face accuracy issues due to proximity with difficult-to-segment objects, occlusions, and environmental changes like lighting and temperature variations, leading to deteriorated performance in augmented and virtual reality systems.

Innovation Solution

A tracker with a feedback engine that computes and outputs feedback to improve tracking performance by adjusting object positioning, such as visual, auditory, or haptic cues, to maintain optimal tracking conditions, ensuring accurate pose and shape parameter calculation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If 3D object tracking is performed using standard sensors and algorithms, then basic tracking functionality is achieved, but tracking accuracy deteriorates when objects are close to difficult-to-segment objects, occluded, or under environmental changes

Engineering Contradiction:
Improvetracking accuracyVSAvoidtracking performance stability
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The system implements a feedback mechanism where the tracker monitors its own performance metrics (tracking accuracy, confidence scores, position stability) and provides feedback to the user through visual, auditory, or haptic cues. This feedback loop enables real-time adjustment of object positioning to maintain optimal tracking conditions, directly addressing the accuracy deterioration issue in challenging scenarios

Inventive Principle:
Principle #23Feedback

2Duration of action of stationary object

If the tracker operates in challenging environments with occlusions and lighting changes, then continuous tracking is maintained, but tracking accuracy decreases

Engineering Contradiction:
Improvecontinuous tracking durationVSAvoidpose parameter accuracy
Core Design Contradiction:
Duration of action of stationary objectVSMeasurement precision

Solution Approach 1:

The feedback engine continuously monitors tracking quality metrics and provides real-time feedback to the user, enabling dynamic adjustment of object positioning to maintain optimal tracking conditions throughout extended operation, thus preserving both continuous tracking duration and pose parameter accuracy in challenging environments

Inventive Principle:
Principle #23Feedback

3Measurement precision

If the system provides detailed feedback to improve tracking, then tracking accuracy improves, but device complexity increases

Engineering Contradiction:
Improvetracking accuracyVSAvoidfeedback system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The feedback engine implements targeted feedback mechanisms that provide specific guidance (visual cues for object separation, auditory signals for occlusion detection, haptic feedback for positioning adjustments) without requiring complex feedback loops. This selective feedback approach improves tracking accuracy while keeping the overall system architecture relatively simple and maintainable

Inventive Principle:
Principle #23Feedback

Data Source

PatentEP3489807B1Feedback for object pose tracker
Publication Date: 2022.07.13 MICROSOFT TECHNOLOGY LICENSING LLC
  • EP3489807B1 patent drawingFigure 1
  • EP3489807B1 patent drawingFigure 2
  • EP3489807B1 patent drawingFigure 3

AI summary

A computing device has an input configured to receive data captured by at least one capture device where the data depicts at least part of an object moving in an environment. The computing device has a tracker configured to track a real-world position and orientation of the object using the captured data. A processor at the computing device is configured to compute and output feedback about performance of the tracker, where the feedback encourages a user to adjust movement of the object for improved tracking of the object by the tracker.