AR Tracking Reliability via Position Estimation Feedback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In augmented reality systems, determining the position of a real object is challenging when it is temporarily concealed, leading to inaccurate or failed tracking, which reduces immersion and reliability, especially in critical applications like medical operations.

Innovation Solution

A method that calculates a reliability value by comparing detected and estimated positions of the real object, using a tracking system and an evaluation unit to continuously assess and display the plausibility of the detected position, allowing the user to trust the virtual object's placement based on this value.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a tracking system is used to detect the position of a real object, then the position can be continuously updated, but the detection becomes unreliable when the object is temporarily concealed

Engineering Contradiction:
Improvetracking reliabilityVSAvoidobject detection difficulty
Core Design Contradiction:
ReliabilityVSDifficulty of detecting and measuring

Solution Approach 1:

The system performs preliminary actions by calculating an estimated position before the actual detection occurs. This estimated position serves as a reference that allows the system to maintain tracking reliability even when the object is temporarily concealed, as the estimated position can be compared with subsequent detections to assess reliability.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system implements feedback by comparing the detected position with the estimated position and determining a reliability value based on their correspondence. This feedback mechanism allows the system to continuously assess tracking quality and provide reliability information to the user, resolving the contradiction between continuous tracking and detection reliability.

Inventive Principle:
Principle #23Feedback

2Measurement precision

If the detected position is used directly to overlay virtual data, then the process is simple, but the immersion degree decreases when detection is inaccurate

Engineering Contradiction:
Improveposition accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system uses feedback by comparing detected position with estimated position and calculating a reliability value. This feedback loop enables the system to assess position accuracy without significantly increasing complexity, as the comparison uses the same coordinate system and straightforward distance calculations.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The estimated position acts as an intermediary element between the tracking system and the final display. It serves as a reference that mediates the relationship between detected position and virtual object placement, enabling reliability assessment while maintaining system simplicity through mathematical comparison.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Reliability

If tracking continues without reliability assessment, then the system remains simple, but user trust in the display decreases

Engineering Contradiction:
Improveuser trustVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system implements feedback by calculating and displaying a reliability value that informs users about the quality of tracking. This feedback mechanism builds user trust by transparently communicating detection confidence without requiring complex additional hardware or processing, as it uses the existing estimated position calculation.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The reliability value serves as an intermediary that translates complex tracking quality assessment into a simple, interpretable metric for users. It mediates between the complex comparison of detected and estimated positions and the user's need for straightforward trust indicators, maintaining simplicity while enhancing reliability communication.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11600012B2Display of a virtual object linked to a real object in an augmented reality display device
Publication Date: 2023.03.07 SIEMENS HEALTHINEERS AG
  • US11600012B2 patent drawing
  • US11600012B2 patent drawing
  • US11600012B2 patent drawing

AI summary

A method for determining the position of a real object and displaying a virtual object linked to the real object in an augmented reality display device is provided. For this purpose, a tracking system is used to detect a position of the real object) at different consecutive measurement times and in each case to calculate an estimated position for the measurement times. A reliability value is determined on the basis of the detected position of the real object and of the estimated position of the real object and shown in the augmented reality display device. The present method furthermore discloses a corresponding augmented reality system having an augmented reality display device for displaying a real object and a virtual object linked to the real object).