AR Image Processing Adaptive Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing augmented reality applications face issues with user unsatisfied visualization due to jittering, misalignment, and discontinuous display of virtual information with the real environment, despite optimized vision-based tracking solutions, as they do not adequately consider the usage, properties of digital and real environments, and display devices.

Innovation Solution

The method involves adjusting parameters and the operating flow of vision-based processing or tracking based on the usage of image processing, visualization, visually perceivable properties of digital and real environments, and display devices, including adjusting similarity measures and re-projection error thresholds to enhance user satisfaction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If vision-based tracking solutions are optimized for accuracy, then measurement precision is improved, but device complexity increases and processing time increases

Engineering Contradiction:
Improvetracking accuracyVSAvoidprocessing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies dynamics by making the tracking system adaptive through adjustable parameters. The system dynamically adjusts tracking sensitivity, update rates, and parameter weights based on application requirements, allowing optimization of precision without permanently increasing complexity. This enables the same system to operate at different precision levels depending on needs.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent implements parameter changes by providing adjustable tracking parameters including sensitivity thresholds, update rates, and parameter weights. These parameters can be modified to balance precision and complexity trade-offs, allowing users to increase measurement precision when needed while reducing processing complexity in other scenarios.

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If vision-based tracking solutions are optimized for accuracy, then measurement precision is improved, but processing speed deteriorates

Engineering Contradiction:
Improvetracking accuracyVSAvoidprocessing speed
Core Design Contradiction:
Measurement precisionVSSpeed

Solution Approach 1:

The system dynamically adjusts processing speed and update rates based on application requirements. By making the tracking system adaptive, it can operate at high precision with lower update rates when accuracy is paramount, or at higher speeds with reduced precision when real-time performance is critical, thus resolving the speed-precision trade-off.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent enables parameter changes including adjustable update rates and processing frequencies. Users can modify these parameters to prioritize either precision or speed depending on application needs, allowing the system to optimize for measurement precision when time is not critical, or for processing speed when real-time performance is required.

Inventive Principle:
Principle #35Parameter changes

3Manufacturing precision

If digital information is superimposed with real environment, then visualization quality is improved, but misalignment and jittering occur

Engineering Contradiction:
Improvealignment precisionVSAvoidvisualization stability
Core Design Contradiction:
Manufacturing precisionVSStability of the object's composition

Solution Approach 1:

The patent implements feedback mechanisms by continuously monitoring alignment quality and using this information to adjust tracking parameters. The system evaluates the stability of digital information superposition and feeds this information back to modify tracking sensitivity and parameter weights, thereby maintaining both alignment precision and visualization stability simultaneously.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system applies beforehand cushioning by pre-adjusting tracking parameters and applying compensation factors before misalignment and jittering occur. By anticipating potential alignment issues and applying corrective measures in advance, the system maintains stable visualization while achieving precise alignment of digital information with the real environment.

Inventive Principle:
Principle #11Beforehand cushioning (Prior cushioning)

4Manufacturing precision

If tracking parameters are adjusted for better alignment, then manufacturing precision is improved, but processing time increases

Engineering Contradiction:
Improvealignment precisionVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent enables parameter changes that allow users to adjust tracking sensitivity and alignment precision levels. By providing controllable parameters, the system can achieve high alignment precision when needed while allowing faster processing with reduced precision when time is more critical, thus managing the trade-off between alignment precision and processing time.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The system applies partial action by adjusting tracking parameters to achieve sufficient rather than perfect alignment precision. By using partial adjustment of parameters, the system achieves adequate alignment for most applications without the full processing time required for maximum precision, thus reducing processing time while maintaining acceptable alignment quality.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentEP2901413B1Method of image processing for an augmented reality application
Publication Date: 2019.05.08 APPLE INC
  • EP2901413B1 patent drawingFigure 1
  • EP2901413B1 patent drawingFigure 2
  • EP2901413B1 patent drawingFigure 3

AI summary

A method of image processing in an augmented reality application comprises the steps of providing at least one image of a real environment, performing image processing in an augmented reality application with the at least one image employing visualization of overlaying digital information with visual impressions or the image of the real environment and employing vision-based processing or tracking, and adjusting at least one of a parameter and operating flow of the vision-based processing or tracking depending on at least one of the following: a usage of the image processing, a usage of the visualization, a visually perceivable property of the digital information or the real environment, a property of a display device employed in the visualization, a manner in which a user is viewing the visualization. The method is capable to improve the performance and usability of augmented reality applications.