Automated AR Frame Calibration via Optical Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional augmented reality systems require manual and time-consuming calibration processes to align virtual objects with real-world scenes, which can be expensive and prone to errors, especially when setting up in new environments or with new objects.

Innovation Solution

An automated frame of reference calibration system using a camera and a tracking system with a wand to establish a coordinate frame, allowing for the automatic computation of mappings between virtual and real object frames of reference, enabling quick and accurate alignment of virtual content with real-world scenes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual calibration is used to align virtual objects with real-world scenes, then alignment accuracy can be achieved, but calibration time becomes excessively long and cost increases

Engineering Contradiction:
Improvealignment accuracyVSAvoidcalibration time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent replaces manual mechanical calibration operations with an automated optical tracking system. The tracking system uses cameras to detect markers on a wand and automatically computes coordinate transformations, eliminating the need for manual measurement and calculation while maintaining high alignment accuracy.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system enables self-calibration by automatically computing the mapping between virtual and real-world coordinate frames. The tracking system independently performs marker detection, coordinate frame establishment, and transformation calculation without requiring external manual intervention, thus reducing calibration time while preserving precision.

Inventive Principle:
Principle #25Self-service

2Measurement precision

If manual calibration processes are used, then alignment can be achieved, but the process becomes expensive and error-prone

Engineering Contradiction:
Improvealignment accuracyVSAvoidcalibration process complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent replaces complex manual calibration procedures with an automated optical tracking system that uses computer vision algorithms to detect markers and compute transformations. This substitution reduces human error and simplifies the overall process while maintaining or improving alignment accuracy.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces markers as intermediary objects that facilitate the calibration process. These markers serve as a common reference between the physical wand and the digital tracking system, enabling automatic and accurate coordinate frame establishment without complex direct measurements.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Productivity

If automated calibration is implemented, then calibration time is reduced, but system complexity increases

Engineering Contradiction:
Improvecalibration speedVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent uses markers as simple intermediary objects that bridge the physical and digital domains. These markers are easily detectable by the tracking system and require minimal processing, enabling fast automated calibration while keeping the system relatively simple and cost-effective.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent creates a digital copy of the physical coordinate frame by tracking the wand's position and orientation through marker detection. This copying approach allows the system to rapidly establish virtual-real world mappings without requiring complex physical measurements or calculations.

Inventive Principle:
Principle #26Copying

4Adaptability or versatility

If manual calibration is performed in new environments, then adaptation can be achieved, but the process becomes time-consuming and labor-intensive

Engineering Contradiction:
Improveenvironment adaptabilityVSAvoidcalibration time
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The patent replaces manual environment adaptation procedures with automated optical tracking. The system can rapidly establish coordinate frames in new environments by simply placing markers and allowing the tracking system to automatically compute transformations, enabling fast adaptation to different locations and objects.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The tracking system with marker detection capabilities provides a universal calibration approach that can be applied to any environment or object. The same system architecture and marker-based methodology work consistently across different settings, eliminating the need for environment-specific manual calibration procedures.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentEP2728548B1Automated frame of reference calibration for augmented reality
Publication Date: 2021.02.24 THE BOEING CO
  • EP2728548B1 patent drawingFigure 1
  • EP2728548B1 patent drawingFigure 2
  • EP2728548B1 patent drawingFigure 3

AI summary

One or more systems, methods, routines and/or techniques for automated frame of reference calibration for augmented reality (100) are described. One or more systems, methods, routines and/or techniques may allow for calibration of an Augmented Reality (AR) system (100), for example, by automatically calibrating the frames of reference of virtual objects and/or a camera (102). One example calibration routine and/or technique may determine and/or calculate a mapping or transform from a frame of reference of a virtual object (112) (e.g., a CAD model) to a coordinate frame (204) associated with the tracking system (108). Another example calibration routine and/or technique may determine and/or calculate a mapping or transform from a camera (102) lens frame of reference to a frame of reference of the whole camera (102) as determined by a tracking system (108). These routines and/or techniques may calibrate an AR system (100) to provide rapid, precise alignment between virtual content and a live camera (102) view of a real scene.