AR Model Alignment via Target Marker Orientation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing augmented reality technologies face difficulties in accurately aligning and orienting three-dimensional models with real-world objects, particularly in industrial settings, where precise superimposition is crucial for effective machine diagnosis and maintenance.

Innovation Solution

A method and device for augmented reality model alignment that involves user input to identify machines, detecting target markers, and determining orientations for superimposing three-dimensional models on images captured by a device, using multiple icons to represent different positions and orientations, allowing for precise alignment and superimposition based on user selection.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional augmented reality alignment methods are used, then the system is simple to implement, but the alignment precision and orientation accuracy of the three-dimensional model are insufficient

Engineering Contradiction:
Improvealignment precisionVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent introduces a target marker as an intermediary element that facilitates precise alignment between the augmented reality model and the real-world object. The marker serves as a reference object with known geometric features that enables the system to calculate transformation matrices and achieve accurate superimposition without requiring complex direct matching algorithms

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system performs preliminary actions by pre-defining multiple possible positions and orientations for the target marker relative to the machine. The user selects from pre-calculated orientation options before the actual augmented reality overlay is applied, which simplifies the real-time processing requirements while maintaining high precision alignment

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If multiple positions and orientations are provided for target marker, then the alignment accuracy is improved, but the user interface complexity increases

Engineering Contradiction:
Improveorientation accuracyVSAvoiduser interface ease
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The system applies local quality by providing different levels of interaction complexity for different users or situations. The interface allows users to select from multiple pre-defined orientation options when needed, while also supporting automatic selection modes. Each icon represents a specific local configuration option, making the complex multi-position system manageable through localized, simple selection actions

Inventive Principle:
Principle #3Local quality

3Productivity

If automatic target marker detection is used, then the productivity is improved, but the detection accuracy may be compromised in complex industrial environments

Engineering Contradiction:
Improvetask efficiencyVSAvoiddetection accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The system incorporates feedback mechanisms where the detected target marker position and orientation are validated against the pre-defined options. The system provides feedback to the user about the detected marker position and allows manual correction or selection from alternative orientations, ensuring both high productivity through automatic detection and high accuracy through validation and user confirmation

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS10983672B2Augmented reality model alignment
Publication Date: 2021.04.20 CATERPILLAR INC
  • US10983672B2 patent drawing
  • US10983672B2 patent drawing
  • US10983672B2 patent drawing

AI summary

A device for augmented reality model alignment is disclosed. The device may receive user input that identifies a machine, identify an augmented reality model associated with the machine, and display a representation of the machine with multiple icons that indicate multiple positions for a target marker. The device may detect a user selection of an icon of the multiple icons and may determine, based on the selected icon, an orientation for superimposition of the augmented reality model. The device may detect the target marker in an image captured by an image capture component of the device and may superimpose the augmented reality model on the image using the orientation.