Augmented Reality Pointer for Defect Localization on Complex Parts

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for precisely locating defects on large or complex real parts during quality inspections are cumbersome, especially when visual references are absent, as they rely on manual measurements which can be inaccurate and inefficient.

Innovation Solution

A method utilizing augmented reality to visualize a real part and superimpose a virtual model, determining a passage matrix to convert real coordinates into virtual coordinates, allowing for automated and precise location of defects by using a pointer to target specific points on both the real and virtual models.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual measuring tools are used to locate defects on large or complex parts, then the measurement process can be performed without specialized equipment, but the measurement precision and ease of operation deteriorate due to the complexity of coordinate conversion and lack of visual references

Engineering Contradiction:
Improvedefect location precisionVSAvoidmeasurement operation complexity
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent replaces manual mechanical measurement tools with an augmented reality system that uses optical tracking and digital processing. The AR device captures images of the part, automatically identifies calibration points, performs coordinate transformations through software, and displays defect locations digitally, eliminating the need for manual rulers and coordinate conversion calculations.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent creates a virtual copy of the physical part within the augmented reality system. This digital model includes calibration points that correspond to physical calibration points on the part. By working with this virtual representation, the system simplifies coordinate mapping and provides visual references that improve measurement ease and precision simultaneously.

Inventive Principle:
Principle #26Copying

2Productivity

If manual measurement and coordinate conversion procedures are used, then no specialized equipment is required, but the productivity and time efficiency deteriorate due to the complex and time-consuming measurement process

Engineering Contradiction:
Improvedefect localization efficiencyVSAvoidmeasurement time
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The patent performs preliminary actions by pre-defining calibration points on both the physical part and its virtual model before the actual defect measurement begins. This setup phase enables automatic coordinate transformation during the measurement process, eliminating the need for manual coordinate calculations and significantly reducing measurement time while improving productivity.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The augmented reality system performs self-service by automatically capturing images, identifying calibration points, performing coordinate transformations, and calculating defect locations without requiring manual intervention for each measurement step. This automation dramatically reduces measurement time and increases productivity.

Inventive Principle:
Principle #25Self-service

3Measurement precision

If visual references are absent on the part, then the part design is not constrained, but the measurement precision deteriorates because operators cannot accurately locate points without visual cues

Engineering Contradiction:
Improvepoint location accuracyVSAvoidpart design flexibility
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent introduces calibration points as intermediary elements that serve as visual references during measurement. These calibration points are added to the part design specifically for measurement purposes and do not constrain the overall part design. They provide the necessary visual cues for accurate point location while maintaining part design flexibility through their temporary and purpose-specific nature.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent adds a visual dimension to the measurement process by superimposing a virtual model with calibration points onto the physical part through augmented reality. This creates a new layer of information that provides visual references without altering the physical part itself, thereby maintaining design flexibility while improving measurement precision.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentEP4105595B1Method for locating at least one point of a real part on a digital model
Publication Date: 2023.08.23 AIRBUS OPERATIONS (SAS)
  • EP4105595B1 patent drawingFigure 1
  • EP4105595B1 patent drawingFigure 2
  • EP4105595B1 patent drawingFigure 3

AI summary

The invention relates to a method for locating at least one point of a real part (26) on a virtual part (12) defined in a first frame by targeting the point of the real part with a pointer (24) of an augmented reality device, the method comprising: - a step of determining a transformation matrix between a frame in which the pointer (24) evolves and a frame in which the virtual part corresponding to the real part (26) is defined, - a step of determining the coordinates in the first frame of the point to be located by converting, using the transformation matrix, the coordinates in the second frame of the pointer (24) pointed at the point to be located.