AR Inspection System Automates Targeting via Shape Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current inspection systems lack automation and ergonomics in targeting procedures, making complex measurement processes time-consuming and requiring high skill levels, especially in detecting and interacting with coordinate measuring instruments.

Innovation Solution

An Augmented Reality (AR)-based inspection system that integrates a coordinate measuring instrument with a camera unit, computer unit, and communication unit, and an AR-device with similar components, enabling the detection of structured shapes, providing overlays, and transmitting trigger signals for measurement, thus enhancing ergonomics and efficiency by allowing seamless user interaction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If manual targeting and detection procedures are used with coordinate measuring instruments, then measurement capability is achieved, but the process becomes complex and time-consuming

Engineering Contradiction:
Improvemeasurement process efficiencyVSAvoidtime required for detection and targeting
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The patent introduces an AR device as an intermediary between the user and the coordinate measuring instrument. The AR device captures images, detects structured shapes through image processing, and presents them to the user via an AR interface. This intermediary automates the detection and targeting process, eliminating manual searching and complex procedures, thereby significantly improving productivity and reducing time loss.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Extent of automation

If automated detection is implemented, then measurement efficiency improves, but system complexity increases

Engineering Contradiction:
Improveautomation of targeting processVSAvoidsystem structure complexity
Core Design Contradiction:
Extent of automationVSDevice complexity

Solution Approach 1:

The AR device serves multiple functions: it acts as a camera unit for image capture, a computer unit for image processing and structured shape detection, and an AR display device for presenting detected shapes to the user. By consolidating these functions into a single universal device, the system achieves high automation without proportionally increasing overall system complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Ease of operation

If seamless user interaction is provided, then ergonomics improve, but system complexity increases

Engineering Contradiction:
Improveuser interaction ergonomicsVSAvoidinteraction system complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system implements continuous feedback by detecting structured shapes in real-time and displaying them through an AR interface that overlays detected shapes onto the user's view of the actual setting. This immediate visual feedback allows users to intuitively understand what is being measured and makes interaction seamless, while the automated nature of the feedback loop prevents complexity from escalating.

Inventive Principle:
Principle #23Feedback

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The AR-based system automates the targeting process, reducing complexity and time required for measurements by enabling precise detection and measurement of structured shapes, improving user interaction and system efficiency.

Implementation Method 1

at least one of the first and the second computer unit is configured for detecting two-dimensional or three-dimensional structured shapes in images captured by at least one of the first and second camera unit

Methodology Applied
Scientific EffectImage processing: Image Processing

Implementation Method 2

work based on time of flight laser technology

Methodology Applied
Scientific EffectTime of flight: Time of Flight

Implementation Method 3

the AR-device is configured for providing a real view of the setting, providing overlays onto the real view according to corresponding AR-data

Methodology Applied
Scientific EffectAugmented Reality:

Data Source

PatentUS10890430B2Augmented reality-based system with perimeter definition functionality
Publication Date: 2021.01.12 LEICA GEOSYSTEMS AG
  • US10890430B2 patent drawing
  • US10890430B2 patent drawing

AI summary

An Augmented Reality (AR)-based inspection system comprising a coordinate measuring instrument having a first camera unit, a first computer unit, and a first communication unit, and an AR-device having a second camera unit, a second computer unit, and a second communication unit, wherein the first and the second communication units are connectable, each of the coordinate measuring instrument and the AR-device is configured for establishing a referenced status relative to a setting, at least one of the first and the second computer unit is configured for detecting two-dimensional or three-dimensional structured shapes in images captured by at least one of the first and second camera unit. The AR-device is configured for providing a real view of the setting, providing overlays onto the real view according to corresponding AR-data, wherein said AR-data are at least in part spatially associated with the detected structured shapes.