Infrared Referencing Markers for AR Pose Accuracy

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing Augmented Reality (AR) systems in metrology, geodesy, and civil engineering face challenges in achieving precise positioning accuracy, especially in low-light environments and situations with limited reference features, which affects the robustness and efficiency of displaying AR data in real-time.

Innovation Solution

The integration of a surveying instrument with an infrared projector that provides referencing markers, allowing AR-devices to accurately reference their pose relative to a coordinate system, using a combination of infrared sensors and inertial sensors for precise positioning, and communication units for data transfer between the AR-device and surveying instrument.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If image-based referencing methods are used in traditional AR systems, then the system can display AR data, but the positioning accuracy deteriorates in low-light environments and situations with limited reference features

Engineering Contradiction:
Improvepositioning accuracyVSAvoidlow-light environment limitations
Core Design Contradiction:
Measurement precisionVSObject-affected harmful factors

Solution Approach 1:

The patent changes the wavelength parameter of the referencing light from visible spectrum to infrared spectrum. The surveying instrument projects infrared referencing markers that are invisible to the human eye but detectable by the AR device's infrared sensor, enabling accurate positioning regardless of ambient lighting conditions. This parameter change resolves the contradiction by making the referencing system independent of visible light intensity.

Inventive Principle:
Principle #35Parameter changes

2Reliability

If traditional image-based referencing is used, then the system structure remains simple, but the robustness of AR data display deteriorates in various lighting conditions

Engineering Contradiction:
Improverobustness of AR data overlayVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The surveying instrument is enhanced with multi-functionality by integrating both traditional surveying capabilities and infrared marker projection functions. The same device serves as both a surveying instrument and an infrared projector, while the AR device functions as both a display device and an infrared sensor. This multi-functionality improves robustness without significantly increasing overall system complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Measurement precision

If visible light referencing markers are used, then the referencing process is simple, but the accuracy of pose determination deteriorates when markers are visible to the human eye

Engineering Contradiction:
Improvepose determination accuracyVSAvoidvisibility of referencing markers
Core Design Contradiction:
Measurement precisionVSIllumination intensity

Solution Approach 1:

The patent replaces visible light-based optical referencing with infrared-based optical referencing. The surveying instrument projects infrared referencing markers that emit infrared radiation detectable by the AR device's sensor but invisible to humans. This substitution eliminates interference between visible marker visibility and positioning accuracy, as the infrared markers operate in a separate spectral domain.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This solution enhances the ergonomics, robustness, and precision of AR data overlay in various lighting conditions, reducing time and improving accuracy by using infrared referencing markers that are invisible to the human eye, thus overcoming limitations of traditional image-based referencing methods.

Implementation Method 1

a projector configured for projecting a light pattern onto a surface in the scene, wherein the pose, in particular and the dimensions, of the light pattern is definable relative to the inner coordinate system

Methodology Applied
Scientific EffectInfrared radiation: Infrared Radiation

Implementation Method 2

The visual sensor is configured for capturing images in an infrared and/or near-infrared range

Methodology Applied
Scientific EffectInfrared detection: Infrared Radiation

Data Source

PatentUS10788323B2Surveying instrument, augmented reality (AR)-system and method for referencing an AR-device relative to a reference system
Publication Date: 2020.09.29 HEXAGON INNOVATION HUB GMBH
  • US10788323B2 patent drawing
  • US10788323B2 patent drawing
  • US10788323B2 patent drawing

AI summary

A surveying instrument for providing a referencing marker designed to allow Augmented Reality (AR)-device to reference their pose relative to the reference system. The invention further relates to an AR-system comprising said surveying instrument and an AR-device. The invention further relates to a method for referencing an AR-device relative to a reference system by means of said surveying instrument.