Inspection Camera Spatial Referencing Using Infrared LEDs

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for spatial referencing of measurement data in closed environments, such as buildings or ships, require prior knowledge or infrastructure, are expensive, and have limitations in real-time capability and accuracy.

Innovation Solution

A sensor unit with an ultrasonic thickness measuring sensor and position transmitter, interacting with an inspection camera unit, uses infrared light-emitting diodes to provide relative location and orientation data, allowing for rapid spatial referencing without a priori knowledge or additional infrastructure.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If photogrammetric georeferencing is used to capture spatially overlapping images for trajectory determination, then spatial referencing of measurement data is achieved, but real-time capability is limited as the entire image block is required for subsequent processing

Engineering Contradiction:
Improvespatial referencing accuracyVSAvoidreal-time capability
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The invention extracts and processes individual images or small image groups sequentially as they are captured, rather than waiting for the entire image block. This allows spatial referencing to be performed in real-time during the inspection process, with each measurement being immediately georeferenced using the current camera position and orientation derived from processed images.

Inventive Principle:
Principle #2Taking out (Extraction)

2Measurement precision

If inertial measurement systems are used to measure angular velocities and accelerations for position and orientation determination, then spatial referencing is achieved, but large and expensive systems are required to avoid error accumulation

Engineering Contradiction:
Improveposition and orientation accuracyVSAvoidsystem size and cost
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system segments the spatial referencing function into two parts: (1) camera-based visual positioning that provides absolute position references, and (2) inertial sensors that provide relative motion data between measurements. This segmentation allows using smaller, less expensive inertial sensors while maintaining accuracy through periodic correction by the camera system.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The camera system acts as an intermediary that periodically corrects and resets the inertial measurement system. The inertial sensors provide continuous high-frequency motion data, while the camera provides periodic absolute position references that correct drift, allowing accurate long-term tracking without large expensive inertial systems.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Measurement precision

If a priori information such as maps or technical aids is used for spatial referencing, then accurate positioning is achieved, but the method becomes expensive and requires prior setup

Engineering Contradiction:
Improvepositioning accuracyVSAvoidprior setup requirement
Core Design Contradiction:
Measurement precisionVSEase of manufacture

Solution Approach 1:

The inspection system performs self-positioning by using the inspection camera itself to capture images of the environment and determine its own position and orientation through visual feature recognition and matching. The system creates its own reference framework from environmental features rather than requiring external maps or pre-installed technical aids.

Inventive Principle:
Principle #25Self-service

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables accurate and rapid spatial referencing of measurement data within closed environments, allowing precise recording of sensor positions and orientations during measurements, enhancing the utility of measurement data without the need for prior setup or expensive equipment.

Implementation Method 1

uses infrared light-emitting diodes to provide relative location and orientation data

Methodology Applied
Scientific EffectLight-emitting diode: Light Emitting Diode

Implementation Method 2

A sensor unit with an ultrasonic thickness measuring sensor

Methodology Applied
Scientific EffectUltrasonic: Ultrasound

Data Source

PatentEP3410064B1Inspection camera unit, method for inspecting interior spaces and sensor unit
Publication Date: 2023.08.09 DEUTSCHES ZENTRUM FÜR LUFT UND RAUMFAHRT E V
  • EP3410064B1 patent drawingFigure 1
  • EP3410064B1 patent drawingFigure 1a
  • EP3410064B1 patent drawingFigure 2

AI summary

In order to specify an inspection camera unit (101) with an inspection camera (104) for taking, preferably color, inspection photos (122) of interiors (121), in particular of ships, or a method for inspecting interiors (121), in particular of ships, by taking, preferably color, inspection photos (122) using an inspection camera unit, which in each case increase the usefulness of the inspection photos and, for example, also enable improved historical review, it is proposed that the inspection camera unit (101) has referencing means (105) for referencing the inspection photos (122) orthat the inspection photos (122) are referenced by determining relative location data of the inspection camera (104) and orientation data of the inspection camera (104) during recording and assigning them to the inspection photos (122), wherein the relative location data and the orientation data are subsequently classified into a coordinate system of the interior (121), wherein the inspection camera unit (101) is preferably designed according to one of claims 1 to 14.