Multi-Camera Imaging Alignment Using Invisible Infrared Markers

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for inspecting structures like bridges using multiple cameras struggle with aligning images from overlapping regions without visible markers, leading to insufficient resolution and potential concealment of cracks by marker beams, especially in areas with repetitive patterns or lack of distinct features.

Innovation Solution

A system comprising multiple cameras and marker-giving mechanisms that use non-visible light markers to align and compose images, calculating correction parameters for positioning and size adjustments to create a high-resolution composite image without visible markers.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If visible laser beams are used as markers to align multiple camera images, then image alignment stability is improved, but the laser beams may conceal cracks in the inspected structure

Engineering Contradiction:
Improveimage alignment stabilityVSAvoidmarker beam concealment of cracks
Core Design Contradiction:
ReliabilityVSObject-affected harmful factors

Solution Approach 1:

The patent extracts the marker function from visible light and transfers it to invisible infrared light. The infrared laser beams serve as alignment markers but remain undetectable to the visible light camera, thus eliminating the concealment problem while maintaining alignment stability. This separation of functions (alignment vs. imaging) resolves the contradiction.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent introduces an intermediary medium - infrared light - that mediates between the alignment requirement and the imaging requirement. The infrared laser beams act as a mediator for alignment purposes while being invisible to the visible light camera, thus mediating the conflict between needing visible markers and avoiding crack concealment.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Area of stationary object

If multiple cameras capture images of large inspection areas, then coverage area is improved, but resolution becomes insufficient in single captured images

Engineering Contradiction:
Improveinspection area coverageVSAvoidimage resolution
Core Design Contradiction:
Area of stationary objectVSMeasurement precision

Solution Approach 1:

The patent merges images from multiple cameras into a single composite image. By aligning and composing the overlapping regions of multiple camera images using infrared markers, the system achieves both extensive coverage area and high resolution in the final composite image. This combining process resolves the contradiction between coverage and resolution.

Inventive Principle:
Principle #5Merging (Combining)

3Manufacturing precision

If images are composed by searching for common objects in adjacent captured images, then image composition accuracy is improved, but processing time increases significantly

Engineering Contradiction:
Improveimage composition accuracyVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent applies preliminary action by pre-positioning infrared laser markers in the overlapping regions before image capture. This pre-arranged marker system eliminates the need for time-consuming search-and-match operations during post-processing. The markers are already in place to guide alignment, significantly reducing processing time while maintaining accuracy.

Inventive Principle:
Principle #10Preliminary action

4Reliability

If the imaging field of view is adjusted to include common imaging regions, then image alignment capability is improved, but the field of view must be carefully controlled to avoid positional deviation

Engineering Contradiction:
Improveimage alignment capabilityVSAvoidfield of view control complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent uses infrared laser markers as an intermediary reference system that simplifies field of view control. Instead of complex computational methods to align images, the invisible infrared markers provide a simple, reliable reference that guides the imaging process. This intermediary approach reduces the complexity of controlling and adjusting fields of view while maintaining alignment reliability.

Inventive Principle:
Principle #24Intermediary (Mediator)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables accurate alignment and composition of images from overlapping regions without marker concealment, improving inspection resolution and efficiency while avoiding the limitations of visible marker-based methods.

Implementation Method 1

a laser beam is radiated to an object 2 in the imaging field of view of a CCD camera 1 and the image of the object 2 is captured by the same CCD camera 1

Methodology Applied
Scientific EffectLaser: Laser

Data Source

PatentUS9423355B2Plural camera images capturing and processing apparatus, and composite imaging method
Publication Date: 2016.08.23 HITACHI LTD
  • US9423355B2 patent drawing
  • US9423355B2 patent drawing
  • US9423355B2 patent drawing

AI summary

A plural camera images capturing and processing apparatus includes a plurality of cameras that capture images of a plurality of adjacent imaging regions which overlap each other, a plurality of laser devices that give a marker to each common imaging region in which imaging regions overlap each other, an imaging control unit that controls each camera and each laser device and acquires a markerless image group to which no marker is given and a marker-given image group to which the marker is given, a non-visible light image processing unit that calculates a correction parameter, which is information for aligning the inclinations, sizes, and positions of the imaging regions, on the basis of the marker-given image group, and a visible light image processing unit that composes the markerless image group to generate a composite image, on the basis of the correction parameter.