Composite Image Generation via Coordinate Alignment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional image processing methods for generating composite images in hardness testing devices often result in discontinuities and errors due to misalignment of coordinate axes between the imaging device and the stage, requiring laborious physical adjustments.

Innovation Solution

An image processing device that shifts the imaging unit relative to the stage to capture overlapping images, performs image matching to align adjacent images, and calculates misalignment angles to generate a composite image with no discontinuities, allowing for accurate alignment without costly physical adjustments.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If physical adjustment of imaging device attitude is performed to match coordinate axes, then alignment accuracy is improved, but adjustment time and cost increase

Engineering Contradiction:
Improvealignment accuracyVSAvoidadjustment time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent replaces the mechanical physical adjustment system with an image processing system. Instead of physically adjusting the imaging device attitude to match coordinate axes, the system captures images with misaligned coordinates and performs computational correction through image matching and coordinate transformation algorithms, thereby eliminating manual adjustment time while maintaining alignment accuracy

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent creates a virtual copy of the coordinate system relationship through image data. By capturing the stage position information and image coordinate information, the system creates a digital representation of the coordinate transformation, allowing virtual alignment correction without physical intervention in the actual imaging device or stage

Inventive Principle:
Principle #26Copying

2Measurement precision

If physical adjustment of imaging device attitude is performed to match coordinate axes, then alignment accuracy is improved, but adjustment cost increases

Engineering Contradiction:
Improvealignment accuracyVSAvoidadjustment cost
Core Design Contradiction:
Measurement precisionVSEase of manufacture

Solution Approach 1:

The patent substitutes expensive mechanical adjustment mechanisms and manual calibration procedures with software-based image processing algorithms. The coordinate alignment is achieved through computational methods including image matching, feature point detection, and coordinate transformation, eliminating the need for costly physical adjustment equipment and expert manual intervention

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system performs self-alignment through automated image processing. The control unit automatically captures images, detects feature points, calculates coordinate transformations, and generates corrected composite images without requiring external manual adjustment, thereby eliminating labor costs and simplifying the manufacturing and operation process

Inventive Principle:
Principle #25Self-service

3Area of stationary object

If stage is shifted to capture multiple images for composite imaging, then imaging range is expanded, but coordinate discontinuity occurs at joining portions

Engineering Contradiction:
Improveimaging rangeVSAvoidcoordinate continuity
Core Design Contradiction:
Area of stationary objectVSStability of the object's composition

Solution Approach 1:

The patent implements feedback through image matching between adjacent captured images. The system detects feature points in overlapping regions of consecutive images, calculates the actual displacement and rotation between them, and uses this feedback information to correct coordinate transformations when generating the composite image, ensuring continuous and accurate coordinate alignment across the entire imaging range

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent performs preliminary capture of stage position information and image coordinate information for each captured image. By recording the stage coordinates and image coordinates at the time of capture, the system prepares the necessary data in advance to perform accurate coordinate transformations and generate a continuous composite image without discontinuities at joining portions

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentEP2631868B1Image processing device and method for image processing
Publication Date: 2020.10.28 MITUTOYO CORP
  • EP2631868B1 patent drawingFigure 1~2
  • EP2631868B1 patent drawingFigure 3
  • EP2631868B1 patent drawingFigure 4

AI summary

A control unit 211 shifts an imaging unit 12 relatively with respect to a stage 3 to take an image IM(1)-IM(6) of a measuring object W at a plurality of places by the imaging unit 12 and thereby obtain a plurality of images IM(1)-IM(6), and generates a composite image IMa of the measuring object W having a range which is wider than an imaging range of the imaging unit 12 by combining the plurality of images IM(1)-IM(6). The control unit 211 shifts the imaging unit 12 relatively with respect to the stage 3 such that parts of images IM(1)-IM(6) adjacent to one another obtained by the imaging unit 12 overlap, and performs an image matching processing that performs image matching of an overlapped portion RIM(1) -RIM(6) of the adj acent images IM(1)-IM(6). The control unit 211 generates the composite image IMa of the measuring object W by joining the adjacent images IM(1)-IM(6) at a position where the image matching is performed in the image matching processing.