Multi-Viewpoint Image Synthesis for Occluded Surface Inspection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional methods for inspecting concrete wall surfaces, such as bridges and tunnels, face challenges in detecting variations like cracks when obstacles are present between the inspection object and the camera, leading to potential overlooking of defects.

Innovation Solution

An image processing apparatus that acquires images from multiple viewpoints, associates feature coordinates, determines corresponding regions, generates a synthesized image by replacing obscured regions, and displays variation data to enhance detection accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a single camera is used to capture images for inspection, then the device complexity is low, but the measurement precision deteriorates because obstacles block the view of certain regions

Engineering Contradiction:
Improvedetection accuracyVSAvoidcomplexity of inspection system
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent introduces multiple viewpoint positions (spatial dimensions) to capture images of the same inspection object. By acquiring images from different spatial locations and synthesizing them, the system overcomes occlusion by obstacles and achieves comprehensive detection of variations such as cracks, thereby improving measurement precision without requiring complex single-point inspection equipment

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Measurement precision

If multiple images from different viewpoints are synthesized, then the measurement precision improves by detecting variations in obscured regions, but the device complexity increases due to multiple cameras and processing requirements

Engineering Contradiction:
Improvedetection accuracyVSAvoidcomplexity of image processing system
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the inspection task by dividing it into multiple viewpoint positions, each capturing specific regions of the inspection object. By associating coordinate positions across different images and synthesizing them separately, the system achieves comprehensive detection while managing processing complexity through structured segmentation of the image data

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces coordinate position association as an intermediary mechanism to link features across multiple images from different viewpoints. This intermediary step enables precise alignment and synthesis of images, allowing the system to detect variations in obscured regions without requiring direct complex interactions between multiple camera systems

Inventive Principle:
Principle #24Intermediary (Mediator)

3Productivity

If close visual inspection is performed manually, then the measurement precision is high for detecting variations, but the productivity deteriorates due to high operation cost and time consumption

Engineering Contradiction:
Improveinspection efficiencyVSAvoiddetection accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent replaces manual close visual inspection (mechanical human operation) with an automated image processing system that captures images from multiple viewpoints and synthesizes them to detect variations. This substitution maintains high detection accuracy while significantly improving productivity by eliminating manual inspection costs and time consumption

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS11830177B2Image processing apparatus, control method and non-transitory computer-readable recording medium therefor
Publication Date: 2023.11.28 CANON KK
  • US11830177B2 patent drawing
  • US11830177B2 patent drawing
  • US11830177B2 patent drawing

AI summary

An image processing apparatus acquires a first image which captures a scene including an object from a first viewpoint position and a second image which captures a scene including the object from a second viewpoint position, and associates a coordinate position corresponding to a position of a feature of the object on the first image with a coordinate position corresponding to a position of a feature of the object on the second image. The image processing apparatus determines a partial region in the second image corresponding to a give region in the first image based on the association, generates a synthesized image by replacing an image of the given region using an image of the determined partial region, and superimposing variation data on the synthesized image.