Remote Visual Inspection Guidance Using Image-Based Path Matching

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current remote visual inspection methods require highly skilled inspectors and are time-consuming and costly, with a need for improved repeatability and efficiency in navigating complex machines like aircraft engines.

Innovation Solution

A method and device that use pre-stored inspection path-defining image groups to guide remote visual inspection devices through feature matching and transformation estimation, generating guidance instructions for optimal path calculation and autonomous movement, reducing the reliance on skilled operators and enhancing inspection efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If highly skilled inspectors manually operate remote visual inspection devices, then inspection accuracy and reliability are maintained, but inspection time and costs increase significantly

Engineering Contradiction:
Improveinspection reliabilityVSAvoidinspection time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The inspection system performs self-navigation and self-positioning by automatically matching features between live images and pre-stored reference images, eliminating the need for skilled operators to manually navigate the device along the inspection path

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces manual mechanical operation with automated image processing and transformation estimation algorithms, substituting human skill-based navigation with computer-vision-based autonomous positioning

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Manufacturing precision

If highly skilled inspectors manually navigate the device, then proper inspection paths are achieved, but the requirement for skilled operators increases costs and reduces efficiency

Engineering Contradiction:
Improveinspection path precisionVSAvoidoperator skill requirement
Core Design Contradiction:
Manufacturing precisionVSEase of operation

Solution Approach 1:

The system autonomously determines its position and navigation path by automatically matching image features and calculating transformations, making the device self-sufficient and eliminating dependence on skilled operators

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent introduces image feature matching and transformation estimation as intermediary processes between the operator and the inspection device, using computational algorithms as a mediator to translate simple operator input into precise device navigation

Inventive Principle:
Principle #24Intermediary (Mediator)

3Productivity

If optimal inspection paths are calculated and used, then inspection efficiency increases, but system complexity increases due to pre-stored image groups and transformation estimation

Engineering Contradiction:
Improveinspection efficiencyVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system performs preliminary actions by pre-storing reference images and their feature data before actual inspections, allowing rapid automated navigation during subsequent inspections without requiring complex real-time processing

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent segments the inspection system into distinct functional modules: feature extraction, feature matching, transformation estimation, and guidance generation, allowing each module to be independently optimized and managed

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS20230260283A1Remote visual inspection guidance
Publication Date: 2023.08.17 ROKE MANOR RESEARCH LTD
  • US20230260283A1 patent drawing
  • US20230260283A1 patent drawing
  • US20230260283A1 patent drawing

AI summary

A method for guiding a remote visual inspection device along an inspection path defined by a pre-stored inspection path-defining image group, from a current position to a target position, includes capturing the live image feed from the remote visual inspection device from the current position during an inspection of an object; matching features of the live captured image to image features in the pre-stored inspection path-defining image group; identifying a key-frame image which is the next closest image in the path-defining image group corresponding to the target position; estimating a transform between the live captured image and next key-frame image, using a transformation estimation method; and generating guidance instructions, based on the transform, and outputting the guidance instructions to enable the device to be moved along the inspection path to the target position.