3D Model-Based Observation Status Tracking for Endoscope Inspection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Industrial endoscope devices face inefficiencies in inspecting large or complex structures, as users often struggle to determine where observations have been performed and where not, leading to repeated inspections and decreased efficiency.

Innovation Solution

A method for operating an observation device that includes an image display, estimation, identification, and determination steps, using a processor to display images, estimate the position and posture of an imaging device, identify corresponding positions on a three-dimensional model, and determine if set imaging conditions are met, allowing for clear observation information to be displayed.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a user performs inspection by using a more reliable method to avoid omitting observation, then the reliability of inspection is improved, but the efficiency of inspection decreases due to repeated inspections

Engineering Contradiction:
Improveinspection reliabilityVSAvoidinspection efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The system provides real-time feedback to the user by displaying observation information that clearly indicates which regions have been observed and which have not. The computer determines whether each region has been observed based on image analysis and presents this information to the user, enabling informed decisions about whether to re-inspect a region or move to a new area, thus eliminating unnecessary repeated inspections while maintaining reliability

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The computer acts as an intermediary between the imaging device and the user, automatically analyzing images to determine whether regions have been observed and presenting this processed information to the user. This intermediary function relieves the user of the burden of manually tracking observation status while providing reliable, objective determination of inspection coverage

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If the computer determines whether or not the inspection object has been observed on the basis of object distance, then the efficiency of inspection increases, but the user cannot correctly understand where observation has been performed and where observation has not been performed

Engineering Contradiction:
Improveinspection efficiencyVSAvoidobservation status information
Core Design Contradiction:
ProductivityVSLoss of information

Solution Approach 1:

The system divides the inspection object into multiple discrete regions and provides separate observation status information for each region. By segmenting the overall inspection task into region-specific status indicators, the system enables the user to clearly understand which specific areas have been observed and which have not, while maintaining high inspection efficiency through automated determination

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system transitions from providing only automated efficiency benefits to adding a spatial dimension of information by displaying observation status mapped to specific locations on the inspection object. This dimensional addition allows users to visually locate and understand the spatial distribution of observed and unobserved regions without compromising inspection efficiency

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS11650407B2Method of operating observation device, observation device, and recording medium
Publication Date: 2023.05.16 EVIDENT CORP
  • US11650407B2 patent drawing
  • US11650407B2 patent drawing
  • US11650407B2 patent drawing

AI summary

An imaging condition set in a first region of a three-dimensional model of a subject and an imaging condition set in a second region of the three-dimensional model are different from each other. A processor of an observation device determines whether or not the imaging condition that has been set in the first region or the second region including a position on the three-dimensional model is satisfied. The position is identified on the basis of a position of an imaging device and a posture of the imaging device. The processor displays observation information on a display on the basis of a result of determination. The observation information represents whether or not the first region or the second region including the position on the three-dimensional model has been observed.