3D Endoscopic Image Mapping for Photographed Area Guidance
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In endoscopic inspection, it is difficult to accurately distinguish areas where photography has not been performed from already-photographed areas, making it challenging to guide the inspector effectively.
Innovation Solution
An image processing device that generates reconstruction data from captured images, matches this data with a standard three-dimensional model of the inspection target, and displays a photographed area indication image on a display device, providing guidance to the inspector.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If the inspector moves the photographing unit to unphotographed areas, then comprehensive inspection coverage is achieved, but it becomes difficult to distinguish unphotographed areas from already-photographed areas
Solution Approach 1:
The patent applies color coding to visually distinguish photographed areas from unphotographed areas on the three-dimensional model. Photographed regions are displayed in one color state while unphotographed regions are displayed in a different color state, enabling the inspector to easily identify areas requiring further inspection and guiding effective movement of the photographing unit.
2Loss of information
If three-dimensional reconstruction is performed from captured images, then spatial understanding of the inspection target is improved, but the system complexity increases
Solution Approach 1:
The patent creates a three-dimensional model as a visual copy or representation of the actual inspection target. This digital twin allows the inspector to view and analyze the spatial structure, photographed areas, and unphotographed areas without physically manipulating the complex endoscopic system, thereby reducing operational complexity while preserving complete spatial information.
Data Source
AI summary
An image processing device 1X includes a three-dimensional reconstruction means 31X, a matching means 32X, and an output control means 33X. The three-dimensional reconstruction means 31X generates reconstruction data Mr acquired by three-dimensionally reconstructing an inspection target on a basis of captured images Ic which a photographing unit provided in an endoscope generates by photographing the inspection target. The matching means 32X performs matching between a standard model “Ms”, which is a standard three-dimensional model of the inspection target, and the reconstruction data Mr. The output control means 33X displays on a display device 2X a photographed area indication image indicating a photographed area of the inspection target on the standard model based on a result of the matching.