Endoscope Image Processing for Unobserved Region Identification
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current endoscope systems lack an effective method to easily identify and display unobserved regions within a subject's organ model during observation, making it difficult for operators to determine the position and posture of the endoscope and ensuring complete observation of all regions.
Innovation Solution
An image processing apparatus and method that acquire image information from an endoscope, generate an organ model, identify unobserved regions, estimate the position and posture of the endoscope, and display the organ model on a monitor, aligning the display direction with the endoscope's visual field to facilitate intuitive recognition of unobserved areas.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If an endoscope system displays observed regions on a three-dimensional shape model image, then the operator can grasp the observation position, but the unobserved regions cannot be easily identified
Solution Approach 1:
The patent applies color changes by displaying unobserved regions in a distinct color different from observed regions on the three-dimensional shape model image. This visual differentiation allows operators to easily identify which regions have not yet been observed, directly resolving the contradiction between maintaining complete information display and improving ease of identification.
2Measurement precision
If the endoscope system provides detailed observation capability, then examination precision is improved, but the operator cannot easily determine the position and posture of the endoscope
Solution Approach 1:
The patent introduces a three-dimensional shape model image as an intermediary that visually represents both the observed regions and the endoscope's position and posture. This intermediary provides spatial context without interfering with the detailed observation capability, allowing operators to understand endoscope orientation while maintaining high observation precision.
Solution Approach 2:
The patent adds a third dimension by displaying spatial position and posture information on a three-dimensional shape model image rather than relying solely on two-dimensional endoscopic images. This dimensional enhancement provides comprehensive spatial awareness while preserving the detailed observation capabilities of the endoscope.
3Reliability
If the system displays both observed and unobserved regions on the examination screen, then complete observation coverage is improved, but the display complexity increases
Solution Approach 1:
The patent applies local quality by using different display characteristics for different regions: observed regions are displayed with one visual characteristic while unobserved regions are displayed with another. This localized differentiation ensures complete observation coverage is tracked without creating uniform complexity across the entire display system.
Data Source
AI summary
An image processing apparatus includes a processor. The processor is configured to acquire image information from an endoscope during observation of an inside of a subject, generate an organ model from the acquired image information, identify an unobserved region that is not observed by the endoscope in the organ model, estimate a top and a bottom and an azimuth of an image pickup visual field of the endoscope with respect to the organ model, set a display direction of the organ model based on the top and the bottom and the azimuth of the image pickup visual field, and output the organ model to the monitor, the organ model being associated with the identified unobserved region.