Endoscope Three-Dimensional Expansion Processing for Lesion Surface Mapping
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing endoscope systems struggle to provide three-dimensional information of feature parts, such as lesion sites, due to the limitations of two-dimensional front-view and side-view observation images, making it difficult to assess the surface unevenness and progression of lesions accurately.
Innovation Solution
An endoscope system equipped with an image processing unit that includes a three-dimensional expansion processor to calculate and expand two-dimensional information into three-dimensional information using position information from multiple capturing positions or windows, utilizing an objective lens to form images on the light receiving surface and a predictive model for machine learning.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of stationary object
If two-dimensional front-view and side-view observation images are used to capture a wide range of the observation target, then the visual field coverage is improved, but the ability to obtain three-dimensional information such as surface unevenness of lesion sites deteriorates
Solution Approach 1:
The patent applies dimensionality change by transforming two-dimensional image data into three-dimensional information through image processing. The system captures images from multiple viewpoints (front-view and side-view) and uses three-dimensional expansion processing to reconstruct surface topography, thereby recovering depth information that is lost in conventional two-dimensional displays. This allows the system to maintain wide visual field coverage while providing three-dimensional lesion information.
2Area of stationary object
If an objective lens with a wide viewing angle is used to capture portions between adjacent folds, then the visual field is expanded, but the measurement precision of lesion site characteristics deteriorates
Solution Approach 1:
By converting two-dimensional wide-angle images into three-dimensional representations through multi-viewpoint image processing, the system maintains expanded visual field coverage while improving measurement precision. The three-dimensional expansion processing reconstructs accurate surface topography and lesion characteristics from multiple two-dimensional views, thereby preserving diagnostic accuracy despite using a wide viewing angle lens.
3Measurement precision
If multiple captured images from different capturing positions are used to calculate three-dimensional information, then the accuracy of lesion assessment is improved, but the device complexity increases
Solution Approach 1:
The system uses multiple two-dimensional image copies from different viewpoints (front-view and side-view observations) to reconstruct three-dimensional information. Rather than requiring complex hardware changes, the invention processes multiple image copies through three-dimensional expansion algorithms, thereby improving lesion assessment accuracy while keeping the additional system complexity manageable through software-based processing.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables the display of three-dimensional information of feature parts, allowing for accurate assessment of lesion sites and surface unevenness, enhancing diagnostic capabilities.
Implementation Method 1
an objective lens provided on a front side of a light receiving surface of the image sensor and configured to form the image of the living tissue on the light receiving surface
Data Source
AI summary
An endoscope system includes an endoscope that captures a living tissue in a body cavity, and an image processing unit. The endoscope includes an objective lens provided on a front side of a light receiving surface of an image sensor and configured to simultaneously form images of the living tissue, obtained through a plurality of windows, on the light receiving surface as the captured image. The image processing unit includes a three-dimensional expansion processor configured to calculate different directions of a feature part visible through the plurality of windows based on position information in each of images of the feature part, which is distinguishably identified from other parts and included in common in the plurality of images obtained through the plurality of windows in the captured image captured by the endoscope, and to expand two-dimensional information of the images of the feature part to three-dimensional information.