Endoscope Mosaic Image Construction via Geometric Linking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The limited field of view and difficulty in controlling the trajectory of endoscopes complicate the diagnosis of lesions in hollow organs, leading to challenges in visualization, second diagnosis, and monitoring of patients, with significant variability in lesion recognition among operators.
Innovation Solution
A method for building a mosaic image from a sequence of endoscope images using a processor and memory, involving steps to select images, determine geometric links, and build the mosaic image, which minimizes artefacts and facilitates a more faithful representation of the hollow organ's interior.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of stationary object
If conventional endoscopy is used, then the endoscope can be inserted into the hollow organ for inspection, but the limited field of view prevents comprehensive visualization and accurate location of lesions
Solution Approach 1:
The patent merges multiple individual endoscope images into a single composite mosaic image that displays the entire hollow organ cavity. This combining of multiple limited-view images creates a comprehensive wide-field view that simultaneously provides both the full anatomical context and detailed lesion information, resolving the contradiction between limited field of view and loss of location information.
2Reliability
If video-endoscopy is recorded during examination, then the examination can be documented, but the recorded video is difficult to use after the examination for second diagnosis or monitoring
Solution Approach 1:
The system performs preliminary processing during the examination to create a mosaic image that consolidates all critical information in a single comprehensive view. This preliminary creation of the composite image ensures that when the examination is completed, the mosaic image is already available as a ready-to-use document that facilitates second diagnoses, monitoring, and multidisciplinary discussions without requiring complex video review procedures.
3Area of stationary object
If multiple images are captured to increase field of view coverage, then more of the hollow organ can be visualized, but the complexity of processing and aligning these images increases
Solution Approach 1:
The system uses geometric links and coordinate transformation matrices as intermediaries to automatically align and integrate multiple captured images. These mathematical intermediaries serve as the bridge between individual images with different perspectives, enabling the system to process and merge numerous images into a single coherent mosaic without requiring complex manual processing, thus resolving the contradiction between increased visualized area and processing complexity.
Data Source
AI summary
A method for constructing a mosaic image from a sequence of images of a hollow organ. The sequence of images originates from an endoscope inserted into the hollow organ. The method is implemented by an electronic device having a processor and a memory. Such a method includes: selecting images, from the sequence of images; providing a subset of images and a reference image among this subset of images; determining geometric links between the previously determined reference image and the images of the subset of images; and constructing the mosaic image from the reference image, at least some of the images of the subset of images and the geometric links of these images of the subset of images.