Capsule Endoscope 3D Image Mapping for Spatially Guided Review
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Medical professionals face challenges in interpreting capsule endoscope images due to the lack of spatial context, leading to interference in image understanding and assessment completeness, especially for less experienced examiners.
Innovation Solution
A method is developed to build an image reading model by constructing a 3D model of the gastrointestinal tract based on capsule endoscope data, mapping images onto this model, and dividing them into sub-areas for enhanced visualization and efficient image retrieval.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If medical professionals review images in the order captured or using a progress bar, then the image review process is simple to operate, but the spatial context is lost and image understanding is interfered with
Solution Approach 1:
The patent creates a 3D model that copies and reconstructs the spatial structure of the gastrointestinal tract based on capsule endoscope positioning data. This virtual 3D replica preserves the original spatial relationships while allowing flexible image retrieval, eliminating the need to view images in capture order and restoring spatial context for medical professionals.
Solution Approach 2:
The patent transforms 2D images captured by the capsule endoscope into a 3D spatial model. By mapping images onto a three-dimensional representation of the gastrointestinal tract, the system adds spatial dimensionality to the review process, enabling doctors to understand anatomical relationships and locate findings within the context of the overall tract structure.
2Loss of time
If capsule endoscope captures images at 4 fps during 10-20 minute examination, then sufficient image coverage is achieved, but the large number of images (2400-4800) makes review time-consuming
Solution Approach 1:
The patent segments the large set of 2400-4800 images by organizing them according to their spatial locations within the 3D model of the gastrointestinal tract. Instead of reviewing all images sequentially, doctors can divide the examination into anatomical segments and review images from specific regions of interest, dramatically reducing review time while maintaining completeness through the ability to access any segment as needed.
Solution Approach 2:
The patent performs preliminary organization and spatial indexing of all captured images during the examination processing phase. By pre-structuring the image set according to 3D spatial coordinates and anatomical locations before the review begins, the system enables rapid retrieval and selective viewing during diagnosis, eliminating the need to sequentially review all images and significantly reducing review time.
3Ease of operation
If passive image review method is used, then the review process is simple to implement, but less experienced examiners find it challenging and assessment completeness is compromised
Solution Approach 1:
The patent introduces a 3D model as an intermediary between the raw image data and the medical professional's interpretation. This intermediate representation provides spatial context and anatomical orientation that guides less experienced examiners through the image set, helping them understand where each image fits in the overall gastrointestinal tract and improving assessment completeness without complicating the review process.
Solution Approach 2:
The patent employs visual enhancements including color coding and highlighting on the 3D model to indicate different anatomical regions, image quality, and areas of interest. These visual cues make it easier for less experienced examiners to navigate the image set, identify important findings, and maintain assessment completeness by providing intuitive guidance through the review process.
Data Source
AI summary
The present invention provides a method for building an image reading model based on a capsule endoscope, a device and a medium. The method includes: driving the capsule endoscope to move within a working area, sequentially recording position coordinates and field of view orientations of the capsule endoscope when it reaches each positioning point at a predetermined first frequency, and driving the capsule endoscope to sequentially capture and record images at a predetermined second frequency; constructing a 3D model corresponding to the outer contour of the working area based on the recorded position coordinates of the capsule endoscope at each positioning point; and mapping the recorded images onto the 3D model to create an image reading model. By mapping the obtained images onto a 3D model of the working area, to enhance the visualization effect of the examination, facilitate observation, save image reading time, and increase the detection efficiency.