Capsule Endoscopy 3D Panoramic View Generation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The existing display systems for capsule endoscopes are inefficient, requiring examiners to manually review numerous images, leading to prolonged examination times, fatigue, and potential errors due to lack of spatial information about the capsule's position and posture during image capture.

Innovation Solution

A display system that converts multiple images from a capsule endoscope into 3D panoramic views, incorporating a 3D mini-map to visualize the capsule's path and position, providing a wider viewing angle and enhancing examination accuracy by generating a 3D panoramic view using image grouping, homography calculation, transformation, and blending algorithms.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If capsule endoscope continuously captures images during passage through organs, then comprehensive organ examination is achieved, but examination time and examiner fatigue increase significantly

Engineering Contradiction:
Improveexamination completenessVSAvoidexamination time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent segments the large number of captured images into meaningful groups based on spatial location and temporal sequence. By organizing images into structured datasets with metadata about capsule position and orientation, the system enables examiners to review representative images from each segment rather than every individual image, significantly reducing review time while maintaining examination completeness.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces spatial dimensionality by incorporating capsule position and posture information into the image display system. This allows images to be contextualized within a 3D representation of the organ cavity, enabling examiners to understand spatial relationships and navigate through the examination data more efficiently, reducing the time needed to correlate images with anatomical locations.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Reliability

If capsule endoscope captures numerous images for thorough examination, then diagnostic accuracy improves, but examiner workload and potential for errors increase

Engineering Contradiction:
Improvediagnostic accuracyVSAvoidexaminer workload
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The patent performs preliminary organization and structuring of image data before examination. By pre-processing the image dataset to include spatial metadata, temporal sequencing, and systematic grouping, the system prepares the data in an optimized format that reduces examiner workload during actual review. This preliminary structuring enables faster navigation and more accurate diagnosis without requiring examiners to manually organize numerous images.

Inventive Principle:
Principle #10Preliminary action

3Device complexity

If traditional capsule endoscope system is used without spatial information, then device simplicity is maintained, but ability to recognize capsule position and posture is lost

Engineering Contradiction:
Improvesystem simplicityVSAvoidspatial information
Core Design Contradiction:
Device complexityVSLoss of information

Solution Approach 1:

The patent introduces spatial metadata and position information as an intermediary layer between the capsule endoscope and the image display system. Rather than fundamentally altering the capsule device, the system adds a processing layer that correlates captured images with spatial coordinates and capsule orientation data. This intermediary approach provides comprehensive spatial information while maintaining relative system simplicity through software-based solutions.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11601732B2Display system for capsule endoscopic image and method for generating 3D panoramic view
Publication Date: 2023.03.07 KOREA INST OF MEDICAL MICROROBOTICS
  • US11601732B2 patent drawing
  • US11601732B2 patent drawing
  • US11601732B2 patent drawing

AI summary

The present disclosure relates to a display system including a capsule image view, a 3D mini-map, and a 3D panoramic view, and a method of generating a 3D panoramic view. Specifically, according to the present disclosure, it is possible to infer the shape of an organ using a 3D mini-map and to simultaneously identify whether or not the capsule endoscope captures the images, and information on the position and posture of the capsule endoscope at primary captured points by visualizing the actual movement path of the capsule endoscope, thereby improving the accuracy of examination, and since multiple 2D images captured by a single capsule endoscope are able to be viewed as a single 3D panoramic image without changing the structure of the capsule endoscope, it is economical and the viewing angle of the image is able to be increased, thereby reducing the examination time and fatigue of the examiner.