Endoscopic Image Reconstruction via 3D Data Modeling

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In endoscopic examinations, doctors face challenges in accurately diagnosing targets by viewing endoscopic images from different positions and directions, which limits their understanding of biological surfaces or internal structures.

Innovation Solution

An image processing system that generates three-dimensional data from a series of endoscopic images, allowing for the creation of two-dimensional images from desired viewpoints, enabling precise diagnosis by displaying these images on a display unit.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If doctors view endoscopic images from the original capture position and direction, then the images are readily available for diagnosis, but the understanding of concavities and convexities on the biological surface is limited

Engineering Contradiction:
Improvediagnostic accuracyVSAvoidviewpoint flexibility
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent applies dimensionality change by transitioning from two-dimensional endoscopic images to three-dimensional reconstructed data. This allows doctors to view the observed target from multiple angles and directions by generating two-dimensional images from different viewpoints based on the three-dimensional data, thereby improving diagnostic accuracy while maintaining ease of access to image data.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Adaptability or versatility

If multiple endoscopic images are captured to enable viewing from different positions, then viewpoint flexibility is improved, but the complexity of image management and processing increases

Engineering Contradiction:
Improveviewpoint flexibilityVSAvoidimage processing complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent uses copying by creating a three-dimensional data model that replicates the spatial structure of the observed target. Instead of managing multiple original endoscopic images, the system generates virtual two-dimensional images from this three-dimensional copy, allowing flexible viewpoint changes without the complexity of managing and processing numerous captured images.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

By transforming multiple two-dimensional endoscopic images into a single three-dimensional data structure, the system reduces image management complexity. The three-dimensional data serves as a consolidated representation from which infinite two-dimensional views can be generated, simplifying the overall image processing workflow.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Measurement precision

If three-dimensional data is generated from multiple endoscopic images, then diagnostic accuracy is improved, but the processing time and computational resources increase

Engineering Contradiction:
Improvediagnostic accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent applies preliminary action by generating the three-dimensional data model in advance during the endoscopic examination procedure. Once the three-dimensional data is created, it can be stored and reused for multiple diagnostic sessions without requiring repeated processing of the original endoscopic images, thereby reducing processing time in subsequent diagnostic activities.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11910993B2Endoscopic task supporting system and endoscopic task supporting method for extracting endoscopic images from a plurality of endoscopic images based on an amount of manipulation of a tip of an endoscope
Publication Date: 2024.02.27 OLYMPUS CORPORATION(JP)
  • US11910993B2 patent drawing
  • US11910993B2 patent drawing
  • US11910993B2 patent drawing

AI summary

An endoscopic task supporting system including: an image storage that stores a plurality of endoscopic images acquired in a time series; a three-dimensional data generation unit that generates three-dimensional data indicating a three-dimensional shape of a predetermined part subject to observation, based on the plurality of endoscopic images stored in the image storage; a two-dimensional image generation unit that generates, from the three-dimensional data generated by the three-dimensional data generation unit, a two-dimensional image corresponding to a viewpoint position and a direction of line of sight entered; and a display control unit that causes a predetermined display unit to display the two-dimensional image generated by the two-dimensional image generation unit.