Laser Endoscope Overlapping Imaging Panoramic View

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current endoscope technologies are limited in their ability to image and detect lesions, such as early-stage cancer, over a wide range without missing parts, particularly in the digestive tract, due to the small size of the lesions and irregularities in the inner wall surface.

Innovation Solution

A laser endoscope device with an imaging unit that moves within the body to capture overlapping images of adjacent regions, an image processing unit that merges these images to create a panoramic view, and a control unit that maintains a fixed distance from the inner wall surface using a spacer, allowing for precise focusing and comprehensive imaging of the digestive tract.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If a single imaging region is captured by the endoscope, then the imaging depth and focus are sufficient, but the imaging range is limited and lesions outside the imaged region cannot be detected

Engineering Contradiction:
Improveimaging rangeVSAvoidlesion detection completeness
Core Design Contradiction:
Area of stationary objectVSLoss of information

Solution Approach 1:

The imaging process is divided into multiple sequential imaging regions that are captured individually and then merged together. The endoscope captures a series of adjacent imaging regions by moving through the digestive tract, with each region overlapping slightly with the next, allowing comprehensive coverage of the entire examination area while maintaining sufficient focus depth for each individual capture.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The solution transitions from a single two-dimensional imaging plane to a three-dimensional comprehensive view by capturing multiple imaging regions at different positions along the digestive tract and merging them into a panoramic image that represents the complete examination space.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Area of stationary object

If the endoscope moves freely to image multiple regions, then the imaging range increases, but the image quality becomes uneven and merging accuracy decreases

Engineering Contradiction:
Improveimaging rangeVSAvoidimage merging accuracy
Core Design Contradiction:
Area of stationary objectVSManufacturing precision

Solution Approach 1:

The system uses identical portions in adjacent imaging regions as reference markers for alignment during the merging process. By identifying and aligning these overlapping regions, the system can accurately register images captured at different positions and orientations, compensating for movement variations and maintaining high merging accuracy across the entire panoramic image.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent employs fluorescence staining that causes specific cell groups to emit characteristic fluorescence signals. These consistent fluorescence patterns in overlapping regions serve as natural alignment markers, enabling accurate image merging by matching the fluorescent characteristics of identical portions across adjacent imaging regions.

Inventive Principle:
Principle #32Color changes

3Measurement precision

If the imaging head is moved closer to the living body to improve focus, then the image sharpness increases, but the risk of collision with irregular inner wall surface increases

Engineering Contradiction:
Improveimage sharpnessVSAvoidcollision risk
Core Design Contradiction:
Measurement precisionVSObject-affected harmful factors

Solution Approach 1:

The system dynamically adjusts the distance between the imaging head and the living body surface based on real-time conditions. By controlling the imaging head to maintain an optimal distance that balances focus quality and collision avoidance, the system can capture sharp images while navigating the irregular inner wall surface of the digestive tract safely.

Inventive Principle:
Principle #15Dynamics

4Loss of information

If multiple imaging regions are captured and merged, then the comprehensive lesion detection improves, but the processing time and complexity increase

Engineering Contradiction:
Improvelesion detection completenessVSAvoidimage processing time
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The system performs preliminary alignment and merging operations on adjacent imaging regions as they are captured sequentially. By progressively building the panoramic image through step-by-step merging of overlapping regions rather than processing all images simultaneously at the end, the system reduces overall processing time and computational complexity.

Inventive Principle:
Principle #10Preliminary action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables exhaustive and precise imaging of the digestive tract's inner wall, detecting microscopic lesions that were previously undetectable, with the ability to generate stereoscopic images and objectively evaluate lesions for early-stage cancer detection.

Implementation Method 1

since the stained cell group emits fluorescence when the multi-photon laser light is applied thereto

Methodology Applied
Scientific EffectFluorescence: Fluorescence

Implementation Method 2

applies multi-photon laser light to the stained cell group to image the cell morphology

Methodology Applied
Scientific EffectMulti-photon absorption: Absorption (EM radiation)

Data Source

PatentEP3420885B1Laser endoscope device
Publication Date: 2022.12.21 MIE UNIVERSITY
  • EP3420885B1 patent drawingFigure 1
  • EP3420885B1 patent drawingFigure 2
  • EP3420885B1 patent drawingFigure 3(a)~3(b)

AI summary

The present invention is provided with an imaging unit (10) that has an imaging head (11) to be inserted into the digestive tract (112) and images a living body by applying a laser to the digestive tract (112) via the imaging head (11); a control unit (50) for controlling the imaging head (11) to move inside the digestive tract (112); and an image processing unit (70) for processing an image captured by the imaging unit (10). The imaging unit (10) captures a plurality of imaging regions (P) to be imaged along with the movement of the imaging head (11) such that a portion of adjacent imaging regions (P1, P2) overlap, and the image processing unit (70) overlaps regions (Pa) in which the plurality of imaging regions (P1, P2) are overlapped to generate a composite image.