Endoscopic Panoramic Image Positioning for Inspection Accuracy

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In endoscopic inspection systems, there is a risk of missing important inspection areas due to the lack of accurate information on the currently photographed position, leading to potential misses during visual judgment from multiple acquired images.

Innovation Solution

An image processing device that acquires a panoramic image of the lumen's wall surface by combining multiple captured images and displays the photographed position information in association with the panoramic image, allowing inspectors to accurately grasp their current location during the inspection process.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If multiple captured images are acquired for inspection, then the coverage of inspection area is improved, but the ability to accurately identify current photographed position deteriorates

Engineering Contradiction:
Improveinspection area coverageVSAvoidphotographed position identification accuracy
Core Design Contradiction:
Area of stationary objectVSMeasurement precision

Solution Approach 1:

A panoramic image is introduced as an intermediary representation that maps the three-dimensional lumen structure onto a two-dimensional plane. This panoramic image serves as a reference framework that enables accurate position identification across multiple captured images by providing a comprehensive overview of the inspection area and the inspector's current location within it.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system transitions from displaying only three-dimensional captured images to incorporating a two-dimensional panoramic view. This dimensional change allows inspectors to simultaneously view detailed three-dimensional image data and their overall position context in the two-dimensional panoramic map, resolving the contradiction between comprehensive area coverage and precise position identification.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Measurement precision

If panoramic image processing is added to combine multiple captured images, then the system complexity increases, but the position information accuracy improves

Engineering Contradiction:
Improveposition information accuracyVSAvoidimage processing system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The panoramic image generation unit is designed to perform multiple functions: combining multiple captured images, creating a two-dimensional planar representation, and providing position reference information. This multi-functionality reduces the need for separate systems for each task, managing complexity while improving position information accuracy.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Ease of operation

If photographed position information is displayed in association with panoramic image, then the ease of operation for inspectors is improved, but the information processing requirement increases

Engineering Contradiction:
Improveinspector operation easeVSAvoidinformation processing data volume
Core Design Contradiction:
Ease of operationVSQuantity of substance

Solution Approach 1:

The system extracts and displays only the essential photographed position information in association with the panoramic image, rather than processing and displaying all possible image data. This extraction approach improves ease of operation by presenting relevant position information clearly while managing information processing requirements through selective data presentation.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS20240374116A1Image processing device, control method and storage medium
Publication Date: 2024.11.14 NEC CORP
  • US20240374116A1 patent drawing
  • US20240374116A1 patent drawing
  • US20240374116A1 patent drawing

AI summary

One objective is to provide an image processing device, a control method, and a storage medium capable of suitably presenting information about a position currently being photographed in endoscopic inspection. To achieve the objective, the image processing device 1X includes a panoramic image acquiring unit 43X and a display control unit 46X. The panoramic image acquiring unit 43X acquires a panoramic image Ip, in which a wall surface in a lumen is expanded in a planar shape, based on plural captured images Ic which were acquired by photographing the lumen by a photographing unit provided in an endoscope in a first photographing process. The display control unit 46X displays on the display device 2 photographed position information relating to a photographed position of the lumen in a second photographing process in association with the panoramic image Ip.