Endoscope Image Processing Stabilizing Scene Recognition During Magnification

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Endoscope image processing systems struggle to maintain accurate scene recognition results when the magnification ratio of endoscope images changes, leading to erroneous recognition during magnified observation modes, which affects the performance of computer-aided diagnosis (CAD) systems.

Innovation Solution

An endoscope image processing apparatus that acquires time-series endoscope images, recognizes scenes, retains scene recognition results, and controls the output based on magnification information, using a processor to manage and output accurate scene recognition results by switching between recognition results obtained during normal and magnified observation modes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If scene recognition is performed on magnified endoscope images, then the system can provide real-time feedback during magnified observation, but the scene recognition accuracy deteriorates due to the significant difference between magnified and normal images

Engineering Contradiction:
Improvereal-time scene recognition capabilityVSAvoidscene recognition accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The system performs scene recognition on non-magnified endoscope images before magnification occurs, storing the recognition results in advance. When magnified images are captured, the system outputs the pre-obtained scene recognition results instead of attempting to recognize the magnified images directly, thereby maintaining high recognition accuracy while supporting real-time magnified observation.

Inventive Principle:
Principle #10Preliminary action

2Speed

If the system outputs scene recognition results for every captured image, then the response speed is fast, but erroneous recognition results occur during magnified observation modes

Engineering Contradiction:
Improveresponse speedVSAvoidrecognition result accuracy
Core Design Contradiction:
SpeedVSReliability

Solution Approach 1:

The system dynamically adjusts its output behavior based on the magnification state. When a non-magnified image is captured, the system performs scene recognition and outputs the result immediately. When a magnified image is captured, the system suppresses output and instead outputs the previously obtained scene recognition result, thereby avoiding erroneous recognition while maintaining appropriate response timing.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS20230414066A1Endoscope image processing apparatus, endoscope image processing method, and endoscope image processing program
Publication Date: 2023.12.28 FUJIFILM CORP
  • US20230414066A1 patent drawing
  • US20230414066A1 patent drawing
  • US20230414066A1 patent drawing

AI summary

In an endoscope image processing apparatus including a processor, the processor is configured to execute: an endoscope image acquiring process of acquiring a time-series endoscope image; a scene recognizing process of recognizing a scene based on the endoscope image; a scene-recognition-result retaining process of causing a retaining unit to retain a scene recognition result of the recognized scene; a magnification information acquiring process of acquiring magnification information from an endoscope system or the endoscope image, the magnification information being related to a magnification ratio of the endoscope image or whether or not the endoscope image is magnified; and an output control process of controlling and outputting the scene recognition result retained in the retaining unit based on the acquired magnification information.