Endoscopic ROI Display Control Using Tool-State Recognition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing endoscope systems struggle to provide clear distinguishability of regions of interest during medical procedures, particularly when tools are being used, which can confuse medical professionals and hinder precise interventions.

Innovation Solution

A medical image processing apparatus and method that recognizes tool information from observation images, distinguishing between treatment, pre-treatment, and non-treatment states, and adjusts image display to enhance or reduce distinguishability based on this information, using tools like frames, symbols, and color changes to highlight regions of interest.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If tool information recognition and state-based display control are implemented, then the distinguishability of regions of interest is improved, but the device complexity increases

Engineering Contradiction:
Improvedistinguishability of region of interestVSAvoidcomplexity of image processing apparatus
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the treatment process into distinct states (non-treatment, pre-treatment, treatment) based on tool information recognition. Each state has specific display control rules applied to the region of interest, allowing complex processing requirements to be divided into manageable state-specific segments that improve distinguishability without overwhelming system complexity

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements dynamic display control that automatically adjusts the distinguishability of the region of interest based on the recognized treatment state. The display characteristics (such as highlighting, framing, or color coding) are dynamically modified according to whether the system is in non-treatment, pre-treatment, or treatment state, enabling adaptive optimization of region visibility without requiring manual intervention

Inventive Principle:
Principle #15Dynamics

2Manufacturing precision

If distinguishability is reduced during treatment state, then the precision of intervention is improved, but the loss of information increases

Engineering Contradiction:
Improveprecision of interventionVSAvoidinformation about region of interest
Core Design Contradiction:
Manufacturing precisionVSLoss of information

Solution Approach 1:

The patent applies local quality modification by selectively altering the display properties of the region of interest based on the treatment state. During treatment, specific visual characteristics (such as outline emphasis, color changes, or framing) are applied locally to the region of interest while maintaining other informational content, thereby enhancing precision of intervention without complete information loss

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent introduces visual intermediaries such as frames, outlines, or symbolic indicators that mediate between the raw image data and the final display during treatment state. These intermediaries serve as additional layers of information that enhance precision by clearly delineating the region of interest while preserving the underlying anatomical information visible through or alongside these indicators

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS12478437B2Medical image processing apparatus, medical image processing method, endoscope system, and medical image processing program
Publication Date: 2025.11.25 FUJIFILM CORP
  • US12478437B2 patent drawing
  • US12478437B2 patent drawing
  • US12478437B2 patent drawing

AI summary

An object of the present invention is to provide a medical image processing apparatus, an endoscope system, a medical image processing method, and a medical image processing program that are capable of displaying a region of interest with appropriate distinguishability. A medical image processing apparatus according to an aspect of the present invention is a medical image processing apparatus including a processor. The processor is configured to perform an image acquisition process of acquiring an observation image of a subject; a region-of-interest recognition process of recognizing a region of interest from the observation image; a tool information recognition process of recognizing tool information from the observation image, the tool information being information on a tool used for treatment of the subject; and a display control process of causing a display device to distinguishably display the observation image in a manner in which the region of interest has distinguishability based on a recognition result of the tool information.