Endoscope Lesion Detection via Risk-Adaptive Marker Display

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing endoscope systems may fail to effectively prevent operators from overlooking lesion areas during medical procedures, despite advanced CAD systems, due to varying image conditions and user attention levels.

Innovation Solution

An endoscope system that includes a processor and display apparatus, which analyzes oversight risk by detecting lesion areas and controls notification methods through two image regions, displaying a marker image only in a smaller region at low risk or in both regions at higher risk, to ensure operator awareness.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a marker image is displayed in both image regions to prevent oversight, then the reliability of lesion detection is improved, but the device complexity and user interface complexity increase

Engineering Contradiction:
Improvelesion detection reliabilityVSAvoidnotification system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The notification system applies different marker display strategies to different regions of the display apparatus based on local conditions. The first image region (main display) and second image region (sub display) receive differentiated notification treatments according to the oversight risk level, allowing the system to maintain reliability while managing complexity through localized adaptation rather than uniform application across all displays

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system dynamically adjusts the notification method by changing which image regions display marker images based on the calculated oversight risk level. When oversight risk is high, marker images are displayed in both the first and second image regions; when oversight risk is low, marker images are displayed only in the second image region. This dynamic adaptation allows the system to maintain high reliability only when necessary, thereby reducing overall system complexity

Inventive Principle:
Principle #15Dynamics

2Reliability

If a marker image is displayed in both image regions to prevent oversight, then the oversight prevention capability is improved, but the ease of operation deteriorates due to increased information overload

Engineering Contradiction:
Improveoversight prevention capabilityVSAvoiduser interface simplicity
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

Different notification intensities are applied to different user contexts. The first image region (typically the main surgical view) and second image region (typically a secondary or reference view) receive differentiated marker display treatments. This allows the system to provide comprehensive oversight prevention in critical views while maintaining interface simplicity in secondary views, thus balancing reliability improvement with ease of operation

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system dynamically adjusts notification intensity based on the calculated oversight risk level. When oversight risk is high, marker images are displayed in both the first and second image regions to maximize oversight prevention. When oversight risk is low, marker images are displayed only in the second image region to minimize information overload and maintain interface simplicity. This dynamic adjustment resolves the contradiction by adapting the notification strategy to the actual risk level

Inventive Principle:
Principle #15Dynamics

3Adaptability or versatility

If the notification method is adjusted based on oversight risk level, then the adaptability of the system is improved, but the device complexity increases due to additional risk assessment mechanisms

Engineering Contradiction:
Improvenotification adaptabilityVSAvoidrisk assessment system complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system performs preliminary calculation of the oversight risk level before determining the notification method. By pre-calculating the risk level based on image analysis and predetermined criteria, the system can then simply select from predefined notification strategies (display marker in first region only, second region only, or both regions). This preliminary assessment separates the complex analysis from the simple execution, improving adaptability while managing complexity through a structured two-stage process

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system changes the notification parameters (which image regions display marker images) based on the calculated oversight risk level. By using the risk level as a parameter to select from predefined notification configurations, the system achieves high adaptability without requiring complex real-time decision-making algorithms. The parameter change approach allows the system to respond flexibly to different risk levels while maintaining manageable system complexity through discrete, pre-defined states

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11642005B2Endoscope system, endoscope image processing method, and storage medium
Publication Date: 2023.05.09 OLYMPUS CORPORATION(JP)
  • US11642005B2 patent drawing
  • US11642005B2 patent drawing
  • US11642005B2 patent drawing

AI summary

A processor of an endoscope system detects from the observation images a lesion area which is an observation target of the endoscope, judges a level of an oversight risk which is a risk that an operator may overlook the lesion area, on the basis of the observation images, and controls notification methods of detection of the lesion area on the basis of the level of the oversight risk. The processor displays the marker image indicating the lesion area only in a second image region of the display apparatus when a level of the oversight risk relating to the lesion area is a first level and displays the marker image in both a first image region and the second image region which is smaller than the first image region when a level of the oversight risk relating to the lesion area is a second level higher than the first level.