Endoscope Image Processing Mode Switching for Surgical Scenes

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing endoscopic imaging systems fail to provide optimal high-definition video images to operators during surgical procedures, as the current techniques for pixel shift processing do not adapt effectively to varying surgical scenes.

Innovation Solution

An information processing apparatus and method that determines a processing mode based on surgical scenes, using an imaging element capable of pixel shift processing, to adjust image processing accordingly, ensuring optimal video image quality.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If pixel shift processing is applied to obtain high definition images, then image resolution is improved, but frame rate decreases and motion smoothness deteriorates

Engineering Contradiction:
Improveimage resolutionVSAvoidframe rate
Core Design Contradiction:
Measurement precisionVSSpeed

Solution Approach 1:

The patent implements dynamic switching between pixel shift processing mode and normal imaging mode based on real-time detection of motion magnitude in the imaged subject. When motion exceeds a threshold, the system automatically transitions from high-definition pixel shift mode to standard imaging mode, thereby adapting the frame rate to match the motion characteristics and maintaining smooth motion representation without unnecessary resolution enhancement.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes the processing parameter (pixel shift processing enabled/disabled) based on the detected motion state of the surgical scene. By monitoring motion magnitude and adjusting the imaging mode accordingly, the system optimizes the balance between resolution and frame rate dynamically throughout the surgical procedure.

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If pixel shift processing is applied continuously, then high definition images are obtained, but processing time increases and surgical efficiency decreases

Engineering Contradiction:
Improveimage definitionVSAvoidsurgical efficiency
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The system dynamically adjusts processing intensity based on surgical scene characteristics. By detecting motion magnitude and selectively applying pixel shift processing only when appropriate (low motion periods), the system reduces overall processing time while maintaining high definition quality during critical static moments, thereby improving surgical workflow efficiency.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

Instead of continuously applying pixel shift processing, the system applies it partially—only during periods when motion is below the threshold. This selective application reduces cumulative processing time and computational load while still providing high definition images during stable surgical phases, optimizing the trade-off between image quality and surgical productivity.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS11744440B2Information processing apparatus, information processing method, and endoscope system for processing images based on surgical scenes
Publication Date: 2023.09.05 SONY GROUP CORP
  • US11744440B2 patent drawing
  • US11744440B2 patent drawing
  • US11744440B2 patent drawing

AI summary

An information processing apparatus, an information processing method, and an endoscope system capable of providing an optimal video image to an operator in accordance with surgical scenes are provided. A processing mode determination unit determines, in accordance with surgical scenes, a processing mode for an in-vivo image captured by an imaging apparatus including an imaging element arranged so as to enable pixel shift processing, and an image combining unit processes an image output from the imaging apparatus, in accordance with the processing mode. The present technology is applicable to, for example, an endoscope system for imaging a living body with an endoscope.