Endoscopic Image Focus Control Using Stereo Depth Estimation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In endoscopic surgery, practitioners face difficulties in adjusting the focus of the surgical region without compromising the cleanliness of the surgical area or requiring an assistant, as existing methods like maintaining constant brightness or contrast may not accurately match the practitioner's desired focus area.

Innovation Solution

A medical image processing apparatus with a computer-readable program that uses a configuration of dual imaging sensors and a focus control system to calculate depth information and automatically adjust focus based on triangulation principles, allowing precise focus control on the desired surgical region without manual intervention.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If the practitioner manually adjusts the screen or focus using both hands, then the adjustment can be performed, but the practitioner cannot hold surgical instruments and maintain surgical cleanliness simultaneously

Engineering Contradiction:
Improvescreen adjustment operationVSAvoidsurgical area contamination
Core Design Contradiction:
Ease of operationVSObject-affected harmful factors

Solution Approach 1:

The system performs automatic focus adjustment by detecting the surgical region of interest and autonomously controlling the focus mechanism, eliminating the need for practitioner intervention. The apparatus serves itself by using image processing algorithms to identify and focus on the surgical area without human input.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The manual mechanical adjustment of focus by the practitioner is replaced with an automated optical/electronic system that uses image sensors, processing units, and motor-driven focus mechanisms to automatically adjust and maintain focus on the surgical region.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Productivity

If an assistant is used to adjust the screen according to practitioner instructions, then the practitioner can focus on surgery, but communication errors may occur and rapid adjustment is difficult

Engineering Contradiction:
Improvesurgical efficiencyVSAvoidfocus accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The system autonomously identifies the surgical region of interest through image processing and automatically adjusts focus without requiring practitioner instructions or assistant intervention. The apparatus independently performs the tasks that previously required human communication and coordination.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system continuously monitors the surgical field, detects changes in the surgical region, and dynamically adjusts focus in real-time based on detected features. The feedback loop ensures accurate and rapid focus adjustment by constantly comparing current image data with desired focus targets.

Inventive Principle:
Principle #23Feedback

3Extent of automation

If focus control is performed on an area with constant brightness or contrast, then automatic focus adjustment is achieved, but the focused area may not match the practitioner's desired surgical region

Engineering Contradiction:
Improveautomatic focus controlVSAvoidfocus target accuracy
Core Design Contradiction:
Extent of automationVSMeasurement precision

Solution Approach 1:

Instead of relying solely on brightness or contrast parameters, the system uses multiple image processing parameters including color information, texture analysis, and surgical instrument detection to identify the surgical region of interest, thereby improving the accuracy of automatic focus targeting.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The system applies different image processing techniques to different regions of the surgical field, specifically targeting areas with surgical instruments or anatomical features of interest. By analyzing local characteristics rather than global image properties, the system accurately identifies the practitioner's desired focus area.

Inventive Principle:
Principle #3Local quality

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables practitioners to perform focus control on the desired surgical region accurately and efficiently, improving surgical precision and reducing the need for assistant intervention while maintaining a clean and organized operating environment.

Implementation Method 1

a depth information generation section 41 that generates depth information of a subject image by using a parallax between right-eye image and left-eye image

Methodology Applied
Scientific EffectParallax: Parallax

Data Source

PatentEP3151719B1Image processing apparatus and program
Publication Date: 2021.02.17 SONY GROUP CORP
  • EP3151719B1 patent drawingFigure 1
  • EP3151719B1 patent drawingFigure 2
  • EP3151719B1 patent drawingFigure 3

AI summary

A medical image processing apparatus including a controller including circuitry configured to determine a position of a distal end of an important object within a medical image, estimate a region of interest within the medical image adjacent to a region including the important object based on the position of the distal end of the important object, and control display of the region of interest.