Endoscope Autofocus Using Treatment Tool Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Endoscopic devices require complex operations to focus on regions of interest outside the central frame, hindering convenience for users like surgeons who need to adjust the observation field to bring specific areas into focus.

Innovation Solution

An endoscopic device with a detection processor and lens controller that automatically sets a detection frame around the distal end of a treatment tool within the captured image, allowing for autofocus on regions of interest without manually repositioning the insertion portion.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If autofocus processing is performed on the central region only, then the focus position can be automatically determined, but the user cannot easily focus on regions of interest outside the central region

Engineering Contradiction:
Improveease of focusing on region of interestVSAvoidcomplexity of adjusting observation field
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system uses the treatment tool itself as a reference marker to automatically determine the detection frame position. The distal end detector detects the treatment tool's position, and the detection frame is automatically set around it, allowing the system to serve itself without requiring manual user input or complex manual adjustment procedures.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The treatment tool acts as an intermediary reference object. Instead of requiring the user to manually position and mark the region of interest, the treatment tool serves as a mediating element that the system can detect and use to automatically determine where to set the detection frame for autofocus processing.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If the detection frame is fixed at the center of the captured image, then the autofocus processing is simple, but the user must manually move the insertion portion to position the region of interest at the center

Engineering Contradiction:
Improveefficiency of focusing operationVSAvoidconvenience of adjusting observation field
Core Design Contradiction:
ProductivityVSEase of operation

Solution Approach 1:

The system performs preliminary detection of the treatment tool's position and automatically sets the detection frame around it before performing autofocus processing. This preliminary action eliminates the need for the user to manually reposition the insertion portion, as the system proactively identifies and prepares the correct detection frame based on the treatment tool's location.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The detection frame position is made dynamic rather than fixed. Instead of being statically positioned at the center of the captured image, the detection frame dynamically adjusts its position based on the detected location of the treatment tool's distal end, allowing the system to adapt to different surgical scenarios automatically.

Inventive Principle:
Principle #15Dynamics

3Ease of operation

If manual focusing is performed by moving the insertion portion, then the region of interest can be brought into focus, but the operation becomes complicated and time-consuming

Engineering Contradiction:
Improvesimplicity of focusing operationVSAvoidtime for adjusting observation field
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The system replaces the mechanical action of manually moving the insertion portion with an automated image processing system. Instead of requiring physical manipulation of the endoscope to reposition the field of view, the system uses image detection and processing to automatically identify the region of interest and adjust the detection frame accordingly, substituting mechanical operations with automated computational methods.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables convenient focusing on desired regions of interest by using the treatment tool as a pointer for setting the detection frame, reducing the complexity of adjusting the observation field and improving user experience.

Implementation Method 1

a lens unit including a focus lens configured to adjust a focus by moving along an optical axis, the lens unit being configured to form the taken in subject image on the imaging unit

Methodology Applied
Scientific EffectOptical focusing: Lens

Data Source

PatentUS11298000B2Endoscopic device
Publication Date: 2022.04.12 SONY OLYMPUS MEDICAL SOLUTIONS
  • US11298000B2 patent drawing
  • US11298000B2 patent drawing
  • US11298000B2 patent drawing

AI summary

An endoscopic device includes: an insertion portion configured to be inserted into a subject; an imaging unit configure to capture the subject image; a lens unit including a focus lens configured to adjust a focus by moving along an optical axis; a detection processor configured to perform detection processing of positioning a position of the focus lens at an in-focus position based on an image within the detection frame; a lens controller configured to position the focus lens at the in-focus position based on a processing result from the detection processor; a distal end detector configured to detect a distal end of a treatment tool in the captured image based on the captured image; and a detection frame setting unit configured to perform setting processing of setting a position of the detection frame in the captured image based on a position of the distal end of the treatment tool.