Monocular Endoscope 3D Reconstruction via Focus Scaling

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing endoscopic technologies cannot measure the absolute dimensions of an imaging subject using a general monocular endoscope, as they require special equipment like stereo optical systems or laser modules, and three-dimensional reconstruction methods provide only relative dimensions.

Innovation Solution

An image processing apparatus that reconstructs three-dimensional information from time-series images acquired by a monocular endoscope, calculates scale information based on focus information, and converts relative dimensions to absolute dimensions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a stereo optical system or laser module is used to measure dimensions, then measurement precision is improved, but device complexity increases

Engineering Contradiction:
Improvedimensional measurement accuracyVSAvoidendoscope system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent extracts the measurement function from specialized equipment (stereo optical system, laser module) and transfers it to a general monocular endoscope by using the endoscope's existing imaging and focus control mechanisms. The dimension measurement capability is achieved through image processing algorithms that analyze focus information from standard monocular images, eliminating the need for additional specialized hardware components.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent replaces the mechanical/optical measurement systems (stereo cameras, laser modules) with a computational approach using a single monocular camera. The physical measurement function is substituted by algorithms that calculate dimensions from image data and focus information, converting a hardware-intensive solution into a software-based measurement system.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Device complexity

If three-dimensional reconstruction is performed using a monocular endoscope, then device complexity is reduced, but measurement precision deteriorates because only relative dimensions are obtained

Engineering Contradiction:
Improveendoscope system simplicityVSAvoiddimensional measurement accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent introduces focus information as an intermediary element that connects the monocular images to absolute dimensional measurements. By utilizing the focus control information from the endoscope's autofocus mechanism, the system establishes a relationship between image plane position and object distance, enabling conversion from relative to absolute dimensions without requiring specialized measurement hardware.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent changes the parameter used for measurement from relative pixel distances to absolute physical dimensions by incorporating focus information. The system uses the focus control information (which represents the lens position or focal length) as a scaling parameter to convert image coordinates into real-world measurements, thereby achieving absolute dimensional accuracy with a monocular system.

Inventive Principle:
Principle #35Parameter changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables the measurement of absolute dimensions of an imaging subject using a general monocular endoscope without the need for special equipment, providing accurate and reliable dimensional data for endoscopic examinations and treatments.

Implementation Method 1

an imaging optical system (5) having an objective lens (5a)

Methodology Applied
Scientific EffectOptical focusing: Focusing

Data Source

PatentUS12205314B2Image processing apparatus for a plurality of timeseries images acquired by an endoscope, image processing method, and recording medium
Publication Date: 2025.01.21 OLYMPUS MEDICAL SYST CORP
  • US12205314B2 patent drawing
  • US12205314B2 patent drawing
  • US12205314B2 patent drawing

AI summary

Provided is an image processing apparatus including a processor. The processor is configured to: reconstruct, by employing a plurality of time-series images acquired by an endoscope, three-dimensional information of an imaging subject containing relative dimensions; calculate, on the basis of focus information of each of the plurality of images, scale information for converting the relative dimensions of the three-dimensional information to absolute dimensions; convert, by employing the scale information, the relative dimensions to the absolute dimensions; and output three-dimensional information containing the absolute dimensions.