Coplanar Image Capture Sensors in Surgical Endoscopes

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing stereoscopic endoscopes face challenges in capturing high-quality images due to the difficulty in focusing tiny lenses and the need for precise calibration, which leads to issues like lateral color distortion and uneven performance in small outer diameter distal-end image capture systems.

Innovation Solution

The implementation of coplanar image capture sensors with a common front end optical structure, eliminating the need for lens calibration and ensuring spatial and temporal registration of images, enhances image quality by providing features like enhanced feature definition, increased resolution, dynamic range, and extended depth of field.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If multiple image capture sensors are used in a distal-end endoscope system, then stereoscopic imaging capability is improved, but device complexity and calibration difficulty increase

Engineering Contradiction:
Improvestereoscopic imaging capabilityVSAvoiddevice complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent combines multiple image capture sensors (first and second image capture sensors) into a single integrated sensor assembly located at the distal end of the endoscope. This merging approach maintains stereoscopic imaging capability while reducing overall device complexity by consolidating components that would otherwise be separate and require individual calibration.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The sensor assembly is designed to perform multiple functions: capturing both two-dimensional and three-dimensional images, and optionally capturing fluorescence images. This multi-functionality is achieved through a unified optical structure that serves all imaging modes, eliminating the need for separate calibration procedures for different imaging functions.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Adaptability or versatility

If multiple image capture sensors are used with separate optical paths, then imaging flexibility is improved, but manufacturing precision and calibration requirements increase

Engineering Contradiction:
Improveimaging flexibilityVSAvoidmanufacturing precision
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The patent merges the optical paths of multiple image capture sensors into a common front-end optical structure. This single optical path serves all sensors, eliminating the need for precise calibration of multiple separate optical paths while maintaining the flexibility to capture various image types (2D, 3D, fluorescence) through the same optical system.

Inventive Principle:
Principle #5Merging (Combining)

3Ease of manufacture

If a common optical path is used for multiple sensors, then calibration requirements are reduced, but image quality and resolution may be compromised

Engineering Contradiction:
Improvecalibration requirementsVSAvoidimage quality
Core Design Contradiction:
Ease of manufactureVSMeasurement precision

Solution Approach 1:

While using a common front-end optical structure, the patent segments the optical path after the common section. Each image capture sensor has its own dedicated optical path segment from the beam splitter, allowing independent optimization for each sensor type (visible light, fluorescence) while sharing the common illumination and initial imaging optics, thus maintaining high image quality without complex calibration.

Inventive Principle:
Principle #1Segmentation

4Illumination intensity

If distal-end image capture is implemented, then surgical site visualization is improved, but focus control and image quality become more difficult

Engineering Contradiction:
Improvesurgical site visualizationVSAvoidfocus control
Core Design Contradiction:
Illumination intensityVSEase of operation

Solution Approach 1:

The patent implements an automated focus control system that eliminates the need for manual focus adjustment by the operator. The system automatically optimizes focus for the distal-end image capture sensors, ensuring consistent image quality at the surgical site without requiring operator intervention or expertise in focus control.

Inventive Principle:
Principle #25Self-service

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This configuration improves image capture by reducing distortion and enhancing image quality, allowing for clearer visualization of surgical sites with improved feature differentiation and depth perception.

Implementation Method 1

A beam splitter in the image capture unit is positioned to receive light and is configured to direct a first portion of the received light onto the first sensor surface and pass a second portion of the received light through the beam splitter

Methodology Applied
Scientific EffectLight reflection: Reflection

Implementation Method 2

A reflective unit in the image capture unit is positioned to receive the second portion of the received light and is configured to direct the second portion of the received light onto the second sensor surface

Methodology Applied
Scientific EffectLight reflection: Reflection

Implementation Method 3

Each of the coplanar image capture sensors in a channel of the endoscope has a common front end optical structure

Methodology Applied
Scientific EffectOptical imaging: Lens

Data Source

PatentUS20210204803A1Image capture unit in a surgical instrument
Publication Date: 2021.07.08 INTUITIVE SURGICAL OPERATIONS INC
  • US20210204803A1 patent drawing
  • US20210204803A1 patent drawing
  • US20210204803A1 patent drawing

AI summary

In a minimally invasive surgical system, an image capture unit includes a prism assembly and sensor assembly. The prism assembly includes a beam splitter, while the sensor assembly includes coplanar image capture sensors. Each of the coplanar image capture sensors has a common front end optical structure. e.g., the optical structure distal to the image capture unit is the same for each of the sensors. A controller enhances images acquired by the coplanar image capture sensors. The enhanced images may include (a) visible images with enhanced feature definition, in which a particular feature in the scene is emphasized to the operator of minimally invasive surgical system; (b) images having increased image apparent resolution; (c) images having increased dynamic range; (d) images displayed in a way based on a pixel color component vector having three or more color components; and (e) images having extended depth of field.