Coplanar Image Capture Sensors in Surgical Endoscopes

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing stereoscopic endoscopes face challenges in capturing high-quality images due to the difficulty in focusing tiny lenses, lateral color distortion, uneven performance between left and right image sensors, and limited imaging quality due to small outer diameters, which restricts pixel size and number, and requires calibration to compensate for lens artifacts.

Innovation Solution

The implementation of coplanar image capture sensors with a common front end optical structure, where a beam splitter and reflective unit are used to direct light equally to both sensors, eliminating the need for calibration and ensuring spatial and temporal registration of images, enhancing feature definition, resolution, and dynamic range.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Length of stationary object

If tiny lenses are used in distal end image capture, then the endoscope outer diameter can be reduced, but image quality deteriorates due to focusing difficulty and lens artifacts

Engineering Contradiction:
Improveendoscope outer diameterVSAvoidimage quality
Core Design Contradiction:
Length of stationary objectVSManufacturing precision

Solution Approach 1:

The patent transitions from distal-end lens-based imaging to proximal-end sensor-based imaging, fundamentally changing the spatial dimension where image capture occurs. By moving the image capture plane from the distal end (tip) to the proximal end (base) of the endoscope, the system eliminates the need for tiny distal lenses while maintaining a small outer diameter, as the optical path is folded back along the endoscope length.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent introduces a proximal end optical system with beam splitters and relay optics as intermediary components between the distal end scene and the proximal end sensors. This intermediary optical train allows light from the distal end to be redirected and focused onto the proximal end sensors, enabling high-quality imaging without requiring precise tiny lenses at the distal tip.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If multiple image capture sensors are used for stereoscopic imaging, then depth perception is improved, but device complexity increases due to alignment and calibration requirements

Engineering Contradiction:
Improvestereoscopic imaging capabilityVSAvoidalignment and calibration complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent merges the optical paths for left and right eye images into a single proximal end mounting plane. Both stereoscopic images are formed on the same proximal end structure, allowing the sensors to be mounted coplanarly with shared mechanical references. This combining of optical paths at the proximal end eliminates the need for complex separate alignment systems that would be required if sensors were mounted at the distal end.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent creates homogeneous mounting conditions for both image capture sensors by providing them with identical coplanar mounting surfaces, shared mechanical references, and equal optical path lengths from the distal end. This homogeneity in the mounting environment ensures that both sensors experience the same thermal, mechanical, and optical conditions, eliminating the need for individual calibration of each sensor's artifacts.

Inventive Principle:
Principle #33Homogeneity

3Adaptability or versatility

If image capture sensors are mounted at distal end, then stereoscopic imaging is enabled, but manufacturing precision deteriorates due to difficulty in focusing tiny lenses and compensating for lens artifacts

Engineering Contradiction:
Improvestereoscopic imaging capabilityVSAvoidfocus consistency and lens artifact compensation
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The patent transitions the image capture location from the distal end (tip) to the proximal end (base) of the endoscope, fundamentally changing the spatial dimension where imaging occurs. This dimensional shift allows the use of large, easily focused lenses at the proximal end while maintaining small distal end dimensions, eliminating the need for difficult-to-focus tiny distal lenses and the associated manufacturing precision problems.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent extracts the image capture function from the distal end optical system and relocates it to the proximal end. By taking out the sensors and main optical processing from the constrained distal end environment, the system eliminates the manufacturing precision issues associated with tiny distal lenses, as all critical optical components are now located at the proximal end where manufacturing and alignment are much easier.

Inventive Principle:
Principle #2Taking out (Extraction)

4Length of stationary object

If small outer diameter endoscope is used, then patient trauma is reduced, but image quality deteriorates due to limited pixel size and number

Engineering Contradiction:
Improveendoscope outer diameterVSAvoidimage resolution and pixel quality
Core Design Contradiction:
Length of stationary objectVSManufacturing precision

Solution Approach 1:

The patent exploits the longitudinal dimension of the endoscope by folding the optical path back along its length to bring large sensors to the proximal end. This dimensional exploitation allows the distal end to remain small for patient comfort while the proximal end houses large sensors with many pixels, effectively decoupling the size constraints from the image quality requirements.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent implements a nested optical structure where the optical path is folded back within the endoscope's longitudinal space. The optical train including beam splitters and relay optics is nested within the endoscope body, allowing light from the distal tip to traverse back through the endoscope length to reach large proximal sensors, effectively nesting the imaging function within the constrained form factor.

Inventive Principle:
Principle #7Nested doll (Nesting)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This configuration allows for improved image capture with enhanced feature definition, increased apparent resolution, and extended depth of field, reducing the need for active registration and preserving dynamic range, while maintaining spatial alignment and focus consistency.

Implementation Method 1

a beam splitter configured to reflect a first portion of the received light as a reflected portion, and to transmit a second portion of the received light as a transmitted portion

Methodology Applied
Scientific EffectLight reflection: Reflection

Implementation Method 2

a beam splitter configured to reflect a first portion of the received light as a reflected portion, and to transmit a second portion of the received light as a transmitted portion

Methodology Applied
Scientific EffectLight transmission: Refraction

Implementation Method 3

a reflective unit positioned to receive the transmitted portion of the received light and positioned to direct the transmitted portion of the received light in a same direction parallel to the first direction to the second image capture sensor

Methodology Applied
Scientific EffectLight reflection: Reflection

Data Source

PatentEP2741702B1An image capture unit in a surgical instrument
Publication Date: 2022.10.19 INTUITIVE SURGICAL OPERATIONS INC
  • EP2741702B1 patent drawingFigure 1A~1D
  • EP2741702B1 patent drawingFigure 2
  • EP2741702B1 patent drawingFigure 3A~3B

AI summary

In a minimally invasive surgical system (200), an image capture unit (325R) includes a lens assembly (304R) and a sensor assembly (320R). Sensor assembly (320R) includes a prism assembly (330R) and coplanar image capture sensors (310R, 315R). Each of the coplanar image capture sensors has a common front end optical structure, e.g., lens assembly (304R). A controller (260) enhances images acquired by the coplanar image capture sensors. The enhanced images may include (a) visible images with enhanced feature definition; (b) images having increased image apparent resolution; (c) images having increased dynamic range; (d) images displayed in a way based on a pixel color component vector having three or more color components; and (e) images having extended depth of field.