3D Surgical Endoscopy Sensor Array for Depth Perception

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current surgical endoscopy systems lack the capability to accurately determine three-dimensional coordinates of physical structures within a surgical scene, limiting the precision and effectiveness of minimally invasive surgical procedures.

Innovation Solution

A surgical endoscopy system equipped with an image sensor array comprising multiple sensors, each with a pixel array, that illuminates a target object and computes three-dimensional coordinates based on projected images onto individual sensors, providing quantitative three-dimensional information overlayed onto the surgical scene.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional surgical endoscopy systems are used, then the system structure remains simple, but the capability to determine three-dimensional coordinates is lost or insufficient

Engineering Contradiction:
Improvethree-dimensional coordinate determinationVSAvoidsystem structure
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system divides the imaging function into multiple sensors (e.g., four sensors arranged in a square pattern), each capturing a portion of the surgical scene. By segmenting the imaging task across multiple sensors, the system achieves three-dimensional coordinate determination through multi-perspective imaging while maintaining manageable system complexity through modular sensor design

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transitions from traditional two-dimensional endoscopic imaging to three-dimensional quantitative imaging by adding spatial dimensionality. Multiple sensors capture images from different spatial positions, and through computational processing, the system reconstructs three-dimensional coordinates of surgical targets, enabling depth perception and precise spatial measurement

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Measurement precision

If multiple sensors are used to determine three-dimensional coordinates, then measurement precision improves, but device complexity increases

Engineering Contradiction:
Improvephysical location and dimensions determinationVSAvoidimage sensor array
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

Each sensor in the array serves multiple functions: capturing two-dimensional images, providing spatial perspective information, and contributing to three-dimensional coordinate reconstruction. The entire sensor array functions as both an imaging system and a measurement system, eliminating the need for separate imaging and ranging devices

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system uses multiple sensors to create multiple copies of the surgical scene from different perspectives. These redundant visual copies are processed computationally to extract three-dimensional information, allowing the system to derive precise spatial coordinates through image correlation and geometric processing

Inventive Principle:
Principle #26Copying

3Manufacturing precision

If quantitative three-dimensional imaging is implemented, then surgical accuracy improves, but processing complexity increases

Engineering Contradiction:
Improvesurgical procedure accuracyVSAvoidimage processing computation
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The system implements real-time feedback by continuously processing images from multiple sensors and providing updated three-dimensional coordinate information. This feedback loop allows dynamic adjustment and monitoring of surgical instrument positions relative to target structures, enhancing surgical precision through real-time spatial awareness

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent replaces complex mechanical measurement systems with computational imaging approaches. Instead of using physical measuring devices or mechanical rangefinders, the system uses software algorithms to process images from standard sensors and compute three-dimensional coordinates, reducing mechanical complexity while maintaining measurement precision

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables precise determination of physical dimensions and locations within the surgical scene, enhancing the accuracy and safety of minimally invasive surgical procedures by providing real-time, high-resolution three-dimensional imaging and location data.

Implementation Method 1

A physical location and/or dimensions of a target object is determined based upon projected images of the object onto individual sensors of the array

Methodology Applied
Scientific EffectLight reflection: Reflection

Data Source

PatentEP3125806B1Quantitative three-dimensional imaging of surgical scenes
Publication Date: 2023.06.14 INTUITIVE SURGICAL OPERATIONS INC
  • EP3125806B1 patent drawingFigure 1~2
  • EP3125806B1 patent drawingFigure 3
  • EP3125806B1 patent drawingFigure 4

AI summary

A device is provided that includes an endoscope; an image sensor array is disposed to image a field of view adjacent to the endoscope, each sensor includes a pixel array that is separate from the pixel arrays of other sensors; and a light source is disposed to illuminate the field of view.