Plenoptic Endoscope Fiber Bundle Microlens 3D Depth Mapping

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current endoscopic imaging technologies struggle to provide real-time, high-resolution, 3D depth maps of internal body structures, which is crucial for precise surgical interventions and diagnostics.

Innovation Solution

A plenoptic endoscope is developed, featuring a fiber bundle with microlenses and an image sensor that captures light field information, enabling the creation of 3D depth maps and focused images at different depths.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional endoscopic imaging is used, then the device structure is simple, but real-time high-resolution 3D depth mapping capability is lost

Engineering Contradiction:
Improve3D depth mapping precisionVSAvoidendoscope structure complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The imaging system is segmented into multiple functional components: a main lens for light collection, a microlens array for directional light field sampling, and an image sensor for capture. This segmentation enables 3D depth mapping by capturing light intensity and direction information from different angles simultaneously, resolving the contradiction between measurement precision and device complexity

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transitions from conventional 2D endoscopic imaging to 4D light field imaging by adding angular dimension information through the microlens array. Each microlens captures light from a specific direction, creating a multi-dimensional data structure that enables real-time 3D depth mapping while maintaining system integration

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Loss of information

If plenoptic camera configuration is implemented, then light field information capture is enabled, but the device complexity increases

Engineering Contradiction:
Improvelight field information captureVSAvoidoptical system complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The main lens and microlens array are merged into a single integrated optical system where the microlens array is positioned at the focal plane of the main lens. This merging allows simultaneous capture of spatial and angular light field information without requiring separate optical paths, reducing overall system complexity while preserving complete light field data

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The microlens array serves multiple functions: it acts as both an optical element for light field sampling and a spatial encoder for depth information. Each microlens simultaneously captures intensity and directional data, enabling the system to extract multiple types of information (2D images, 3D depth maps, focal planes) from a single light field capture, thereby reducing information loss without proportionally increasing complexity

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The plenoptic endoscope allows for precise 3D visualization and depth sensing within the body, enhancing surgical precision, improving diagnostic accuracy, and facilitating complex surgical procedures.

Implementation Method 1

a plurality of fiber optic strands each extending from the distal end to the sensor end

Methodology Applied
Scientific EffectOptical fiber transmission: Optical Fibre

Implementation Method 2

a plurality of microlenses disposed between the image sensor and the sensor end of the fiber bundle. The plurality of microlens elements form an array that receives light from one or more of the plurality of fiber optic strands of the fiber bundle and directs the light onto the image sensor

Methodology Applied
Scientific EffectLens focusing: Lens

Data Source

PatentUS12235436B2Plenoptic endoscope with fiber bundle
Publication Date: 2025.02.25 INTUITIVE SURGICAL OPERATIONS INC
  • US12235436B2 patent drawing
  • US12235436B2 patent drawing
  • US12235436B2 patent drawing

AI summary

A plenoptic endoscope includes a fiber bundle with a distal end configured to receive light from a target imaging region, a sensor end disposed opposite the distal end, and a plurality of fiber optic strands each extending from the distal end to the sensor end. The plenoptic endoscope also includes an image sensor coupled to the sensor end of the fiber bundle, and a plurality of microlenses disposed between the image sensor and the sensor end of the fiber bundle, the plurality of microlens elements forming an array that receives light from one or more of the plurality of fiber optic strands of the fiber bundle and directs the light onto the image sensor. The plurality of microlens elements and the image sensor together form a plenoptic camera configured to capture information about a light field emanating from the target imaging region.