ToF Camera for Endoscope 3D Imaging

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Modern endoscopes struggle to provide high-quality three-dimensional images, which are essential for accurate diagnosis and intervention, due to the complexity and disadvantages of stereoscopic imaging, such as extreme complexity and larger shank cross sections.

Innovation Solution

A camera device that uses a Time of Flight (ToF) image sensor to acquire both distance and intensity images in the red spectral range, combined with intensity images in blue and green spectral ranges, reducing the need for multiple sensors and enabling the creation of a color image with three sensors, and a beam splitter to separate light into different wavelength ranges for simultaneous acquisition of optical and spatial structure properties.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a stereoscopic endoscope is used to acquire three-dimensional images, then the three-dimensional visual impression is improved, but the device complexity increases and the shank cross section becomes larger

Engineering Contradiction:
Improvethree-dimensional image qualityVSAvoidendoscope structure complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The endoscope system is divided into two independent parts: a conventional endoscope for capturing two-dimensional images and a separate ToF sensor for acquiring depth information. This segmentation allows each component to be optimized independently, avoiding the complexity of integrating multiple cameras and optical paths into a single stereoscopic endoscope while still achieving three-dimensional visualization through post-processing combination of the two data types.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

A ToF (Time of Flight) sensor is introduced as an intermediary device between the conventional endoscope and the final three-dimensional image output. The ToF sensor acts as a mediator that captures depth information separately and combines it with the two-dimensional image data, enabling three-dimensional reconstruction without requiring complex stereoscopic optical systems in the endoscope itself.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If multiple image sensors are used to acquire optical properties in different wavelength ranges, then the optical property measurement is improved, but the device complexity and number of components increases

Engineering Contradiction:
Improveoptical property detection accuracyVSAvoidnumber of sensors
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The ToF sensor is designed with multi-functionality, serving both as a depth measurement device and as an intensity sensor for the red spectral range. By making the sensor universal, the system eliminates the need for separate dedicated intensity sensors, reducing the total number of sensors while maintaining the ability to measure optical properties across multiple wavelength ranges through the beam splitter's wavelength-dependent reflection.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Measurement precision

If a ToF sensor is used to acquire distance information, then the spatial structure property is improved, but the number of sensors required increases

Engineering Contradiction:
Improvedistance measurement accuracyVSAvoidsensor quantity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent merges the functions of multiple sensors by using a single ToF sensor that can operate in different modes. The same sensor that measures distance (spatial structure) also captures intensity information when combined with the beam splitter's wavelength-dependent reflection properties. This merging reduces the total sensor count while maintaining both distance measurement accuracy and optical property detection capabilities.

Inventive Principle:
Principle #5Merging (Combining)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This solution allows for the simultaneous acquisition of optical and spatial structure properties, reducing the number of sensors required and improving color rendering, while enabling the differentiation of benign and malignant tissue, and generating a stereoscopic image for enhanced visualization.

Implementation Method 1

a beam splitter for splitting light coming from an object into the plurality of different wavelength ranges

Methodology Applied
Scientific EffectWavelength-dependent reflection: Reflection

Implementation Method 2

a first image sensor for generating a sensor signal related to a predetermined wavelength range, wherein the first image sensor, on the basis of a temporally modulatable sensitivity, is designed for acquiring a distance between an object and the camera device from a time of flight of light

Methodology Applied
Scientific EffectTime of flight: Time of Flight

Implementation Method 3

a first image sensor for generating a sensor signal related to a predetermined wavelength range

Methodology Applied
Scientific EffectPhotoelectric effect: Photoelectric Effect

Data Source

PatentUS9998678B2Camera for acquiring optical properties and spatial structure properties
Publication Date: 2018.06.12 KARL STORZ SE & CO KG
  • US9998678B2 patent drawing
  • US9998678B2 patent drawing
  • US9998678B2 patent drawing

AI summary

A camera device acquires optical properties in two or more different wavelength ranges as well as spatial structure properties of an object. The device includes a beam splitter for splitting light coming from an object into the two or more different wavelength ranges. A first image sensor generates a first sensor signal related to a first predetermined wavelength range. A first signal processing device generates a first intensity image signal and a distance image signal using information about the temporal modulation of illumination light (M) and the first sensor signal. At least one second image sensor generates a second intensity image signal for a second predetermined wavelength range. A second signal processing device generates a color image signal from the first intensity image signal and the second intensity image signal.