Endoscopic Imaging Sensor Rotation Correction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional endoscopes with image sensors placed in handpiece units are prone to misalignment and damage, leading to image quality degradation and require frequent repairs due to their delicate nature, and are limited to capturing only color images, while applications for fluorescence, hyperspectral, and laser mapping imaging require specialized equipment and multiple sensors, which are not suitable for space-constrained environments.

Innovation Solution

An endoscopic imaging system with an image sensor placed at the distal tip of the endoscope, using a monochromatic pixel array that pulses different wavelengths of electromagnetic radiation to generate color and additional imaging data types like hyperspectral, fluorescence, and laser mapping, allowing for a single imaging session with improved optical simplicity and reduced sensor size.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If the image sensor is placed in the handpiece unit, then the endoscope structure is simplified, but the image quality degrades due to misalignment and damage

Engineering Contradiction:
Improveendoscope structureVSAvoidimage quality
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The patent uses software-based image processing to create a virtual model of the endoscope's optical path and sensor characteristics. This digital twin allows for real-time correction of alignment deviations and damage effects, compensating for the fragility of the physical sensor in the handpiece unit while maintaining image quality.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The system implements continuous feedback loops that monitor image quality metrics and automatically adjust calibration parameters. When misalignment or damage is detected, the software dynamically corrects the imaging data, ensuring stable image quality despite the delicate nature of the handpiece-mounted sensor.

Inventive Principle:
Principle #23Feedback

2Adaptability or versatility

If multiple specialized sensors are used for fluorescence, hyperspectral, and laser mapping imaging, then imaging capabilities are enhanced, but the device size and complexity increase

Engineering Contradiction:
Improveimaging capabilitiesVSAvoidsensor array
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent employs a universal monochromatic sensor that can capture multiple types of imaging data (color, fluorescence, hyperspectral, laser mapping) through software-based spectral unmixing and processing. This single sensor replaces what would traditionally require multiple specialized sensors, significantly reducing device complexity while maintaining full imaging versatility.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system changes the operational parameters of the single monochromatic sensor by adjusting exposure times, illumination wavelengths, and processing algorithms to extract different imaging modalities from the same sensor, enabling multi-functional imaging without adding physical sensors.

Inventive Principle:
Principle #35Parameter changes

3Area of stationary object

If a monochromatic pixel array is used, then the sensor size is reduced, but the ability to capture color information is limited

Engineering Contradiction:
Improvesensor sizeVSAvoidcolor information
Core Design Contradiction:
Area of stationary objectVSLoss of information

Solution Approach 1:

The patent replaces the mechanical/color-filter-based color capture system with a software-based computational imaging approach. The monochromatic sensor captures intensity data, and software algorithms reconstruct color information by analyzing spectral characteristics and comparing against reference data, eliminating the need for physical color filters while recovering color information.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system introduces software-based spectral processing as an intermediary between the monochromatic sensor and the final color image output. This computational layer extracts and reconstructs color information from the monochromatic data through spectral unmixing and synthesis algorithms, bridging the gap between single-wavelength sensing and full-color imaging.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS20240389841A1Image rotation in an endoscopic hyperspectral, fluorescence, and laser mapping imaging system
Publication Date: 2024.11.28 CILAG GMBH INTERNATIONAL
  • US20240389841A1 patent drawing
  • US20240389841A1 patent drawing
  • US20240389841A1 patent drawing

AI summary

Image rotation in an endoscopic hyperspectral, fluorescence, and/or laser mapping imaging system is described. A system includes an emitter for emitting pulses of electromagnetic radiation and an image sensor comprising a pixel array for sensing reflected electromagnetic radiation. The system includes a rotation sensor for detecting an angle of rotation of a lumen relative to a handpiece of an endoscope. The system is such that at least a portion of the pulses of electromagnetic radiation emitted by the emitter comprises one or more of a hyperspectral emission, a fluorescence emission, and/or a laser mapping pattern.