Per-Frame Pixel Binning for Endoscopic Sensor Readout

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Endoscopic visualization systems face challenges in capturing high-definition color, multispectral, fluorescence, and laser mapping data due to the inherent inefficiencies of image sensors in accumulating electromagnetic radiation across different wavebands, leading to inconsistent exposure and inadequate data capture in light-deficient environments.

Innovation Solution

An endoscopic system with an emitter and controller that synchronizes operations to adjust the frame rate and illumination cycle of the image sensor on a per-frame basis, implementing pixel binning and variable pulse cycles to ensure consistent exposure and efficient data accumulation across different wavebands.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a fixed frame duration is used for standard operating mode, then the frame rate remains constant and data transmission timing is stable, but the pixel array cannot accumulate sufficient electromagnetic radiation at wavebands where it is inherently inefficient

Engineering Contradiction:
Improveconsistent exposureVSAvoiddata accumulation efficiency
Core Design Contradiction:
ReliabilityVSMeasurement precision

Solution Approach 1:

The patent applies dynamics by transitioning from a fixed frame duration to a variable frame duration that adapts to the specific waveband and pixel array efficiency characteristics. The frame duration is dynamically adjusted based on the inherent efficiency of the pixel array for different wavebands, allowing longer accumulation times for inefficient wavebands and shorter times for efficient ones, thereby resolving the contradiction between consistent exposure and data accumulation efficiency.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes the parameter of frame duration from a fixed value to a variable parameter that depends on the waveband and pixel array characteristics. By making the frame duration a function of the waveband efficiency, the system optimizes data accumulation for each waveband while maintaining overall system reliability through controlled variation in this critical parameter.

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If the frame duration is extended to accumulate sufficient electromagnetic radiation at inefficient wavebands, then data accumulation improves, but the frame rate decreases and time for other visualization modalities is reduced

Engineering Contradiction:
Improvedata accumulation efficiencyVSAvoidframe rate
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The system dynamically adjusts frame duration based on the specific requirements of each waveband and visualization modality. Rather than using a uniformly extended frame duration that would reduce overall productivity, the system flexibly varies the frame duration to match the actual data accumulation needs, thereby maintaining higher frame rates for efficient wavebands while extending only when necessary for inefficient ones.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes the frame duration parameter from a fixed value to a variable parameter that is optimized for each specific imaging task. This allows the system to extend frame duration only when needed for data accumulation efficiency, while maintaining shorter durations for other modalities, thus balancing measurement precision with overall productivity.

Inventive Principle:
Principle #35Parameter changes

3Loss of time

If pixel binning is implemented to reduce readout period, then the readout time decreases, but the resolution and detail in the image is reduced

Engineering Contradiction:
Improvereadout periodVSAvoidimage resolution
Core Design Contradiction:
Loss of timeVSMeasurement precision

Solution Approach 1:

The patent applies dynamics by making the pixel binning configuration variable rather than fixed. The system dynamically adjusts the degree of binning based on the specific waveband, illumination conditions, and data accumulation requirements. This allows the system to use stronger binning (higher resolution) when time is not critical and weaker binning (faster readout) when time is critical, resolving the contradiction between readout time and image resolution.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes the pixel binning parameter from a fixed configuration to a variable parameter that adapts to system conditions. By making the binning level a function of the current imaging requirements, the system optimizes the trade-off between readout time and resolution for each specific task, allowing flexible adjustment rather than a fixed compromise.

Inventive Principle:
Principle #35Parameter changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables consistent and efficient capture of advanced visualization data with improved exposure levels, allowing for precise tissue identification, three-dimensional mapping, and enhanced diagnostic capabilities in light-deficient environments.

Implementation Method 1

the pixel array accumulates electromagnetic radiation during a variable duration period corresponding to a waveband of the electromagnetic spectrum for which the pixel array is inefficient

Methodology Applied
Scientific EffectElectromagnetic radiation accumulation: Absorption (EM radiation)

Implementation Method 2

an image sensor that accumulates electromagnetic radiation and reads out data according to a variable sensor cycle

Methodology Applied
Scientific EffectPhotoelectric effect: Photoelectric Effect

Data Source

PatentUS20240179419A1Pixel binning on a per-frame basis
Publication Date: 2024.05.30 CILAG GMBH INTERNATIONAL
  • US20240179419A1 patent drawing
  • US20240179419A1 patent drawing
  • US20240179419A1 patent drawing

AI summary

Endoscopic visualization with customizable image sensor readout on a per-frame basis. A system includes an emitter comprising a plurality of electromagnetic radiation sources, an image sensor comprising a pixel array that detects electromagnetic radiation with a plurality of pixels, and a controller that synchronizes operations of the emitter and the image sensor. The controller sets readout configurations for the image sensor on a per-frame basis based at least in part on an acceptable resolution and a desired exposure of a resultant data frame, wherein the readout configuration for at least a portion, but fewer than all, of the plurality of frame periods comprises a binning configuration for the pixel array.