Single-Sensor Array Layout for Registered Color and Hyperspectral Imaging

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing sensor arrays require multiple image sensors to capture color and hyperspectral images, leading to complex setups, low color image resolution, and spatial registration issues, which complicates medical imaging applications.

Innovation Solution

A sensor array with subcells and supercells, where each subcell has at least one color filter from a color channel, and the characteristic wavelengths of the color filters differ between subcells within a supercell, allowing a single image sensor to capture both high-resolution color and hyperspectral images without spatial misalignment.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If multiple image sensors are used to capture color and hyperspectral images, then the spectral information coverage is improved, but the device complexity and spatial registration difficulty increase

Engineering Contradiction:
Improvespectral information coverageVSAvoidnumber of image sensors
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent combines multiple color channels (Red, Green, Blue, Cyan, Magenta, Yellow) and infrared sensitivity into a single image sensor array. This merging approach captures both color and hyperspectral information simultaneously without requiring multiple separate sensors, thereby reducing device complexity while maintaining comprehensive spectral coverage.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The image sensor is designed with universal functionality to detect multiple spectral ranges including visible light (RGB) and infrared radiation. This multi-functional sensor can capture both color images and hyperspectral data in a single operation, eliminating the need for specialized separate sensors for different spectral regions.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Loss of information

If multiple image sensors are used to capture color and hyperspectral images, then the spectral information coverage is improved, but spatial registration accuracy deteriorates

Engineering Contradiction:
Improvespectral information coverageVSAvoidspatial registration accuracy
Core Design Contradiction:
Loss of informationVSMeasurement precision

Solution Approach 1:

By merging all color channels and infrared sensitivity into one integrated sensor array, the patent eliminates spatial misalignment issues that occur when multiple separate sensors are used. All spectral measurements are taken from the same physical location simultaneously, ensuring perfect spatial registration between color and hyperspectral data.

Inventive Principle:
Principle #5Merging (Combining)

3Ease of operation

If a Bayer sensor configuration is used, then the color image capture is simplified, but the spectral resolution and hyperspectral imaging capability are limited

Engineering Contradiction:
Improvecolor image capture simplicityVSAvoidspectral resolution
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The sensor array is segmented into multiple subcells within each pixel location, with each subcell dedicated to a specific color channel (R, G, B, C, M, Y, or IR). This segmentation allows each subcell to specialize in detecting specific wavelengths, thereby improving spectral resolution while maintaining the simplicity of color image capture through the integrated array structure.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different regions of the sensor array (subcells) are assigned different spectral sensitivities tailored to their specific function. For example, certain subcells are optimized for red detection while others for infrared, allowing each local region to have the quality needed for its specific measurement task, thereby achieving high spectral resolution across the entire array.

Inventive Principle:
Principle #3Local quality

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables the recording of high-resolution color and hyperspectral images using a single image sensor, simplifying the setup and reducing spatial registration errors, while providing additional spectroscopic information for improved medical imaging capabilities.

Implementation Method 1

the image sensor has a multiplicity of small light-sensitive areas, so-called photocells, upstream of which in the optical beam path there is respectively arranged a color filter. The photocell can thus detect only a brightness value for light in a wavelength range which is transmitted through the upstream color filter.

Methodology Applied
Scientific EffectPhotoelectric Effect: Photoelectric Effect

Data Source

PatentUS11778288B2Sensor array, method for calculating a color image and a hyperspectral image, method for carrying out a white balance and use of the sensor array in medical imaging
Publication Date: 2023.10.03 SCHOLLY FIBEROPTIC GMBH
  • US11778288B2 patent drawing
  • US11778288B2 patent drawing
  • US11778288B2 patent drawing

AI summary

A sensor array (1) for recording a color image in the visible spectrum (8) and hyperspectral information that is spatially linked with the color image, wherein the sensor array (1) includes an image sensor (2) composed of a plurality of photocells (3), wherein respectively a color filter (4) is fixedly assigned to at least one portion of the photocells (3), wherein each photocell (3) is assigned to a subcell (5) and each subcell (5) is assigned to a supercell (6). Each subcell (5) has at least one additional filter of a channel, and all the channels together cover at least the entire visible spectrum (8), and the characteristic wavelengths (9) of the individual filters belonging to a channel in each case differ from one another between the subcells (5) of a supercell (6).