Hybrid Sensor Array for Low Light Color Imaging

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Digital image capturing devices struggle to produce high-quality color images under low light conditions due to the lack of non-chromatic sensing elements in their sensor arrays, resulting in images with poor clarity and contrast.

Innovation Solution

A hybrid sensor array is introduced, co-locating chromatic and non-chromatic sensing elements, with a higher ratio of non-chromatic to chromatic elements, mimicking the human retina's rod and cone cells, to enhance sensitivity and image quality. This hybrid sensor includes interface optics and electronics for efficient light signal processing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a sensor array with only chromatic sensing elements is used, then color information can be captured, but sensitivity in low light conditions deteriorates

Engineering Contradiction:

Improvecolor information captureVSAvoidsensitivity in low light conditions

Core Design Contradiction:

Measurement precisionVSReliability

Solution Approach 1:

The sensor array is segmented into two distinct types of sensing elements: chromatic sensing elements for capturing color information and non-chromatic sensing elements for capturing luminance information. This segmentation allows each type of element to be optimized for its specific function, resolving the contradiction between color capture and low-light sensitivity.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The sensor array achieves multi-functionality by incorporating both chromatic and non-chromatic sensing elements, enabling it to simultaneously capture both color information and luminance information. This universal approach allows the system to maintain color accuracy while improving sensitivity in low light conditions.

Inventive Principle:

Principle #6Universality (Multi-functionality)

2Measurement precision

If more chromatic sensing elements are used, then color accuracy improves, but low light detection capability worsens

Engineering Contradiction:

Improvecolor accuracyVSAvoidlow light detection capability

Core Design Contradiction:

Measurement precisionVSIllumination intensity

Solution Approach 1:

Different regions of the sensor array have different qualities: chromatic sensing elements are distributed to provide color information, while non-chromatic sensing elements are positioned to capture luminance information. This local differentiation ensures that color accuracy is maintained where chromatic elements are present, while low-light detection is enhanced where non-chromatic elements are concentrated.

Inventive Principle:

Principle #3Local quality

Solution Approach 2:

The sensor array transitions from a single-dimension chromatic sensing approach to a two-dimension approach by adding the luminance dimension through non-chromatic sensing elements. This dimensional expansion allows the system to capture both color and brightness information independently, resolving the trade-off between color accuracy and low-light detection.

Inventive Principle:

Principle #17Another dimension (Dimensionality change)

3Reliability

If a hybrid sensor with non-chromatic elements is used, then sensitivity in low light improves, but device complexity increases

Engineering Contradiction:

Improvesensitivity in low lightVSAvoidsensor array structure

Core Design Contradiction:

ReliabilityVSDevice complexity

Solution Approach 1:

The chromatic and non-chromatic sensing elements are merged into a single integrated sensor array structure, sharing common support infrastructure such as readout circuits and processing electronics. This merging approach reduces the overall device complexity compared to using separate sensors, while still achieving improved low-light sensitivity through the inclusion of non-chromatic elements.

Inventive Principle:

Principle #5Merging (Combining)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The hybrid sensor enables the generation of high-sensitivity full-frame color images with reduced noise and improved clarity, especially in low light environments, by effectively combining luminance and chromatic data to produce enhanced image quality.

Implementation Method 1

non-chromatic sensing elements co-located on the sensor array... partial-frame color-insensitive data generated by the non-chromatic sensing elements

Methodology Applied

Scientific EffectPhotoelectric Effect: Photoelectric Effect

Implementation Method 2

chromatic sensing elements... partial-frame chromatic data generated by the chromatic sensing elements

Methodology Applied

Scientific EffectPhotoelectric Effect: Photoelectric Effect

Data Source

PatentUS12120472B2High sensitivity color image generation using hybrid sensor

Publication Date: 2024.10.15 MEDIATEK INC

AI summary

Various schemes pertaining to generating a full-frame color image using a hybrid sensor are described. An apparatus receives sensor data from the hybrid sensor, wherein the sensor data includes partial-frame chromatic data of a plurality of chromatic channels and partial-frame color-insensitive data. The apparatus subsequently generates full-frame color-insensitive data based on the partial-frame color-insensitive data. The apparatus subsequently generates the full-frame color image based on the full-frame color-insensitive data and the partial-frame chromatic data. The apparatus provides benefits of enhancing image quality of the full-frame color image especially under low light conditions.