Four-Channel Color Filter Array Interpolation for Noise Reduction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing color filter array (CFA) patterns in digital cameras face challenges in achieving high color fidelity and spatial resolution due to the compromise between spectral selectivity and light sensitivity, leading to noise susceptibility and limited spatial resolution in interpolated images.

Innovation Solution

A four-channel CFA pattern with three narrowband color channels and one broadband panchromatic channel, where color pixels are arranged along diagonals in a repeating pattern, allowing for nonlinear interpolation of panchromatic values to enhance spatial resolution without increasing the percentage of color pixels, thereby reducing noise and maintaining color fidelity.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the CFA spectral responsivities are made more selective (narrowed) to improve color fidelity and broaden color gamut, then color fidelity is improved, but the overall amount of light reaching the pixel is reduced, increasing susceptibility to noise

Engineering Contradiction:
Improvecolor fidelityVSAvoidnoise susceptibility
Core Design Contradiction:
Measurement precisionVSObject-affected harmful factors

Solution Approach 1:

The CFA is segmented into four distinct channels: three narrowband color channels (R, G, B) for high color fidelity and one broadband panchromatic channel for high light sensitivity. This segmentation allows each channel to specialize in its function, resolving the contradiction between color fidelity and noise susceptibility by distributing these competing requirements across separate sensor elements.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The CFA uses a composite filter structure combining narrowband interference filters for color channels and a broadband clear filter for the panchromatic channel. This composite approach integrates the advantages of both selective and non-selective filtering, enabling the system to achieve high color fidelity from narrowband channels while maintaining low noise through the broadband panchromatic channel.

Inventive Principle:
Principle #40Composite materials

2Measurement precision

If the CFA uses three color channels with narrow spectral sensitivities to achieve high color fidelity, then color fidelity is improved, but the spatial resolution of the resulting image is reduced

Engineering Contradiction:
Improvecolor fidelityVSAvoidspatial resolution
Core Design Contradiction:
Measurement precisionVSManufacturing precision

Solution Approach 1:

The patent merges the advantages of narrowband color filtering and broadband panchromatic sensing by combining data from all four channels. The panchromatic channel provides high spatial resolution information that is then combined with the color information from the narrowband channels, achieving both high color fidelity and high spatial resolution in the final image.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent adds a fourth dimension to the traditional three-channel CFA by incorporating a panchromatic channel. This additional channel provides independent spatial information that can be used to enhance spatial resolution without compromising color fidelity, effectively adding a new dimension of information to the imaging system.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Manufacturing precision

If more color pixels are used in the CFA pattern to improve color spatial resolution, then color spatial resolution is improved, but the percentage of color pixels increases, reducing the number of panchromatic pixels and lowering overall light sensitivity

Engineering Contradiction:
Improvecolor spatial resolutionVSAvoidlight sensitivity
Core Design Contradiction:
Manufacturing precisionVSUse of energy by moving object

Solution Approach 1:

The CFA pattern assigns different local functions to different pixel locations: color pixels (R, G, B) provide local color information while panchromatic pixels provide local high-sensitivity luminance information. This local differentiation allows the system to achieve high color spatial resolution where needed while maintaining overall light sensitivity through the distributed panchromatic pixels.

Inventive Principle:
Principle #3Local quality

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach improves color spatial resolution and reduces noise in images without increasing the spectral bandwidth of color pixels, resulting in high color fidelity and low noise, high spatial resolution images.

Implementation Method 1

The CFA comprises an array of color filters that filter the light being detected by each pixel

Methodology Applied
Scientific EffectOptical filtering: Filter (optical)

Implementation Method 2

The fourth broadband panchromatic channel would produce an image with lower noise and higher spatial resolution

Methodology Applied
Scientific EffectBroadband light detection: Photoelectric Effect

Data Source

PatentUS8237831B2Four-channel color filter array interpolation
Publication Date: 2012.08.07 OMNIVISION TECHNOLOGIES INC
  • US8237831B2 patent drawing
  • US8237831B2 patent drawing
  • US8237831B2 patent drawing

AI summary

A method of forming a full-color output image from a color filter array image having a plurality of color pixels having at least two different color responses and panchromatic pixels, comprising capturing a color filter array image using an image sensor including panchromatic pixels and color pixels having at least two different color responses, the pixels being arranged in a repeating pattern having a square minimal repeating unit having at least three rows and three columns, the color pixels being arranged along one of the diagonals of the minimal repeating unit, and all other pixels being panchromatic pixels; computing an interpolated panchromatic image from the color filter array image; computing an interpolated color image from the color filter array image; and forming the full color output image from the interpolated panchromatic image and the interpolated color image.