Modified Bayer Pattern Filter Array for Zigzag Edge Reduction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional CMOS image sensors using the Bayer pattern suffer from zigzag edges during binning or high dynamic range combination, which reduces sharpness and resolution, and requires costly memory for re-interpolation.

Innovation Solution

A modified Bayer pattern is introduced, where successive columns alternate between two patterns, each characterized by specific color filter arrangements, allowing for different exposure times in rows to achieve smooth edges and improved sharpness without sacrificing resolution.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If conventional Bayer pattern is used for down-sampling, then color information is captured, but zigzag edges occur during binning or HDR combination which reduces sharpness and resolution

Engineering Contradiction:
Improveimage sharpness and resolutionVSAvoidzigzag edges
Core Design Contradiction:
Manufacturing precisionVSObject-generated harmful factors

Solution Approach 1:

The patent applies asymmetry by modifying the conventional symmetric Bayer pattern into an asymmetric modified Bayer pattern. Specifically, the filter array uses alternating columns where odd columns have a first color pattern (e.g., RGGB) and even columns have a second color pattern (e.g., GBGR), breaking the symmetry of the traditional Bayer pattern. This asymmetric arrangement allows for different exposure times in alternating columns, enabling smooth HDR combination and binning operations that eliminate zigzag edges while maintaining image sharpness and resolution.

Inventive Principle:
Principle #4Asymmetry

2Object-generated harmful factors

If re-interpolation algorithm is used to correct zigzag edges, then edge smoothness improves, but sharpness and resolution are sacrificed

Engineering Contradiction:
Improvezigzag edge smoothnessVSAvoidimage sharpness and resolution
Core Design Contradiction:
Object-generated harmful factorsVSManufacturing precision

Solution Approach 1:

The patent applies preliminary action by pre-configuring the sensor with a modified Bayer pattern that anticipates and prevents zigzag edge formation before image processing occurs. Instead of correcting zigzag edges after capture through re-interpolation, the asymmetric filter arrangement is designed in advance to enable natural smooth transitions during binning and HDR combination. This preliminary structural configuration eliminates the need for post-processing re-interpolation algorithms that would otherwise compromise image sharpness and resolution.

Inventive Principle:
Principle #10Preliminary action

3Object-generated harmful factors

If re-interpolation is performed to smooth edges, then zigzag artifacts are reduced, but memory requirements and cost increase significantly

Engineering Contradiction:
Improvezigzag artifact reductionVSAvoidmemory requirements and cost
Core Design Contradiction:
Object-generated harmful factorsVSDevice complexity

Solution Approach 1:

The patent applies the extraction principle by removing the need for complex re-interpolation algorithms and associated memory resources. The modified Bayer pattern is designed to produce images that are naturally suitable for direct binning and HDR combination without requiring additional interpolation processing. This extracts or eliminates the harmful zigzag artifacts at the sensor level through the asymmetric filter configuration, rather than requiring expensive post-processing memory and computational resources to correct them.

Inventive Principle:
Principle #2Taking out (Extraction)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The modified Bayer pattern effectively minimizes zigzag edges and enhances image sharpness and resolution by allowing for varying exposure times, thereby improving the dynamic range and image quality.

Implementation Method 1

each pixel includes a photodetector that transforms incident light photons into current signals

Methodology Applied
Scientific EffectPhotoelectric Effect: Photoelectric Effect

Implementation Method 2

a filter array including a plurality of red, green, and blue filter elements. Each filter element is in optical communication with a respective light sensitive element. Each red filter element is configured to transmit only red colored light, each green filter element is configured to transmit only green colored light, and each blue filter element is configured to transmit only blue colored light

Methodology Applied
Scientific EffectOptical filtering: Filter (optical)

Data Source

PatentUS8624997B2Alternative color image array and associated methods
Publication Date: 2014.01.07 OMNIVISION TECHNOLOGIES INC
  • US8624997B2 patent drawing
  • US8624997B2 patent drawing
  • US8624997B2 patent drawing

AI summary

An image sensor includes an array of light sensitive elements and a filter array. Each filter element is in optical communication with a respective light sensitive element. The image sensor receives filtered light having a repeating pattern. Light sensitive elements in at least two successive rows alternately receive light having a first color and a second color, and light sensitive elements in common columns of the successive rows alternately receive light having the first color and the second color. Light sensitive elements in at least two additional successive rows alternately receive light having a third and a fourth color, and light sensitive elements in common columns of the additional successive rows alternately receive light having the third color and the fourth color. Output values of pairs of sampled light sensitive elements receiving light of a common color and from successive rows are combined to generate a down-sampled image.