Panchromatic Color Sensor Interpolation for Motion Blur Reduction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current electronic imaging systems face challenges in reducing motion blur in low-light conditions without increasing noise, adding complexity or cost, and without the use of photographic flashes or specialized hardware.

Innovation Solution

A method involving processors to interpolate between panchromatic and color pixels to produce full-resolution images, using color correction weights to modify the color image and reduce blur, without the need for long exposure times or additional memory.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Illumination intensity

If exposure time is lengthened to gather sufficient light in low-light conditions, then image brightness is improved, but motion blur increases

Engineering Contradiction:
Improveimage brightnessVSAvoidmotion blur
Core Design Contradiction:
Illumination intensityVSObject-affected harmful factors

Solution Approach 1:

The sensor array is segmented into two functional zones: a first region with color filter pixels for capturing color information and a second region with panchromatic pixels for capturing brightness information. This segmentation allows each region to be optimized for its specific function, with the panchromatic region using shorter exposure times to minimize motion blur while the color region captures color data, ultimately producing a composite image that combines the advantages of both approaches.

Inventive Principle:
Principle #1Segmentation

2Object-affected harmful factors

If exposure time is shortened to reduce motion blur, then motion blur is reduced, but image brightness decreases and noise increases

Engineering Contradiction:
Improvemotion blurVSAvoidimage brightness
Core Design Contradiction:
Object-affected harmful factorsVSIllumination intensity

Solution Approach 1:

The patent merges the output signals from the color filter pixels and panchromatic pixels through signal processing to generate a final composite image. The panchromatic pixels, which captured brightness information during a shorter exposure time with less motion blur, are combined with the color information from color filter pixels, producing an image that achieves both reduced motion blur and adequate brightness without requiring extremely long exposure times.

Inventive Principle:
Principle #5Merging (Combining)

3Object-affected harmful factors

If a photographic flash is used to supplement light and reduce motion blur, then motion blur is reduced, but device complexity and cost increase

Engineering Contradiction:
Improvemotion blurVSAvoiddevice complexity
Core Design Contradiction:
Object-affected harmful factorsVSDevice complexity

Solution Approach 1:

The imaging system uses its own sensor array, specifically the panchromatic pixels, to capture brightness information during the exposure period. This self-service approach eliminates the need for external lighting sources like photographic flashes, as the panchromatic region provides the necessary brightness data independently, reducing device complexity and cost while still enabling reduced motion blur through shorter exposure times.

Inventive Principle:
Principle #25Self-service

4Object-affected harmful factors

If specialized hardware is used to monitor electron collection rates and stop exposure, then motion blur is reduced, but device complexity and cost increase

Engineering Contradiction:
Improvemotion blurVSAvoiddevice complexity
Core Design Contradiction:
Object-affected harmful factorsVSDevice complexity

Solution Approach 1:

Instead of using specialized hardware to monitor and stop exposure dynamically, the patent employs a simpler approach where the panchromatic pixels continuously capture brightness information throughout the exposure period. This partial action approach, where the panchromatic region operates independently with a shorter effective exposure time, reduces motion blur without requiring complex real-time monitoring and exposure control hardware.

Inventive Principle:
Principle #16Partial or excessive action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enables the production of improved full-resolution color images with reduced motion blur using conventional sensors, without increased noise, cost, or complexity, and without requiring additional memory or specialized hardware.

Implementation Method 1

Each pixel is typically provided with either a red, green, or blue filter, as described by Bayer in commonly assigned U.S. Pat. No. 3,971,065 issued Jul. 20, 1976, so that a color image can be produced. Regardless of electronic technology employed, e.g., CCD or CMOS, the pixel acts as a bucket in which photoelectrons are accumulated in direct proportion to amount of light that strikes the pixel during the capture of an image by the electronic imaging system.

Methodology Applied
Scientific EffectPhotoelectric Effect: Photoelectric Effect

Data Source

PatentUS8224082B2CFA image with synthetic panchromatic image
Publication Date: 2012.07.17 OMNIVISION TECHNOLOGIES INC
  • US8224082B2 patent drawing
  • US8224082B2 patent drawing
  • US8224082B2 patent drawing

AI summary

A method for forming a final digital color image with reduced motion blur including of a processor for providing images having panchromatic pixels and color pixels corresponding to at least two color photo responses, interpolating between the panchromatic pixels and color pixels to produce a panchromatic image and a full-resolution color image to produce a full-resolution synthetic panchromatic image from the full-resolution color image; and developing color correction weights in response to the synthetic panchromatic image and the panchromatic image; and using the color correction weights to modify the full-resolution color image to provide a final color digital image.