Image Sensor Data Processing via Single-Pass Demosaicing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for processing color video signals from solid state image sensors require multiple passes through image data, leading to increased computational load and memory access, which limits speed and accuracy.

Innovation Solution

A method that performs range scaling and demosaicing in a single pass, followed by matrixing, range clipping, and gamma correction in another single pass, with optional white balance statistics gathering and correction, using look-up tables to reduce computational complexity and memory access.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If multiple passes are used to process image data, then processing completeness is improved, but computational load and memory access increase

Engineering Contradiction:
Improveprocessing completenessVSAvoidcomputational load
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent combines multiple image processing operations (range scaling, demosaicing, matrixing, range clipping, and gamma correction) into a single pass through the image data. This merging of operations eliminates the need for multiple sequential passes, thereby reducing computational load and memory access while maintaining processing completeness through a unified algorithmic approach that performs all necessary transformations in one traversal.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent performs preliminary computations during the single pass, including calculating white balance statistics from a sample of pixels and preparing lookup tables for range scaling and gamma correction. These preliminary actions are completed before the main processing pass, allowing the subsequent single pass to execute all operations efficiently without requiring multiple traversals of the complete image data.

Inventive Principle:
Principle #10Preliminary action

2Speed

If hardware processing is used, then processing speed is improved, but circuit complexity and silicon area increase

Engineering Contradiction:
Improveprocessing speedVSAvoidcircuit complexity
Core Design Contradiction:
SpeedVSDevice complexity

Solution Approach 1:

The patent merges multiple processing stages into a single computational pass, which can be efficiently implemented in hardware with reduced complexity. By combining range scaling, demosaicing, matrixing, range clipping, and gamma correction into one unified algorithmic flow, the hardware implementation requires fewer separate circuit blocks and interconnections, thereby reducing overall circuit complexity and silicon area while maintaining high processing speed.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent performs preliminary computations such as white balance statistics gathering and lookup table generation before the main processing operation. These preliminary actions can be pre-computed or cached, allowing the main hardware processing path to be simplified and faster, as it only needs to execute the optimized single-pass algorithm without repeated data traversals or complex conditional logic.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If software processing is used, then image quality is improved, but computational power requirements increase

Engineering Contradiction:
Improveimage qualityVSAvoidcomputational power
Core Design Contradiction:
Measurement precisionVSPower

Solution Approach 1:

The patent combines multiple image processing operations into a single pass algorithm that can be efficiently implemented in software. This merging reduces the total number of computational operations required, thereby lowering computational power requirements while maintaining high image quality through the unified processing approach that performs range scaling, demosaicing, matrixing, range clipping, and gamma correction in one efficient traversal.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent performs preliminary computations such as white balance statistics gathering from sampled pixels and prepares lookup tables for range scaling and gamma correction before the main processing. These preliminary actions reduce the computational burden during the main processing pass, allowing software implementations to achieve high image quality with lower overall computational power requirements by avoiding repeated data traversals and operations.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS7791615B2Processing of image data
Publication Date: 2010.09.07 STMICROELECTRONICS (RES & DEV) LTD
  • US7791615B2 patent drawing
  • US7791615B2 patent drawing
  • US7791615B2 patent drawing

AI summary

A method of processing image data produced by a solid state image sensor that is overlaid with a color filter array is based on range scaling, demosaicing, matrixing, range clipping and gamma correction being performed in two data collection passes. The demosaicing can be performed with pixels grouped in 2×2 blocks, or quads.