Edge Directed Demosaicing Using Interpolation Error Minimization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing demosaicing methods in digital cameras introduce color artifacts and require significant processing time, especially when determining interpolation directions in images with sharp edges.

Innovation Solution

A non-linear demosaicing algorithm that calculates interpolation errors in East-West and North-South directions to determine the edge direction with the minimum error, allowing for efficient interpolation of missing pixel values using only shifts and additions, reducing computational complexity.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If linear interpolation is used to interpolate missing pixel values, then the processing is simple and fast, but color artifacts appear around sharp edges

Engineering Contradiction:
Improveprocessing speedVSAvoidedge reconstruction accuracy
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The patent applies dynamics by making the interpolation direction adaptive rather than fixed. The algorithm dynamically selects between horizontal and vertical interpolation directions based on local edge detection results, allowing the processing method to change according to the specific characteristics of each region in the image, thus resolving the contradiction between simple processing and accurate edge reconstruction

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent applies local quality by using different interpolation strategies for different regions of the image. Instead of applying a uniform interpolation method across the entire image, the algorithm detects local edge orientations and applies interpolation along the detected edge directions, ensuring high-quality edge reconstruction in each local region while maintaining overall processing efficiency

Inventive Principle:
Principle #3Local quality

2Manufacturing precision

If gradient-based edge detection is used to determine interpolation direction, then edge reconstruction improves, but processing time increases significantly

Engineering Contradiction:
Improveedge reconstruction accuracyVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent applies taking out by extracting only the essential information needed for edge detection - specifically using simple gradient calculations in horizontal and vertical directions rather than complex multi-directional gradient analysis. This extraction of key features maintains edge reconstruction accuracy while dramatically reducing processing time by eliminating unnecessary computational steps

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent applies partial action by performing gradient calculations only in the two primary directions (horizontal and vertical) rather than computing gradients in all possible directions. This partial computation approach provides sufficient information for determining interpolation direction along sharp edges while avoiding the excessive processing time that would result from omnidirectional gradient analysis

Inventive Principle:
Principle #16Partial or excessive action

3Manufacturing precision

If adaptive horizontal or vertical interpolation decisions are made, then color artifacts are reduced, but computational complexity increases

Engineering Contradiction:
Improvecolor accuracyVSAvoidalgorithm complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent applies segmentation by dividing the image processing into distinct stages: first detecting horizontal gradients, then detecting vertical gradients, comparing the two, and finally selecting the appropriate interpolation direction. This segmentation of the adaptive interpolation process into discrete, simple steps reduces algorithmic complexity while maintaining the ability to reduce color artifacts through direction-aware interpolation

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS7525584B2Fast edge directed demosaicing
Publication Date: 2009.04.28 ENGHOUSE INTERACTIVE
  • US7525584B2 patent drawing
  • US7525584B2 patent drawing
  • US7525584B2 patent drawing

AI summary

An edge directed demosaicing algorithm for determining an edge direction from an input color filter array (CFA) sampled image is disclosed. Aspects of the present invention include calculating for a current missing green pixel, interpolation errors in an East-West (EW) direction at known neighboring green pixels, and averaging the EW interpolation errors to obtain an EW error. Interpolation errors are also calculated for the current missing green pixel in a North-South (NS) direction at known neighboring green pixels, and the NS interpolation errors are averaged to obtain a NS error. An EW or NS direction indicated by a minimum of the EW error and the NS error is then selected as the edge direction.