Image Signal Processing Bad Pixel Interpolation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Image sensors often produce distorted results during interpolation due to the inclusion of bad pixels, as neighboring pixels used for interpolation may also be bad, leading to inaccurate data representation.

Innovation Solution

A method is introduced to determine whether input pixel data is from bad or normal pixels, performing interpolation only using normal pixel data to generate accurate image data, and combining it with input pixel data, while also applying de-mosaicing to produce RGB data for display.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If interpolation is performed using neighboring pixel data including bad pixels, then the interpolation process can be simplified, but the image quality deteriorates due to distorted results from bad pixel inclusion

Engineering Contradiction:
Improveinterpolation process complexityVSAvoidimage quality
Core Design Contradiction:
Device complexityVSManufacturing precision

Solution Approach 1:

The patent extracts and removes bad pixel data from the interpolation process. A bad pixel determination unit identifies bad pixels, and the interpolation unit excludes their data when performing interpolation, using only normal pixel data to generate accurate interpolated values for bad pixel locations.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent segments the pixel data into two categories: normal pixel data and bad pixel data. This segmentation allows the system to selectively process different types of data through different pathways, with normal pixel data used for interpolation and bad pixel data excluded, thereby resolving the contradiction between simplicity and quality.

Inventive Principle:
Principle #1Segmentation

2Quantity of substance

If bad pixel data is included in interpolation, then more data is available for processing, but the reliability of the resulting image data decreases

Engineering Contradiction:
Improveavailable pixel dataVSAvoidimage data accuracy
Core Design Contradiction:
Quantity of substanceVSReliability

Solution Approach 1:

The patent converts the harmful effect of bad pixels into a beneficial process by systematically identifying and excluding them. The bad pixel determination unit detects bad pixels, and this information is used to guide the interpolation unit to exclude only the necessary bad pixel data while maintaining sufficient normal pixel data for accurate interpolation, thus improving reliability without unnecessarily reducing data quantity.

Inventive Principle:
Principle #22Blessing in disguise (Convert harm into benefit)

3Manufacturing precision

If interpolation uses only normal pixel data excluding bad pixels, then image accuracy is improved, but the processing complexity increases

Engineering Contradiction:
Improveinterpolation accuracyVSAvoidprocessing complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent applies preliminary action by performing bad pixel determination before the interpolation process. The bad pixel determination unit identifies and flags bad pixels in advance, so that when the interpolation unit processes the data, it can efficiently exclude only the predetermined bad pixel data without complex runtime decisions, thereby achieving high accuracy with manageable processing complexity.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS8836827B2Method of processing image signals and related method of image capture
Publication Date: 2014.09.16 SAMSUNG ELECTRONICS CO LTD
  • US8836827B2 patent drawing
  • US8836827B2 patent drawing
  • US8836827B2 patent drawing

AI summary

A method of processing image signals comprises determining whether each of multiple units of input pixel data received from an image sensor is bad pixel data generated by a bad pixel of the image sensor or normal pixel data generated by a normal pixel of the image sensor, and performing interpolation to generate image data corresponding to the bad pixel using only normal pixel data and omitting bad pixel data.