Image Signal Processor Saturated Pixel Compensation via Color Correlation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Image sensors with narrow dynamic ranges often result in inaccurate color representation due to saturation, leading to loss of detailed information as different color channels become saturated, causing distortion and loss of data.

Innovation Solution

An image signal processor that detects saturated pixels, performs correlation calculations between color channels, and uses non-saturated pixels for compensation to recover lost information through a color-transfer method, extending the dynamic range.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If the image sensor uses a narrow dynamic range to capture digital signals, then the device complexity is reduced, but the color accuracy and information completeness deteriorate due to saturation

Engineering Contradiction:
Improvedevice complexityVSAvoidloss of information
Core Design Contradiction:
Device complexityVSLoss of information

Solution Approach 1:

The patent introduces an intermediate processing stage (saturation compensation unit) that mediates between the saturated pixel data and the final output. This unit uses non-saturated pixels as reference data to compensate for saturated pixels, effectively recovering lost information without requiring a complete system redesign

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent changes the parameter state of saturated pixels by transforming their data values based on correlation calculations with non-saturated pixels. This parameter transformation recovers the original color information that was lost due to saturation, converting clipped values back to accurate color representations

Inventive Principle:
Principle #35Parameter changes

2Illumination intensity

If the image sensor captures high intensity light signals, then the brightness range is improved, but the color accuracy deteriorates due to channel saturation

Engineering Contradiction:
Improvebrightness rangeVSAvoidcolor accuracy
Core Design Contradiction:
Illumination intensityVSMeasurement precision

Solution Approach 1:

The patent implements a feedback mechanism where non-saturated pixels provide reference information that is used to correct saturated pixels. The saturation compensation unit continuously references non-saturated pixel data to restore accurate color values in saturated regions, creating a self-correcting system

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent exploits the asymmetric relationship between saturated and non-saturated pixels by using non-saturated pixels as reliable references to compensate for saturated ones. This asymmetric approach recognizes that non-saturated pixels contain valid information while saturated pixels require correction

Inventive Principle:
Principle #4Asymmetry

3Device complexity

If the digital signal is clipped to maximum code for saturated channels, then the device complexity is reduced, but the manufacturing precision of color data deteriorates

Engineering Contradiction:
Improvedevice complexityVSAvoidcolor data precision
Core Design Contradiction:
Device complexityVSManufacturing precision

Solution Approach 1:

The patent performs preliminary compensation operations on saturated pixels before final image processing. By detecting saturation early and applying compensation using non-saturated pixel data, the system prevents permanent loss of color precision in the digital signal processing pipeline

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS20240147081A1Image signal processor supporting compensation operation for saturated pixel and method of operating the same
Publication Date: 2024.05.02 SAMSUNG ELECTRONICS CO LTD
  • US20240147081A1 patent drawing
  • US20240147081A1 patent drawing
  • US20240147081A1 patent drawing

AI summary

An image signal processor configured to receive a digital signal from an image sensor includes a saturation detecting unit configured to classify each of a plurality of pixels, corresponding to the digital signal, as either a saturated pixel or a non-saturated pixel and to select a compensable pixel among the saturated pixels, a color processing unit configured to estimate channel values for each color for each of the plurality of pixels corresponding to the digital signal and to perform a correlation calculation between the channel values for each color, and a saturation compensation unit configured to select at least one color-transfer pixel, among the non-saturated pixels, based on the correlation calculation value between the channel values for each color and to perform a compensation operation on the compensable pixel based on the at least one color-transfer pixel. The image signal processor may recover information, lost due to saturation, through a color-transfer method using a correlation between colors. Accordingly, a dynamic range may be extended.