Image Processing Apparatus Temperature Gain Correction

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

When composing pixel signals from large and small pixels with different photoelectric conversion unit sizes, temperature-dependent characteristics can lead to image quality degradation, such as false colors, due to the lack of consideration for temperature-dependent characteristics.

Innovation Solution

An image processing apparatus that acquires pixel signals from both types of pixels, detects temperature, determines a composition gain based on temperature-dependent corrections, and multiplies the small-pixel signal by this gain to compose the images, maintaining linearity across varying luminance levels.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If pixels with different photoelectric conversion unit sizes are used to achieve different light reception sensitivities, then the ability to capture images with different luminance levels is improved, but temperature-dependent characteristics cause image quality degradation such as false colors

Engineering Contradiction:

Improvelight reception sensitivityVSAvoidimage quality

Core Design Contradiction:

Adaptability or versatilityVSReliability

Solution Approach 1:

The patent applies parameter changes by adjusting the composition gain based on temperature variations. The composition gain determination unit calculates a gain value that compensates for temperature-dependent characteristics, and the composition unit uses this gain to multiply the pixel signal from the small pixel, thereby maintaining image quality across different temperature conditions while preserving the ability to capture various luminance levels

Inventive Principle:

Principle #35Parameter changes

Solution Approach 2:

The patent implements feedback through the temperature detection unit that continuously monitors temperature and feeds this information to the composition gain determination unit. This feedback loop allows the system to dynamically adjust the composition gain in response to temperature changes, preventing image quality degradation from false colors while maintaining the versatility of different light reception sensitivities

Inventive Principle:

Principle #23Feedback

2Device complexity

If the composition gain is not adjusted for temperature variations, then the processing complexity is reduced, but linearity in pixel signal composition deteriorates causing false colors

Engineering Contradiction:

Improveprocessing complexityVSAvoidsignal linearity

Core Design Contradiction:

Device complexityVSManufacturing precision

Solution Approach 1:

The patent changes the composition gain parameter based on temperature conditions. The composition gain determination unit calculates temperature-specific gain values and provides them to the composition unit, which applies the appropriate gain to maintain signal linearity. This parameter adjustment ensures precise signal composition across temperature variations while keeping the overall processing architecture relatively simple

Inventive Principle:

Principle #35Parameter changes

3Reliability

If temperature-dependent characteristics are considered in pixel signal composition, then image quality is maintained, but additional processing steps are required

Engineering Contradiction:

Improveimage qualityVSAvoidprocessing steps

Core Design Contradiction:

ReliabilityVSDevice complexity

Solution Approach 1:

The patent applies preliminary action by pre-calculating composition gain values based on temperature conditions before the actual pixel signal composition occurs. The composition gain determination unit determines the appropriate gain values in advance based on temperature detection, and these pre-determined gains are then applied during the composition process. This approach maintains image quality while minimizing the complexity of real-time processing

Inventive Principle:

Principle #10Preliminary action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach effectively suppresses image quality degradation by ensuring linearity in pixel signal composition across different temperatures, preventing false colors and maintaining image quality in wide dynamic range images.

Implementation Method 1

a temperature detection unit that detects temperature

Methodology Applied

Scientific EffectTemperature detection:

Implementation Method 2

a pixel that includes a photoelectric conversion unit such as a PD (photodiode) having a large size

Methodology Applied

Scientific EffectPhotoelectric conversion: Photoelectric Effect

Data Source

PatentUS11750932B2Image processing apparatus, image processing method, and electronic apparatus

Publication Date: 2023.09.05 SONY SEMICON SOLUTIONS CORP

AI summary

An image processing apparatus includes a first acquisition unit that acquires a first pixel signal output from a first pixel, a second acquisition unit that acquires a second pixel signal output from a second pixel having a size smaller than that of the first pixel, a temperature detection unit that detects temperature; a composition gain determination unit that determines a composition gain corresponding to the detected temperature, and a composition unit that composes the first pixel signal and the second pixel signal multiplied by the composition gain.