Camera Module Crosstalk Calibration Across Color Temperatures

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current image signal processing technologies face limitations in calibrating image data at color temperatures other than 5100K, leading to difficulties in correcting image quality due to noise caused by crosstalk in Tetra sensors during the remosaic process.

Innovation Solution

A camera module with an image sensor and control logic that operates in two modes: one mode turns off calibration to generate crosstalk calibration data based on raw image data from a display, while the other mode turns on calibration to generate image data based on raw image data from both the display and exterior, allowing for calibration across various color temperatures.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If calibration is performed only at a fixed color temperature of 5100K, then the calibration process is simple and fast, but the image quality cannot be corrected at other color temperatures

Engineering Contradiction:
Improvecolor temperature adaptabilityVSAvoidcalibration system complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system performs preliminary calibration actions by capturing raw image data at multiple predetermined color temperatures (e.g., 5100K, 6504K, 9300K) and generates corresponding crosstalk calibration data in advance. This preliminary calibration data is stored and later applied according to the actual color temperature conditions, avoiding the need for real-time recalibration and reducing system complexity while maintaining broad adaptability

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system changes the calibration parameters by storing multiple sets of crosstalk calibration data corresponding to different color temperatures. When the actual color temperature is detected, the appropriate calibration data set is selected and applied, enabling the system to adapt to various color temperatures without requiring a single complex universal calibration model

Inventive Principle:
Principle #35Parameter changes

2Reliability

If calibration is turned on for all operations, then image quality is improved, but processing time increases due to continuous calibration operations

Engineering Contradiction:
Improveimage qualityVSAvoidprocessing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system performs calibration operations in advance by generating crosstalk calibration data during manufacturing or initial setup at multiple color temperatures. This preliminary calibration eliminates the need for real-time calibration computations during normal image capture, ensuring high image quality while minimizing processing time delays

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system dynamically adjusts the calibration operation mode based on actual usage conditions. Instead of continuously performing full calibration operations, the system selectively applies pre-generated crosstalk calibration data according to the detected color temperature, maintaining image quality while reducing unnecessary processing time

Inventive Principle:
Principle #15Dynamics

3Productivity

If calibration is turned off to save processing time, then processing speed increases, but crosstalk noise cannot be corrected

Engineering Contradiction:
Improveprocessing speedVSAvoidcrosstalk noise
Core Design Contradiction:
ProductivityVSObject-generated harmful factors

Solution Approach 1:

The system performs the computationally intensive calibration operations in advance during manufacturing or initial setup, generating crosstalk calibration data that captures the specific crosstalk characteristics of each sensor. This preliminary action removes the burden of real-time calibration computation, enabling fast processing speed while maintaining the ability to correct crosstalk noise through applied calibration data

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system creates copies of calibration data for different color temperatures and applies the appropriate copy based on current conditions. This allows the system to use pre-computed calibration information without performing expensive real-time calculations, maintaining both high processing speed and effective crosstalk correction

Inventive Principle:
Principle #26Copying

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables effective calibration and improvement of image quality across different color temperatures by generating and applying crosstalk calibration data, reducing distortion and enhancing image quality.

Implementation Method 1

An image sensor included in a smartphone, a tablet personal computer (PC), a digital camera, etc. converts light reflected from an external object into an electrical signal to obtain image information about the external object.

Methodology Applied
Scientific EffectPhotoelectric Effect: Photoelectric Effect

Data Source

PatentUS20240073548A1Camera module for calibrating image data, operating method of camera module, and electronic device including camera module
Publication Date: 2024.02.29 SAMSUNG ELECTRONICS CO LTD
  • US20240073548A1 patent drawing
  • US20240073548A1 patent drawing
  • US20240073548A1 patent drawing

AI summary

Disclosed is a camera module which includes an image sensor including pixels outputting raw image data based on light incident from at least one of a display or the exterior, and control logic receiving the raw image data and generating image data. In a first operation mode, the control logic turns off calibration of the image sensor, receives first raw image data, which are based on the light incident from the display, from the image sensor, and generates crosstalk calibration data based on first output values included in the first raw image data. In a second operation mode, the control logic turns on the calibration of the image sensor, receives second raw image data, which are based on light incident from the display and the exterior, from the image sensor, and generates the image data based on second output values included in the second raw image data.