IR Crosstalk Compensation in RGB-IR Image Processing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional RGB-IR sensor technologies fail to effectively compensate for infrared (IR) crosstalk, leading to color washout and unnatural image distortions due to uniform compensation across all pixels, which does not account for non-uniform IR influence across the image frame.

Innovation Solution

A grid-based image compensation method that divides the image into blocks, generates initial compensation coefficients for each block, adjusts these coefficients based on adjacent blocks, and interpolates to achieve personalized IR crosstalk compensation, using calibrated parameters to dynamically adjust R, G, and B values.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If uniform compensation coefficients are applied to all pixels in the frame, then the compensation process is simple and fast, but the color accuracy and naturalness of the image deteriorate due to non-uniform IR influence

Engineering Contradiction:
Improvecompensation processing speedVSAvoidcolor accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The image frame is divided into multiple blocks (e.g., 4x4 grid), and each block is assigned its own compensation coefficients calculated based on local IR values. This segmentation allows the system to handle different regions with different compensation parameters, improving color accuracy while maintaining reasonable processing complexity through localized rather than fully pixel-level processing.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different compensation coefficients are applied to different blocks within the image frame based on their local IR characteristics. The compensation amount varies locally across the image to match the non-uniform IR influence, ensuring that each region is compensated appropriately for its specific conditions rather than applying a single uniform compensation to the entire frame.

Inventive Principle:
Principle #3Local quality

2Device complexity

If rough compensation by deducting a fixed proportion of IR value is applied, then the compensation process is simple, but over-compensation and color distortion occur

Engineering Contradiction:
Improvecompensation algorithm complexityVSAvoidcompensation accuracy
Core Design Contradiction:
Device complexityVSManufacturing precision

Solution Approach 1:

The compensation coefficients are dynamically calculated based on the actual IR values in each block rather than using fixed predetermined values. The coefficients k1, k2, and k3 for each block are derived from the relationship between IR values and RGB channel values, allowing the compensation amount to adapt to the actual IR contamination level in each region and preventing over-compensation.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The system automatically calculates the compensation coefficients based on the image data itself without requiring external calibration data or manual intervention. The IR values and RGB values from the captured image are used directly to compute the appropriate compensation parameters, making the system self-adjusting and eliminating the need for separate calibration procedures.

Inventive Principle:
Principle #25Self-service

3Ease of operation

If the same compensation amount is applied to all blocks, then the processing is uniform and simple, but unnatural color shifts occur in regions with different IR influence

Engineering Contradiction:
Improveprocessing uniformityVSAvoidimage naturalness
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The image is divided into multiple blocks that can be processed with different compensation parameters. This segmentation maintains processing uniformity within each block while allowing variation between blocks, balancing the ease of uniform processing with the need for region-specific compensation to preserve image naturalness.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Each block receives compensation tailored to its local IR characteristics rather than a uniform compensation across the entire image. The compensation coefficients are calculated separately for each block based on local IR values, ensuring that regions with different IR influence (such as different distances from the light source) are compensated appropriately to maintain overall image naturalness.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS10943332B2Image adjustment method and associated image processing circuit for image quality improvement
Publication Date: 2021.03.09 REALTEK SEMICON CORP
  • US10943332B2 patent drawing
  • US10943332B2 patent drawing
  • US10943332B2 patent drawing

AI summary

An image adjustment method includes: receiving an image, and retrieving R, G and B values and an infrared ray (IR) value from the image; dividing the image into a plurality of blocks; generating initial compensation coefficients respectively corresponding to the R, G, B and IR values for each block within the blocks; and performing following operations upon each block within the blocks: adjusting initial compensation coefficients of a current block according to a plurality of adjacent blocks next to the current block, in order to generate adjusted compensation coefficients of the current block; and using the adjusted compensation coefficients of the current block to perform IR crosstalk compensation upon the current block.