RGBIr Sensor Crosstalk Correction Algorithm
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional three-color (RGB) sensors experience low sensitivity in low light environments and suffer from color washout phenomena due to infrared (IR) crosstalk interference, especially in hybrid RGBIr sensors used for applications like face recognition and depth identification, where the IR cutoff filter is not used, leading to color shift issues.
Innovation Solution
An image processing device and method that calculates crosstalk response values for primary colors and IR rays, subtracts interference to obtain real response values, and adjusts brightness using an IR active light source, compensating for lens shifts and hardware dark current effects to restore accurate color performance and reduce color shift.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If an infrared (IR) cutoff filter is used in traditional RGB sensors, then color accuracy is improved, but device complexity and cost increase
Solution Approach 1:
The patent extracts and removes the harmful IR crosstalk component from the RGB sensor output through mathematical processing. By calculating crosstalk response values and subtracting interference responses, the system eliminates the need for physical IR cutoff filters while maintaining color accuracy.
Solution Approach 2:
The patent replaces the mechanical/optical IR cutoff filter with a computational algorithm. Instead of using physical filtering components that increase device complexity, the system uses software-based crosstalk subtraction to achieve the same color accuracy improvement.
2Measurement precision
If an infrared (IR) cutoff filter is used in traditional RGB sensors, then color accuracy is improved, but manufacturing cost increases
Solution Approach 1:
The patent extracts and removes the harmful IR crosstalk component from the RGB sensor output through mathematical processing. By calculating crosstalk response values and subtracting interference responses, the system eliminates the need for physical IR cutoff filters while maintaining color accuracy.
Solution Approach 2:
The patent replaces the mechanical/optical IR cutoff filter with a computational algorithm. Instead of using physical filtering components that increase device complexity, the system uses software-based crosstalk subtraction to achieve the same color accuracy improvement.
3Illumination intensity
If IR pixels are used to absorb light in hybrid RGBIr sensors, then sensitivity in low light environments is improved, but color accuracy deteriorates due to IR crosstalk interference
Solution Approach 1:
The patent converts the harmful IR crosstalk effect into a beneficial solution by using the IR sensor data to calculate and subtract the crosstalk interference from RGB channels. The IR information that causes color accuracy problems is transformed into a tool for correcting those same problems.
Solution Approach 2:
The patent uses feedback from the IR sensor channels to correct the RGB color information. By calculating crosstalk response values based on IR data and subtracting them from RGB outputs, the system continuously compensates for color accuracy degradation caused by IR interference.
4Measurement precision
If the mechanical IR cutoff filter is used, then color accuracy is maintained, but the filter is susceptible to damage due to excessive use
Solution Approach 1:
The patent replaces the mechanical/optical IR cutoff filter with a computational algorithm. Instead of using physical filtering components that are susceptible to damage, the system uses software-based crosstalk subtraction that has no moving parts or physical degradation.
Solution Approach 2:
The patent enables the sensor system to self-correct for IR crosstalk interference through computational processing. The system automatically calculates and subtracts crosstalk responses without requiring external mechanical components, making the solution inherently more reliable and maintenance-free.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The solution effectively reduces IR crosstalk interference, corrects color deviations, enhances image brightness, and improves color accuracy in low light conditions by compensating dynamic ranges and eliminating hardware-related effects, thereby addressing the color shift and washout issues in RGB images.
Implementation Method 1
a sensor including a plurality of pixels, each of the pixels sensing three primary colors and an infrared ray of an image
Data Source
AI summary
An image processing method, applied to a device including a sensor and a processor connected to the sensor, the sensor including a plurality of pixels, in which each of the pixels senses three primary colors and an infrared ray of an image, the processor executing the method including: calculating a real response value of the infrared ray without a crosstalk interference from the three primary colors according to the crosstalk interference from the three primary colors to the infrared ray; calculating real response values of the three primary colors without a crosstalk interference from the infrared ray according to the crosstalk interference of the real response value from the infrared ray to the three primary colors; and increasing a brightness of the image according to a brightness of the real response value of the infrared ray and the real response values of the three primary colors.