RGB-IR Image Processing for Full-Resolution Low-Light Vision
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
RGB-IR sensors in imaging systems face a resolution drop in low light conditions due to the abrupt switch from RGB to IR pixel usage, leading to lower quality images and reduced machine vision performance.
Innovation Solution
A dynamic image processing pipeline that adjusts IR subtraction and color correction factors based on scene detection values, maintaining full resolution by leveraging both RGB and IR pixel data across varying lighting conditions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Illumination intensity
If the system switches from RGB sensors to IR sensors when visible light diminishes, then the system can capture images in low light conditions, but the image resolution drops to 1/4 of the original resolution
Solution Approach 1:
The patent combines data from both RGB sensors and IR sensors to generate output images. By merging the color information from RGB sensors with the luminance information from IR sensors, the system maintains full resolution while enabling low light capture. The processing pipeline integrates both sensor types rather than switching between them, resolving the resolution drop issue.
Solution Approach 2:
The patent implements a dynamic processing pipeline that adjusts the contribution of RGB and IR sensor data based on lighting conditions. The system dynamically controls the blending ratio and processing parameters according to scene brightness, allowing it to adapt to varying illumination levels while maintaining optimal image quality and resolution throughout the transition from day to night conditions.
2Illumination intensity
If the system uses only IR sensor pixels in low light conditions, then the system can function in darkness, but the image quality and usefulness are reduced
Solution Approach 1:
The patent merges RGB and IR sensor data to produce output images that maintain full resolution and high quality. By combining the color information from RGB sensors with the luminance information from IR sensors, the system ensures reliable image quality in low light conditions while avoiding the degradation that would result from using IR sensors alone.
Solution Approach 2:
The patent maintains continuous use of all sensor pixels (both RGB and IR) across all lighting conditions rather than discontinuing RGB sensor usage. This continuous utilization of all available sensor data ensures that the system always operates at full resolution and maintains high image quality, regardless of whether the environment is bright or dark.
3Adaptability or versatility
If the system has a visible light threshold for switching between RGB and IR data, then the system can adapt to lighting conditions, but the transition causes abrupt resolution changes and quality loss
Solution Approach 1:
The patent implements a dynamic processing pipeline that continuously adjusts the blending ratio and processing parameters based on scene brightness. This dynamic approach allows smooth transitions between different lighting conditions without abrupt changes, as the system gradually shifts the contribution of RGB and IR sensor data rather than making sudden switches at fixed thresholds.
Solution Approach 2:
The patent maintains continuous operation of both RGB and IR sensor processing pipelines simultaneously, allowing for smooth blending and transition between sensor types. This continuous dual-processing approach eliminates the abrupt resolution changes that would occur with threshold-based switching, as both sensor data streams are always available and can be smoothly blended according to lighting conditions.
Data Source
AI summary
A system, such as for use in an automobile, is configured to process image data that includes infrared values and visible light values (e.g., data generated by a red, green, blue, infrared (RGB-IR) sensor). The system determines how to blend IR data and visible light data together to generate optimal images according to current light levels. In embodiments, the system computes a scene detection value for the image data based on a comparison between the infrared values and the visible light values. The system can then determine an amount of infrared correction, a color correction factor, a color saturation factor, etc. to apply to the image data. The system then transforms the image data based on the amount of infrared correction, the color correction factor, the color saturation factor, etc. The transformed image data includes more information for low light scenes than is traditionally available, and thus produces higher quality images in embodiments.