Multi-Sensor Image Color Conversion for White Point Consistency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Image sensors in a device capture images with different white points due to variations in resolution, focal length, field of view, and manufacturing tolerances, leading to inconsistent color representation across multiple sensors.
Innovation Solution
An image acquisition apparatus and method that applies common illumination information to multiple image sensors within a device, using a processor to estimate and overlay individual illumination information to achieve color consistency through techniques like deep-learning networks and image registration.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If multiple image sensors with different resolutions, focal lengths, and fields of view are used in one device, then the device can capture images with different characteristics and perspectives, but the images output from the image sensors have different white points and represent different colors
Solution Approach 1:
The patent applies parameter changes by adjusting the white balance parameters of each image sensor based on its specific characteristics (resolution, focal length, field of view). The processor calculates individual white balance correction parameters for each sensor to compensate for their inherent differences, thereby achieving color consistency across multiple sensors with varying specifications.
Solution Approach 2:
The patent implements feedback by using the captured images themselves to determine and adjust the white balance settings. The processor analyzes the images from each sensor and uses this information to calculate the appropriate white balance correction, creating a closed-loop system that automatically adapts to each sensor's characteristics and ensures color accuracy.
2Manufacturing precision
If white balance is adjusted individually for each image sensor, then color accuracy for each sensor is improved, but the processing complexity and time required increases
Solution Approach 1:
The patent applies universality by implementing a single, unified white balance processing algorithm that can handle multiple image sensors with different characteristics. The processor uses a general approach that automatically adapts to each sensor's specific parameters, eliminating the need for separate, sensor-specific processing pipelines and reducing overall system complexity.
Solution Approach 2:
The patent applies preliminary action by pre-calculating or pre-determining the white balance correction parameters based on the known characteristics of each image sensor. This allows the processing to be more efficient during actual image capture, as the correction framework is already established and ready to be applied systematically to each sensor's output.
3Quantity of substance
If images from multiple image sensors are captured simultaneously, then the device can capture comprehensive scene information, but the images have different white points due to manufacturing tolerances and sensor characteristics
Solution Approach 1:
The patent applies parameter changes by dynamically adjusting the white balance parameters for each sensor based on its specific characteristics and the captured scene. The processor modifies the color parameters of each sensor's output image to ensure they all represent the same white point, thereby maintaining color consistency while preserving the comprehensive scene information captured by multiple sensors.
Solution Approach 2:
The patent applies merging by combining the white balance correction processes for multiple sensors into a unified processing pipeline. The processor integrates the color correction operations across all sensors, ensuring that despite their different characteristics, the final output images from all sensors are color-matched and consistent with each other.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
An image acquisition apparatus includes: a sensor unit including a plurality of first image sensors that are based on a wavelength band of 380 nm to 780 nm; and at least one processor. The at least one processor is configured to: acquire common illumination information from an image output from at least one of the plurality of first image sensors, and color-convert an image output from each of the plurality of first image sensors based on the common illumination information.