Synchronizing Image Signal Processing Across Multiple Sensors
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Designing head-mounted devices with multiple cameras poses a challenge in ensuring that images captured by these cameras have synchronized settings, as mismatched settings can cause visual discomfort for the user.
Innovation Solution
The method involves capturing images using multiple image sensors with different fields of view, determining occlusion by comparing thumbnail, brightness, color, and focus information, and synchronizing processing parameters such as auto exposure, white balance, and tone mapping using image statistics collection and signal processing blocks to harmonize the images displayed to the user.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of stationary object
If multiple image sensors are used to capture video feed with different fields of view, then the coverage area and functionality are improved, but image setting consistency and visual comfort deteriorate
Solution Approach 1:
The patent merges image statistics from multiple image sensors by collecting and combining exposure, white balance, and tone mapping statistics from different cameras. The system determines occlusion status and selectively combines statistics from non-occluded sensors to generate unified image signal processing control parameters, ensuring consistent image settings across multiple sensors with different fields of view.
2Area of stationary object
If multiple image sensors with different fields of view are used, then the field of view coverage is improved, but visual comfort deteriorates due to mismatched settings
Solution Approach 1:
The patent implements feedback mechanisms where image statistics from multiple sensors are continuously collected, compared, and analyzed. The system determines occlusion status based on feedback from thumbnail, brightness, color, and focus information comparisons. This feedback loop enables dynamic adjustment of image signal processing control parameters to maintain visual comfort across different fields of view.
3Measurement precision
If image statistics from multiple sensors are combined, then image processing accuracy is improved, but processing complexity increases
Solution Approach 1:
The patent segments the image processing task by dividing it into distinct control parameters: exposure control, white balance control, and tone mapping control. Each parameter is processed separately using dedicated circuitry and algorithms. This segmentation allows the system to handle multiple image sensors independently for each parameter type, improving processing accuracy while managing complexity through modular architecture.
Data Source
AI summary
An apparatus can include a first image sensor having a first field of view (FOV) and configured to capture a first image, a second image sensor having a second FOV and configured to capture a second image, an image statistics collection subsystem configured to gather first image statistics information associated with the first image and to gather second image statistics information associated with the second image, a disparity detection subsystem configured to compare the first image statistics information with the second image statistics information, and image signal processing blocks configured to synchronize processing of the first and second images based on the comparison of the first image statistics information with the second image statistics information. Processing of the first and second images can involve using one or more combined image signal processing control parameters based on image statistics information within an overlapping FOV and/or a within a total FOV.