Camera Array Image Processing Using Depth and Color Data
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing camera array technologies face challenges in accurately calculating corresponding points between images due to redundant data from cameras with the same color information and differing pixel values, leading to reduced accuracy in depth calculation and color reproduction.
Innovation Solution
An image processing device that uses a combination of first and second color information calculation units to enhance the accuracy of corresponding point search and depth calculation, employing multiple filter sets in a camera array to reduce redundancy and improve color information acquisition.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If cameras with the same color filter are used in the camera array, then the color information is consistent across cameras, but redundant data is generated and processing efficiency is reduced
Solution Approach 1:
The patent segments the camera array into groups with different color filter configurations. Specifically, some cameras use standard RGB filters while others use alternative filter sets (e.g., different spectral characteristics or filter combinations). This segmentation allows each camera to capture different color information, reducing redundancy while maintaining consistency within each camera group. The segmented approach enables more efficient processing by eliminating duplicate color data across the entire array.
2Loss of information
If cameras with different color filters are used in the camera array, then more color information on the subject is acquired, but the pixel values differ between cameras reducing corresponding point search accuracy
Solution Approach 1:
The patent introduces a color space conversion process as an intermediary step between capturing images with different filters and performing corresponding point search. All images are converted to a common reference color space (e.g., XYZ or LAB) before matching. This intermediary conversion enables accurate corresponding point search despite the original filters being different, while still preserving the benefit of diverse color information capture. The conversion acts as a bridge that reconciles the difference in filter characteristics.
Solution Approach 2:
The patent changes the color space parameters of images captured with different filters to a unified reference frame. By applying color space transformation (changing the parameter system from camera-specific RGB to a standard color space), the patent enables accurate comparison and matching of corresponding points across cameras with different spectral characteristics, while maintaining the advantage of acquiring diverse color information.
3Ease of operation
If all cameras use the same color filter configuration, then corresponding point search is easier, but redundant data increases and processing time is wasted
Solution Approach 1:
The patent segments the camera array into functional groups with different filter configurations. Cameras within each segment share the same filter type, maintaining ease of corresponding point search within segments. Different segments use different filters to capture diverse color information. This segmentation strategy reduces overall processing time by eliminating redundant comparisons across the entire array while preserving matching simplicity within homogeneous groups.
Data Source
AI summary
To enhance the accuracy of the search of a corresponding point in a plurality of sheets of images photographed by a camera array and to acquire more pieces of color information on a subject. First color information is calculated from pixel values of the plurality of pieces of photographed image data photographed by the camera array, and the first color information is used to calculate a corresponding point between images indicated by the plurality of pieces of photographed image data. The calculated corresponding point is used to calculate information on the depth of the subject in the image indicated by the photographed image data. Second color information that is used for reproducing the color of the subject faithfully is calculated from the pixel values of the plurality of pieces of photographed image data. The calculated depth information and second color information are used to combine the plurality of photographed images.