Camera Array Depth Map Fusion for Mobile Imaging
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current mobile phone camera technologies face challenges in reducing camera size without compromising image quality, and they lack the capability to effectively fuse images from a camera array, which is essential for improving resolution and performance in smaller devices.
Innovation Solution
A system and method for fusing images from a camera array by using multiple cameras with lenses arranged to capture images in different color channels, processing these images using disparity maps to correct for spatial disparities, and combining them into a multi-channel color image, thereby reducing the physical size of the camera while maintaining image quality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If multiple cameras with lenses arranged in an array are used to capture images in different color channels, then image resolution and quality are improved, but device complexity increases
Solution Approach 1:
The patent combines multiple cameras with different color channel lenses into a single integrated camera array unit. Each camera captures a specific color channel (red, green, blue) and the signals are merged through image processing to generate a complete color image, achieving high resolution without requiring separate physical cameras for each channel
Solution Approach 2:
The camera array system performs multiple functions simultaneously - capturing different color channels, generating depth information, and producing fused images - all through a single integrated structure. This multi-functionality reduces the need for separate devices while maintaining high image quality
2Measurement precision
If images from multiple cameras are fused using disparity maps, then spatial accuracy is improved, but processing time increases
Solution Approach 1:
The system pre-calculates disparity maps and depth information during the image capture process rather than performing these calculations afterward. By preparing the spatial transformation data in advance, the actual image fusion process is accelerated while maintaining high spatial accuracy
Solution Approach 2:
The patent introduces disparity maps as an intermediary data structure that bridges the multiple camera inputs and the final fused image. This intermediate representation enables efficient spatial alignment and reduces the computational complexity of directly fusing multiple color channel images
3Measurement precision
If a camera array is used to capture multiple color channels, then image quality is improved, but the physical size of the camera increases
Solution Approach 1:
The patent implements a nested camera array structure where multiple small cameras with individual lenses are arranged in a compact grid pattern. Each camera is nested within the overall array structure, allowing the system to capture multiple color channels through a compact footprint rather than requiring large individual cameras
Data Source
AI summary
A method, apparatus, system, and computer program product for of digital imaging. Multiple cameras comprising lenses and digital images sensors are used to capture multiple images of the same subject, and process the multiple images using difference information (e.g., an image disparity map, an image depth map, etc.). The processing commences by receiving a plurality of image pixels from at least one first image sensor, wherein the first image sensor captures a first image of a first color, receives a stereo image of the first color, and also receives other images of other colors. Having the stereo imagery, then constructing a disparity map and an associated depth map by searching for pixel correspondences between the first image and the stereo image. Using the constructed disparity map, captured images are converted into converted images, which are then combined with the first image, resulting in a fused multi-channel color image.