Camera Module Image Synthesis via Pixel Structure Mapping
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image capturing apparatuses fail to effectively improve image resolution using images from camera modules with different pixel structures, as they lack a method to optimally combine images from camera modules with varying pixel forms and color types.
Innovation Solution
An image capturing apparatus comprising a first camera module with a square pixel structure and a second camera module with a different pixel structure, where a controller maps and synthesizes images based on parallax information to select either a color or monochromatic image as a reference for improved image synthesis, ensuring enhanced resolution and signal-to-noise ratio.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If images from camera modules with different pixel structures are combined, then image resolution is improved, but the complexity of image processing increases
Solution Approach 1:
The patent changes the parameter of pixel structure by using camera modules with different pixel configurations (e.g., square pixels vs. non-square pixels, different pixel densities). This allows the system to capture images at different resolutions and orientations, which are then processed to improve overall image resolution by combining the complementary strengths of each pixel structure type.
Solution Approach 2:
The patent applies composite material principle by combining images from multiple camera modules with different pixel structures into a single composite image. The controller synthesizes the images by mapping and aligning features from each source, creating a final image that leverages the high resolution of one pixel structure and the color accuracy or other advantages of another, similar to how composite materials combine properties of different materials.
2Reliability
If multiple camera modules with different pixel structures are used, then color reproduction and detail are improved, but the device complexity increases
Solution Approach 1:
The patent segments the imaging function across multiple camera modules, each optimized for specific pixel structure types (e.g., one module for square pixels with high detail, another for non-square pixels with better color sampling). The controller then segments the processing task by identifying which image regions benefit from which camera module's pixel structure, combining only the relevant portions to achieve superior overall quality without requiring all modules to contribute equally to all image aspects.
Solution Approach 2:
The controller implements a universal image synthesis algorithm that can handle multiple pixel structure types from different camera modules. This multi-functional processing capability allows the system to adaptively combine images regardless of the specific pixel structure configuration, making the system versatile in handling various camera module combinations while maintaining simplified control logic.
3Measurement precision
If images are mapped and synthesized using parallax information, then image quality is improved, but the processing time increases
Solution Approach 1:
The patent applies preliminary action by pre-calculating and storing parallax information and mapping parameters for different camera module configurations. When images need to be synthesized, the controller can quickly retrieve pre-computed mapping data based on the detected pixel structures and parallax values, avoiding the need to perform complex geometric calculations in real-time, thus reducing processing time while maintaining high image quality.
Data Source
AI summary
An image capturing apparatus is provided, including: a first camera module and a second camera module configured to capture an image of a same subject; and a controller configured to map a second image obtained from the second camera module to a first image obtained from the first camera module, and to synthesize a third image of the subject using the first image and the mapped second image, wherein an image sensor included in the first camera module has a first pixel structure in which a pixel has a square shape, and an image sensor included in the second camera module has a second pixel structure that is different from the first pixel structure.