Image Fusion for Smartphone Sensitivity and Portability
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Portable information processing terminals, such as smartphones, face challenges in obtaining high-sensitivity images without compromising image quality due to the larger size of detachable cameras and the limitations of multiple imaging sections, which reduces portability and image performance.
Innovation Solution
An image processing apparatus and method that fuse monochrome and color images from different viewpoints, using feature amounts like parallax dispersion and saturation to determine if image quality deterioration occurs, and selectively output either the fusion image or the original images based on predetermined conditions to maintain high sensitivity without lowering image quality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a detachable camera is used to obtain high-sensitivity images, then image sensitivity is improved, but device portability and ease of operation deteriorate due to the need for communication setup and manipulation
Solution Approach 1:
The patent combines a monochrome imaging section and a color imaging section into a single integrated device. The monochrome imaging section provides high sensitivity for low-light conditions, while the color imaging section captures color information. By merging these two sections and fusing their images through parallax adjustment, the system achieves high-sensitivity imaging without requiring a separate detachable camera, thus maintaining portability and ease of operation.
2Measurement precision
If multiple imaging sections are provided to improve image quality, then image performance is improved, but device complexity increases
Solution Approach 1:
The patent replaces complex mechanical image processing with computational image fusion. Instead of using multiple complex imaging sections with different mechanical configurations, the system uses a monochrome imaging section and a color imaging section with different viewpoints, then applies image fusion algorithms to combine them. This substitution of mechanical complexity with computational processing achieves high image quality while controlling device complexity.
Solution Approach 2:
The imaging device performs multiple functions using two imaging sections: the monochrome imaging section captures high-sensitivity luminance information, while the color imaging section captures color information and serves as a reference for parallax adjustment. This multi-functionality allows the system to achieve both high sensitivity and accurate color reproduction without requiring each section to be specialized for a single function, thereby controlling overall device complexity.
3Measurement precision
If image fusion is performed to obtain high-sensitivity images, then image sensitivity is improved, but image quality may deteriorate due to parallax and saturation issues
Solution Approach 1:
The patent employs feedback mechanisms to monitor and control image quality during the fusion process. The system calculates feature amounts from both the monochrome imaged image and the color imaged image, compares these features against predetermined conditions, and adjusts the fusion process accordingly. This feedback loop ensures that image quality deterioration from parallax or saturation is detected and corrected, maintaining high image sensitivity while preserving image quality.
Data Source
Figure 1(a)~1(b)
Figure 2
Figure 3(a)~3(b)
AI summary
A fusion decision processing section 36-1, based on a feature amount calculated by using a monochrome imaged image acquired by imaging a subject with an imaging section 21-BW, and a color imaged image acquired by imaging the subject from a different point-of-view position with an imaging section 21-CR, performs fusion decision as to whether or not deterioration of image quality is caused in fusion processing for producing a fusion image obtained by fusion of the monochrome imaged image and the color imaged image with the monochrome imaged image as a reference in a fusion processing section 35-fb. Moreover, the fusion decision processing section 36-1 selects the fusion image data produced in the fusion processing section 35-fb in a case where it is decided that deterioration of image quality is not caused in the fusion processing, and produces an image selection signal selecting demosaic data produced in a demosaic processing section 34 in a case where it is decided that the deterioration of the image quality is caused in the fusion processing to output the image selection signal to an image selecting section 39. A high-quality imaged image can be produced by using the imaged images acquired in a plurality of imaging sections.