Camera Image Resolution Correction via Re-mosaic Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Smartphone cameras with wider field of view struggle to maintain image resolution due to image distortion caused by lenses that compress images in specific directions, leading to a narrowed field of view and discarded image portions during cropping.
Innovation Solution
An electronic device with a multi-pixel image sensor and an image signal processor that performs re-mosaic processing on pixel data to correct distortion, generating re-mosaiced pixel data by interpolating and upsampling in the direction of compression, thereby improving image resolution.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a lens with greater distortion is used to obtain a wider field of view, then the field of view is improved, but image resolution deteriorates due to compression in specific directions
Solution Approach 1:
The image sensor is divided into multiple pixel types (first, second, and third pixels) with different color filters arranged in a specific pattern. This segmentation allows each pixel type to capture specific color information that, when combined, reconstructs the distorted image components separately, enabling resolution recovery in compressed directions
Solution Approach 2:
The patent introduces a new dimension to image processing by capturing not only color information but also spatial distribution patterns of different pixel types. The re-mosaic processing operates in this additional dimensional space, separating and recombining image components along compression and non-compression axes to restore resolution
2Manufacturing precision
If image cropping is performed to correct distortion, then image quality is improved, but the field of view is narrowed and image portions are discarded
Solution Approach 1:
The patent performs preliminary action by capturing additional color information at specific pixel locations during the image acquisition phase. The first pixels capture red color information at positions where second pixels (green filters) are located in the original image, preemptively gathering the data needed for distortion correction without requiring subsequent cropping
3Manufacturing precision
If re-mosaic processing is performed to correct distortion, then image resolution is improved, but processing complexity increases
Solution Approach 1:
The patent changes processing parameters by performing re-mosaic processing only in the direction of image compression rather than in all directions. This selective parameter approach reduces computational complexity while still achieving resolution improvement in the problematic compression axis
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The solution effectively corrects image distortion, enhancing image resolution and maintaining a wider field of view without the need for image cropping, allowing for a more expansive and clear image capture.
Implementation Method 1
A CMOS image sensor includes pixels implemented with CMOS transistors, and converts light energy to an electrical signal by using a photoelectric conversion element included in each pixel
Data Source
AI summary
An electronic device, method thereof, and digital camera are provided, including an image sensor that generates pixel data based on light received through a lens that permits distortion where a captured image is compressed in a first direction, and an image signal processor that performs re-mosaic processing on the pixel data for correcting distortion occurring in the first direction and to generate re-mosaiced pixel data.