Pixel Shift Image Pickup Apparatus for High Resolution
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional image pickup apparatuses face limitations in generating high-resolution images due to advancements in pixel opening ratios, where pixel opening widths exceeding 50% of the pixel pitch lead to reduced image quality and contrast, especially in pixel shift techniques.
Innovation Solution
An image pickup apparatus and method that perform pixel shifts to achieve relative positions differing by non-integral multiples of the pixel pitch, synthesizing multiple images to generate composite data with higher resolution, and determine edge enhancement parameters based on pixel opening characteristics for improved image processing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Use of energy by moving object
If pixel opening width is increased to improve light reception, then light gathering ability is improved, but image quality and contrast deteriorate due to reduced pixel density
Solution Approach 1:
The patent transitions from a two-dimensional pixel array to a three-dimensional stacked sensor architecture. Multiple pixel layers are arranged vertically, allowing each pixel to have a smaller opening while maintaining high light reception through depth. This vertical dimensionality resolves the contradiction by decoupling pixel opening size from pixel density.
Solution Approach 2:
The patent implements nested pixel structures where multiple pixel layers are stacked within the same horizontal footprint. Each layer captures light at different depths, effectively nesting functional elements within a compact volume. This allows small pixel openings to achieve high light reception through cumulative effect across layers.
2Ease of operation
If pixel shift amount is set to integral multiple of pixel pitch, then alignment is simplified, but resolution enhancement capability is reduced
Solution Approach 1:
The patent employs asymmetric pixel shift amounts that are specifically designed to be non-integral multiples of pixel pitch. This asymmetric positioning allows synthesized images to capture sub-pixel information that enhances resolution. The asymmetric shifts are calculated to optimize resolution enhancement while remaining manageable through computational methods.
Solution Approach 2:
The patent dynamically adjusts pixel shift parameters to non-integral values based on desired resolution enhancement goals. By changing the shift parameter from fixed integral multiples to variable non-integral values, the system achieves higher resolution synthesis. Computational algorithms compensate for the increased complexity, maintaining ease of operation.
3Measurement precision
If multiple images are synthesized to enhance resolution, then image resolution is improved, but processing complexity increases
Solution Approach 1:
The patent performs preliminary alignment and registration of multiple captured images before synthesis. By pre-processing the images to establish accurate geometric relationships and compensate for shifts, the actual synthesis process becomes more efficient. This preliminary action reduces the computational burden during final image generation.
Solution Approach 2:
The patent uses computational copying methods where pixel information from multiple shifted images is virtually replicated and repositioned to reconstruct high-resolution details. Instead of complex physical processing, digital copying and repositioning of pixel data achieves resolution enhancement with manageable computational complexity.
Data Source
AI summary
An image pickup apparatus includes an image pickup device including a plurality of pixels arrayed at a predetermined pixel pitch, a shift mechanism configured to perform a pixel shift in a movement amount which is a non-integral multiple of the pixel pitch, a microcomputer configured to cause the image pickup device to pick up an image at pixel shifting positions to respectively acquire a plurality of pieces of image data, a synthesis processing section configured to synthesize the acquired plurality of pieces of image data to generate composite image data with a high resolution, and an image processing section configured to determine an edge enhancement parameter based on a characteristic relating to a pixel opening of the composite image data and perform edge enhancement processing for the composite image data.