Pixel Shift Image Processing for Depth of Field
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image pickup technologies face challenges in generating high-resolution images with a large depth of field, as they require multiple images at different focus positions and aperture settings, leading to increased data processing and storage needs.
Innovation Solution
An image pickup apparatus and method that performs pixel shift photographing and depth combination processing, extracting focused regions from images acquired at varying aperture diameters to generate high-resolution images with a large depth of field by selectively processing partial image regions, reducing data requirements and processing loads.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If pixel shift photographing is performed at multiple focus positions to generate high-resolution images with large depth of field, then image quality and depth of field are improved, but data processing load and storage requirements increase
Solution Approach 1:
The image is divided into multiple focus regions, each processed separately through pixel shift combination. Only regions requiring high resolution undergo full pixel shift processing, while other regions use standard processing, thereby reducing overall data volume while maintaining high resolution in critical areas.
Solution Approach 2:
Different processing qualities are applied to different regions of the image based on focus requirements. The focused region receives high-resolution pixel shift combination processing, while non-focused regions use conventional processing, optimizing the balance between image quality and data processing load.
2Manufacturing precision
If pixel shift combination processing is performed on entire image regions at multiple focus positions, then high-resolution images with large depth of field are generated, but processing time increases
Solution Approach 1:
The image processing is segmented into different focus regions. Only the focused region undergoes time-consuming pixel shift combination processing, while other regions are processed more quickly using conventional methods, significantly reducing total processing time.
Solution Approach 2:
Instead of applying full pixel shift combination processing to the entire image, the method applies partial processing only to the necessary focused region. This partial action approach maintains high resolution where needed while avoiding unnecessary processing time in other areas.
3Productivity
If multiple images are acquired at different aperture diameters for focused region extraction, then image acquisition efficiency is improved, but memory capacity requirements increase
Solution Approach 1:
Multiple images are acquired at different aperture diameters for focused region extraction, but after the focused region is identified and extracted, the original multiple images are discarded. This temporary use and subsequent disposal of multiple images enables efficient focused region detection while managing memory capacity.
Data Source
AI summary
An image pickup apparatus includes a processor configured of hardware functioning as a pixel-shift-combination processing section configured to perform pixel shift combination of a plurality of image data acquired by performing pixel shift photographing in a certain focus position to generate combined image data, a depth-combination processing section configured to perform depth combination of a plurality of combined image data in different focus positions that the depth-combination processing section causes the pixel-shift-combination processing section to generate, and a microcomputer configured to extract a focused region in at least one or more of the plurality of focus positions. The pixel-shift-combination processing section performs, concerning a focus position where the focused region is extracted, the pixel shift combination concerning only a partial image region including the focused region.