Pixel Shift Image Processing for High-Resolution Capture
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for generating high-resolution images from low-resolution movies are either computationally intensive or difficult to implement in consumer devices due to increased processing load and cost constraints, making it challenging to capture high-quality still images at the best moment without missing the shot.
Innovation Solution
An image processing device that utilizes a pixel shift process to estimate pixel values by overlapping light-receiving units and employing an estimation calculation section to determine intermediate pixel values based on relational expressions and similarity evaluations, allowing for the generation of high-resolution images from low-resolution frames with reduced processing complexity.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If pixel shift process is used to generate high-resolution images from low-resolution movies, then image resolution is improved, but processing load increases
Solution Approach 1:
The patent applies preliminary action by performing the pixel shift process during movie recording, capturing multiple shifted low-resolution frames in advance. This allows the high-resolution image generation to be done later from pre-captured data, reducing real-time processing load while maintaining high resolution output quality.
Solution Approach 2:
The patent segments the image generation process into multiple steps: capturing shifted low-resolution frames, estimating pixel values from overlapping regions, and synthesizing the final high-resolution image. This segmentation allows complex processing to be distributed and optimized at different stages, reducing overall processing burden.
2Measurement precision
If complex estimation calculation is used to determine pixel values, then image quality is improved, but processing complexity increases
Solution Approach 1:
The patent uses a cost-effective estimation calculation approach that leverages the temporal redundancy in video sequences. By utilizing the fact that consecutive frames are similar, the system performs simple pixel value estimation rather than complex optimization, achieving good results with lower computational cost.
Solution Approach 2:
The estimation calculation section uses the overlapping regions from sequentially shifted light-receiving units to self-determine pixel values. The system leverages its own captured data from multiple shifted positions to estimate missing pixel values without requiring external complex processing or additional hardware.
3Measurement precision
If sequential pixel shift process is performed for each frame, then high-resolution image quality is improved, but processing time increases
Solution Approach 1:
The patent maintains continuity of useful action by performing the pixel shift process continuously during movie recording without interrupting the capture sequence. Multiple shifted frames are captured in continuous time series, allowing efficient batch processing later while minimizing the time penalty for high-resolution generation.
Data Source
Figure 1A~1B
Figure 2A~2B
Figure 3~5
AI summary
An image processing device, an imaging device, a program, an image processing method, and the like that can acquire a high-resolution image from a low-resolution movie using a simple process are disclosed. Light-receiving units are set corresponding to a plurality of pixels. The pixel values of a plurality of pixels included in the light-receiving units are added up, and read as light-receiving values a00 to a11 to acquire a low-resolution frame image. The image processing device includes an estimation calculation section that estimates the pixel values v00 to v11 of the pixels included in the light-receiving unit based on a plurality of low-resolution frame images, and an image output section that outputs a high-resolution frame image based on the estimated pixel values. The light-receiving values a00 to a11 are read while sequentially performing a pixel shift process so that the light-receiving units overlap each other. The estimation calculation section estimates the pixel values v00 to v11 of the pixels included in the light-receiving unit based on the light-receiving values a00 to a11 obtained by performing the pixel shift process.