Image Processing Device Pixel Shift Resolution
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The pixel-shift imaging method requires multiple captures to achieve high-resolution images, leading to increased imaging time and potential deterioration in image quality due to object changes during long exposure, especially when observing moving objects or fluorescence.
Innovation Solution
An image processing device and method that acquires multiple images while shifting the image sensor's light-receiving plane and estimates high-resolution images by correlating pixel values between different color filters, reducing the number of pixel shifts required.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If multiple pixel shifts are performed to achieve high-resolution imaging, then image resolution is improved, but imaging time increases and image quality deteriorates due to object changes
Solution Approach 1:
The patent applies partial action by performing only the minimum necessary pixel shifts (e.g., one horizontal shift and one vertical shift) rather than multiple shifts in all directions. This partial shifting approach, combined with correlation-based estimation, achieves high-resolution imaging with reduced imaging time while minimizing object changes during capture
Solution Approach 2:
The patent replaces the mechanical approach of performing multiple physical pixel shifts with a computational method using correlation-based pixel value estimation. Instead of mechanically shifting the sensor multiple times to capture all necessary data, the system uses mathematical correlation to estimate missing pixel values from fewer captured images, substituting mechanical repetition with computational processing
2Measurement precision
If multiple pixel shifts are performed to achieve high-resolution imaging, then image resolution is improved, but image quality deteriorates due to object changes during long exposure
Solution Approach 1:
By performing only partial pixel shifts (minimum necessary shifts) rather than exhaustive multiple shifts, the patent reduces the total capture time, thereby minimizing object changes during imaging and maintaining image quality reliability while still achieving high resolution through correlation-based estimation
Solution Approach 2:
The patent replaces multiple mechanical pixel shift operations with a computational correlation estimation system. This substitution reduces the time objects are exposed to imaging conditions, minimizing changes during capture and improving image quality reliability while maintaining high resolution through mathematical processing
3Measurement precision
If pixel size is reduced to increase the number of pixels, then image resolution is improved, but light intensity per pixel decreases and S/N ratio deteriorates
Solution Approach 1:
The patent transitions from improving resolution through pixel size reduction (two-dimensional constraint) to achieving high resolution through temporal and computational dimensions. By capturing images at different pixel shift positions and using correlation-based estimation, the system achieves high resolution without reducing pixel size, thereby maintaining light intensity and S/N ratio
Data Source
AI summary
An image processing device includes an image acquisition section that acquires a plurality of images captured while sequentially shifting the relative positions of a light-receiving plane of an image sensor and an image formed in the light-receiving plane, and an estimation calculation section that estimates a high-resolution image based on the plurality of images, the high-resolution image having a number of pixels larger than that of each of the plurality of images. The estimation calculation section estimates the pixel values of the high-resolution image corresponding to a first color based on the pixel values of the plurality of images corresponding to a second color when the estimation calculation section has determined that the pixel values of the plurality of images corresponding to the first color and the pixel values of the plurality of images corresponding to the second color have a high correlation.