Super-Resolution Image Processing for High-Speed Camera Sensors
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Image processing devices face a deterioration in image quality when operating in high-speed reading modes due to the limited image transfer speed of imaging sensors, which results in reduced resolution and frame rate.
Innovation Solution
An image processing device that switches between low-resolution and high-resolution modes based on shooting periods and motion detection, using a super-resolution unit to up-convert low-resolution images captured during high-speed shooting to maintain high frame rates while improving image quality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If thinned-pixels reading is used to achieve high frame rate, then frame rate is improved, but image quality deteriorates due to reduced resolution
Solution Approach 1:
The patent captures a reference image at full resolution before the shooting period begins. This preliminary full-resolution image is stored and later used for super-resolution processing during the shooting period, allowing high frame rate capture without sacrificing final image quality.
Solution Approach 2:
The patent introduces a super-resolution processing unit that acts as an intermediary between the thinned-pixel low-resolution images and the final output. This unit uses the pre-captured full-resolution reference image to generate high-quality output images from the low-resolution input, resolving the contradiction between frame rate and image quality.
2Manufacturing precision
If all-pixels reading is used to maintain high resolution, then image quality is improved, but frame rate decreases due to limited data transfer speed
Solution Approach 1:
The patent divides the imaging process into two distinct segments: a reference image capture phase at full resolution before shooting, and a high-speed capture phase using thinned pixels during shooting. This segmentation allows each phase to optimize for its specific purpose without compromising the other.
Solution Approach 2:
The patent performs the resource-intensive full-resolution image capture in advance, before the actual shooting period. This preliminary action stores essential high-quality reference data that enables subsequent high-speed processing without requiring full-resolution reading during the time-critical shooting phase.
3Speed
If high-speed reading mode is used for continuous shooting, then shooting speed is improved, but resolution is reduced due to pixel thinning
Solution Approach 1:
The super-resolution processing unit serves as an intermediary that transforms thinned-pixel low-resolution images into high-resolution output images. It uses the pre-captured full-resolution reference image to reconstruct fine details that were lost during high-speed thinned-pixel capture, thereby maintaining resolution while enabling high shooting speed.
Solution Approach 2:
The patent captures the full-resolution reference image in advance before the high-speed shooting sequence begins. This preliminary full-resolution capture provides the detailed information needed to later enhance the resolution of rapidly captured thinned-pixel images without compromising shooting speed.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The solution effectively suppresses image quality deterioration in high-speed reading modes by generating high-resolution images through super-resolution processing, maintaining high frame rates and enhancing image quality without lowering the frame rate during shooting periods.
Implementation Method 1
an imaging unit 102 which includes a plurality of pixels each converting light into an electrical signal
Data Source
AI summary
An image processing device (200) according to the present invention includes: a shooting period obtaining unit (205) configured to obtain a shooting period; an imaging unit (202) which includes a plurality of pixels each converting light into an electrical signal, and which has a first mode in which a low-resolution image signal is outputted and a second mode in which a high-resolution image signal is outputted, the low-resolution image signal including electrical signals converted by a first number of pixels among the plurality of pixels, the high-resolution image signal including electrical signals converted by a second number of pixels among the plurality of pixels, and the second number being greater than the first number; a control unit (210) configured to cause the imaging unit (202) to operate in the first mode during the shooting period, and to operate in the second mode during a period other than the shooting period; and a super-resolution unit (203) configured to generate a super-resolution image signal by performing a resolution up-converting process on the low-resolution image signal outputted by the imaging unit (202) during the shooting period, using the high-resolution image signal outputted by the imaging unit (202) during the period other than the shooting period.