Memory-Aware Image Super-Resolution for High-Frame-Rate Capture
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing camera modules in devices like smartphones and laptops face a trade-off between image resolution and frame rate, resulting in decreased quality when capturing images in slow motion modes, which is exacerbated when viewing on larger screens.
Innovation Solution
An image resolution adjustment method that selects a target memory from multiple buffer memories based on usage rate, processes the image using an image processing model to increase resolution, and presents the image at a higher resolution without changing the frame rate.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If the resolution of the captured image is increased, then the image quality is improved, but the frame rate of the captured image will be inevitably decreased
Solution Approach 1:
The system performs image super-resolution processing in advance using an image processing model to enhance the resolution of low-resolution images captured at high frame rates, so that when images are displayed on larger screens, they maintain both high resolution and high frame rate characteristics
Solution Approach 2:
An image processing model is introduced as an intermediary component between the camera module and the display interface, which processes the captured images to resolve the contradiction between resolution and frame rate by generating high-resolution versions from low-resolution inputs
2Speed
If the frame rate of the captured image is increased, then the motion capture capability is improved, but the resolution of the captured image will be inevitably decreased
Solution Approach 1:
The system captures images at high frame rates with acceptable resolution, then applies super-resolution processing in advance to enhance the resolution before display, ensuring that fast motion scenes can be captured at high frame rates while maintaining high image quality on larger screens
Solution Approach 2:
The image processing model serves as a mediator that takes low-resolution high-frame-rate images and transforms them into high-resolution versions, enabling the system to achieve both high frame rate and high resolution simultaneously
3Manufacturing precision
If image processing performance is enhanced to improve resolution, then the image quality is improved, but the processing time and computational resources are increased
Solution Approach 1:
The image processing model performs resolution enhancement in advance during the capture process, so that when images are later displayed on larger screens, they are already processed and ready, reducing the processing time burden during display
Solution Approach 2:
The image processing model acts as an intermediary that efficiently transforms low-resolution images to high-resolution versions using pre-computed algorithms, balancing processing speed and output quality by leveraging learned patterns from training data
Data Source
AI summary
An image resolution adjustment method and an electronic device are disclosed. The method includes: executing a target application to obtain a target image with a first resolution based on a first frame rate; and during an execution of the target application, selecting a target memory from a plurality of buffer memories according to a usage rate of each of the buffer memories; processing the target image by an image processing model and the target memory to adjust a resolution of the target image from the first resolution to a second resolution, where the second resolution is higher than the first resolution; and controlling a display interface to present the target image with the second resolution based on the first frame rate.