Gradient-Guided Super Resolution Using Residual LUT Kernels
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image super-resolution techniques struggle to efficiently enhance low-resolution images in real-time on mobile devices, particularly in terms of computational efficiency and resource utilization.
Innovation Solution
A processor-implemented method utilizing residual look-up tables (LUTs) and kernel sets to determine image direction types based on gradients, generating super-resolution images through weighted sums of operation results, and applying interpolation for enhanced image upscaling.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If deep learning-based super-resolution techniques are used, then image quality is improved, but computational complexity and processing time increase
Solution Approach 1:
The patent segments the super-resolution process into multiple stages: gradient calculation to determine direction types, directional kernel selection from predefined sets, and iterative refinement cycles. This segmentation transforms the complex deep learning task into manageable discrete operations that can be executed efficiently on mobile devices while maintaining image quality improvement.
Solution Approach 2:
The patent performs preliminary actions by pre-calculating and storing gradient direction types and selecting appropriate directional kernels before the actual super-resolution enhancement. By determining direction types based on gradient calculations in advance and preparing kernel sets accordingly, the system reduces real-time computational burden while preserving the ability to generate high-quality super-resolution images.
2Productivity
If real-time processing is implemented on mobile devices, then processing speed is improved, but resource utilization and memory usage increase
Solution Approach 1:
The patent changes parameters by using gradient-based direction types to select from multiple predefined kernel sets, rather than using a single fixed kernel or a large neural network. This parameter-driven approach allows the system to adapt to different image regions and directions while using a compact set of pre-computed kernels, significantly reducing memory requirements compared to storing large deep learning models on mobile devices.
Solution Approach 2:
The patent uses copying by storing pre-computed gradient direction information and kernel parameters in lookup tables rather than recalculating them during real-time processing. This copying of pre-prepared data structures enables fast retrieval and application during super-resolution enhancement, achieving real-time processing speeds while minimizing the memory footprint on mobile devices.
3Manufacturing precision
If directional kernels are used for super-resolution, then image detail preservation is improved, but algorithm complexity increases
Solution Approach 1:
The patent applies local quality by using gradient-based direction types to select different directional kernels for different regions of the image. Instead of applying a uniform super-resolution approach, the system adapts the kernel selection to local image characteristics (edges, textures, smooth regions), preserving image details more effectively while maintaining a relatively simple algorithm structure based on predefined kernel sets.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A processor-implemented method with super resolution comprising: determining a direction type of an input image based on a gradient of the input image; acquiring a first intermediate image that is a super-resolution image corresponding to the input image based on a residual look-up table (LUT) corresponding to a kernel set mapped to the determined direction type; determining a LUT strength map of the input image based on the gradient of the input image and a preset tuning parameter; and generating an output image that is a super-resolution image of the input image based on the LUT strength map and the first intermediate image.