Gradient-Guided Super Resolution Using Residual LUT Kernels

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image super-resolution techniques struggle to efficiently enhance low-resolution images in real-time on mobile devices, particularly in terms of computational efficiency and resource utilization.

Innovation Solution

A processor-implemented method utilizing residual look-up tables (LUTs) and kernel sets to determine image direction types based on gradients, generating super-resolution images through weighted sums of operation results, and applying interpolation for enhanced image upscaling.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If deep learning-based super-resolution techniques are used, then image quality is improved, but computational complexity and processing time increase

Engineering Contradiction:
Improveimage qualityVSAvoidcomputational complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the super-resolution process into multiple stages: gradient calculation to determine direction types, directional kernel selection from predefined sets, and iterative refinement cycles. This segmentation transforms the complex deep learning task into manageable discrete operations that can be executed efficiently on mobile devices while maintaining image quality improvement.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary actions by pre-calculating and storing gradient direction types and selecting appropriate directional kernels before the actual super-resolution enhancement. By determining direction types based on gradient calculations in advance and preparing kernel sets accordingly, the system reduces real-time computational burden while preserving the ability to generate high-quality super-resolution images.

Inventive Principle:
Principle #10Preliminary action

2Productivity

If real-time processing is implemented on mobile devices, then processing speed is improved, but resource utilization and memory usage increase

Engineering Contradiction:
Improveprocessing speedVSAvoidmemory usage
Core Design Contradiction:
ProductivityVSQuantity of substance

Solution Approach 1:

The patent changes parameters by using gradient-based direction types to select from multiple predefined kernel sets, rather than using a single fixed kernel or a large neural network. This parameter-driven approach allows the system to adapt to different image regions and directions while using a compact set of pre-computed kernels, significantly reducing memory requirements compared to storing large deep learning models on mobile devices.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent uses copying by storing pre-computed gradient direction information and kernel parameters in lookup tables rather than recalculating them during real-time processing. This copying of pre-prepared data structures enables fast retrieval and application during super-resolution enhancement, achieving real-time processing speeds while minimizing the memory footprint on mobile devices.

Inventive Principle:
Principle #26Copying

3Manufacturing precision

If directional kernels are used for super-resolution, then image detail preservation is improved, but algorithm complexity increases

Engineering Contradiction:
Improveimage detail preservationVSAvoidalgorithm complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent applies local quality by using gradient-based direction types to select different directional kernels for different regions of the image. Instead of applying a uniform super-resolution approach, the system adapts the kernel selection to local image characteristics (edges, textures, smooth regions), preserving image details more effectively while maintaining a relatively simple algorithm structure based on predefined kernel sets.

Inventive Principle:
Principle #3Local quality

Data Source

PatentEP4488927B1Method and apparatus with super resolution
Publication Date: 2026.04.22 SAMSUNG ELECTRONICS CO LTD
  • EP4488927B1 patent drawingFigure 1
  • EP4488927B1 patent drawingFigure 2
  • EP4488927B1 patent drawingFigure 3

AI summary

A processor-implemented method with super resolution comprising: determining a direction type of an input image based on a gradient of the input image; acquiring a first intermediate image that is a super-resolution image corresponding to the input image based on a residual look-up table (LUT) corresponding to a kernel set mapped to the determined direction type; determining a LUT strength map of the input image based on the gradient of the input image and a preset tuning parameter; and generating an output image that is a super-resolution image of the input image based on the LUT strength map and the first intermediate image.