Image Super-Resolution via Iterative Collaborative Filtering

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional super-resolution techniques require significant processing resources and time or produce poor image quality, making them unsuitable for devices with limited resources, such as security cameras, which struggle to achieve high-quality image resolution.

Innovation Solution

The method involves resizing an original image, injecting high-frequency data, and using iterative collaborative filtering to adjust the data based on correlations between similar blocks within the image, retaining consistent components and removing noise, thereby enhancing image resolution without relying on external training data or large processing resources.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional super-resolution techniques use external training data or large processing resources, then image resolution enhancement quality improves, but processing time and resource consumption increase significantly

Engineering Contradiction:
Improveimage resolution enhancement qualityVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent applies self-service by using the image's own low-resolution patches to generate high-resolution patches without external training data. The system extracts patches from the input image itself, processes them through the GAN-based super-resolution model, and uses the generated high-resolution patches to train the translation model, making the system self-sufficient and eliminating the need for large external datasets or prolonged training periods.

Inventive Principle:
Principle #25Self-service

2Measurement precision

If conventional super-resolution techniques use external training data, then image resolution enhancement quality improves, but data storage space and processing resources increase

Engineering Contradiction:
Improveimage resolution enhancement qualityVSAvoiddata storage space
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent extracts only the necessary components from the input image—specifically, low-resolution patches—that are required for super-resolution processing. Instead of storing or processing large external training datasets, the system extracts and processes only the relevant image patches from the input image itself, significantly reducing data storage requirements while maintaining enhancement quality.

Inventive Principle:
Principle #2Taking out (Extraction)

3Productivity

If conventional super-resolution techniques select best matching patches within the same image, then processing resources are reduced, but resolution enhancement quality deteriorates

Engineering Contradiction:
Improveprocessing efficiencyVSAvoidresolution enhancement quality
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent introduces a GAN-based translation model as an intermediary that learns the mapping from low-resolution to high-resolution patches. This intermediary model, trained on extracted image patches, enables the system to generate high-quality super-resolution images without extensively searching for matching patches, thus maintaining processing efficiency while significantly improving enhancement quality through learned transformations.

Inventive Principle:
Principle #24Intermediary (Mediator)

4Adaptability or versatility

If devices with limited processing resources use conventional super-resolution techniques, then device compatibility is maintained, but image resolution enhancement quality is insufficient

Engineering Contradiction:
Improvedevice compatibilityVSAvoidimage resolution enhancement quality
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The patent segments the image into multiple patches and processes them independently through the super-resolution model. This segmentation approach reduces the computational burden on devices with limited resources, as each patch can be processed separately with smaller memory requirements, while still achieving high enhancement quality through the GAN-based translation model.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11403733B2Systems and methods for image super-resolution using iterative collaborative filtering
Publication Date: 2022.08.02 TELEDYNE FLIR LLC
  • US11403733B2 patent drawing
  • US11403733B2 patent drawing
  • US11403733B2 patent drawing

AI summary

Various techniques are disclosed for systems and methods to provide image resolution enhancement. For example, a method includes: receiving an original image (e.g., a visible light image) of a scene comprising image pixels identified by pixel coordinates; resizing the original image to a larger size, where the resized image is divided into a first plurality of reference blocks; enhancing a resolution of the resized image by iteratively: injecting high frequency data into the resized image, extracting from the resized image a first plurality of matching blocks that meet a mutual similarity condition with respect to the reference block, and adjusting the high frequency data of the reference block based on a correlation between the reference block and the first plurality of matching blocks. A system configured to perform such a method is also disclosed.