Cascaded Back Projection Networks for Data-Faithful Super-Resolution Images

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image/video super resolution methods often lead to blurring effects when scaling images to higher resolutions, particularly in fields requiring high data fidelity like medicine and architecture.

Innovation Solution

A cascaded back projection network architecture that iteratively generates super resolution images by determining residual images between successive stages, maintaining data fidelity and reducing signal-to-noise ratio through continuous learning and flexible deployment on edge devices or clouds.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If fixed up-sampling methods are used to scale source images to higher resolution, then the image resolution is improved, but blurring effects occur and data fidelity deteriorates

Engineering Contradiction:
Improveimage resolutionVSAvoiddata fidelity
Core Design Contradiction:
Measurement precisionVSManufacturing precision

Solution Approach 1:

The patent divides the super-resolution process into multiple stages using a cascaded network architecture. Instead of a single fixed up-sampling operation, the image is processed through multiple sequential stages (first network, second network, etc.), each performing a portion of the up-sampling task. This segmentation allows each stage to focus on specific frequency components or resolution levels, preventing the blurring that occurs in single-stage fixed up-sampling while maintaining data fidelity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent employs dynamic residual learning where each network stage adapts to the specific characteristics of the input image and previous outputs. The residual connection mechanism allows the network to dynamically adjust its behavior based on the input, learning optimal up-sampling transformations rather than applying fixed pre-determined transformations. This dynamic approach prevents blurring by adapting to the actual image content and maintaining fidelity to the original low-resolution input.

Inventive Principle:
Principle #15Dynamics

2Productivity

If single-stage super resolution network is used, then the processing speed is improved, but image quality and data fidelity deteriorate

Engineering Contradiction:
Improveprocessing speedVSAvoidimage quality
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The patent segments the super-resolution task into multiple stages, with each stage handling a specific portion of the up-sampling process. The first network performs initial up-sampling to an intermediate resolution, and subsequent networks continue the process to achieve the final high resolution. This segmentation allows each stage to be computationally efficient while collectively achieving high image quality that would be difficult to obtain in a single stage.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements continuous refinement through residual connections, where each network stage builds upon the previous stage's output. The residual learning mechanism ensures that each stage contributes useful information to the final output, and the continuous nature of this refinement process allows the system to achieve high image quality progressively rather than requiring a single complex stage.

Inventive Principle:
Principle #20Continuity of useful action

3Manufacturing precision

If high-resolution image data is stored and transmitted directly, then data fidelity is maintained, but storage requirements and transmission burden increase significantly

Engineering Contradiction:
Improvedata fidelityVSAvoiddata volume
Core Design Contradiction:
Manufacturing precisionVSQuantity of substance

Solution Approach 1:

The patent applies preliminary super-resolution processing to transform low-resolution captured images into high-resolution images before storage and transmission. By performing this up-sampling operation in advance using the cascaded network, the system reduces the amount of data that needs to be stored and transmitted while maintaining high data fidelity. The residual learning mechanism ensures that the transformation preserves essential image information.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent changes the resolution parameter of the image data through the cascaded network processing. The system transforms images from low resolution to high resolution by applying multiple up-sampling operations in sequence, each building upon the previous one. This parameter change allows the system to maintain data fidelity equivalent to capturing high-resolution images directly, while significantly reducing the actual data volume that needs to be stored and transmitted.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS20250232401A1Method, device, and computer program product for generating super resolution image
Publication Date: 2025.07.17 DELL PROD LP
  • US20250232401A1 patent drawing
  • US20250232401A1 patent drawing
  • US20250232401A1 patent drawing

AI summary

The present disclosure relates to a method, a device, and a computer program product for generating a super resolution image. The method includes: generating, by a first network and based on a first image of first resolution, a second image of first super resolution; determining, by the first network, a first residual image based on the first image and the second image; and generating, by a second network, a third image of second super resolution based on the first residual image and the second image, wherein the first super resolution is higher than the first resolution and the second super resolution is higher than the first super resolution. In this way, the data fidelity can be maintained and the signal-to-noise ratio can be reduced when generating high resolution images, thereby improving the image quality.