Cascaded Back Projection Networks for Data-Faithful Super-Resolution Images
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image/video super resolution methods often lead to blurring effects when scaling images to higher resolutions, particularly in fields requiring high data fidelity like medicine and architecture.
Innovation Solution
A cascaded back projection network architecture that iteratively generates super resolution images by determining residual images between successive stages, maintaining data fidelity and reducing signal-to-noise ratio through continuous learning and flexible deployment on edge devices or clouds.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If fixed up-sampling methods are used to scale source images to higher resolution, then the image resolution is improved, but blurring effects occur and data fidelity deteriorates
Solution Approach 1:
The patent divides the super-resolution process into multiple stages using a cascaded network architecture. Instead of a single fixed up-sampling operation, the image is processed through multiple sequential stages (first network, second network, etc.), each performing a portion of the up-sampling task. This segmentation allows each stage to focus on specific frequency components or resolution levels, preventing the blurring that occurs in single-stage fixed up-sampling while maintaining data fidelity.
Solution Approach 2:
The patent employs dynamic residual learning where each network stage adapts to the specific characteristics of the input image and previous outputs. The residual connection mechanism allows the network to dynamically adjust its behavior based on the input, learning optimal up-sampling transformations rather than applying fixed pre-determined transformations. This dynamic approach prevents blurring by adapting to the actual image content and maintaining fidelity to the original low-resolution input.
2Productivity
If single-stage super resolution network is used, then the processing speed is improved, but image quality and data fidelity deteriorate
Solution Approach 1:
The patent segments the super-resolution task into multiple stages, with each stage handling a specific portion of the up-sampling process. The first network performs initial up-sampling to an intermediate resolution, and subsequent networks continue the process to achieve the final high resolution. This segmentation allows each stage to be computationally efficient while collectively achieving high image quality that would be difficult to obtain in a single stage.
Solution Approach 2:
The patent implements continuous refinement through residual connections, where each network stage builds upon the previous stage's output. The residual learning mechanism ensures that each stage contributes useful information to the final output, and the continuous nature of this refinement process allows the system to achieve high image quality progressively rather than requiring a single complex stage.
3Manufacturing precision
If high-resolution image data is stored and transmitted directly, then data fidelity is maintained, but storage requirements and transmission burden increase significantly
Solution Approach 1:
The patent applies preliminary super-resolution processing to transform low-resolution captured images into high-resolution images before storage and transmission. By performing this up-sampling operation in advance using the cascaded network, the system reduces the amount of data that needs to be stored and transmitted while maintaining high data fidelity. The residual learning mechanism ensures that the transformation preserves essential image information.
Solution Approach 2:
The patent changes the resolution parameter of the image data through the cascaded network processing. The system transforms images from low resolution to high resolution by applying multiple up-sampling operations in sequence, each building upon the previous one. This parameter change allows the system to maintain data fidelity equivalent to capturing high-resolution images directly, while significantly reducing the actual data volume that needs to be stored and transmitted.
Data Source
AI summary
The present disclosure relates to a method, a device, and a computer program product for generating a super resolution image. The method includes: generating, by a first network and based on a first image of first resolution, a second image of first super resolution; determining, by the first network, a first residual image based on the first image and the second image; and generating, by a second network, a third image of second super resolution based on the first residual image and the second image, wherein the first super resolution is higher than the first resolution and the second super resolution is higher than the first super resolution. In this way, the data fidelity can be maintained and the signal-to-noise ratio can be reduced when generating high resolution images, thereby improving the image quality.


