Video Super-Resolution via Segmented Integral and Non-Integral Scaling

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing super-resolution methods for video images face issues such as blurring and jagged edges when magnification is large, and methods based on fuzzy motion estimation struggle with accurate mapping for non-integral multiple scaling.

Innovation Solution

A method that performs super-resolution processing based on fuzzy motion estimation by integral multiple times to obtain an intermediate high-resolution image, followed by interpolation by non-integral multiple times to achieve the target high-resolution image, with additional edge information extraction and gain control for enhancement.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If super-resolution processing is performed by non-integral multiple times directly on low-resolution video image, then the target high-resolution video image can be obtained, but coordinate mapping between low-resolution and high-resolution images becomes inaccurate

Engineering Contradiction:
Improvecoordinate mapping accuracyVSAvoidprocessing complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent segments the super-resolution process into two distinct stages: first performing super-resolution processing by integral multiple times to obtain an intermediate high-resolution video image, then performing super-resolution processing by non-integral multiple times on the intermediate image to obtain the final target high-resolution video image. This segmentation allows coordinate mapping to be performed accurately in the first stage with integral multiples, while the second stage handles the remaining non-integral scaling with reduced error propagation.

Inventive Principle:
Principle #1Segmentation

2Ease of manufacture

If super-resolution method based on interpolation is used, then processing is simple, but blurring and jagged edges occur when magnification is large

Engineering Contradiction:
Improveprocessing simplicityVSAvoidimage quality
Core Design Contradiction:
Ease of manufactureVSManufacturing precision

Solution Approach 1:

The patent merges two different super-resolution processing methods: super-resolution processing by integral multiple times (which provides accurate coordinate mapping and reduces blurring) and super-resolution processing by non-integral multiple times (which provides processing simplicity). By combining these methods in sequence, the patent achieves both good image quality and processing efficiency, avoiding the blurring and jagged edges that occur when using interpolation alone for large magnifications.

Inventive Principle:
Principle #5Merging (Combining)

3Manufacturing precision

If super-resolution method based on fuzzy motion estimation is used, then image quality improves, but accurate mapping cannot be achieved for non-integral multiple scaling

Engineering Contradiction:
Improveimage qualityVSAvoidscaling adaptability
Core Design Contradiction:
Manufacturing precisionVSAdaptability or versatility

Solution Approach 1:

The patent introduces dynamic adaptability by detecting whether the scaling factor is an integral multiple or a non-integral multiple, and then dynamically selecting the appropriate processing path. When the scaling factor is an integral multiple, the system performs super-resolution processing by integral multiple times with accurate coordinate mapping. When the scaling factor is a non-integral multiple, the system performs super-resolution processing by non-integral multiple times. This dynamic adaptation allows the system to maintain high image quality while being versatile across different scaling scenarios.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS9076234B2Super-resolution method and apparatus for video image
Publication Date: 2015.07.07 HUAWEI TECH CO LTD
  • US9076234B2 patent drawing
  • US9076234B2 patent drawing
  • US9076234B2 patent drawing

AI summary

A super-resolution method and apparatus for a video image are disclosed. The method includes performing super-resolution processing based on fuzzy motion estimation by integral multiple times on an original low-resolution video image, to obtain an intermediate high-resolution video image. When resolution of the intermediate high-resolution video image is different from resolution of a target high-resolution video image, a non-integral multiple between the resolution of the target high-resolution video image and the resolution of the intermediate high-resolution video image is calculated. Super-resolution processing based on interpolation by the non-integral is performed multiple times on the intermediate high-resolution video image, to obtain the target high-resolution video image.