Video super-resolution reconstruction method

A super-resolution reconstruction and low-resolution technology, which is applied in the field of digital image processing, can solve problems such as low efficiency, large amount of calculation, and failure to restore the current frame, so as to reduce the amount of parameters, enhance the fusion effect, improve network storage and The effect of computing efficiency

Active Publication Date: 2020-01-17
WUHAN UNIV
View PDF3 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This method only needs to be processed once per frame, which is faster, but it cannot use the information of the next delayed frame to help restore the current frame
Jo et al. proposed a video super-resolution

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Video super-resolution reconstruction method
  • Video super-resolution reconstruction method
  • Video super-resolution reconstruction method

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0017] In order to facilitate the understanding and implementation of the present invention by those of ordinary skill in the art, the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the implementation examples described here are only used to illustrate and explain the present invention, and are not intended to limit this invention.

[0018] Please see figure 1 with figure 2 , A video super-resolution reconstruction method based on non-local spatio-temporal correlation and progressive fusion network, including the following steps:

[0019] Step 1: Select a number of video data as training samples, intercept an image of T×H×s×W×s×C pixels from the same position in each video frame as a high-resolution learning target, and downsample it by s times , Get the low-resolution image of size T×H×W×C as the input of the network. Where T is the number of frames, H and W are the height and...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a video super-resolution reconstruction method, including a non-local space-time network and a progressive fusion network. In the non-local space-time network, input multiple frames are fused together to form a whole high-dimensional feature tensor graph, and the whole high-dimensional feature tensor graph is deformed, separated, calculated and extracted to obtain a multi-frame video mixed with the non-local space-time correlation. And in the progressive fusion network, multiple frames output by the non-local space-time network are sent into the progressive fusion residual block, and the space-time correlation among the multiple frames is gradually fused. And finally, the fused low-resolution feature tensor graph is amplified to obtain a final high-resolution videoframe. According to the video super-resolution reconstruction method, the spatial-temporal correlation among multiple frames is effectively fused, and rich texture details can be recovered while the video resolution is enhanced.

Description

technical field [0001] The invention belongs to the technical field of digital image processing, and relates to a video super-resolution reconstruction method, in particular to a video super-resolution reconstruction method based on non-local spatiotemporal correlation and progressive fusion network. Background technique [0002] With the development of science and technology, people's demand for high-definition video is also increasing, from 720P (1280×720) to 1080P (1920×1080) high-definition, to 4K (3840×2160) or even 8K (7680×4320) Ultra HD. Therefore, as a technique that can generate high-resolution video from a given low-resolution video, video super-resolution has an important use. At present, video super-resolution is widely used in fields such as video surveillance, digital television, and satellite remote sensing. [0003] Traditional super-resolution methods have interpolation-based methods, such as bicubic interpolation methods. These methods compute from a gi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T3/40G06T5/00G06N3/04
CPCG06T3/4053G06T5/00G06T2207/20081G06T2207/20084G06T2207/10016G06N3/045
Inventor 王中元易鹏江奎韩镇胡瑞敏
Owner WUHAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap