Video super-resolution method based on adversarial learning and attention mechanism

A super-resolution and attention technology, applied in image analysis, image enhancement, instrumentation, etc., can solve the problem of low video computing efficiency

Active Publication Date: 2019-04-16
WUHAN UNIV
View PDF6 Cites 13 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Second, the sliding window used in motion estimation contains a large amount of computational redundancy. Only a single frame can be reconstructed by using

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Video super-resolution method based on adversarial learning and attention mechanism
  • Video super-resolution method based on adversarial learning and attention mechanism
  • Video super-resolution method based on adversarial learning and attention mechanism

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0059] In order to facilitate those of ordinary skill in the art to understand and implement the present invention, the present invention will be described in further detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the implementation examples described here are only used to illustrate and explain the present invention, and are not intended to limit this invention. Concrete steps of the present invention are:

[0060] (1) Construct a deep neural network;

[0061] (2) training deep neural network;

[0062] (3) Use the trained model for video super-resolution.

[0063] The described construction depth neural network of step (1), specific process is as follows:

[0064] (11) Construct a generation network, such as figure 1 , the specific steps are as follows:

[0065] (111) Construct a frame encoding module, whose input is the frame sequence of the original video, and the output is the feature map (feature map) of each ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an end-to-end video super-resolution method based on adversarial learning and an attention mechanism in order to overcome defects that a traditional video resolution method ishigh in calculation overhead, low in calculation efficiency and incapable of efficiently processing a long sequence. According to the method, space-time correlation is extracted by adopting adjacent frame fusion and an attention mechanism, and a long sequence is processed at a time by adopting a circulating structure, so that a high-resolution reconstructed video rich in details and coherent in time sequence can be obtained. The video super-resolution method based on the attention mechanism and the adversarial learning has the advantages: 1, the novel video super-resolution method based on theattention mechanism and the adversarial learning is provided, and the super-resolution effect is improved; 2, the video super-resolution method based on the attention mechanism and the adversarial learning provided by the invention is better in effect; and 3, the video super-resolution can be applied to an actual scene, such as a monitoring device and a satellite image.

Description

technical field [0001] The invention belongs to the technical field of computer digital image processing, and in particular relates to a video super-resolution method based on an attention model and an adversarial learning model. Background technique [0002] The main way for humans to obtain information is vision, and most vision-based applications depend on image quality. However, usually due to factors such as hardware equipment or harsh environments, it is difficult to obtain high-resolution video images. Super-resolution technology processes a given sequence of low-resolution images or video frames to reconstruct detailed high-resolution images or video frames without the cost of upgrading the imaging system. [0003] The early super-resolution technology was proposed in the 1980s. Initially, mathematical methods were used for reconstruction, such as iterative and repeated projection methods and interpolation methods, but failed to achieve good results. At present, th...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T3/40
CPCG06T3/4076G06T2207/20081G06T2207/10016Y02T10/40
Inventor 王浩哲陈艳姣谈震威
Owner WUHAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap