Video super-resolution processing method and device, and storage medium
A super-resolution and processing method technology, applied in the field of computer vision and deep learning, can solve the problems that the model cannot be fully and effectively used, and the video super-resolution problem is not well-posed.
Pending Publication Date: 2021-04-23
SOUTH CHINA UNIV OF TECH
View PDF0 Cites 15 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0003] It is well known that the video super-resolution problem is an ill-posed problem
However, stacking large amounts of information can put a lot of pressure on the remaining parts of the network, preventing the model from fully and effectively utilizing all features
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0074] Embodiments of the present invention are described in detail below, examples of which are shown in the drawings, wherein the same or similar reference numerals designate the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the figures are exemplary only for explaining the present invention and should not be construed as limiting the present invention. For the step numbers in the following embodiments, it is only set for the convenience of illustration and description, and the order between the steps is not limited in any way. The execution order of each step in the embodiments can be adapted according to the understanding of those skilled in the art sexual adjustment.
[0075] In the description of the present invention, it should be understood that the orientation descriptions, such as up, down, front, back, left, right, etc. indicated orientations or positional relationships are based...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention discloses a video super-resolution processing method and device, and a storage medium, which are realized by a video processing model, and comprise the following steps: obtaining a video sequence, and extracting a feature map of a reference frame and a feature map of an adjacent frame in the video sequence; aligning the feature maps of the adjacent frames to a reference frame; performing local feature fusion on the aligned feature map to obtain a local fusion feature map; performing global feature fusion on the aligned feature maps to obtain a global fusion feature map; splicing the local fusion feature map and the global fusion feature map and performing video frame reconstruction to obtain a high-definition video frame; and combining the obtained high-definition video frames to obtain a high-resolution video sequence. The performance of the video super-resolution method is improved through the alignment technology and the feature fusion technology, the low-resolution video is effectively reconstructed into the high-resolution video, the visual effect is improved through the technical means, dependence on hardware equipment can be reduced, and the video super-resolution method can be widely applied to the field of computer vision and deep learning.
Description
technical field [0001] The invention relates to the fields of computer vision and deep learning, in particular to a video super-resolution processing method, device and storage medium. Background technique [0002] As one of the fundamental subtasks of video enhancement, video super-resolution aims to map low-resolution videos to corresponding high-resolution videos. Video super-resolution can be considered as an independent task or combined with other tasks. Additionally, the high availability of this method makes it useful in many situations, including satellite video, high dynamic range video, and surveillance video, among others. Therefore, research on video super-resolution has scientific and practical significance. [0003] It is well known that the video super-resolution problem is an ill-posed problem. This property means that a given input may correspond to various outcomes, and how to recover complex outputs remains difficult. On the other hand, although single...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More IPC IPC(8): G06T5/50G06T3/60G06T3/40G06N3/08G06N3/04
CPCG06T5/50G06T3/4076G06T3/60G06T3/4038G06N3/08G06T2207/20221G06T2200/32G06N3/045
Inventor 苏德伟张平健
Owner SOUTH CHINA UNIV OF TECH