Video-oriented super-resolution method and device, equipment and storage medium

A super-resolution and video technology, applied in the field of video processing, can solve the problems of super-resolution effect degradation, inability to deal with video motion blur, poor super-resolution effect, etc., to achieve the effect of improving video super-resolution

Active Publication Date: 2019-08-16
BEIJING BAIDU NETCOM SCI & TECH CO LTD
View PDF16 Cites 13 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In the existing super-resolution technology, the image super-resolution method is used to super-resolution the video frame by frame, the super-resolution effect is poor, and the motion blur in the video cannot be dealt with; The super-resol

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Video-oriented super-resolution method and device, equipment and storage medium
  • Video-oriented super-resolution method and device, equipment and storage medium
  • Video-oriented super-resolution method and device, equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0054] In the following, only some exemplary embodiments are briefly described. As those skilled in the art would realize, the described embodiments may be modified in various different ways, all without departing from the spirit or scope of the present invention. Accordingly, the drawings and descriptions are to be regarded as illustrative in nature and not restrictive.

[0055] figure 1 A flowchart showing a video-oriented super-resolution method according to an embodiment of the present invention. Such as figure 1 As shown, the method may include:

[0056] Step S101, extracting a hypergraph based on continuous frame images in the original video.

[0057] The video segment can be uniformly sampled from the original video, and then a fixed-length continuous frame image is randomly selected from the video segment. The continuous frame images may include a sequence of multiple frame images arranged in time order. A hypergraph is extracted based on the continuous frame ima...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention provides a video-oriented super-resolution method and device, equipment and a storage medium. The video-oriented super-resolution method comprises the following steps:extracting a super-image based on continuous frame images in an original video; inputting the super-image vector corresponding to the super-image into a residual convolutional neural network to obtainan output result of the residual convolutional neural network; and inputting an output result of the residual convolutional neural network into a spatial upsampling network to obtain a super-resolution video frame, the super-resolution video of the original video comprising a plurality of video frames. According to the method provided by the embodiment of the invention, the time domain information in the original video is reserved on the basis of the super-image formed by the continuous frame images, and the residual convolutional neural network and the spatial sampling network are used for modeling the original video, so that the video super-resolution effect can be greatly improved under the calculation complexity of the same magnitude as that of the image super-resolution network.

Description

technical field [0001] The present invention relates to the technical field of video processing, in particular to a video-oriented super-resolution method, device, equipment and storage medium. Background technique [0002] With the rise of the mobile Internet, the way users store and forward information gradually transitions from text and pictures to video. However, video transmission requires high network bandwidth, and video storage also requires increased hard disk space. Video super-resolution technology can convert low-resolution video into high-resolution video. Video services can transmit and store lower-resolution videos, and use super-resolution technology to present high-resolution videos for users when playing, saving bandwidth and storage space while providing users with high-quality video viewing experience. In the existing super-resolution technology, the image super-resolution method is used to super-resolution the video frame by frame, the super-resolution...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T3/40G06T7/90H04N21/4402
CPCG06T3/4076G06T3/4046G06T7/90H04N21/440263G06T2207/10016G06T3/4053
Inventor 李超何栋梁刘霄丁予康文石磊丁二锐张赫男孙昊
Owner BEIJING BAIDU NETCOM SCI & TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap