Video space-time super-resolution implementation method and device

A technology of super-resolution and implementation methods, applied in neural learning methods, image analysis, instruments, etc., can solve problems such as the inability to make full use of super-resolution performance, and achieve the goal of improving super-resolution performance, quality, and visual quality. Effect

Active Publication Date: 2021-04-27
SHENZHEN UNIV
View PDF5 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, they are strongly correlated, and such methods cannot fully utilize their correlations to improve super-resolution performance.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Video space-time super-resolution implementation method and device
  • Video space-time super-resolution implementation method and device
  • Video space-time super-resolution implementation method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0070] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0071] It should be understood that when used in this specification and the appended claims, the terms "comprising" and "comprises" indicate the presence of described features, integers, steps, operations, elements and / or components, but do not exclude one or Presence or addition of multiple other features, integers, steps, operations, elements, components and / or collections thereof.

[0072] It should also be understood that the terminology used ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a video space-time super-resolution implementation method and device, and the method comprises the steps of carrying out the edge enhancement of a video frame of a video, and obtaining an edge-enhanced video frame; inputting the plurality of edge-enhanced adjacent video frames into an optical flow estimation module in pairs to obtain a bidirectional optical flow; calculating the bidirectional optical flow to obtain an estimated optical flow, and inputting the estimated optical flow and the bidirectional optical flow into a bidirectional prediction module together to obtain a predicted optical flow; calculating the prediction optical flow and the corresponding video frame to obtain an intermediate frame for time domain super-resolution, and inserting the intermediate frame into a corresponding position in the video; and performing spatial domain super-resolution processing on the intermediate frame and the corresponding video frame through a cyclic super-resolution network to obtain a plurality of reconstructed frame; and circularly executing the steps until the space-time super-resolution of the whole video is completed. The invention has the beneficial effects that space-time joint super-resolution can be effectively carried out on the video, and the visual quality of the video is improved.

Description

technical field [0001] The present invention relates to a method and device for realizing video spatio-temporal super-resolution, in particular to a method and device for realizing video spatio-temporal super-resolution. Background technique [0002] The purpose of video super-resolution is to increase the resolution of a video. Compared with improving the video resolution by improving the hardware equipment for capturing video images, the cost of using video super-resolution technology is lower. Usually video super-resolution techniques reconstruct high-quality frames by multiple adjacent frames with high correlation. How to utilize the useful information of adjacent frames is the key to video super-resolution technology. [0003] Video super-resolution technology is usually divided into two types: spatial super-resolution and temporal super-resolution. Spatial super-resolution is used to improve the clarity of video frames, and temporal super-resolution is used to increa...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/13G06T3/40G06N3/08G06N3/02
CPCG06T7/13G06T3/4053G06N3/02G06N3/084
Inventor 王妙辉郑彬
Owner SHENZHEN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap