Video restoration method and device, electronic device and storage medium

A repair method and video technology, applied in the field of video repair, can solve the problems that video repair cannot achieve continuous consistency, lack of timing consistency, and it is difficult to repair in real time

Active Publication Date: 2019-05-28
BEIJING SENSETIME TECH DEV CO LTD
View PDF10 Cites 15 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] At present, some existing methods for image restoration can be directly applied to video, but due to the lack of timing consistency, it is difficult to achieve continuous consistency between frames in video.
Other traditional video repair algorithms based on optimization, because they need to continuously se

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Video restoration method and device, electronic device and storage medium
  • Video restoration method and device, electronic device and storage medium
  • Video restoration method and device, electronic device and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0107] Various exemplary embodiments, features, and aspects of the present disclosure will be described in detail below with reference to the accompanying drawings. The same reference numbers in the figures indicate functionally identical or similar elements. While various aspects of the embodiments are shown in drawings, the drawings are not necessarily drawn to scale unless specifically indicated.

[0108] The word "exemplary" is used exclusively herein to mean "serving as an example, embodiment, or illustration." Any embodiment described herein as "exemplary" is not necessarily to be construed as superior or better than other embodiments.

[0109] The term "and / or" in this article is just an association relationship describing associated objects, which means that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist simultaneously, and there exists alone B these three situations. In addition, the term "at least one" herein mean...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a video restoration method and apparatus, an electronic device and a storage medium. The method comprises the steps of obtaining a first forward optical flow and a first reverse optical flow between adjacent images in multiple continuous frames of images; performing optical flow optimization processing on the first forward optical flow and the first reverse optical flow respectively to obtain a second forward optical flow corresponding to each first forward optical flow and a second reverse optical flow corresponding to each first reverse optical flow; carrying out forward conduction optimization on the continuous multi-frame images by utilizing the second forward optical streams, and carrying out reverse conduction optimization on the continuous multi-frame imagesby utilizing the second reverse optical streams until all the images in the optimized continuous multi-frame images meet repair requirements; and according to the optimized images obtained through the forward conduction optimization and the reverse conduction optimization, obtaining the continuous restored image of the multi-frame image. According to the embodiment of the invention, the consistency of the continuous frame repair and the real-time performance of repair can be improved.

Description

technical field [0001] The present disclosure relates to the field of video restoration, and in particular to a video restoration method and device, electronic equipment and a storage medium. Background technique [0002] Image inpainting has always been an important issue in computer vision, and has important applications in many fields. For example, image dewatermarking and image inpainting can be achieved through image inpainting. Video inpainting, as an extension of image inpainting on video, is much more difficult to implement than pure image inpainting. However, with the development of the Internet, the application of video repair algorithms has a wider prospect, such as the need to remove video watermarks and certain parts of videos. [0003] At present, some existing methods for image restoration can be directly applied to video, but due to the lack of timing consistency, it is difficult to achieve continuous consistency between frames in video. Other traditional v...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T5/00H04N5/14
CPCG06T5/001G06T2207/10016H04N7/0137G06T2207/20081G06V10/10
Inventor 徐瑞李晓潇周博磊吕健勤
Owner BEIJING SENSETIME TECH DEV CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products