Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Video generation method, video generation device, electronic device and storage medium

A video and sequence generation technology, applied in the field of image processing, can solve the problems of uncontrollable dynamic video and difficult deployment of application scenarios for video generation methods, and achieve the effect of improving controllability

Active Publication Date: 2018-11-27
BEIJING SENSETIME TECH DEV CO LTD
View PDF7 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, in the process of motion modeling, it will be affected by noise and abnormal posture (pose), resulting in uncontrollable dynamic video; and in actual application scenarios, noise and abnormal posture are ubiquitous, so such video Generative methods are difficult to deploy to actual application scenarios

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Video generation method, video generation device, electronic device and storage medium
  • Video generation method, video generation device, electronic device and storage medium
  • Video generation method, video generation device, electronic device and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0073] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, rather than all embodiments . Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0074] The terms "first", "second" and the like in the description and claims of the present invention and the above drawings are used to distinguish different objects, rather than to describe a specific order. Furthermore, the terms "include" and "have", as well as any variations thereof, are intended to cover a non-exclusive inclusion. For example, a process, method, system, product or device comprising a series of steps or units is not ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention relates to the technical field of image processing and discloses a video generation method, a video generation device, an electronic device and a storage medium. The method comprises the steps: obtaining an input image and a target action type, generating a first posture sequence according to the input image and the target action type and then generating dynamic video according to the input image and the first posture sequence. Thus, the video generation method disclosed by the embodiment of the invention can avoid noise and abnormal postures and can prevent generated video from including mutant video frames, so that video generation controllability is improved.

Description

technical field [0001] The present invention relates to the technical field of image processing, in particular to a video generation method, a video generation device, an electronic device and a storage medium. Background technique [0002] With the development of basic technology in the field of image processing, the technology of video generation is also in the ascendant. Video generation can use single or multiple images to generate continuous dynamic videos, which can not only be used in interactive applications, but also can be used to generate more data to increase the amount of data and reduce manual labeling when the amount of data is scarce workload. [0003] With the emergence of Generative Adversarial Network (GAN), video generation technology has made a huge breakthrough. The common idea of ​​video generation is to perform video motion modeling and content modeling separately, and finally obtain dynamic video through two-step processing. However, in the proces...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): H04N5/262G06N99/00G06K9/00
CPCH04N5/262G06V40/176G06V40/20
Inventor 杨策元王哲石建萍
Owner BEIJING SENSETIME TECH DEV CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products