Video generation method and device, electronic equipment and storage medium

A video and video frame technology, applied in the computer field, can solve the problem of wasting user time, save time and improve user experience.

Pending Publication Date: 2022-03-11
BEIJING DAJIA INTERNET INFORMATION TECH CO LTD
View PDF0 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The present disclosure provides a video generation method, device, and electronic equipment to at least solve the technical problem in the related art that the video generation process requires the user to participate in the whole process, resulting in a waste of a lot of time for the user

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Video generation method and device, electronic equipment and storage medium
  • Video generation method and device, electronic equipment and storage medium
  • Video generation method and device, electronic equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0068] In order to enable ordinary persons in the art to better understand the technical solutions of the present disclosure, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings.

[0069] It should be noted that the terms "first" and "second" in the specification and claims of the present disclosure and the above drawings are used to distinguish similar objects, but not necessarily used to describe a specific sequence or sequence. It is to be understood that the data so used are interchangeable under appropriate circumstances such that the embodiments of the disclosure described herein can be practiced in sequences other than those illustrated or described herein. The implementations described in the following exemplary examples do not represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatuses and methods consi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a video generation method and device, electronic equipment and a storage medium, and relates to the technical field of computers.The method comprises the steps that after the electronic equipment obtains a face image, the obtained face image is input into a first-order motion model for motion synthesis, an initial video is obtained, and each video frame face image in the initial video carries a face motion; performing feature extraction on each video frame face image in the initial video to obtain a first expression coefficient sequence corresponding to each video frame face image; inputting the lyrics into the multi-modal model to obtain a second expression coefficient sequence corresponding to the lyrics; wherein the multi-modal model is obtained by training according to a mapping relation between the lyric sample and the expression coefficient sequence; and adjusting key points in the face image of each video frame according to the first expression coefficient sequence and the second expression coefficient sequence to obtain a face action and lyric matching target video. Therefore, not only is the time of the user saved, but also the use experience of the user is improved.

Description

technical field [0001] The present disclosure relates to the field of computer technology, and in particular to a video generation method, device, electronic equipment and storage medium. Background technique [0002] With the development of video communication technology and mobile devices, and the prevalence of live broadcast and short videos in recent years, shooting short videos on terminal devices has become a basic demand of users. [0003] In related technologies, when a user makes a short video of singing, a terminal device is used to record when the user sings, so as to obtain a short video of the user singing. However, the generation process of the entire short video requires the user to participate in the whole process, which wastes a lot of time of the user. Contents of the invention [0004] The present disclosure provides a video generation method, device and electronic equipment, to at least solve the technical problem in the related art that the video gene...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06V40/16G06T5/50H04N21/81
CPCG06T5/50H04N21/8106H04N21/8126G06T2207/20132G06T2207/20221G06T2207/30201
Inventor 饶强黄旭为张国鑫
Owner BEIJING DAJIA INTERNET INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap