Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Video generation method, storage medium and equipment

A technology of video and audio clips, applied in the computer field, can solve the problems of high production cost, consumption, and many manpower

Active Publication Date: 2021-07-06
GUANGZHOU HUYA TECH CO LTD
View PDF7 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, such a method needs to consume more manpower, and the production cost is higher

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Video generation method, storage medium and equipment
  • Video generation method, storage medium and equipment
  • Video generation method, storage medium and equipment

Examples

Experimental program
Comparison scheme
Effect test

specific Embodiment

[0066] In this embodiment, target video 23 is generated for the initial picture 21 and target text 22 input by the user, such as figure 2 as shown, figure 2 is a schematic diagram of the video generation process shown in this specification according to an exemplary embodiment, wherein the specific process is as follows:

[0067] S201. Detect the face frame in the initial picture 21, correct the detected face frame through the face frame correction module, obtain the corrected face frame, crop the initial picture, and extract the picture 24 of the face area;

[0068] S202. Detect the key points of the human face in the picture 24, and use the key points of the human face to obtain the initial human face features 25, the initial human face features 25 include initial human face shape features and initial head posture features;

[0069] S203. Input the target text 22 into a preset TTS model for conversion, and obtain output audio data 26;

[0070] S204. Segment the audio data...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a video generation method, a storage medium and equipment; the method comprises the steps: carrying out the decoupling of an initial face feature in an initial image, obtaining an initial face shape feature and an initial head posture feature, segmenting audio data, obtaining a target expression feature corresponding to a segmented audio segment, and carrying out the segmentation of the target expression feature; and combining the initial face shape feature, the initial head posture feature and the target expression feature to construct a target picture corresponding to the audio clip, and finally combining the target pictures corresponding to all the audio clips to obtain a target video. Therefore, the video is generated according to the initial picture and the audio data, the production cost of producing the video based on a single face image is reduced, and the reality is improved.

Description

technical field [0001] This specification relates to the field of computer technology, and in particular to a video generation method, storage medium and equipment. Background technique [0002] Face-based image processing technology is developing rapidly and has been widely used, especially in virtual reality, film production, game entertainment and other fields. At present, the method of making animation based on a single face image is usually to first establish a face model based on the face image, and then capture real face motion to extract expression parameters and synthesize expressions. However, such a method needs to consume more manpower, and the production cost is higher. Contents of the invention [0003] In order to overcome the problems existing in related technologies, this specification provides a video generation method, storage medium and equipment. [0004] According to the first aspect of the embodiments of this specification, there is provided a meth...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T13/20G06T13/40G06K9/00
CPCG06T13/205G06T13/40G06V40/169G06V40/171
Inventor 林哲陀得意韩欣彤康世胤
Owner GUANGZHOU HUYA TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com