Unlock instant, AI-driven research and patent intelligence for your innovation.

Digital human video generation method and device, electronic equipment and storage medium

A digital human and video technology, applied in metadata video data retrieval, video data retrieval, neural learning methods, etc., can solve problems such as poor digital human picture effect and sketch image effect, and achieve the effect of improving efficiency and speed

Pending Publication Date: 2022-01-28
SHENZHEN ZHUIYI TECH CO LTD
View PDF0 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] However, in these existing schemes, if the key points of the generated face are not accurate and the effect of the generated sketch is relatively poor, the effect of the final generated digital human picture will be relatively poor.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Digital human video generation method and device, electronic equipment and storage medium
  • Digital human video generation method and device, electronic equipment and storage medium
  • Digital human video generation method and device, electronic equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0096] Various exemplary embodiments of the present disclosure will now be described in detail with reference to the accompanying drawings. It should be noted that the relative arrangement of the components and steps, the numerical expressions and numerical values ​​set forth in these embodiments do not limit the scope of the present disclosure unless specifically stated otherwise.

[0097] Those skilled in the art can understand that terms such as "first" and "second" in the embodiments of the present disclosure are only used to distinguish objects such as different steps, devices, or modules, and neither represent any specific technical meaning nor represent any of them. logical sequence between them.

[0098] It should also be understood that, in the embodiments of the present disclosure, "a plurality" may refer to two or more, and "at least one" may refer to one, two or more.

[0099] It should also be understood that any component, data or structure mentioned in the embo...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention discloses a digital human video generation method and device, electronic equipment and a storage medium. The method comprises the following steps: acquiring a target audio and a target face image; and for an audio frame in the target audio, inputting an audio frame sequence corresponding to the audio frame and a target area image in the target face image into a pre-trained end-to-end model, and generating a target image corresponding to the audio frame, wherein the audio frame sequence corresponding to the audio frame is a sequence of continuous audio frames including the audio frame in the target audio, and the target area image is an area image except a mouth area image in the target face image, and the target image corresponding to the audio frame is used for indicating a person indicated by the target face image to send an audio indicated by the audio frame; generating a digital human video based on the generated target image. According to the embodiment of the invention, the digital human generation efficiency can be improved.

Description

technical field [0001] The present disclosure relates to the technical field of digital human video generation, and in particular, to a digital human video generation method, device, electronic device and storage medium. Background technique [0002] The generation technology of digital human is becoming more and more mature. The existing solutions include digital human generation methods based on pix2pix, pix2pixHD, and video2videosynthesis. Specifically, a large number of digital human generation technologies have emerged, such as digital human generation methods based on pix2pix, pix2pixHD, Vid2Vid, few shot video2video, NERF, and StyleGAN. [0003] However, in these existing solutions, if the key points of the generated face are inaccurate and the effect of generating the sketch map is relatively poor, the effect of the final generated digital human picture will be relatively poor. SUMMARY OF THE INVENTION [0004] In view of this, in order to solve some or all of th...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/783G06F16/78G06V40/16G06V20/40G06V10/44G06V10/774G06V10/82G06K9/62G06N3/04G06N3/08
CPCG06F16/7834G06F16/784G06F16/7844G06F16/7867G06N3/08G06N3/044G06N3/045G06F18/214
Inventor 王鑫宇刘炫鹏常向月刘云峰
Owner SHENZHEN ZHUIYI TECH CO LTD