Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Digital human generation method and device, equipment and medium

A life and digital technology, applied in the fields of equipment and media, digital human generation methods, and devices, it can solve problems such as unnatural postures of digital human beings, and achieve the effect of improving user experience and natural posture.

Pending Publication Date: 2022-01-04
SHENZHEN ZHUIYI TECH CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, the facial key points deduced based on sound contain facial pose information, and the face pose information has an angle problem. Therefore, the digital human pose finally generated by applying the above scheme is unnatural.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Digital human generation method and device, equipment and medium
  • Digital human generation method and device, equipment and medium
  • Digital human generation method and device, equipment and medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0096] In order to make the purposes, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments It is a part of the embodiments of this application, but not all of them. Based on the embodiments in the present application, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present application.

[0097] see figure 1 , shows a flowchart of steps of a method for generating a digital human provided by an embodiment of the present application. Specifically, the digital human generation method provided by this application can be applied to video generation scenarios, such as the situation where a virtual image of a video is generate...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a digital human generation method and device, equipment and a medium, and relates to the technical field of computers, and the digital human generation method comprises the steps: inputting a target audio into a trained first generator, and obtaining a plurality of first human face key points which do not contain human face posture information; extracting 3D face reconstruction parameters from the target face image; determining a plurality of second face key points including face pose information according to the plurality of first face key points and the 3D face reconstruction parameters; and according to the second face key points, generating a digital human picture. Therefore, the generated posture of the digital human is more natural, and the user experience is improved.

Description

technical field [0001] The present application relates to the field of computer technology, and in particular to a method, device, equipment and medium for generating a digital human. Background technique [0002] A digital human is a virtual simulation of the form and function of the human body at different levels using the method of information science. With the rapid development of computer technology, the generation technology of digital human is becoming more and more mature. In actual processing, if the digital human generation technology is to be applied in business to achieve real-time interaction, the digital human generation solution needs to meet at least two points: good generation effect and high reasoning efficiency; among them, good digital human generation effect is necessary The premise is that high reasoning efficiency is a business need. [0003] At present, in order to improve the reasoning efficiency of digital humans, there has been a solution to gene...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/783G06F16/78G06K9/00G06K9/62G06N3/04G06N3/08
CPCG06F16/7834G06F16/784G06F16/7844G06F16/7867G06N3/08G06N3/045G06F18/214
Inventor 王鑫宇常向月刘炫鹏刘云峰
Owner SHENZHEN ZHUIYI TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com