Unlock instant, AI-driven research and patent intelligence for your innovation.

Virtual image synthesis method and device, electronic equipment and storage medium

A virtual image and synthesis method technology, applied in the field of image processing, can solve the problems of unrealistic and natural expressions, achieve the effect of natural and realistic muscle linkage, and solve linkage problems

Pending Publication Date: 2020-05-12
IFLYTEK CO LTD
View PDF11 Cites 16 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Embodiments of the present invention provide a virtual image synthesis method, device, electronic equipment, and storage medium to solve the problem that the existing virtual image's corresponding expression is not realistic and natural when outputting voice

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Virtual image synthesis method and device, electronic equipment and storage medium
  • Virtual image synthesis method and device, electronic equipment and storage medium
  • Virtual image synthesis method and device, electronic equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0043] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments It is a part of embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

[0044] In the prior art, synthesis technologies for virtual images can be mainly divided into the following three categories:

[0045] The first category is voice-driven virtual image synthesis technology: the language information and expression information obtained from the voice are independently applied to the final synthesized video. In this ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

Embodiments of the invention provide a virtual image synthesis method and apparatus, an electronic device and a storage medium. The method comprises the steps of determining related features of voicedata, wherein the related features are used for representing features related to the expressions of the speaker contained in the voice data; inputting the image data and the related features into an expression synthesis model to obtain a virtual image video output by the expression synthesis model, wherein the virtual image in the virtual image video is configured with an expression correspondingto the voice data, the expression synthesis model is obtained by training based on the sample speaker video, the related characteristics of the sample voice data corresponding to the sample speaker video and the sample image data. According to the method and device, the electronic equipment and the storage medium provided by the embodiment of the invention, the virtual image expression can betterfit the voice data and is more natural and real.

Description

technical field [0001] The invention relates to the technical field of image processing, in particular to a virtual image synthesis method, device, electronic equipment and storage medium. Background technique [0002] In recent years, with the continuous progress of computer speech synthesis and video synthesis technology, the industry has developed a variety of voice-driven avatar synthesis technologies. Avatars can perform tasks such as news broadcasting, weather forecasting, explaining games, and providing food ordering services. [0003] In the process of performing the above tasks, most avatars only synthesize mouth shapes that match the output voice, and the avatar always maintains a neutral expression, or presets several basic expressions, and configures corresponding expressions for different voice output content. When the avatar thus synthesized is outputting voice, its corresponding expression is often not realistic and natural enough, and the user experience is ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T11/00G06F16/783G06N3/08
CPCG06T11/001G06F16/7834G06N3/08
Inventor 左童春何山胡金水刘聪
Owner IFLYTEK CO LTD