Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Virtual animation role live broadcast method, system and device, and storage medium

A character and action technology, applied in animation production, image data processing, instruments, etc., can solve the problems of expression dislocation, long preparation time, and many operation steps, and achieve the effect of enhancing attractiveness and improving simulation

Active Publication Date: 2020-01-03
苏州大禹网络科技有限公司
View PDF6 Cites 19 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, its disadvantages are that all hardware and software are imported, the price is high, and the price of secondary packaging is even more expensive; the key real-time effect is average, frame drops, expression misalignment is serious, deployment is troublesome, there are many operation steps, and the preparation time is long
[0009] The reasons for the above shortcomings are: face capture is based on an older RGB camera and an old opencv face vision algorithm, the real-time effect is not ideal, the light requirements are very high, and the tracking target will be lost if the environment changes slightly
Each actor needs to create a special expression library before capturing, and it needs to be re-created every time a person is replaced, which requires 1-2 hours of preset processing, which is very inconvenient

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Virtual animation role live broadcast method, system and device, and storage medium
  • Virtual animation role live broadcast method, system and device, and storage medium
  • Virtual animation role live broadcast method, system and device, and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0067] Such as figure 1 Shown is a method for live broadcasting of a virtual animation character provided by an embodiment of the present invention, wherein the method includes the following steps:

[0068] Step S11: capture the actor's action information;

[0069] Step S12: capture the expression information of the actor;

[0070] Step S13: capture the voice information of the actor;

[0071] Step S14: Fusing the action information and expression information with the virtual animation character, and driving the virtual animation character to perform corresponding actions and expressions;

[0072] Step S15: Outputting the driven virtual animation character together with the sound information in the form of a live video stream.

[0073] The present invention captures the actor's action information, facial expression information, and voice information, fuses them with virtual animation characters, and then outputs them in the form of live video broadcasting, thereby changing ...

Embodiment 2

[0099] at the same time as Figure 4 , the present invention also discloses a virtual animation character live broadcast system, which includes:

[0100] A motion capture module 1 configured to capture motion information of an actor;

[0101] The facial expression capture module 2 is configured to capture the facial expression information of the actor;

[0102] A sound capture module 3 configured to capture voice information of actors;

[0103] The integration module 4 is configured to integrate the action information and expression information with the virtual animation character, and drive the virtual animation character to perform corresponding actions and expressions; and

[0104] The video output module 5 is configured to output the driven virtual animation character and sound information together in the form of a live video stream.

[0105]Through the motion capture module 1, expression capture module 2, and voice capture module 3, the actor's motion information, expr...

Embodiment 3

[0127] Figure 5 It is a schematic structural diagram of a terminal device provided by Embodiment 9 of the present invention. Figure 5 A block diagram of an exemplary device 12 suitable for use in implementing embodiments of the invention is shown. Figure 5 The shown device 12 is only an example and should not impose any limitation on the functions and scope of use of the embodiments of the present invention.

[0128] Such as Figure 5 As shown, device 12 takes the form of a general purpose computing device. Components of device 12 may include, but are not limited to: one or more processors or processing units 16, system memory 28, bus 18 connecting various system components including system memory 28 and processing unit 16.

[0129] Bus 18 represents one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a processor, or a local bus using any of a variety of bus structures. These archit...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a virtual animation role live broadcast method, system and device, and a storage medium, and the method comprises the following steps: capturing the motion information of an actor; capturing expression information of actors; capturing sound information of the actor; fusing the action information and the expression information with the virtual cartoon character, and driving the virtual cartoon character to perform corresponding actions and expressions; and outputting the driven virtual animation role and the sound information in the form of a live video stream. The virtual cartoon character live broadcast method and system have the advantages that the traditional mode that live broadcast can only be carried out by a real person basically is changed, the defect that atraditional virtual cartoon character can only carry out a few fixed actions is overcome, and meanwhile the invention further discloses a corresponding virtual cartoon character live broadcast systemand device and a storage medium.

Description

technical field [0001] The present invention relates to the technical field of animation live broadcast, in particular to a method, device, equipment and storage medium for live broadcast of virtual animation characters. Background technique [0002] With the development of electronic entertainment industry and network transmission technology, live video broadcast, as a brand-new online entertainment method, is more and more popular among young audiences. At present, the more mainstream ones are usually all kinds of real-life anchors, including game and singing anchors. At present, some Internet companies are trying to use new technologies to create some virtual animation characters for live broadcast to meet the preferences of different groups of people. [0003] The traditional live broadcast of virtual animation characters adopts the mode of recording and broadcasting, and very few adopt the model of motion capture real-time live broadcasting, but it is basically impossi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): H04N21/2187G06T13/40G06F3/01
CPCG06F3/011G06T13/40H04N21/2187
Inventor 周航
Owner 苏州大禹网络科技有限公司
Features
  • Generate Ideas
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com