Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Animation image driving method and device based on artificial intelligence

An image and animation technology, applied in the field of data processing, can solve the problems of unsatisfactory user immersion and lack of perfect animation image driving method.

Active Publication Date: 2019-12-03
TENCENT TECH (SHENZHEN) CO LTD
View PDF7 Cites 78 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The user immersion brought by this type of human-computer interaction is difficult to meet the interaction needs of current users. In order to improve user immersion, animation images with the ability to change expressions, such as mouth-shaped changes, are the current research and development direction.
[0004] However, there is currently no perfect animation image driving method

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Animation image driving method and device based on artificial intelligence
  • Animation image driving method and device based on artificial intelligence
  • Animation image driving method and device based on artificial intelligence

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0049] Embodiments of the present application are described below in conjunction with the accompanying drawings.

[0050] At present, it is the main research direction of human-computer interaction to regard the animated image with the ability of changing expression as the interactive object to interact with the user.

[0051]For example, in the game scene, you can build a game character (animated image) that is the same as the user's own face. When the user inputs text or voice, the game character can make a voice and make a corresponding expression (such as mouth shape, etc.); Or, in the game scene, build a game character with the same face shape as the user, etc. When the other party inputs text or voice, the game character can reply to the voice and make corresponding expressions according to the other party's input.

[0052] In order to better drive the animated image, for example, to drive the animated image to make a voice and make a corresponding expression, an embodim...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention discloses an animation image driving method based on artificial intelligence. The method comprises the following steps: collecting media data of facial expression changes when a speaker speaks voice, determining a first expression base of a first animation image corresponding to the speaker, and reflecting different expressions of the first animation image through the first expression base. After target text information used for driving the second animation image is determined, acoustic features and target expression parameters corresponding to the target text information are determined according to the target text information, the collected media data and the first expression base. Acoustic features and target expression parameters are used. A second animation image with a second expression base can be driven. According to the method and the device, the second animation image can give out the sound of the target text information spoken by the speaker through acoustic feature simulation, and the facial expression conforming to the due expression of the speaker is made in the sounding process, so that vivid substitution feeling and immersion feeling are brought to the user. The interaction experience of the user and the animation image is improved.

Description

technical field [0001] The present application relates to the field of data processing, in particular to an artificial intelligence-based animation image driving method and device. Background technique [0002] With the development of computer technology, human-computer interaction has become more common, but most of them are pure voice interaction. For example, the interactive device can determine the reply content according to the text or voice input by the user, and play the virtual sound synthesized according to the reply content. [0003] The user immersion brought by this type of human-computer interaction is difficult to meet the interaction needs of current users. In order to improve user immersion, animation images with the ability to change expressions, such as mouth-shaped changes, are the current research and development direction. . [0004] However, there is no perfect animation image driving method at present. Contents of the invention [0005] In order to...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/01G06F3/16G06T13/40
CPCG06F3/011G06F3/167G06T13/40G10L21/10G10L2021/105A63F13/54A63F13/55G06F3/017G06V20/46G06V40/174G10L13/00G06T13/205G10L15/02G10L2015/025
Inventor 暴林超康世胤王盛林祥凯季兴朱展图李广之陀得意刘朋
Owner TENCENT TECH (SHENZHEN) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products