Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Interaction method, interaction device, electronic equipment and storage medium

An interactive method and text technology, applied in the Internet field, can solve problems such as lack of human-like emotional expression and inability to achieve interactive experience, and achieve the effect of an interesting interactive experience

Pending Publication Date: 2022-04-15
IFLYTEK CO LTD
View PDF0 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] This application provides an interaction method, an interaction device, an electronic device, and a storage medium to solve the problem that the avatar in the prior art does not have human-like emotional expression and cannot achieve a very natural interaction experience

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Interaction method, interaction device, electronic equipment and storage medium
  • Interaction method, interaction device, electronic equipment and storage medium
  • Interaction method, interaction device, electronic equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0031] The inventor has found through long-term research that with the popularity of AR (Augmented Reality) / VR (Virtual Reality) concepts in recent years, virtual image technology has gradually entered people's field of vision. Among them, virtual image technology uses specific digital images in computers to perform tasks such as news broadcasting, program interaction, and man-machine dialogue. It serves as the humanoid avatar of users or machines in scenarios such as VR / AR and metaverse, providing users with more natural interactive experience.

[0032] The current avatar technology can be roughly divided into two categories: two-dimensional avatar based on real-person video data, and three-dimensional avatar based on modeling software design. The generation method of the two-dimensional virtual image is based on real-person video data, and uses a deep neural network to perform the face video generation task. Its advantage is that the generated virtual image video is very re...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an interaction method, an interaction device, electronic equipment and a storage medium, and the interaction method comprises the steps: obtaining an inquiry text and a facial expression of a user, and determining a current emotion type label of the user; determining a reply text of the inquiry text based on the inquiry text and the emotion type label, and forming a dialogue text based on the inquiry text and the reply text; utilizing the dialogue text and the emotion type label to obtain emotion response data matched with the emotion type label; and loading the emotional response data into the virtual image so as to make an interactive response with emotions to the user. Through the above scheme, the virtual image corresponding to the interaction method can perform human-like emotion expression, so that the user can correspondingly obtain more natural and more interesting interaction experience.

Description

technical field [0001] The present application relates to the technical field of the Internet, and in particular, relates to an interaction method, an interaction device, electronic equipment, and a storage medium. Background technique [0002] The current avatar technology can be roughly divided into two categories: two-dimensional avatar based on real-person video data, and three-dimensional avatar based on modeling software design. The generation method of the two-dimensional virtual image is based on real-person video data, and uses a deep neural network to perform the face video generation task. The generation method of the 3D virtual image is to create a drivable 3D virtual image model based on modeling software in advance, and then use the deep neural network method to control the facial expressions and body movements of the model. [0003] However, regardless of whether it is a 2D or 3D avatar, the current avatar interaction system can only perform simple facial exp...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F16/332G06F16/338G06F16/33G06V40/16G06F40/295G06K9/62G06V10/774
CPCG06F16/3329G06F16/338G06F16/3344G06F40/295G06F18/214
Inventor 胡诗卉何山胡金水殷兵刘聪
Owner IFLYTEK CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com