Human-machine interaction method and device, electronic equipment and storage medium

A human-computer interaction and individual technology, applied in the field of human-computer interaction, can solve problems such as difficult to achieve human-to-human interaction, affect interaction, loss, etc., and achieve the effect of increasing the amount of input information, convenient interaction experience, and good interaction effect

Active Publication Date: 2020-05-19
AIWAYS AUTOMOBILE CO LTD
View PDF7 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the existing human-computer interaction systems are difficult to achieve the level of human-human interaction, only the user's voice information is obtained, and there is a lack of more diversified input information, resulting in the entire interaction not reaching the level of human-human interaction
In the dialogue between man and machine, people sometimes have other modalities (such as expressions, gestures, body movements, etc.) Unable to collect richer information, affecting subsequent interactions

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Human-machine interaction method and device, electronic equipment and storage medium
  • Human-machine interaction method and device, electronic equipment and storage medium
  • Human-machine interaction method and device, electronic equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0073] Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in many forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete and fully convey the concept of example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.

[0074] Furthermore, the drawings are merely schematic illustrations of the invention and are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and thus repeated descriptions thereof will be omitted. Some of the block diagrams shown in the drawings are functional entities and do not necessarily correspond to physically or logically separate entities. These functional entities may be impleme...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a human-machine interaction method and device, electronic equipment, a storage medium. The human- machine interaction method comprises the following steps: S110, collecting video data containing a user; S120, analyzing the video data, including analyzing voice data in the video data to obtain first semantic information; analyzing a user gesture in the video data to obtain second semantic information; analyzing a user head action in the video data to obtain third semantic information; analyzing the user expression in the video data to obtain fourth semantic information; S130, performing multimode fusion on the first semantic information, the second semantic information, the third semantic information and the fourth semantic information to obtain a multimode output; and S140, inputting the multimode output into a reply prediction model, and taking the output of the reply prediction model as reply information. According to the invention, multimode human-machine interaction is realized.

Description

technical field [0001] The present invention relates to the field of human-computer interaction, in particular to a method, device, electronic equipment, and storage medium for human-computer interaction. Background technique [0002] Human-computer interaction helps users solve problems through intelligent interaction of intelligent dialogue and instant question and answer. As artificial intelligence technology has gradually become practical in many fields in recent years, human-computer interaction has become more and more intelligent. AI technology is continuously empowering the intelligent upgrade of human-computer interaction, and human-computer interaction systems, robot devices, chat robot devices, etc. have appeared. The systems in these systems and devices combine natural language understanding, natural language generation, and intelligent dialogue management in human-computer voice interaction systems to make the interactive experience smoother and smarter. Howev...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/332G06F16/783G06K9/62
CPCG06F16/3329G06F16/784G06F16/7844G06F16/7847G06F16/7834G06F18/253
Inventor 王国锋赵江杰陈曲张坤雷陈学文
Owner AIWAYS AUTOMOBILE CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap