Multi-round dialogue semantic comprehension subsystem based on multi-modal emotion identification system

A technology of emotion recognition and semantic understanding, which is applied in the field of multi-round dialogue semantic understanding subsystems, can solve the problems of unintegrated human expressions, spoken words, body, voice, intonation, and physiological characteristics, so as to improve emotional analysis and improve user-friendliness Sexuality and cost reduction effect

Active Publication Date: 2018-11-23
南京云思创智信息科技有限公司
View PDF6 Cites 30 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, it does not integrate people's facial expressions, spoken wo...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-round dialogue semantic comprehension subsystem based on multi-modal emotion identification system
  • Multi-round dialogue semantic comprehension subsystem based on multi-modal emotion identification system
  • Multi-round dialogue semantic comprehension subsystem based on multi-modal emotion identification system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0061] The invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments.

[0062] Because the production of any emotion is accompanied by certain changes in the body, such as facial expressions, muscle tension, and visceral activities. Using these signal changes to directly perform emotion recognition is the so-called basic recognition method, also known as a single-modal emotion recognition method. The current main methods include facial images, language, text, gestures and physiological signals. The present invention proposes to integrate, correspond and reason the understanding of emotions by computers in each of the following single modes to obtain a more complete and accurate emotion recognition method and system.

[0063] The emotion recognition system based on multimodal that present embodiment proposes, its system is made up of following several parts ( figure 1 It is a schematic diagram of a multimodal emo...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present invention discloses a multi-round dialogue semantic comprehension subsystem based on a multi-modal emotion identification system. The system comprises a data collection device and an output device. The system further comprises an emotion analysis software system which performs comprehensive analysis and inference of data obtained through the data collection device and finally outputs aresult to the output device; the emotion analysis software system comprises the multi-round dialogue semantic comprehension subsystem based on a multi-modal emotion identification system. The multi-round dialogue semantic comprehension subsystem based on a multi-modal emotion identification system gets through the emotion identification of five single modals, creatively employs a deep neural network to perform comprehensive determination of information of the single modals of the deep neural network through encoding of the neural network and deep association and comprehending so as to greatlyimprove the accuracy, and the multi-round dialogue semantic comprehension subsystem is suitable for most of general inquiry interaction application scenes.

Description

technical field [0001] The present invention relates to the technical field of emotion identification, in particular, to multimodal emotion recognition systems based on machine learning, deep learning, computer vision, natural language processing, speech recognition, human action recognition, non-contact physiological detection, etc. Round dialogue semantic understanding subsystem. Background technique [0002] Emotion recognition is a technology for judging people's emotional changes. It mainly collects people's external expressions and behavior changes to infer people's psychological state. In modern society, emotion recognition technology is widely used in the development of smart devices, sales guide robots, health management, advertising and marketing, etc. Emotion is a state that integrates people's feelings, thoughts, and behaviors. It includes people's psychological responses to external or self-stimuli, as well as the physiological responses that accompany such psy...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G10L15/24G10L15/25G10L25/63G10L15/18G06K9/00G06K9/62
CPCG10L15/1822G10L15/24G10L15/25G10L25/63G06V40/174G06V40/16G06V40/20G06V20/49G06F18/253
Inventor 俞旸凌志辉
Owner 南京云思创智信息科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap