Multi-modal emotion recognition device, method, and storage medium using artificial intelligence

a multi-modal emotion and recognition device technology, applied in the field of multi-modal emotion recognition devices, methods, and storage media using artificial intelligence, can solve the problems of false recognition, insufficient recognition information, false recognition results, etc., and achieve the effect of accurate confirmation of emotion sta

Active Publication Date: 2019-05-30
GENESIS LAB
View PDF0 Cites 19 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Benefits of technology

[0039]According to an embodiment of the present disclosure as described above, the multi-modal emotion recognition dev...

Problems solved by technology

Recognition information can be insufficient with the occlusion problem in a static image simply.
In addition, when a target person talks upon recognizing emotion with face expression, a false emotion recognition result is derived.
In the emotion r...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-modal emotion recognition device, method, and storage medium using artificial intelligence
  • Multi-modal emotion recognition device, method, and storage medium using artificial intelligence
  • Multi-modal emotion recognition device, method, and storage medium using artificial intelligence

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0052]Hereinafter, exemplary embodiments of the present disclosure will be described with reference to the accompanying drawings so that those skilled in the art to which the present disclosure pertains can easily practice the present disclosure.

[0053]The present disclosure can be embodied in various forms and is not limited to the embodiments described herein. In order to clearly describe the present disclosure in the drawings, parts not related to the description have been omitted, and the same or similar components are denoted by the same reference numerals throughout the specification. In addition, the size and thickness of each component illustrated in the drawings are arbitrarily illustrated for convenience of explanation, and thus the present disclosure is not necessarily limited to those illustrated in the drawings.

[0054]In the present disclosure, the term “on” means located above or below the object member, and does not necessarily mean that the object is located on the upp...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

A multi-modal emotion recognition system is disclosed. The system includes a data input unit for receiving video data and voice data of a user, a data pre-processing unit including a voice pre-processing unit for generating voice feature data from the voice data and a video pre-processing unit for generating one or more face feature data from the video data, a preliminary inference unit for generating situation determination data as to whether or not the user's situation changes according to a temporal sequence based on the video data. The system further comprises a main inference unit for generating at least one sub feature map based on the voice feature data or the face feature data, and inferring the user's emotion state based on the sub feature map and the situation determination data.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS[0001]Any and all applications for which a foreign or domestic priority claim is identified in the Application Data Sheet as filed with the present application are hereby incorporated by reference under 37 CFR 1.57.BACKGROUNDTechnical Field[0002]Embodiments of the present disclosure relate to multi-modal emotion recognition device, method, and storage medium using artificial intelligence.Related Art[0003]A conventional technology recognizes occlusion and processes it as an error. Covering a mouth with a hand is important information and can determine the intensity of the emotion state. Recognition information can be insufficient with the occlusion problem in a static image simply.[0004]In addition, when a target person talks upon recognizing emotion with face expression, a false emotion recognition result is derived. In the emotion recognition through expression recognition, a mouth shape is very important information, but the mouth shape often...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/00G10L25/63G06V10/764
CPCG06K9/00315G06K9/00281G06K9/00718G10L25/63G06K9/00355G06K2009/00738G10L25/30G06V40/175G06V40/161G06V40/113G06V10/454G06V10/82G06V10/806G06V10/764G06F18/253G10L25/24G06V40/176G06V20/41G06V40/28G06V40/171G06V20/44
Inventor YOO, DAE-HUNLEE, YOUNG-BOK
Owner GENESIS LAB
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap