Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Body language-based emotion perception method adopting deep learning and UKF

A deep learning, body technology, applied in the field of emotion perception based on body language

Active Publication Date: 2018-08-03
SOUTH CHINA UNIV OF TECH
View PDF8 Cites 23 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

But this approach is useless if people's emotions are not shown on their faces

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Body language-based emotion perception method adopting deep learning and UKF
  • Body language-based emotion perception method adopting deep learning and UKF
  • Body language-based emotion perception method adopting deep learning and UKF

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0106] Current methods of emotion perception include electrocardiogram (ECG), facial expression, voice, text and gestures for emotion perception. Electrocardiograms contain reliable emotional information. The electrocardiographic approach has been shown to be effective for emotion perception. However, this method requires special equipment and requires direct contact with the human body. Facial expressions are the more obvious features that convey emotion. Through facial expressions, emotions can be given generality. But this approach is useless if people's emotions are not shown on their faces. In the process of speaking, pitch and speed can also reflect the emotion of the speaker. This feature is also used for emotion perception. When people read, the text can also express the author's emotion, so the present invention is also one of the ways of emotion perception. Text is an effective way of conveying emotion in written communication, but people don't often use text f...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a body language-based emotion perception method adopting deep learning and UKF. The method comprises the following steps of monitoring a person entering a Kinect work area by adopting Kinect, and then calculating skeleton points of the person in real time; estimating the positions of the skeleton points by using unscented Kalman filtering, and calculating a measurement error generated by a tracking error and noises of a device; adopting a convolutional neural network method for static body actions, and adopting bidirectional long-short-term memory conditional random field analysis for dynamic body actions; and directly putting output items of characteristics obtained after action processing into a softmax classifier for performing identification, thereby identifyingeight emotions. The body language-based emotion perception has the following advantages that firstly, body languages can be more easily captured by a sensor; secondly, emotion perception-based body language noises are relatively small; thirdly, the body languages have less fraudulence; and fourthly, the capture of the body actions does not influence or disturb the actions of participants.

Description

technical field [0001] The invention relates to the technical field of industrial robot teaching, in particular to an emotion perception method based on body language using deep learning and UKF. Background technique [0002] Today, robots are always used to replace humans to perform repetitive and dangerous tasks. With the further development of computer technology, emotion perception has become a new requirement for robots. Humans expect robots to be able to sense human emotions during interactions and respond accordingly. When people communicate with each other, they can understand each other's emotional state by observing details such as speech rate and facial expression. The development of sensor technology and deep learning algorithms has made emotion perception based on information fusion possible. [0003] Emotion sensing methods are: Emotion sensing electrocardiogram (ECG), facial expressions, voice, words and gestures. Electrocardiograms contain reliable emotio...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/62
CPCG06V40/10G06V40/20G06F18/2415
Inventor 杜广龙张爱玲张博刘彩冰张平
Owner SOUTH CHINA UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com