Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Emotion recognition method and system based on mobile intelligent terminal sensor equipment

A technology of mobile intelligent terminal and sensor equipment, which is applied in the fields of emotion recognition and psychological diagnosis and treatment, and can solve the problems of lack of research results and applications.

Pending Publication Date: 2020-11-13
NAT UNIV OF DEFENSE TECH +1
View PDF1 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] Emotional analysis of text, facial expression, and voice has matured in the market, while emotional analysis of other data forms on mobile smart terminal devices, especially the emotional analysis method derived from many data information on the mobile terminal and tools, there are no particularly mature research results and applications on the market

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Emotion recognition method and system based on mobile intelligent terminal sensor equipment
  • Emotion recognition method and system based on mobile intelligent terminal sensor equipment
  • Emotion recognition method and system based on mobile intelligent terminal sensor equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0074] Embodiment 1, the mobile smart terminal used is a smart phone, and the sensor device on the smart phone is used to collect raw sensor data.

[0075] Please refer to figure 1 , in the mobile smart terminal of the user, the embodiment of the present invention provides a data collection method, comprising the following steps:

[0076] Step 1. Receive the emotion recognition task from the user and start the data collection service.

[0077] Step 2, obtaining the corresponding sensor management object corresponding to the data collection.

[0078] Step 3: Register the listener for the sensor device with the smartphone, start the monitoring service, monitor the data of each sensor in real time, record its real-time changes, and obtain all the sensor data required within the time period.

[0079] Step 4: Send the sensor information data obtained through monitoring to the server, and log off the sensor monitor after the data collection is completed.

[0080] Step 5, receivin...

Embodiment 2

[0082] Embodiment 2, on the server side, the embodiment of the present invention provides an emotion recognition method, comprising the following steps:

[0083] Step 1. Perform data processing, data cleaning and preprocessing for the raw sensor data collected in real time by each sensor on the user's mobile smart phone.

[0084] Step 11, filtering illegal data, adding a code verification function in the background of the server, filtering illegal data, such as null values, data that obviously exceeds the sensor data range, and eliminating them.

[0085] Step 12, the data is subjected to a median filtering operation. In general, data collected from hardware requires filtering operations. There are two main filtering methods: mean filtering and median filtering. Among them, mean filtering is realized based on calculating the average value of the neighborhood, so the edge information and feature information in the waveform image will be blurred. The median filter can highligh...

Embodiment 2

[0088] In step 2 of Embodiment 2, the sensors include motion sensors, light sensors, GPS sensors or / and network sensors. The methods for extracting features from various sensor data are as follows:

[0089] Acceleration sensors and gyroscopes belong to motion sensors; for motion sensors, their data are divided into three dimensions of x, y, and z, corresponding to the real three-dimensional space, which are drawn into curved waveform graphs, and their peak and valley values ​​are counted as For the violent value of the fluctuation, count the number of peaks and troughs as the number of fluctuations, and count the time occupied by the peaks and troughs as the fluctuation time, so as to obtain the eigenvector corresponding to the motion sensor data.

[0090] For the light sensor, the following features are extracted from the light sensor data as the corresponding feature vectors: According to the light sensor data, the usage environment information of the mobile smart terminal a...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides an emotion recognition method and system based on mobile intelligent terminal sensor equipment. The method comprises the steps: collecting original sensor data under different emotion types through all sensors on a mobile intelligent terminal, enabling the original sensor data to serve as training samples, and marking the real emotion types corresponding to all training samples; features are extracted from the preprocessed sensor data, feature vectors corresponding to the training samples under different emotion categories are obtained, and a training set is constructed;obtaining a final emotion recognition classifier based on the training set; and utilizing the emotion recognition classifier to predict original sensor data acquired by each sensor on the mobile intelligent terminal in real time to obtain an emotion prediction result. According to the method, the multi-dimensionality of the sensor data collected by the mobile intelligent terminal and the low participation and convenience of the collection mode are fully utilized, and a good emotion recognition prediction result is obtained under the emotion recognition classifier.

Description

technical field [0001] The invention belongs to the technical field of emotion recognition, and relates to an emotion recognition method under a mobile intelligent terminal device, which can be used in the fields of emotion recognition, psychological diagnosis and treatment, and the like. Background technique [0002] At present, emotion recognition has been developed very well, but most of its applications are distributed in semantic recognition, speech recognition, facial expression recognition, etc., and the application in mobile group sensing technology is still very scarce. [0003] Due to the continuous development of the Internet and the widespread popularization of mobile smart terminal devices capable of carrying various sensors, mobile sensing technology is becoming more and more mature. It uses the sensors on the mobile smart terminal equipment that people carry to obtain information about people and the surrounding environment, and uploads the relevant informatio...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06K9/00G06K9/62A61B5/00A61B5/16
CPCA61B5/165A61B5/7267A61B5/7275G06F2218/10G06F2218/04G06F2218/12G06F18/23213G06F18/2431
Inventor 李修建董洛兵衣文军何施俊朱炬波朱梦均刘吉英董朝华
Owner NAT UNIV OF DEFENSE TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com