Dimension emotion recognition method based on multi-scale time sequence modeling

A multi-scale, time-series technology, applied in character and pattern recognition, instruments, computer components, etc., can solve the problems of limited range of time-series modeling, inability to fully reflect the key role of emotional time-series information, and achieve effective prediction

Active Publication Date: 2015-02-18
中科极限元(杭州)智能科技股份有限公司
View PDF3 Cites 21 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, HMM can only perform temporal modeling on a single time scale, and the scope of temporal modeling i

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Dimension emotion recognition method based on multi-scale time sequence modeling
  • Dimension emotion recognition method based on multi-scale time sequence modeling
  • Dimension emotion recognition method based on multi-scale time sequence modeling

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0017] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be described in further detail below in conjunction with specific embodiments and with reference to the accompanying drawings.

[0018] It should be noted that, in the drawings or descriptions of the specification, similar or identical parts all use the same figure numbers. The implementations shown or described in the accompanying drawings are forms known to those of ordinary skill in the art. It should be pointed out that the described examples are only considered for the purpose of illustration and not limitation of the present invention.

[0019] figure 1 is a flow chart of the present invention's dimensional emotion recognition method based on multi-scale time-series modeling, such as figure 1 As shown, the described dimension emotion recognition method based on multi-scale time series modeling comprises the following steps:

[0020] Step 1...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a dimension emotion recognition method based on multi-scale time sequence modeling. The method includes performing face detection and tracking on each frame image of a video sequence, and extracting face key points as first class face features; extracting gray values of pixels of a face region image, mouth region image and eye region image as second, third and fourth class face features; performing dimension emotion initial prediction according to the four classes of face features of the multiple frame image in a unit period t; performing time sequence and modality combination through a linear regression device according to the emotion initial prediction results of N unit periods t, and outputting an emotion prediction value of the video sequence. According to the method, time sequence modeling with different scales is performed on video sequence signals, and the precision prediction of each time sequence unit is implemented; the method is adaptive to emotion recognition of face signals of videos and has the advantages of fine real-time performance and greatly improved recognition precision.

Description

technical field [0001] The invention belongs to the field of video signal processing, and in particular relates to a method for dimensional emotion recognition based on multi-scale time series modeling, which improves the accuracy of continuous dimensional emotion recognition. Background technique [0002] In recent years, researchers at home and abroad have done a lot of research work on continuous dimension emotion recognition, and proposed many effective methods for emotion recognition. These methods can be divided into detection methods based on static classifiers and detection methods based on dynamic classifiers in terms of processing strategies. Detection methods based on static classifiers mostly use support vector machines (SVM), neural networks, Boosting, etc., and most of these classifiers are discriminative models. Due to its strong discrimination ability, it is widely used in the field of emotional state recognition, but this method ignores the fact that emotio...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/00G06K9/62
CPCG06V40/176
Inventor 陶建华巢林林杨明浩
Owner 中科极限元(杭州)智能科技股份有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products