Emotion recognizing and tracking method based on video information

Abstract

The invention relates to an emotion recognizing and tracking method based on video information. The emotion recognizing and tracking method based on video information comprises the steps that 1, an image is obtained, and three-dimensional head modeling is conducted on the obtained image; 2, image fusion is conducted by means of a generated three-dimensional head model, and continuous emotion expressions and emotion expressions having nothing to do with people are formed; 3, a training sample is constructed by means of a generated fused image, the three-dimensional head model and the emotion values of the three-dimensional head model; 4, an emotion recognition model is trained by means of the constructed training sample; 5, a series of pretreatment operations are conducted before testing is executed if necessary, three-dimensional head key point tracking and emotion recognizing are conducted by means of the trained emotion recognition model till all emotion recognition tasks are completed. The emotion recognizing and tracking method based on video information is suitable for recognition of discrete emotions as well as for emotion recognition under the continuous emotion space expression condition, can be used for tabletop scenes and movable interactive scenes, is not limited by visual information acquisition equipment and can improve the natural man-machine interaction quality.

Description

technical field [0001] The invention belongs to the field of human-computer interaction, and in particular relates to a general emotion recognition and tracking method based on video information. Background technique [0002] With the development of human-computer interaction technology, the traditional human-computer interaction technology has gradually changed to the direction of intelligent interaction and natural interaction. The focus of human-computer interaction has also evolved from defining interaction methods and designing interaction semantics to focusing on users' inner emotions, and then mining users' implicit needs. One of the main tasks of realizing natural human-computer interaction is to enable the computer to naturally perceive the user's emotion in the process of interacting with the user, track its emotional changes, and then communicate and interact with it more subjectively, or speculate on the user's inner feelings. Basic wishes, etc. It can be seen ...

AI Technical Summary

Problems solved by technology

This method enhances the stability and accuracy of the method, but the 3D camera is expensive and bulky, which will impose certain restrictions on interactive operations and greatly reduce the user experience

In addition, compared with the 2D network cameras that have been fully popularized in various terminals, the 3D cameras are not fully popularized, which also limits the popularization and development of the method of using depth image feature extraction equipment to a certain extent.

Images