Game interaction method based on facial expression recognition

Abstract

The invention relates to a game interaction method based on facial expression recognition, and the method comprises the steps: (1) extracting visual features through the learning of different types ofexpression static images through a convolutional neural network, determining the relation between the conversion of facial expressions in an image sequence and facial basic expressions, and obtaininga training model; (2) collecting video information of a player to be detected, and carrying out image interception on the video information according to frames; (3) preprocessing the video image to generate a preprocessed image; (4) performing facial expression analysis, matching the facial expression with the expression features in the training model, and analyzing the current expression of theplayer; (5) controlling the game role through the current facial expression. According to the method, the face of the player is shot only through the camera, the expression analysis and recognition are carried out in the computer, the result is converted into the control instruction of the game, role control in the game is achieved, the player can also be directly or assisted in talking with otherroles, and a conventional game interaction mode is expanded.

Description

technical field [0001] The invention relates to the technical field of facial expression image analysis and recognition, in particular to a game interaction method based on human facial expression recognition. Background technique [0002] Emoji can be said to be an Esperanto, regardless of national boundaries, races and genders, it can be said that everyone has common expressions. Facial expression recognition is widely used in robotics, medical care, driver fatigue detection and human-computer interaction systems. As early as in the 20th century, Ekman and Friesen defined six basic expressions through cross-cultural research: anger, fear, and disgust , happy, sad, and surprised, and then added the "contempt" emoji. The groundbreaking work and intuitive definition make this model still popular in automatic facial expression analysis (AFEA). According to the feature representation, the processing objects of the task of the facial expression recognition system can be divide...

AI Technical Summary

Problems solved by technology

However, with the development of game types and content, these modes can no longer meet the stronger needs of human-computer interaction, and it has become an inevitable trend to apply facial expression recognition technology to games.

Images