Human-computer interaction method and device based on facial features

Abstract

The invention provides a human-computer interaction method and device based on facial features, and the method comprises the steps of continuously obtaining a plurality of user images when a preset video is played, and extracting a user face image in each user image; extracting facial feature information in each user face image; determining the pose change information of the user according to the change value of the facial feature information of the plurality of user face images and the time interval between the collected user face images, wherein the pose change information comprises an angle change value and an angular velocity change value; and generating a corresponding control instruction according to the pose change information, and executing a corresponding control operation on the preset video based on the control instruction. According to the human-computer interaction method and device based on the facial features, the current motion state of the face of the user is judged by detecting the biological features and the motion posture of the face of the human body, then control signals such as pause or playing can be sent out, and video playing control through face motion is achieved.

Description

technical field [0001] The present invention relates to the technical field of human-computer interaction, in particular, to a method and device for human-computer interaction based on facial features. Background technique [0002] In the process of calligraphy education, the body state includes the posture of holding the pen, hand movements, body posture, etc. Changes in mental state include shifting focus of attention, fluctuations in learning interest, interruption of learning rhythm, etc. In the process of traditional calligraphy informatization teaching, students can practice calligraphy while watching the teaching video, but when watching the teaching video, the students may be required to operate the equipment that plays the teaching video, which may change the physical or psychological state of the students, physical and psychological changes It constitutes a major obstacle in the learning process of students. [0003] The existing methods for controlling playback ...

AI Technical Summary

Problems solved by technology

[0004] The manual click control method requires the learner to put down the pen, change the writing posture, and cause fluctuations in the writing mentality

Voice control, playback and pause requires learners to switch from static to dynamic, which will affect their psychological state, and voice recognition is prone to ambiguity, and it is not suitable for multiple people learning at the same time

Images