Learning state hybrid analysis method for static multi-person scene

Abstract

The invention provides a learning state hybrid analysis method for a static multi-person scene. At the beginning of a class, the concentration degrees of the students are highly concentrated, according to the invention, the face is detected by using an algorithm with high front face detection speed and high precision, and the static position areas of the students are estimated; then, the life values and the hit values of the static positions of the students are judged, an algorithm with high side face detection precision is called, so that through the double-layer face detection, the accuracy of face detection in the static multi-person scene, such as a classroom, etc., is greatly improved, and the operation speed is ensured. For the recognized and obtained head postures and facial expressions of the students, the concentration degrees of the students are obtained by comparing and calculating the head postures of the students with the head postures of the surrounding students, the expressions of the students are classified in a plurality of ways, and the diversity of the expression classification and the calculation of the concentration degree of the students can improve the reliability of the analysis result of a multi-modal feature analysis module.

Description

technical field [0001] The present invention relates to a learning state hybrid analysis method for static multi-person scenes, more specifically, it relates to multi-modal information feature fusion of static multi-person scene double-layer face detection, student head posture recognition, and expression recognition. A real-time analysis method for students' learning status in a static multi-person scene. Background technique [0002] Existing studies have shown that students' positive emotions in the classroom can promote students' cognition, while negative emotions hinder students' cognition. Therefore, in the teaching process, the teacher should adjust the teaching strategy in time according to the emotional state of the students to get better teaching effect. The traditional method of mastering the emotional state of students requires the teacher to pay great attention to each student in the class, or to know the emotional state of the students in this class through an...

AI Technical Summary

Problems solved by technology

[0004] In order to solve the time-consuming and labor-intensive situation for teachers in natural classrooms to control students' emotional states and learning states, the present invention performs double-layer face detection on video single-frame still images under a hybrid method, locates face areas, and obtains students' facial expressions, head Posture information and static position information of students, and then through the fusion analysis of multi-modal information features, the learning status of students in the classroom can be obtained

Images