Learning concentration detection method, computer equipment and readable medium

Abstract

The invention discloses a learning concentration detection method, computer equipment and a readable medium. The method comprises the following steps: acquiring a voiceprint signal and a head posture image of a to-be-detected object; inputting the voiceprint signal and the head posture image into a trained multi-modal fusion model, and extracting current voiceprint emotion features and head posture features of the to-be-detected object; the multi-modal fusion model comprises a first network model and a second network model; the multi-modal fusion model carries out fusion classification on the voiceprint emotion features output by the first network model and the head posture features output by the second network model to obtain the current voiceprint emotion state and the head posture angle of the to-be-detected object; generating a current concentration detection result of the to-be-detected object based on the voiceprint emotional state and the head posture angle; according to the invention, complementation of the voiceprint signal and the head posture image information is realized, the accuracy of learning concentration detection under the multi-person audio aliasing background is improved, and objective support data is provided for improving the online learning concentration of students.

Description

technical field [0001] The present application relates to the field of intelligent human-computer interaction technology, and more specifically, to a learning concentration detection method, computer equipment and readable media that integrate voiceprint and head posture clues. Background technique [0002] With the rapid development of education informatization, artificial intelligence technology has been increasingly used in the process of education and teaching. In recent years, the outbreak of novel coronavirus pneumonia has broken the traditional offline teaching mode, and online distance teaching methods have been widely adopted for a while. However, in the absence of close supervision from teachers, how to achieve remote supervision or self-supervision to ensure the learning status and learning efficiency of learners' independent learning has become an urgent problem to be solved. Therefore, it is of great significance to adopt a real-time online learning concentrati...

AI Technical Summary

Problems solved by technology

However, in the process of online learning, learners will listen to lectures quietly and read books with their heads down. It is difficult to accurately judge the current learner's learning concentration state only by relying on unilateral information capture, resulting in a decrease in the accuracy of the test results.

Images