Student psychological state analysis method and device based on audio and video, terminal and medium

Abstract

The invention relates to the technical field of artificial intelligence, and provides a student psychological state analysis method and device based on audio and video, a terminal and a medium, and the method comprises the steps: carrying out the transfer learning and training of a student emotion expression recognition model based on an open source emotion expression data set and a private emotion expression data set; carrying out distortion correction and grid mapping on the student panoramic video to obtain a student target video of each student; recognizing the student target video througha student emotional expression recognition model to obtain an activation degree and a pleasure degree; calculating a student target video to obtain activeness; calculating negative emotion accordingto the audios of the students; and analyzing the psychological state of the student according to the activation degree, the pleasure degree, the activity degree and the negative emotion. The method can be applied to wisdom education, the psychological states of students can be comprehensively analyzed in multiple modes, and the accuracy is high. In addition, the invention also relates to the technical field of the block chain, and the psychological state can be stored in the block chain.

Description

technical field [0001] The present invention relates to the technical field of artificial intelligence, in particular to an audio-video-based method, device, terminal and medium for analyzing students' mental states. Background technique [0002] With the continuous improvement of the informatization of the society, schools are paying more and more attention to the mental health of students. In different growth environments, students may have psychological allergies due to mental or physical changes, and thus induce mental illness. If it is not detected and treated in time, it will lead to more serious consequences. [0003] In the prior art, although the expression changes of the students are analyzed by collecting the video of each student, and the psychological state of the students is identified based on the expression changes, this technology has the following disadvantages: collecting the video of each student is time-consuming and laborious; Different students have ...

AI Technical Summary

Problems solved by technology

If not detected and treated in time, it will lead to more serious consequences

[0003] In the prior art, although the expression changes of the students are analyzed by collecting the video of each student, and the psychological state of the students is identified based on the expression changes, this technology has the following disadvantages: collecting the video of each student is time-consuming and laborious; Different students have different personalities. Even if some students already have mental illness, it is difficult to express it from the expression, resulting in poor accuracy of the analyzed psychological state, which cannot truly represent the psychological state of the student, or cannot perform expression analysis at all.

Images