A multimodal-based student learning state analysis method and device

Abstract

The present invention proposes a multimodal-based student learning state analysis method and device. By processing the collected first RGB image, the depth image, the second RGB image and the environmental sound signal, combined with the students' preference, behavior, environment Multi-modal analysis of the sound, and finally get the students' attention concentration, which can effectively evaluate the students' learning attention, get the students' learning status, and help the instructors and parents to guide and correct the students' learning status. , timely and effectively correct the bad habits of students in the learning process, and help students learn better.

Description

technical field [0001] The invention relates to the technical field of student learning state analysis, in particular to a multimodal-based student learning state analysis method and device. Background technique [0002] It is observed that most primary and secondary school students are easily distracted in class, like to do small movements, or talk casually, do homework for a while and play for a while, and are easily disturbed by the outside world, etc. These are all important manifestations of attention deficit, which is an important reason for the decline of learning efficiency and poor learning effect. Moreover, as the pace of life is getting faster and faster, parents seldom take time to help students with their studies. When there are problems in learning and learning, parents cannot quickly locate the students' problems, nor can they help students correct the problems and lead to family disharmony. And other issues. [0003] In addition, scholars have found that at...

AI Technical Summary

Problems solved by technology

[0006] The present invention solves the problem that the prior art does not evaluate the students' attention and cannot guide and correct the students' learning status in a targeted manner, and proposes a method and device for analyzing the students' learning status based on multimodality, which helps parents and teachers more convenient Quickly understand the learning status of students, and according to the current learning status of students, timely and effectively correct the bad habits of students in the learning process to help students learn better

Images