The invention discloses a learner emotion intelligent recognition method based on a multi-
modal adaptive fusion network, and the method is characterized in that the method comprises the steps: collecting multi-
modal data of a learner in a
digital learning process, carrying out the
semantic enhancement of a single-
modal feature through a cross-modal semantic supervision module, and carrying out the recognition of the single-modal feature; all the
modes can still obtain complementary emotional representation when
noise exists or information is insufficient; an information self-adaptive fusion module is used for dynamically distributing weights according to the difference of the contribution degrees of different emotion categories to the
modes, and self-adaptive fusion of the multi-mode features is achieved; and finally, inputting the fused features into a classifier, and outputting the emotional state of the learner. Compared with the prior art, the method has the advantages of high recognition precision, high adaptability and outstanding education scene application value, realizes intelligent recognition of the emotion of the learner, assists in adjusting the teaching strategy according to the recognition result, improves the
personalized learning guide level, and improves the learning experience. The problems of insufficient feature expression, inflexible fusion mode, poor educational application adaptability and the like are solved.