Teaching video sentiment analysis method and system based on multi-modal analysis

Through the teaching video sentiment analysis method based on multimodal analysis, multimodal data in teaching videos is extracted and integrated, and event recognition and sentiment analysis is solved, and the problem of insufficient integration of teacher emotions and multimodal data in the existing technology is solved, and more accurate and comprehensive sentiment analysis is achieved.

CN119649271AActive Publication Date: 2025-03-18SUN YAT SEN UNIV
5 Cites 0 Cited by

Patent Information

Application Number
CN202411723999.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-11-28
Publication Date
2025-03-18
Estimated Expiration
2044-11-28

AI Technical Summary

Technical Problem

The existing teaching video sentiment analysis technology ignores teacher emotions, lacks integration of multimodal data, and the limitations of emotional event recognition models, making it difficult to fully demonstrate the synergistic relationship of multimodal data in different situations.

Method used

A teaching video emotion analysis method based on multimodal analysis is proposed. By obtaining classroom teaching videos, students' face information, teaching audio information and teaching text information are extracted, and a multimodal emotion analysis model is input to the multimodal emotion analysis model to identify events, and a multimodal teaching emotional interaction visual analysis system is built to conduct emotional evolution analysis, student group emotional correlation analysis and teacher-student teaching emotional interaction analysis.

Benefits of technology

Effectively pay attention to the emotional changes of teachers and students, integrate multimodal data, improve analysis accuracy in complex situations, provide intuitive and credible emotional analysis data, and support classroom effect evaluation.

✦ Generated by Eureka AI based on patent content.
Patent Text Reader

Abstract

The invention discloses a teaching video sentiment analysis method and system based on multi-modal analysis, and the method comprises the steps: obtaining a classroom teaching video, and processing the classroom teaching video to obtain an original data set which can be used for sentiment analysis; inputting original data in the original data set into a multi-modal sentiment analysis model to obtain a target data set; performing event identification according to target data in the target data set to obtain a plurality of event results; and according to the event result, carrying out emotion evolution analysis, student group emotion correlation analysis and teacher-student teaching emotion interaction analysis on the teacher and student individuals by constructing a multi-mode teaching emotion interaction visual analysis system, and obtaining a teaching video emotion analysis result. According to the embodiment of the invention, emotional changes of teachers and students can be concerned, multi-modal data are integrated, the analysis accuracy under a complex situation is improved, and the method can be widely applied to the technical field of computers.
Need to check novelty before this filing date? Find Prior Art