Intelligent teaching evaluation and diagnosis system and method based on multi-mode audio and video analysis

By acquiring multimodal audio and video data and analyzing it using MTES technology, the problems of modal fragmentation and fixed-segment interference in teaching evaluation were solved. This enabled dynamic segmentation and accurate diagnosis of teaching events, improving the accuracy of teaching evaluation and the completeness of segmented segments.

CN120997010AActive Publication Date: 2025-11-21NANJING HEARING TECH CO LTD
15 Cites 2 Cited by

Patent Information

Application Number
CN202511517111.4
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-10-23
Publication Date
2025-11-21
Estimated Expiration
2045-10-23

AI Technical Summary

Technical Problem

Existing teaching evaluation technologies process video, audio, and screen content independently, failing to capture cross-modal correlation phenomena, and the fixed-time slicing method leads to interference between teaching evaluation and diagnostic results.

Method used

By deploying camera arrays, directional microphone groups, and screen capture devices, time-stamp-aligned video streams of teacher and student behavior, audio streams, and teaching screen content streams are collected simultaneously to construct multimodal audio and video data. Combined with MTES technology, teaching status features are extracted and time-series model analysis is performed to achieve dynamic segmentation and diagnostic assessment.

Benefits of technology

It effectively solves the problem of cross-modal spatiotemporal mismatch, improves the accuracy and precision of teaching evaluation, and ensures the integrity of segmented segments and the reliability of diagnostic reports.

✦ Generated by Eureka AI based on patent content.
Patent Text Reader

Abstract

The invention relates to the technical field of teaching evaluation and diagnosis management, in particular to an intelligent teaching evaluation and diagnosis system and method based on multi-mode audio and video analysis. Carrying out classroom teaching event identification on the teaching state feature set extracted at the current time; in combination with an MTES technology, classroom teaching event evolution process analysis based on a time sequence model is carried out, and classroom audios and videos are dynamically segmented based on an obtained classroom teaching event evolution process analysis result. According to the method, a mode of comprehensively quantifying the index set bound with each classroom teaching event based on the MTES technology can effectively solve a modal splitting phenomenon among modal acquisition data in a teaching evaluation and diagnosis process; according to the invention, the dynamic segmentation points of the classroom audio and video are screened, locked and calibrated from multiple angles, and the accuracy of the classroom audio and video segmentation segments is ensured.
Need to check novelty before this filing date? Find Prior Art