Teaching interactive answering positioning method, device, computer equipment and storage medium
Through multimodal fusion technology and momentum perception Transformer module, the problem of inaccurate answer positioning in classroom interactive teaching is solved, and a more efficient and fair teaching environment is achieved.
CN119559972BActive Publication Date: 2025-04-18GUANGDONG OPEN UNIV (GUANGDONG POLYTECHNIC VOCATIONAL COLLEGE)
2 Cites 0 Cited by
Patent Information
- Application Number
- CN202510111911.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2025-01-24
- Publication Date
- 2025-04-18
- Estimated Expiration
- 2045-01-24
AI Technical Summary
Technical Problem
In the existing classroom interactive teaching environment, there are inaccurate problems in the positioning method of students' quick answers, which affects teaching fairness and classroom order.
Method used
Multimodal fusion technology is adopted to generate a spectrum mask through feature extraction and fusion of video frame sequences and mixed audio files, and a visual sound source positioning map is generated through momentum perception Transformer module and CAM.
Benefits of technology
It improves the accuracy and response speed of quiz positioning, enhances the interactive and interesting teaching, and improves teaching efficiency and quality.
✦ Generated by Eureka AI based on patent content.
Abstract
The present invention belongs to the field of artificial intelligence, and relates to a teaching interactive answering positioning method, device, computer equipment and storage medium. The method includes: obtaining a set of video frame sequences and a corresponding mixed audio file; identifying key frames in the set of video frame sequences, performing feature extraction, and performing short-time Fourier transform on the mixed audio, and then performing feature extraction on the audio; performing multimodal fusion to generate a spectrum mask; calculating the momentum information of continuous video frames and generating momentum embedding, and performing spectrum embedding processing according to the spectrum mask; inputting a momentum-aware Transformer module to generate sequence information; performing residual fusion to generate a spectrum mask; and generating a visual sound source localization map. Multimodal fusion improves positioning accuracy, momentum embedding and spectrum embedding enhance timing sensitivity, residual fusion optimizes feature integration, and a visual sound source localization map enhances intuitiveness, enhances the interactivity and fun of learning, and helps to improve teaching efficiency and quality.
Need to check novelty before this filing date? Find Prior Art