Unlock instant, AI-driven research and patent intelligence for your innovation.

Student behavior log generation method and system based on audio scene recognition

A scene recognition and audio technology, which is applied in speech analysis, biological neural network models, data processing applications, etc., to achieve strong category discrimination capabilities, accurate recognition and classification, and enhanced semantic expression

Pending Publication Date: 2022-05-27
SHANDONG NORMAL UNIV
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At present, the research on generating student behavior logs through audio scene recognition technology has not been reported.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Student behavior log generation method and system based on audio scene recognition
  • Student behavior log generation method and system based on audio scene recognition
  • Student behavior log generation method and system based on audio scene recognition

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0038] This embodiment provides a method for generating a student behavior log based on audio scene recognition. In this embodiment, the method is applied to a server for illustration. It can be understood that the method can also be applied to a terminal, and can also be applied to a terminal including a terminal. And servers and systems, and through the interaction of terminals and servers. The server can be an independent physical server, a server cluster or a distributed system composed of multiple physical servers, or a cloud service, cloud database, cloud computing, cloud function, cloud storage, network server, cloud communication, intermediate Cloud servers for basic cloud computing services such as software services, domain name services, security services CDN, and big data and artificial intelligence platforms. The terminal may be a smart phone, a tablet computer, a notebook computer, a desktop computer, a smart speaker, a smart watch, etc., but is not limited theret...

Embodiment approach

[0043] As one or more embodiments, the training process of the educational scene recognition model includes:

[0044] Extract the spectral features of audio documents and the probability distribution of topics on audio words;

[0045] Generate a topic feature matrix based on the probability distribution of topics on audio words and the spectral features of audio documents;

[0046] Update topic feature matrix based on graph neural network;

[0047] Classify the updated topic feature matrix;

[0048] Output audio scene recognition results.

[0049] As one or more embodiments, the process of extracting the spectral features of the audio document and the probability distribution of the subject on the audio words includes:

[0050] Label each audio document of each type of educational scene with an educational scene label, and build a training set based on the audio document feature matrix and educational labels of all types of educational scenes;

[0051] Perform K-means clus...

Embodiment 2

[0067] This embodiment provides a system for generating student behavior logs based on audio scene recognition.

[0068] A student behavior log generation system based on audio scene recognition, comprising:

[0069] an acquisition module, which is configured to: acquire the recorded audio document, and divide the audio document into several audio segments;

[0070] a prediction module, which is configured to: adopt a trained educational scene recognition model based on the audio clips to obtain educational scene prediction labels of each audio clip;

[0071] The behavior log generation module is configured to: mark a start time point and an end time point for each audio clip, mark the start time point and the end time point according to each audio clip, and combine the educational scene prediction labels of each audio clip to generate a time distribution behavior log;

[0072] The process of predicting the educational scene recognition model includes: a feature generation m...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention belongs to the technical field of audio scene recognition, and provides a student behavior log generation method and system based on audio scene recognition. The method comprises the following steps: acquiring a recorded audio document, and dividing the audio document into a plurality of audio clips; based on the audio clips, adopting a trained education scene recognition model to obtain education scene prediction labels of the audio clips; marking a starting time point and an ending time point for each audio clip, and generating a time distribution behavior log according to the starting time point and the ending time point marked by each audio clip in combination with the education scene prediction tag of each audio clip; wherein the education scene recognition model prediction process comprises the steps of extracting spectrum features of audio documents and probability distribution of themes on audio words, generating theme features based on the probability distribution of the themes on the audio words and the spectrum features of the audio documents, updating the theme features, and performing classification based on the updated theme features. And obtaining an education scene prediction label.

Description

technical field [0001] The invention belongs to the technical field of audio scene recognition, and in particular relates to a method and system for generating student behavior logs based on audio scene recognition. Background technique [0002] The statements in this section merely provide background information related to the present invention and do not necessarily constitute prior art. [0003] Education in the "Internet +" era is a flexible, diverse and open personalized education. This kind of education attaches great importance to the individualized and diverse development of learners, and its educational form has the characteristics of multiple heterogeneity, dynamic change, openness and sharing. This new type of education makes the education scene no longer limited to the traditional classroom education scene, but gradually transforms to a diversified education scene. Such changes in educational scenes have an urgent need for educational scene recognition technolo...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G10L25/12G10L25/18G10L25/30G06Q10/04G06Q50/20G06N3/04
CPCG10L25/12G10L25/18G10L25/30G06Q10/04G06Q50/205G06N3/047G06N3/048G06N3/045Y02D10/00
Inventor 冷严刘祯李甜甜王青路安芹潘杰
Owner SHANDONG NORMAL UNIV