Multimedia resource processing method based on speech recognition and on-line teaching system thereof

Abstract

The invention discloses a multimedia resource processing method based on speech recognition and an online teaching system thereof. The method comprises the steps: audio and video frequencies are collected simultaneously and data are processed to process audio documents into a speech recognizable format; the audio documents are imposed with the speech recognition to generate script documents and with automatic generation and synchronization of Chinese captions with the video documents; and a content retrieval is imposed on the video documents, an automatic story segmentation based on the content is imposed on the script documents of the audio documents which are stored into the video database after being matched and labeled. The multimedia resource processing method based on the speech recognition and the online teaching system thereof are applied with the automatic processing technology of the multimedia resources, greatly increase the processing speed of such information as captions and the like by the use of high-performance computation of the computer, and reduce the participation degree of manual processing, thus accelerating the video manufacturing process and improving the work efficiency.

Description

technical field [0001] The invention relates to a multimedia automatic processing method and system, in particular to a method and system for automatic processing and online management of a large number of multimedia files such as videos related to teaching courses. Background technique [0002] In the existing technology, with the rapid development of multimedia technology, a large number of teaching courses are presented in the form of multimedia, including recorded teaching course videos, related presentations, etc. The average teaching video per hour contains tens of thousands of words of text content . [0003] Faced with such a massive amount of multimedia information, most online teaching websites still use manual methods, that is, using a large number of senior typists to make subtitles for multimedia materials such as video files and synchronize presentations. This kind of operation based on manual listening and watching is a primitive manual processing method, whi...

AI Technical Summary

Problems solved by technology

However, the system also has many problems, including: the supported video format is single; the accuracy rate of feature value extraction is low, and there is more demand for manual semi-automatic labeling; other multimedia content in distance learning, such as presentations, etc. Integrated processing; the support for the functions required in distance teaching is relatively simple

[0008]However, at present, the multimedia management system for teaching courses that can effectively meet the actual functional requirements in distance teaching and cross-integrate the above-mentioned technologies such as speech recognition and multimedia retrieval is still blank

Images