System and method for automatic extraction and generation of audiovisual product content abstract

Abstract

The invention relates to a system and a method for automatic extraction and generation of an audiovisual product content abstract. The system comprises an audiovisual media decoding module, a voice processing module, a text extracting module, a scene segmenting module and a scene semantic annotation and abstract generating module, wherein the scene semantic annotation and abstract generating module is used for generating a text abstract of audiovisual media according to text keywords extracted by the text extracting module and generating a video abstract of the audiovisual media according to scenes aggregated by the scene segmenting module. With adoption of the structure, the system and the method for automatic extraction and generation of the audiovisual product content abstract has the advantages that text keyword information is blended in a conventional scene segmentation algorithm, accordingly, obvious semantic features are provided while the scene is segmented, an audiovisual multimedia content abstract based on semantics is approached by one step, the problem that the text abstract is irrelevant with low-level features is solved simultaneously, so that the text abstract and the video abstract are in accordance semantically, and the system and the method are suitable for large-scale popularization and application.

Description

technical field [0001] The present invention relates to the fields of computer vision and natural language understanding, in particular to the field of extracting audio-visual product content abstracts, and specifically refers to a system and method for automatically extracting and generating audio-visual product content abstracts. Background technique [0002] With the rapid development of network and multimedia technology, multimedia data has exploded. Faced with massive audio-visual media data, people urgently need technologies that can quickly retrieve and browse multimedia data. However, the richness and diversity of audio-visual media data, as well as the unique spatio-temporal high-dimensional structure of feature data, make how to effectively express, store, and manage massive videos become a research hotspot in academia and a focus of industry. focus. Video summarization technology came into being. [0003] Video abstract (Video Abstract), that is, to analyze the...

AI Technical Summary

Problems solved by technology

Its advantage is that it is easy to implement and relatively objective, and it is still the most widely used technology in the industry, such as the preview method of Youku and LeTV Video; the disadvantage is that the selection of key frames has no focus, and it does not conform to the non-uniformity of the temporal and spatial structure of the story , cannot reflect the semantic structure of the video content well

However, compared with audio-visual media information, this technology basically disrupts the original story structure

Images