Video classification method and device

Abstract

The embodiment of the invention discloses a video classification method, and is used for overcoming the defect in the prior art that videos cannot be accurately classified, and improving the degree of accuracy of video classification. The video classification method includes obtaining information in a video, the information in the video including image information, light stream information and acoustic information; utilizing a deep neural network to generate first reference information corresponding to the image information, second reference information corresponding to the light stream information and third reference information corresponding to the acoustic information; processing the video according to the first reference information, the second reference information and the third reference information to obtain a confidence degree matrix of the video and a category relation matrix of the video; and substituting the confidence degree matrix of the video and the category relation matrix of the video into an objective function to obtain an objective fusion parameter of the video, wherein the objective fusion parameter is used for classifying the video.

Description

technical field [0001] The present invention relates to the communication field, in particular to a video classification method and device. Background technique [0002] Video classification refers to the use of visual information, auditory information and action information in the video to process and analyze the video, and to judge and identify the actions and events appearing in the video. Video classification can be applied to many practical problems, such as intelligent monitoring, video data management, etc. [0003] In video classification, early fusion of features is a means of video classification, and early fusion refers to the fusion of feature levels. Such as figure 1 and figure 2 As shown, different features in the video are extracted, such as image features and audio features, and the extracted different features are connected to form a combined feature. During training, the combined features are trained through a support vector machine (English full name:...

AI Technical Summary

Problems solved by technology

[0005] Embodiments of the present invention provide a video classification method and device, which are used to solve the defect that videos cannot be classified accurately in the prior art, and improve the accuracy of video classification

Images