Video classification method and device, model training method and device, equipment and storage medium

Abstract

The embodiment of the invention discloses a video classification method and device, a model training method and device, equipment and a storage medium, and belongs to the technical field of computer vision. The method comprises the following steps: acquiring a video; selecting n image frames from the video; extracting respective feature information of the n image frames through a feature extraction network according to a learned feature fusion strategy; and determining a video classification result according to respective feature information of the n image frames. According to the learned feature fusion strategy, feature information of the image frame is extracted; wherein the feature fusion strategy indicates that each image frame is fused with feature information of other image frames; the proportion of the feature information of each image frame is determined, the classification result of the video is determined according to the feature information of the image frames, the feature fusion strategy replaces complex and repeated 3D convolution operation through simple feature information fusion, the workload is small, the time for finally obtaining the classification result of thevideo is short, and the efficiency is high.

Description

technical field [0001] The embodiments of the present application relate to the technical field of computer vision, and in particular to a video classification method, a model training method, a device, a device, and a storage medium. Background technique [0002] In order to enable users to learn video content more quickly, a corresponding video classification label is usually set for each video. [0003] In the related art, the video classification label is set in the following manner: divide the video into multiple sub-videos on average; extract an image frame from each of the above-mentioned multiple sub-videos to obtain multiple image frames; Perform 3D (three-dimension, three-dimensional) convolution operation on the time dimension to obtain the feature information of each image frame fused with other image frames; determine the video classification label of the above-mentioned video according to the feature information of each image frame. [0004] However, since the...

AI Technical Summary

Problems solved by technology

[0005] The embodiment of the present application provides a video classification method, model training method, device, equipment, and storage medium, which can be used to solve the problem in the related art that it takes a long time to finally obtain the video classification label due to the large amount of calculation of the 3D convolution operation

Images