Embodiments of the present disclosure provide a video data processing method and device, electronic equipment and storage medium. The method comprises: obtaining a clustering representation corresponding to a target topic label and to-be-processed video data comprising the target topic label, wherein the clustering representation is obtained by clustering a plurality of target video data comprising the target topic label; performing multi-modalfeature extraction on the to-be-processed video data to obtain a multi-modal representation of the to-be-processed video data; and determining the relevance of the target topic label and the to-be-processed video data according to the clustering representation corresponding to the target topic label and the multi-modal representation of the to-be-processed video.