The invention belongs to the technical field of
computer vision and video analysis, and particularly relates to a
time sequence adaptive filtering weak supervision video
anomaly detection method based on CLIP assistance. According to the method, a
time sequence modeling and filtering framework fusing vision-language cross-
modal information is designed, and the method comprises the steps that firstly, video local and
global time sequence dependence is decomposed and modeled through a local-
global time sequence adapter, and the capturing capacity of a model for the dynamic evolution process of abnormal events is enhanced; secondly, a double-
branch architecture is adopted, pure visual features are used for completing coarse-grained
anomaly detection, fine-grained anomaly recognition is achieved in combination with visual-language alignment features, and detection requirements of different complexity scenes are met; and finally, introducing a
Fourier transform time sequence filter, adaptively suppressing
noise in a
frequency domain, strengthening abnormal feature representation, and improving the anti-interference capability of the model. The method is remarkably superior to an existing weak supervision method, and the precision and robustness of
anomaly detection can be effectively improved through the synergistic effect of the modules.