The invention provides a weak supervision video
anomaly detection method and
system based on prototype orthogonality, and the method comprises the steps: inputting a visual feature sequence into a selective
state space model, so as to filter redundant information in a
time sequence, capture a key dynamic state, and output a high-value
time sequence feature; then, a learnable prototype
codebook containing a normal category prototype
codebook and an abnormal category prototype
codebook is given, end-to-end training is carried out by adopting a multi-instance learning framework of a video-level
label, prototype orthogonality constraint is applied in the training process, and after training is completed, the normal category prototype codebook and the abnormal category prototype codebook are subjected to end-to-end training; according to the method, only the distance between the high-value
time sequence feature and the nearest prototype in the abnormal category prototype codebook is needed, and the video anomaly
score is obtained according to the distance, so that video
anomaly detection is realized. According to the method, the global geometric constraint of prototype orthogonality is introduced, and the selective
state space model (S3M) with efficient calculation is combined, so that the
extremely light weight of the model is realized while the high detection precision is ensured.