The invention provides a
video monitoring early warning method based on a multi-
modal behavior mode, and the method comprises the following steps: extracting multi-
modal data according to a video
stream, carrying out the preprocessing, carrying out the alignment and fusion of the preprocessed multi-
modal data, and enabling the multi-
modal data to comprise RGB frames, an
optical flow field,
human skeleton key points, and a scene semantic segmentation map; performing short-time behavior pattern feature and behavior pattern
library establishment and scene behavior baseline construction on the fused multi-
modal data; updating a dynamic behavior pattern
library based on
online learning, reducing a historical data weight in combination with a time
decay factor, and adjusting an anomaly judgment threshold according to the complexity of a current scene; performing multi-level early warning according to the abnormal judgment threshold value, and performing feedback optimization; according to the method, an intelligent
video monitoring early warning scheme which can automatically learn a scene behavior mode, dynamically adjust an early warning threshold value and fuse multi-dimensional feature analysis is provided, and the problems of high
false alarm rate and poor adaptability in the prior art are solved.