The invention discloses a video monitoring method and a video monitoring system. The method comprises the following steps: S100, acquiring a video stream to be analyzed currently; S200, detecting whether a motion object exists in the video stream, if yes, carrying out background modeling, morphological process and eliminating shadow, if no, carrying out circular detection; S300, using a particle filtering or a Kalman filtering tracking method to track the motion object; S400, analyzing the shape information and motion characteristics of the motion object, analyzing abnormal situations by utilizing dispersion degree and area information, classifying the motion object and accomplishing abnormal action identification process analysis; and S500, making an emergency alarm when abnormal situation happens to the video stream. With the method in the invention, the motion object can be analyzed intelligently, multiple bottom layer calculation for one same video stream is carried out only once, and miss report and false report rate of abnormal action in monitoring can be reduced; and with the method. Besides, the method also can be linkaged with security, so that monitoring personnel can make response in time.