The invention provides a ViBe algorithm performance improvement method. The method comprises the following steps of: 1, creating two Boolean matrixes M1 and M2 with the same size as a ViBe input image; 2, modifying an operation performed when the current pixel (x, y) is judged as a background point in a ViBe algorithm; and 3, after the ViBe scans the current image, updating the sample points of the ViBe, and executing the step 2 again. According to the invention, the updating logic of the background model is updated by modifying the ViBe, therefore, the ViBe can be in a high-resolution video sequence, the random number function calling frequency of the ViBe algorithm is greatly reduced, the background model updating speed of the ViBe algorithm is increased, the calculation redundancy is reduced, the calculation efficiency is greatly improved, and meanwhile, the influence on the segmentation quality of the foreground and the background of the ViBe algorithm is extremely low.