A moving object detection method based on coarse-to-fine image segmentation comprises the following steps: n frame detection images are acquired; feature points are extracted from the first frame image, and the feature points are extracted from the next n-1 frame image to generate motion cues, and a classification of the feature points in the n-th frame image is determined by performing motion segmentation on the motion cues; superpixel segmentation is performed on the n-th frame image to reduce the dimension of the n-th frame image; according to the classification of the mark points in the n-th frame image, the superpixels are marked, and the superpixels are clustered by the similarity measure method, and the rough segmentation of the image is completed on the basis of clustering. The coarse segmentation image is constructed into a quaternary image, and then the quaternary image is fine segmented, so as to realize the accurate detection of the moving object. Through the segmentation from the coarse to the fine, the invention not only has high accuracy rate to the detection of the moving object in the image, but also has faster detection speed, and is more suitable for the detection of the fast moving object.