The invention provides a background modeling and motion object detection method with image gradient and gray scale integration. The method comprises: 1, collecting N frames of video monitoring data as a training sample; 2, establishing an image-gray-scale-based single Gaussian model; 3, selecting pixel points to establish a gradient model; and 4, carrying out moving object detection. In addition, the invention also provides a background modeling and motion object detection apparatus with image gradient and gray scale integration. The apparatus consists of an image acquisition unit, a gray scale background modeling unit, a gradient background modeling unit, a model judging unit, a moving object detection unit and a background model updating unit. According to the invention, backgrounds are distinguished into a single back ground and a complicated background based on a gray scale standard difference and different background models are established for description; and with the single background model, the background can be described rapidly and effectively, and with the complicated background model, the complicated background change can be described well. Therefore, accuracy of the moving object detection can be improved well.