The invention discloses a tracking method of a human body moving object with environmental disturbance resistance, comprising the following steps: step 1, determining the characteristic template range of an object to be tracked, and giving out the position range of the characteristic template of the object to be tracked according to the determined upper border, lower border, left border and rightborder of the template; step 2, determining the characteristic template information of the object to be tracked; step 3, determining the state of the object to be tracked, and dividing the state of the object to be tracked into three conditions, such as single object, multiple object adhesion and adhesion object separation, for processing respectively; step 4, tracking the object to be tracked, wherein the tracking manners comprise an object tracking manner under the state of the single object, an object tracking manner under the adhesion object state and an object tracking manner of the adhesion object separation; and step 5, updating the characteristic template of the object to be tracked. By utilizing the method, the complexity of the algorithm is lowered, and the accuracy and real-time performance of the object tracking are simultaneously improved.