The invention discloses a fast correlation neighborhood feature point-based sliding window target tracking method. The method includes the following steps of: S1, target window template generation; S2, fast correlation neighborhood feature point extraction; S3, optimal point of interest screening; S4, point of interest sliding window search; S5, feature point template matching update; and 6, decision voting output. The invention also discloses a fast correlation neighborhood feature point-based sliding window target tracking system. With the method and system of the invention adopted, the problem of poor real-time performance and low stability of target tracking in a complex condition can be solved. According to the method and system, fast correlation neighborhood feature points, adopted as point of interests, are detected, and therefore, the robustness of target feature description in a complex condition can be enhanced; point of interest screening is carried out through using a window cross-correlation relation, and therefore, the accuracy of the target description can be improved; and sliding window search and adaptive multi-scale template matching online update are adopted in template construction, and target window output is realized through adopting decision voting, and therefore, the accuracy and stability of target tracking in the complex condition can be improved.