The invention discloses a video pedestrian detection method fusing multi-target tracking clues, and belongs to the field of image processing of computer vision.A pedestrian detection module (improvedFaster R-CNN) and a multi-target tracking module are included. According to the method, the feature pyramid is introduced into the feature extraction network, pedestrians are detected on more scales,features of different layers are fused to improve the prediction effect, and the detection rate and accuracy of small targets are improved. According to the invention, the multi-target tracking moduleis used for assisting pedestrian detection, the inter-frame information of the front and rear frames of the video is introduced, the detection stability can be improved, and the historical frame target track and the target number obtained through the tracking module are used for relieving the detection instability caused by deformation, shielding and targets located at the edge of the picture. According to the invention, the anchor point box is modified in the pedestrian detection network part, so that the pedestrian detection network part better conforms to the characteristics of pedestrians, thereby improving the pedestrian detection precision.