The invention discloses a joint reasoning-based video multi-target tracking method in the technical field of video processing. The method comprises the following steps: firstly, reading a frame of image of a video file, carrying out image rasterization processing, and then calibrating a candidate position of a target by adopting an online detector and a KLT tracking algorithm as a tracker, respectively screening and then integrating the results; secondly, carrying out quantitative grading on the obtained candidate position result; finally, describing the target tracking condition by using a joint function, and taking the optimal solution based on the joint function as the position of the target in the frame, so as to achieve target tracking. By adopting the joint reasoning-based video multi-target tracking method, the processing of the treatment method combined with a detection tracking algorithm and multi-target relationship in the tracking technology under multi-target tracking can be achieved, and the multi-target relationship is described by using the joint function, so that not only is the result fusion of detection and tracking achieved, but also the relationship between the targets is integrated according to overall situation, so that a global optimal resolution is obtained.