The invention discloses a detection and tracking method of a moving small target in an aerial shot video. The method includes the steps of 1, collecting images, 2, extracting SURF feature points, 3, carrying out grouped matching on the images, 4, obtaining an affine matrix, 5, obtaining a difference image, 6, carrying out opening operation, 7, extracting a target area, 8, determining a target template, 9, determining a target detection area, 10, extracting and matching the feature points, 11, determining a registering center position of a target, 12, determining a target central position, and 13, determining the length and the width of the target. The method has good real-time performance and robustness in the target tracking process, and can obtain smooth target moving tracks in the target tracking process.