A visual target tracking method for quadrotor UAV based on binocular camera

Abstract

The invention discloses a binocular camera-based four-rotor unmanned aerial vehicle visual target tracking method. The tracking target is detected through a target recognition algorithm, and then the visual tracking algorithm based on correlation filtering is used to complete the position tracking of the target in the pixel sense. and scale tracking, and judge whether the tracking loss needs to start the relocation program or update the long-term tracker according to the tracking effect; then, according to the image area selected by the tracking frame, use the LK optical flow method to carry out the four-rotor UAV and For the calculation of the relative distance of the tracking target, the Kalman filter is used to estimate the global state of the tracking target after coordinate transformation; finally, according to the estimated global position and velocity state of the target, the state quantity of the outer loop control system of the UAV is designed to realize the Man-machine stable tracking of the tracking target without delay.

Description

technical field [0001] The invention belongs to the technical field of quadrotor drones, and more specifically relates to a binocular camera-based visual target tracking method for quadrotor drones. Background technique [0002] In the field of quadrotor UAV technology, visual target tracking UAV has good practical value. In the field of military reconnaissance, through the use of target recognition and tracking technology on UAVs, the target can be continuously locked and monitored, and the position and movement state information of the target can be estimated, so as to guide one's own side to carry out precise fire strikes; in terms of aerial photography, small to consumption In the high-end market, ordinary consumers have a huge demand for follow-up shots when playing games, and in the industrial application market, motion close-up shots during film and television shooting. These functions used to require experienced drone operators to complete, and the operating threshol...

AI Technical Summary

Problems solved by technology

[0003] There are two main implementation methods for existing similar UAV target tracking systems. The first method requires the tracking target to carry GPS or other electronic beacons that can communicate with the UAV. The UAV completes the target tracking by receiving the positioning information of the beacon. This method obviously has great limitations in application; the second method is to use the visual tracking algorithm to track the tracking target, but most of the tracking algorithms used are traditional tracking algorithms, which have poor tracking ability and do not have Long-term tracking capability. In addition, many similar systems need to know the shape and size of the target in advance in order to obtain the state information such as the relative distance between the UAV and the tracking target and the speed of movement, or use the flying height of the UAV as one of the state estimation conditions. one, this makes it only possible to track known targets or targets that are moving on the ground

These situations affect the practicability of visual target tracking drones, and the application scenarios have great limitations

Images