The invention relates to an intelligent tracking flight system and method of a UAV, and belongs to the field of intelligent autonomous navigation of the UAV. The flight system comprises an image acquisition unit for image acquisition, a flight attitude measurement unit for detecting a flight inertia, a neural network processing unit for neural network processing and a control unit for control flight motion of the UAV; an image collected by a camera in the front of the UAV serves as input, the input is identified by the convolutional neural network, and an obstacle avoidance strategy is given.In the flight process, the alight attitude measurement unit based on a tunnel magnetic resistance effect characterized by high response is used to obtain key change position of the flight attitude ofthe UAV, the image acquisition unit is started to capture key images, a stereoscopic model of the flight environment is formed, key position images are provided for the UAV tracking flight path, and the integrated safety of the UAV tracking flight is improved.