The invention provides an unmanned aerial vehicle cluster
obstacle avoidance strategy generation method based on a double-
delay depth deterministic strategy gradient (TD3). According to the method, a Markov
decision model is constructed by combining task requirements, environmental conditions and unmanned aerial vehicle performance parameters, the Markov
decision model comprises a
state space, an action space and a reward function, and the model is trained through a TD3
algorithm. The method comprises the following steps: firstly, determining a target
motion direction and density of an unmanned aerial vehicle cluster, and setting a minimum safety distance and an obstacle distance to ensure
flight safety; and then, defining a reward function, and guiding the unmanned aerial vehicle to realize effective
obstacle avoidance and formation maintenance in a complex environment. Compared with a traditional rule-driven and classical
algorithm (such as geometric path planning and an artificial
potential field method), the scheme based on the TD3 has higher
adaptive capacity and flexibility, the strategy can be rapidly adjusted in a dynamic environment, and
local optimum is avoided. Besides, the TD3
algorithm improves the stability and convergence of the strategy through
delay strategy updating and experience playback, so that the unmanned aerial vehicle cluster keeps real-time
obstacle avoidance and formation stability in a high-density scene. Experimental results show that the method can effectively avoid obstacles, maintain a preset formation and reduce
energy consumption in a
simulation environment, and the application potential of the method in unmanned aerial vehicle cluster cooperative tasks is proved. The method is suitable for multi-unmanned aerial vehicle cluster tasks in the fields of military, logistics distribution, environment monitoring and the like, and the task execution efficiency and safety can be remarkably improved.