Unmanned aerial vehicle formation safety optimization control method based on leader-follower

By introducing speed instruction saturation function and adaptive dynamic programming algorithm in the drone formation control, the problems of speed limit and instruction tracking errors are solved, and the safety optimization and stability of the drone formation are achieved, and safety accidents are avoided. occur.

CN118915815AActive Publication Date: 2024-11-08NAT UNIV OF DEFENSE TECH

Patent Information

Application Number
CN202410828872.0
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-06-25
Publication Date
2024-11-08
Estimated Expiration
2044-06-25

AI Technical Summary

Technical Problem

The existing leader-follower-based drone formation control method fails to effectively consider the speed limits of the drone system and the underlying unknown command tracking error, resulting in unstable formation control, which may lead to safety such as inter-aircraft collisions or crashes. ACCIDENT.

Method used

Under the leader-follower formation control structure, by modeling the formation tracking dynamics of the follower drone as an integrator model, the speed instruction saturation function and the underlying unknown instruction tracking error are introduced to set up the optimal control problem, and use the The Hamiltonian and Hamiltonian-Jacobby-Belmann equations solve the optimal control strategy, and apply an adaptive dynamic programming algorithm to update the control law parameters based on the iterative learning of neural network training to perform adaptive compensation for speed limiting and instruction tracking errors.

Benefits of technology

The safety optimization of the drone formation has been achieved, which significantly reduces the formation tracking error, ensures the stability and safety of the drone flight, avoids safety accidents caused by speed limits and command tracking errors, and enhances the formation. Collaborative operation ability.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118915815A_ABST
    Figure CN118915815A_ABST
Patent Text Reader

Abstract

The invention discloses a leader-follower-based unmanned aerial vehicle formation safety optimization control method, and the method comprises the steps: S01, constructing an unmanned aerial vehicle formation under a leader-follower formation control structure; s02, converting the formation tracking kinetic model of the follower unmanned aerial vehicle into an integrator model, introducing a speed instruction saturation function into the integrator model, and representing an unknown instruction tracking error of a bottom layer as an uncertain item in the model; s03, setting an optimal control problem, considering the actual speed limitation of the unmanned aerial vehicle, and solving to obtain an optimal control strategy considering the speed constraint by introducing a Hamiltonian amount and a Hamiltonian-Jacobian-Bellman equation; and step S04, applying a self-adaptive dynamic programming algorithm to carry out self-adaptive compensation on speed limitation and instruction tracking errors. The method has the advantages of simple principle, wide application range, high safety performance and the like.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention mainly relates to the technical field of unmanned aerial vehicle control, and in particular to a safety optimization control method for an unmanned aerial vehicle formation based on a leader-follower system. Background Art

[0002] With the rapid development of drone technology, drone formation control has become a research hotspot in the field of drone applications. In terms of specific applications, drone formations can efficiently cover large areas for operations and can collaboratively perform precise target tasks. In other applications, drone formations can greatly improve the efficiency of emergency rescue, power inspection, forest fire prevention, remote sensing mapping, and agricultural plant protection. However, in practical applications, the safety of drone formations is often crucial. UAV systems are susceptible to speed limits and underlying unknown command tracking errors, which can lead to unstable formation control and even crashes, which not only leads to the failure of mission execution, but may also cause casualties and property losses. Therefore, it is necessary to consider modeling the speed limit and underlying unknown command tracking error of drones, and then design a model and data hybrid driven adaptive learning formation control algorithm to ensure the safety of drone formation flight.

[0003] Among the existing UAV formation control methods, the leader-follower method has many advantages such as simple structure, flexible and scalable, and easy to implement. It is the most commonly used formation control method in practical applications. In the leader-follower formation control, the leader UAV is usually responsible for tracking the flight route planned online or offline, and the follower UAV makes corresponding control adjustments based on the status information of the leader UAV to ensure the stability and safety of the formation. However, the existing leader-follower formation control method does not take into account the speed limitations faced by the actual UAV system and the underlying unknown command tracking errors. On the one hand, this will cause the leader UAV to be unable to accurately track the flight route, and on the other hand, it will cause the follower UAV to be unstable when making formation control adjustments, and even cause collisions or crashes. Summary of the invention

[0004] The technical problem to be solved by the present invention is: in response to the technical problems existing in the prior art, the present invention provides a leader-follower based UAV formation safety optimization control method with simple principle, wide application range and high safety performance.

[0005] In order to solve the above technical problems, the technical solution proposed by the present invention is: A leader-follower-based UAV formation safety optimization control method, comprising: Step S01: Under the leader-follower formation control structure, a UAV formation is constructed; wherein the leader UAV flies according to a preset or real-time planned flight route, and the follower UAV adjusts its own flight attitude according to the status information of the leader UAV to maintain the relative position in the formation; Step S02: transforming the formation tracking dynamics model of the follower UAV into an integrator model, introducing a speed command saturation function into the integrator model, and expressing the underlying unknown command tracking error as an uncertain term in the model; Step S03: setting up an optimal control problem, considering the actual speed limit of the UAV, and solving the optimal control strategy considering the speed constraint by introducing the Hamiltonian and the Hamilton-Jacobi-Bellman equation; Step S04: Apply an adaptive dynamic programming algorithm, based on UAV simulation and actual flight data, through a neural network training process, iteratively learn and update control law parameters, and adaptively compensate for speed limits and command tracking errors.

[0006] As a further improvement of the method of the present invention: in step S02, the speed limit of the actual UAV and the underlying unknown instruction tracking error are considered to establish the following equation:

[0007] in, is the actual calculated speed command, Represents the underlying unknown command tracking error, which is about the speed command Unknown function.

[0008] As a further improvement of the method of the present invention: in step S04, the process of the adaptive dynamic programming algorithm includes: Step S401: Initially set the neural network parameters and use the simple P control law to perform preliminary data collection; Step S402: Based on the collected flight data, the weights of the neural network are updated using the least square method to approach the optimal control strategy; Step S403: Repeat the above data collection and weight updating process until a predetermined learning convergence condition is reached.

[0009] As a further improvement of the method of the present invention: the adaptive dynamic programming algorithm solution process: Step S411: Two neural networks, namely the evaluation network and the execution network, are used to approximate the optimal value function , and optimal virtual speed control instruction as follows:

[0010] in , , and They are and Wiki functions; Step S412: Collect the flight data of the UAV for neural network training. A simple P control law is used during the collection:

[0011] Step S413: Initialization , ; Step S414: Run the loop to iterate and solve the following equation until , is the judgment threshold, usually set to :

[0012] Step S415: When ,make , , exit the loop.

[0013] As a further improvement of the method of the present invention: it also includes step S05: establishing a data link between the follower UAV and the leader UAV through the wireless communication module, so that the follower UAV can receive the leader's position and heading information in real time, and make flight control adjustments according to the updated control law to make the formation stable and safe.

[0014] As a further improvement of the method of the present invention, it also includes step S06: using the training results of the adaptive dynamic programming algorithm, that is, the iteratively optimized control instructions, to guide the actual UAV formation to perform tasks, ensuring that the formation control instructions comply with the UAV dynamic constraints under the conditions of speed restrictions and unknown instruction errors.

[0015] As a further improvement of the method of the present invention: the flight data is collected from the simulated flight or the actual flight test of the UAV.

[0016] Compared with the prior art, the advantages of the present invention are: 1. The leader-follower based UAV formation safety optimization control method of the present invention has a simple principle, a wide range of applications, and high safety performance. The present invention can adaptively learn and adjust the optimal formation speed control instructions based on the speed limit of the actual UAV and the underlying unknown instruction tracking error, thereby avoiding the problem of safety accidents caused by not considering the speed limit and the underlying unknown instruction tracking error in the actual UAV formation flight.

[0017] 2. The leader-follower based UAV formation safety optimization control method of the present invention models the speed limit of the UAV system and the underlying unknown command tracking error, designs a model and data hybrid driven adaptive learning formation control algorithm, and further ensures the safety of UAV formation flight.

[0018] 3. The leader-follower-based UAV formation safety optimization control method of the present invention models the speed limit and the underlying unknown command tracking error, and adopts a method based on adaptive dynamic programming to perform adaptive learning based on UAV simulation and actual flight data. Therefore, compared with the formation control algorithm that does not consider the speed limit of the actual UAV and the underlying unknown command tracking error, the optimal formation control algorithm after iterative learning has a smaller formation tracking error. In addition, since the present invention takes into account the speed limit and the underlying unknown command tracking error, the UAV formation control command calculated by the optimal formation control algorithm is more in line with the dynamic constraints of the actual UAV, further ensuring the flight safety of the UAV formation.

[0019] 4. The leader-follower-based UAV formation safety optimization control method of the present invention realizes effective management of the communication topology between multiple UAVs in the formation through the constructed formation control system structure, ensures accurate transmission and response of information, and enhances the overall collaborative operation capability of the formation. By implementing the method of the present invention, the formation tracking error can be significantly reduced, flight safety can be improved, and the instability problem caused by ignoring speed limits and command tracking errors in traditional formation control can be effectively solved. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] Figure 1 It is a schematic diagram of a UAV formation based on a leader-follower in a specific application example of the present invention.

[0021] Figure 2 It is a schematic diagram of relative position parameters corresponding to the "I"-shaped and "V"-shaped formations used in a specific application example of the present invention.

[0022] Figure 3 It is a schematic diagram of the communication topology relationship between multiple follower drones and a leader drone in a specific application example of the present invention.

[0023] Figure 4 It is a flow chart of the adaptive dynamic programming algorithm of the present invention in a specific application example.

[0024] Figure 5 It is a schematic diagram of the formation control system structure of follower UAVs in a specific application example of the present invention.

[0025] Figure 6It is a schematic diagram of the flow of flight data collection in a specific application example of the present invention.

[0026] Figure 7 It is a schematic diagram of the process of the method of the present invention in a specific application example. DETAILED DESCRIPTION

[0027] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0028] In actual UAV formation flight, the leader UAV is usually responsible for tracking the flight route, and the task of maintaining the formation is mainly completed by the follower UAV. However, existing formation control methods often do not take into account the speed limitations faced by actual UAV systems and the underlying unknown command tracking errors, resulting in unstable formations and prone to safety accidents. The purpose of the present invention is to ensure the stability and safety of actual formation flight by modeling the speed limitations of actual UAV systems and the underlying unknown command tracking errors, and by establishing an optimal control problem, using an adaptive dynamic programming algorithm to solve the optimal formation speed control instructions. That is, under the leader-follower formation control framework, by modeling the speed limitations of UAVs and the underlying unknown command tracking errors, the safe optimization control of UAV formations is achieved using an adaptive learning method based on a hybrid model and data drive.

[0029] In the actual UAV formation system, although a simple and reliable leader-follower-based formation control structure is adopted, the speed limit and the underlying unknown command tracking error are not considered, which can easily lead to the failure of the actual formation control system and even cause safety accidents such as collision and crash of the UAV. Therefore, the present invention designs a model- and data-hybrid-driven adaptive learning formation control algorithm by modeling the speed limit of the UAV system and the underlying unknown command tracking error, so as to further ensure the safety of UAV formation flight.

[0030] To this end, the innovative principle of the present invention is to model the formation tracking dynamics of the follower UAV as an integrator model under the leader-follower formation control framework. Secondly, on the basis of the integrator model, the saturation function of the speed command is introduced, and the underlying unknown command tracking error is modeled as an uncertain term. Finally, an iterative optimization control algorithm based on adaptive dynamic programming is designed, and adaptive learning and training are performed using data collected from simulation or actual flight, so as to iteratively learn the optimal formation control algorithm that takes into account the speed limit and the underlying unknown command tracking error.

[0031] like Figure 1 As shown, it is a schematic diagram of a UAV formation based on a leader-follower in a specific application of the present invention; Figure 7 As shown, a safety optimization control method for a UAV formation based on a leader-follower system of the present invention comprises: Step S01: Under the leader-follower formation control structure, a UAV formation is constructed; wherein the leader UAV flies according to a preset or real-time planned flight route, and the follower UAV adjusts its own flight attitude according to the status information of the leader UAV to maintain the relative position in the formation; Step S02: transforming the formation tracking dynamics model of the follower UAV into an integrator model, introducing a speed command saturation function into the integrator model, and expressing the underlying unknown command tracking error as an uncertain term in the model; Step S03: setting up an optimal control problem, considering the actual speed limit of the UAV, and solving the optimal control strategy considering the speed constraint by introducing the Hamiltonian and the Hamilton-Jacobi-Bellman equation; Step S04: Apply an adaptive dynamic programming algorithm, based on UAV simulation and actual flight data, through a neural network training process, iteratively learn and update control law parameters, and adaptively compensate for speed limits and command tracking errors.

[0032] In a specific application example, in step S02, the speed limit of the actual drone and the underlying unknown command tracking error are considered to establish the following equation:

[0033] in, is the actual calculated speed command, Represents the underlying unknown command tracking error, which is about the speed command Unknown function.

[0034] In a specific application example, in step S04, the process of the adaptive dynamic programming algorithm includes: Step S401: Initially set the neural network parameters and use the simple P control law to perform preliminary data collection; Step S402: Based on the collected flight data, the weights of the neural network are updated using the least square method to approach the optimal control strategy; Step S403: Repeat the above data collection and weight updating process until a predetermined learning convergence condition is reached.

[0035] As a further improvement of the method of the present invention: the adaptive dynamic programming algorithm solution process: Step S411: Two neural networks, namely the evaluation network and the execution network, are used to approximate the optimal value function , and optimal virtual speed control instruction as follows:

[0036] in , , and They are and Wiki functions; Step S412: Collect the flight data of the UAV for neural network training. A simple P control law is used during the collection:

[0037] Step S413: Initialization , ; Step S414: Run the loop to iterate and solve the following equation until , is the judgment threshold, usually set to :

[0038] Step S415: When ,make , , exit the loop.

[0039] In a specific application example, step S05 is also included: establishing a data link between the follower UAV and the leader UAV through a wireless communication module, so that the follower UAV can receive the leader's position and heading information in real time, and make flight control adjustments according to the updated control law to make the formation stable and safe.

[0040] In a specific application example, step S06 is also included: using the training results of the adaptive dynamic programming algorithm, that is, the iteratively optimized control instructions, to guide the actual UAV formation to perform tasks, ensuring that the formation control instructions comply with the UAV dynamic constraints under the conditions of speed restrictions and unknown instruction errors.

[0041] In specific application examples, flight data is collected from simulated flights or actual flight tests of UAVs.

[0042] As can be seen from the above, the formation control method proposed in this embodiment is based on a leader-follower formation control structure, where the leader UAV tracks the flight route planned online or offline, and the follower UAV tracks the leader UAV and maintains a given relative position relationship with it.

[0043] In a specific application example, a given relative position relationship is usually expressed as a set of three-dimensional relative position parameters. Indicates, for example It means that the follower drone is 10 meters away from the leader drone in the inertial coordinate system in the north direction and 20 meters away in the east direction, and the flight altitude is 5 meters higher. According to different formation configuration requirements, the corresponding relative position parameters can be adjusted. The relative position parameters corresponding to the "I" formation and the "V" formation are as follows: Figure 2 shown.

[0044] The follower drone establishes a communication link with the leader drone through the wireless communication module and receives information from the leader drone, including the GPS position and heading angle of the leader drone, and the communication topology relationship between multiple follower drones and the leader drone, such as Figure 3 shown.

[0045] The drone is modeled as an integrator as follows:

[0046] in, and are the position and velocity of the follower UAV in the inertial coordinate system.

[0047] Considering the speed limit of the actual drone and the underlying unknown command tracking error, the following equation is established:

[0048] in, is the actual calculated speed command, Represents the underlying unknown command tracking error, which is about the speed command Unknown function.

[0049] To realize the formation of UAVs, we first need to obtain the formation error equation of the follower UAV tracking the leader UAV, and let the tracking error be , which is a three-dimensional vector, namely Substituting the UAV model into the equation, we get the formation error equation as follows:

[0050] Among them, the speed command must satisfy the constraints .

[0051] Next, we design the following performance indicator function (for the convenience of describing the method, , , the former represents the state of the system, and the latter represents the control input of the system):

[0052] Formulate the optimal control problem:

[0053] The optimal control law is designed as follows:

[0054] in, It is a stable reference speed control instruction, which can be calculated by simple PID control. It is the virtual speed control instruction to be optimized.

[0055] Therefore, the optimal control problem can be rewritten as:

[0056] in, , , .

[0057] Defining the optimal value function for:

[0058] in, is the set of all feasible control laws.

[0059] Next, for the above optimal control problem, the Hamiltonian of the system is defined as:

[0060] in, for right The partial derivative of .

[0061] Then the optimal value function Satisfies the Hamilton-Jacobi-Bellman equation:

[0062] By deriving the above formula, the optimal control law of the system is obtained as follows:

[0063] Substituting the above formula into the Hamilton-Jacobi-Bellman equation, we get:

[0064] Solving the above Hamilton-Jacobi-Bellman equation can obtain the optimal virtual speed instruction , but the equation is highly nonlinear and contains unknown terms , so it is difficult to solve it directly analytically. The following uses an adaptive dynamic programming algorithm to solve it.

[0065] Adaptive dynamic programming algorithm solution process: 1) Two neural networks, the evaluation network and the execution network, are used to approximate the optimal value function , and optimal virtual speed control instruction as follows:

[0066] in , , and They are and Wiki function.

[0067] 2) Collect the flight data of the UAV for neural network training. A simple P control law can be used during the collection:

[0068] 3) Initialization , .

[0069] 4) Run the loop to iterate and solve the following equation until , is the judgment threshold, usually set to :

[0070] 5) When ,make , , exit the loop.

[0071] The specific derivation of the neural network weight update in the above adaptive dynamic programming algorithm loop is as follows: 1) The neural network Substitute into the equation have:

[0072] 2) Order , ,in is the order of the input vector, then: , Right now

[0073] 3) Rewrite the above formula as ; in , , .

[0074] 4) Due to and is linearly related, so it can be obtained by sampling Group and , the least squares method is used to update the neural network weights.

[0075] 5) Specifically, the least squares method is used to update the neural network weights as follows:

[0076] in, , .

[0077] The flow chart of the adaptive dynamic programming algorithm is as follows Figure 4 shown.

[0078] Based on the above method of the present invention, in a specific example, the formation control system structure of the follower drone is as follows: Figure 5 shown.

[0079] Specifically, the data used for training the adaptive dynamic programming algorithm can be either simulated flight data or real flight data. The flow chart of simulated and real flight data collection is as follows: Figure 6 shown.

[0080] Those skilled in the art should understand that the above-mentioned embodiments of the present application can be provided as methods, systems, or computer program products. Therefore, the present application can take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present application can take the form of a computer program product implemented on one or more computer-readable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code. The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the process Figure 1 A process or multiple processes and / or boxes Figure 1These computer program instructions can also be stored in a computer-readable memory that can guide a computer or other programmable data processing device to work in a specific way, so that the instructions stored in the computer-readable memory produce a product including an instruction device, which implements the functions specified in the process. Figure 1 A process or multiple processes and / or boxes Figure 1 These computer program instructions can also be loaded onto a computer or other programmable data processing device, so that a series of operation steps are executed on the computer or other programmable device to produce a computer-implemented process, so that the instructions executed on the computer or other programmable device provide for implementing the process in the process. Figure 1 A process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0081] The above is only a preferred embodiment of the present invention, and does not limit the present invention in any form. Although the present invention has been disclosed as a preferred embodiment, it is not intended to limit the present invention. Therefore, any simple modification, equivalent change and modification made to the above embodiment according to the technical essence of the present invention without departing from the content of the technical solution of the present invention shall fall within the scope of protection of the technical solution of the present invention.

Claims

1. A safety optimization control method for UAV formation based on leader-follower, characterized in that: include: Step S01: constructing a UAV formation under a leader-follower formation control structure; The leader drone flies according to a preset or real-time planned flight route, and the follower drone adjusts its flight attitude according to the status information of the leader drone to maintain its relative position in the formation; Step S02: transforming the formation tracking dynamics model of the follower UAV into an integrator model, introducing a speed command saturation function into the integrator model, and expressing the underlying unknown command tracking error as an uncertain term in the model; Step S03: setting up an optimal control problem, considering the actual speed limit of the UAV, and solving the optimal control strategy considering the speed constraint by introducing the Hamiltonian and the Hamilton-Jacobi-Bellman equation; Step S04: Apply an adaptive dynamic programming algorithm, based on UAV simulation and actual flight data, through a neural network training process, iteratively learn and update control law parameters, and adaptively compensate for speed limits and command tracking errors.

2. The leader-follower based UAV formation safety optimization control method according to claim 1 is characterized in that: In step S02, the following equation is established by considering the actual speed limit of the drone and the underlying unknown command tracking error: in, is the actual calculated speed command, Represents the underlying unknown command tracking error, which is about the speed command Unknown function.

3. The leader-follower based UAV formation safety optimization control method according to claim 1 is characterized in that: In step S04, the process of the adaptive dynamic programming algorithm includes: Step S401: Initially set the neural network parameters and use the simple P control law to perform preliminary data collection; Step S402: Based on the collected flight data, the weights of the neural network are updated using the least squares method to approach the optimal control strategy; Step S403: Repeat the above data collection and weight updating process until a predetermined learning convergence condition is reached.

4. The leader-follower based UAV formation safety optimization control method according to claim 3 is characterized in that: The adaptive dynamic programming algorithm solution process: Step S411: Two neural networks, namely the evaluation network and the execution network, are used to approximate the optimal value function , and optimal virtual speed control instruction as follows: in , , and They are and Wiki functions; Step S412: Collect the flight data of the UAV for neural network training. A simple P control law is used during the collection: Step S413: Initialization , ; Step S414: Run the loop to iterate and solve the following equation until , is the decision threshold: Step S415: When ,make , , exit the loop.

5. The leader-follower-based UAV formation safety optimization control method according to any one of claims 1 to 4, characterized in that: The process also includes step S05: establishing a data link between the follower UAV and the leader UAV through a wireless communication module, so that the follower UAV can receive the position and heading information of the leader in real time, and make flight control adjustments according to the updated control law to make the formation stable and safe.

6. The leader-follower-based UAV formation safety optimization control method according to any one of claims 1 to 4, characterized in that: The method also includes step S06: using the training results of the adaptive dynamic programming algorithm, i.e. the iteratively optimized control instructions, to guide the actual UAV formation to perform tasks, ensuring that the formation control instructions meet the UAV dynamic constraints under the conditions of speed limit and unknown instruction error.

7. The leader-follower-based UAV formation safety optimization control method according to any one of claims 1 to 4, characterized in that: The collection of flight data comes from the simulated flight or actual flight test of the UAV.

Citation Information

Patent Citations

  • Unmanned ship formation path tracking method based on deep reinforcement learning

    CN111694365A

  • Unmanned aerial vehicle-unmanned ship heterogeneous cooperative obstacle avoidance formation control method based on preset performance control

    CN118151527A

Cited By

  • Input-limited optimal formation tracking control method based on adaptive dynamic programming

    CN119472737A

  • Iterative learning control method based on master-slave architecture

    CN121187133A