Intelligent network connection vehicle anti-DoS attack fixed time optimal control method based on hierarchical structure

By adopting a layered optimal control method in intelligent connected vehicles, combining virtual reference signals and event triggering mechanisms, and using reinforcement learning algorithms, the complexity and performance balance of intelligent connected vehicles system under DoS attacks is solved, and the system is realized Efficient attack resistance and performance optimization.

CN119051892AActive Publication Date: 2024-11-29ARMY ENG UNIV OF PLA

Patent Information

Application Number
CN202411022929.4
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-29
Publication Date
2024-11-29
Estimated Expiration
2044-07-29

AI Technical Summary

Technical Problem

The optimal control method of existing intelligent connected vehicles is highly complex when facing DoS attacks and cannot balance control targets and performance costs, and cannot effectively resist the impact of attacks on the system.

Method used

Using a fixed-time optimal control method for intelligent connected vehicles against DoS attacks based on hierarchical structure, the hierarchical optimal control method is designed by building an intelligent connected vehicle system model, including virtual reference signal generation layer and tracking control layer, and fusion attack Under the elastic algorithm and distributed algorithm, an event triggering mechanism is introduced, and a reinforcement learning algorithm is used to determine the approximately optimal control law of weight vector approximation.

Benefits of technology

Effectively resist DoS attacks, improve system security and stability, balance communication computing resources and system performance, and significantly improve system efficiency and performance.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119051892A_ABST
    Figure CN119051892A_ABST
Patent Text Reader

Abstract

The invention provides an intelligent network connection vehicle anti-DoS attack fixed time optimal control method based on a hierarchical structure. The method comprises the following steps: step 1, constructing an intelligent network connection vehicle system model; the intelligent network connection vehicle system model comprises a leading vehicle and a following vehicle; step 2, designing a hierarchical optimal control method based on the intelligent networked vehicle dynamics model; and 3, triggering optimal control based on an event, and determining a weight vector approximate optimal control law by using an online algorithm based on reinforcement learning. According to the hierarchical cooperation optimal control method provided by the invention, the virtual reference layer determines the distributed elastic reference signal so as to ensure that the leader agent and the reference signal realize fixed time consistency under the condition of intermittent communication interruption caused by DoS attack, and the tracking control layer designs the optimal control strategy based on the reference signal and the event triggering mechanism, so that the optimal control effect is achieved. Reference signals are tracked in fixed time, and the overall performance of the system is optimized.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the technical field of intelligent networked vehicles, and in particular to a fixed-time optimal control method for intelligent networked vehicles to resist DoS attacks based on a hierarchical structure. Background Art

[0002] Road transportation is the lifeblood of the national economy, but the existing road infrastructure is difficult to expand. Traffic congestion and exhaust pollution caused by insufficient road capacity and the rapid increase in the number of cars have posed severe challenges to traffic control departments. With the rapid development of autonomous driving technology and V2V (Vehicle-to-vehicle) communication technology, the stability of vehicle queues has been improved and reaction delays have been reduced by sharing vehicle status (position, speed, acceleration) information. Studies have shown that vehicles traveling in a queue mode can effectively improve road traffic efficiency, vehicle fuel economy, and driving safety. The goal of vehicle queue control is to keep the vehicles in the queue at an equal distance and at a uniform speed, and to prevent adjacent vehicles from colliding.

[0003] However, the open information transmission and high-speed vehicle mobility make the connected autonomous vehicle platoon control system vulnerable to malicious network attacks, such as data theft, tampering and interruption, which poses a great threat to user privacy, property and safety. Denial of service (DoS) attack is one of the potential attack types of connected vehicles. Its attack characteristics are to interfere with the radio frequency of the vehicle network or block V2V network access with a large number of requests to prevent information exchange between vehicles, thereby destroying data transmission and platoon control systems between vehicles.

[0004] The collaborative control method of intelligent connected vehicles usually adopts distributed control, that is, the control protocol only relies on the information exchange between the connected vehicle and its neighbors. Although this control method can realize vehicle platoon control and reasonably utilize computing and communication resources, it cannot guarantee the optimality of the overall performance cost. Due to limited system resources, it is necessary to explore a control method that balances control objectives and performance costs.

[0005] The traditional optimal control design method is to establish the performance index function and Hamilton-Jacobi-Bellman equation based on the coupled cooperative error. This will greatly increase the complexity of obtaining the optimal value function and the optimal control strategy, and it is impossible to balance the control objectives and performance indicators under DoS attacks. Summary of the invention

[0006] The present application provides a fixed-time optimal control method for intelligent connected vehicles to resist DoS attacks based on a hierarchical structure, which can be used to solve the technical problems that the optimal value function and the optimal control strategy are too complex and cannot balance the control objectives and performance indicators under DoS attacks.

[0007] The present application provides a fixed-time optimal control method for intelligent networked vehicles to resist DoS attacks based on a hierarchical structure, the method comprising:

[0008] Step 1: construct an intelligent networked vehicle system model; the intelligent networked vehicle system model includes a leading vehicle and a following vehicle;

[0009] Step 2: Design a hierarchical optimal control method based on the mathematical model of the power of intelligent connected vehicles;

[0010] The layers include virtual reference signal generation layer and tracking control layer; the virtual reference signal generation layer integrates the resilience algorithm and distributed algorithm under attack to resist the impact of DoS attacks; the tracking control layer introduces event trigger mechanism to the optimal control strategy to balance the relationship between communication computing resources and system performance optimization;

[0011] Step 3: Based on event-triggered optimal control, an online algorithm based on reinforcement learning is used to determine the weight vector to approximate the optimal control law.

[0012] Furthermore, step 1, constructing a smart connected vehicle system model; including:

[0013] The longitudinal dynamics equation of the i-th, i=1, 2, ..., N intelligent connected vehicles is described as:

[0014]

[0015] where p i represents the position of vehicle i, represents the speed of vehicle i, represents the acceleration of vehicle i, F i e represents the vehicle driving force, and the dynamic equation is expressed as:

[0016]

[0017] Where u i represents the throttle input of vehicle i, represents the gravity component of vehicle i parallel to the road surface,

[0018] represents air resistance. Assuming that all vehicles are moving in the same direction, sig(v i +v w )=1, m represents the vehicle weight, represents the body resistance of vehicle i, g represents the acceleration due to gravity, represents the angle between the plane of the i-th vehicle and the road slope, m a Represents the air density, S a represents the cross-sectional area of ​​the vehicle, d crepresents the air resistance coefficient, v w represents the wind speed and T represents the inertia time of the power transmission system.

[0019] Let x i =[p i , v i , a i ] T is the state vector of the following connected vehicle, x0 is the nonlinear function of the leading connected vehicle, f(x0) is the nonlinear function of the leading connected vehicle, is a nonlinear function that follows the connected car. is the external disturbance of the following connected vehicle, ω0 represents the external disturbance of the leader connected vehicle, and the system models of the leading vehicle and the following vehicle i are expressed as:

[0020]

[0021] and

[0022]

[0023] in and is the coefficient matrix, y i and y0 represent the output states of the leading vehicle and the following vehicle respectively, is the output matrix.

[0024] Furthermore, in step 2, based on the mathematical model of the power of the intelligent connected vehicle, a hierarchical optimal control method is designed, including:

[0025] Step 21, constructing a virtual reference signal generation layer;

[0026] Step 22, construct a tracking control layer. The tracking control layer is used to formulate an optimal control plan to ensure that the reference signal is tracked within a fixed time and the overall performance index of the system is optimized.

[0027] Further, step 21, constructing a virtual reference signal generation layer; comprising:

[0028] The DoS attack signal is defined as:

[0029]

[0030] Where k represents the number of attacks, t ak represents the time when the attack signal is activated, τ k represents the attack residence time, t a(k+1) represents the end time of the kth attack, A k =[t ak , t k ), t k =t ak +τk Indicates the attack interval;

[0031] The virtual reference signal is designed as follows:

[0032]

[0033] where K1 and K2 are gain matrices of moderate dimension, is the indicator function, ρ1 is a normal number satisfying is a positive constant, V1 is the Lyapunov function designed to determine the stability of the implementation; a ij The adjacency matrix A = (a ij )∈R N×N The element of ij >0 means that the following connected vehicle i can obtain status information from the following connected vehicle j, otherwise a ij =0; N i represents the set of connected vehicles that have communication connections with the i-th connected vehicle; d i Indicates the communication connection between the ith follower connected vehicle and the leader connected vehicle. When the leader and the ith follower connected vehicle are connected, d i >0, otherwise d i =0; represents the elements of the adjacency matrix under the attack signal, Represents the communication connection between the leader and the i-th follower connected vehicle under the attack signal.

[0034] Based on the reference signal, the time for the reference signal to be consistent with the fixed time of the leading connected vehicle is calculated as:

[0035]

[0036] Where γ is the state convergence rate, ρ1 is a positive constant satisfying is a normal number, T 21 yes The minimum positive solution, T 22 yes The minimum correct solution of A constant limiting the total duration of a DoS attack.

[0037] Further, in step 22, a tracking control layer is constructed. The tracking control layer is used to formulate an optimal control scheme to ensure that the reference signal is tracked within a fixed time and the system comprehensive performance index is optimized, including:

[0038] Step 221, constructing a tracking error model;

[0039] Based on the designed virtual reference signal and the dynamic model of the following connected vehicle, the tracking error state is defined as e i =Cx i -Cζ i , the error model is:

[0040]

[0041] in

[0042]

[0043] Step 222, construct a performance index function related to the error state and the control law:

[0044] Based on the set tracking error state e, the performance index function is defined as:

[0045]

[0046] In the formula Meet L i (0, 0) = 0, P i >0 and Q i >0 is a symmetric positive definite matrix, allowing control u i ∈U(Ω) is piecewise continuous, satisfying u i (0) = 0 and during the rest time T max The internal error system of the connected vehicle is stabilized.

[0047] Step 223, define the Hamiltonian function and propose the general form of the optimal control law:

[0048] Define the Hamiltonian function:

[0049]

[0050] in Represents the optimal value function V i (e i )About e i Find the partial derivative and transpose; the optimal value function is solved by the equation It is obtained and expressed as:

[0051]

[0052] Optimal Control Law for:

[0053]

[0054] Among them B T Represents the transpose of the coefficient matrix B of the connected vehicle system. C Trepresents the transpose of the networked vehicle system output matrix C. Step 224, propose an event triggering rule and an event triggering optimal control law for achieving optimal control within a fixed time:

[0055] set up is the triggering time sequence of the i-th error state, s represents the s-th triggering time, is the observation error, Indicates the trigger time The tracking error value at in is the sth trigger interval of the ith error state. Under the event trigger mechanism, the event-triggered optimal control law is expressed as:

[0056]

[0057] The trigger time sequence is determined by the following event trigger rules:

[0058]

[0059] Among them, 0<ω1<1 is a positive constant, λ max (Q i ) represents the matrix Q i The maximum eigenvalue of min (P i ) represents the matrix P i The minimum eigenvalue of min (Q i ) represents the matrix Q i The minimum eigenvalue, L ui yes The Lipschitz constant satisfied.

[0060] Further, step 3, based on event-triggered optimal control, uses an online algorithm based on reinforcement learning to determine the weight vector approximate optimal control law; including:

[0061] Step 31, constructing an approximate value function of a judgment neural network;

[0062] Step 32, estimating the value function and proposing the corresponding optimal control law;

[0063] Step 33, define the weight error vector, Bellman function and error E i ;

[0064] Step 34, determine the weight vector update rule and rest time.

[0065] Furthermore, step 31, constructing an approximate value function of a judgment neural network, including:

[0066] , the approximate value function and gradient of the judging neural network are expressed as:

[0067]

[0068]

[0069] In the formula represents the weight vector, represents the activation function, is the number of neurons, ∈ i is the approximation error, and its upper bound is ∈ im .

[0070] Furthermore, step 32, estimating the value function and proposing a corresponding optimal control law, includes:

[0071] Since the weight vector W i Unknown, let the estimate be The value function is expressed as:

[0072]

[0073] in Yes V i (e i ), and then the optimal control strategy can be obtained, which is expressed as:

[0074]

[0075] Based on the estimated value function and the event-triggered optimal control law, the estimate of the Hamiltonian function is expressed as:

[0076]

[0077] Further, step 33, define the weight error vector, Bellman function and error E i ;include:

[0078] Define the weight vector error separately Bellman Error And function E i for

[0079]

[0080]

[0081] in express In t l The residual function at time, η il Represents η i In t l The value at time t l For time series The elements satisfy 0≤t l , ..., t s <t,s>0.

[0082] Furthermore, step 34, determining a weight vector update rule and a rest time, includes:

[0083] In order to accurately estimate the weight vector The learning law is α The update rule is

[0084]

[0085] Based on the fixed time stability theory, the stable dwell time of the tracking error model is:

[0086]

[0087] in is a constant, is a constant, r1 is a constant, is a normal number, is a constant, Represents the matrix Y i =[η i1 , η i2 , ..., η ir ], is a constant, and τ1 is a positive constant.

[0088] In order to resist the impact of DoS attacks on system performance, this application designs a hierarchical cooperative optimal control method. The virtual reference layer designs a distributed elastic reference signal to ensure that the leader agent and the reference signal are consistent at a fixed time in the case of intermittent communication interruption caused by DoS attacks. The tracking control layer designs an optimal control strategy based on the reference signal and event trigger mechanism to track the reference signal within a fixed time and optimize the overall system performance.

[0089] Since it is difficult to obtain an accurate expression for the value function related to the event-triggered optimal control strategy, this application designs and evaluates a self-learning optimization control framework based on a reinforcement learning algorithm. The framework aims to minimize the Bellman error within a fixed time, and updates the weights along the gradient descent direction of the performance indicator function to ensure the search efficiency and path optimization, thereby approximating the optimal control strategy. BRIEF DESCRIPTION OF THE DRAWINGS

[0090] Figure 1 A communication connection network diagram of an intelligent connected workshop provided in an embodiment of the present application;

[0091] Figure 2 A virtual signal and a position error diagram of a leading connected vehicle provided in an embodiment of the present application;

[0092] Figure 3 A virtual signal and a speed error diagram of a leading connected vehicle provided in an embodiment of the present application;

[0093] Figure 4 A virtual signal provided in an embodiment of the present application and an acceleration error diagram of a leading connected vehicle;

[0094] Figure 5 A tracking position error diagram provided by an embodiment of the present application;

[0095] Figure 6 A tracking speed error diagram provided by an embodiment of the present application;

[0096] Figure 7 A tracking acceleration error diagram provided by an embodiment of the present application;

[0097] Figure 8 An event triggering time diagram provided for an embodiment of the present application;

[0098] Fig. 9 A cost function diagram provided for an embodiment of the present application. DETAILED DESCRIPTION

[0099] In order to make the objectives, technical solutions and advantages of the present application clearer, the implementation methods of the present application will be further described in detail below with reference to the accompanying drawings.

[0100] This application fully considers practical applications. The virtual reference layer integrates the resilience algorithm under attack and the distributed algorithm design, which can effectively resist the impact of DoS attacks and improve the security and stability of the system. The tracking control layer introduces the event trigger mechanism to the optimal control strategy, balances the relationship between limited communication computing resources and system performance optimization, and significantly improves system efficiency and performance.

[0101] Step 1: construct an intelligent networked vehicle system model; the intelligent networked vehicle system model includes a leading vehicle and a following vehicle;

[0102] The longitudinal dynamics equation of the i-th, i=1, 2, ..., N intelligent connected vehicles is described as:

[0103]

[0104] where p i represents the position of vehicle i, represents the speed of vehicle i, represents the acceleration of vehicle i, F i e represents the vehicle driving force, and the dynamic equation is expressed as:

[0105]

[0106] Where u i represents the throttle input of vehicle i, represents the gravity component of vehicle i parallel to the road surface, represents air resistance. Assuming that all vehicles are moving in the same direction, sig(v i +v w )=1. m represents the vehicle weight, represents the body resistance of vehicle i, g represents the acceleration due to gravity, represents the angle between the plane of the i-th vehicle and the road slope, m a Represents the air density, S a represents the cross-sectional area of ​​the vehicle, d c represents the air resistance coefficient, v w represents the wind speed and T represents the inertia time of the power transmission system.

[0107] Let x i =[p i , v i , a i ] T is the state vector of the following connected vehicle, x0 is the nonlinear function of the leading connected vehicle, f(x0) is the nonlinear function of the leading connected vehicle, is a nonlinear function that follows the connected car. is the external disturbance of the following connected vehicle, ω0 represents the external disturbance of the leader connected vehicle, and the system models of the leading vehicle and the following vehicle i are expressed as:

[0108]

[0109] and

[0110]

[0111] in and is the coefficient matrix, y i and y0 represent the output states of the following vehicle and the leading vehicle respectively, is the output matrix.

[0112] In the constructed intelligent connected vehicle system model, the state dynamic behavior is characterized by the system output state. Based on the output matrix C, the system output state has a coupling effect with the vehicle's position, velocity and acceleration.

[0113] Step 2: Design a hierarchical optimal control method based on the mathematical model of the intelligent connected vehicle power system.

[0114] The hierarchical control method includes a virtual reference signal generation layer and a tracking control layer; the virtual reference layer signal generation layer integrates the resilience algorithm and the distributed algorithm under attack to resist the impact of DoS attacks and improve the security and stability of the system; the tracking control layer introduces an event trigger mechanism to the optimal control strategy to balance the relationship between limited communication computing resources and system performance optimization, which can significantly improve system efficiency and performance.

[0115] Step 21: Construct a virtual reference signal generation layer

[0116] The purpose of the virtual reference layer is to design a virtual reference signal to ensure the fixed time consistency of the leader agent and the virtual signal under the influence of DoS attacks.

[0117] The DoS attack signal is defined as:

[0118]

[0119] Where k represents the number of attacks, t ak represents the time when the attack signal is activated, τ k represents the attack residence time, t a(k+1) represents the end time of the kth attack, A k =[t ak , t k ), t k =t ak +τ k Indicates the attack range.

[0120] The virtual reference signal is designed as follows:

[0121]

[0122] where K1 and K2 are gain matrices of moderate dimension, is the indicator function, ρ1 is a normal number satisfying is a positive constant, V1 is the Lyapunov function designed to determine the stability of the implementation; a ij The adjacency matrix A = (a ij )∈R N×N The element of ij >0 means that the following connected vehicle i can obtain status information from the following connected vehicle j, otherwise a ij =0; N i represents the set of connected vehicles that have communication connections with the i-th connected vehicle; d i Indicates the communication connection between the ith follower connected vehicle and the leader connected vehicle. When the leader and the ith follower connected vehicle are connected, d i >0, otherwise d i =0; represents the elements of the adjacency matrix under the attack signal, Represents the communication connection between the leader and the i-th follower connected vehicle under the attack signal.

[0123] Based on the reference signal, the estimated time for the reference signal to achieve fixed time consistency with the leading connected vehicle is calculated as:

[0124]

[0125] Where γ is the state convergence rate, ρ1 is a positive constant satisfying is a positive constant, T 21 yes The minimum positive solution, T 22 yes The minimum correct solution of A constant limiting the total duration of a DoS attack.

[0126] Step 22, construct a tracking control layer. The tracking control layer is used to formulate an optimal control plan to ensure that the reference signal is tracked within a fixed time and the overall performance index of the system is optimized.

[0127] Step 221, constructing a tracking error model;

[0128] Based on the designed virtual reference signal and the dynamic model of the following connected vehicle, the tracking error state is defined as e i =Cx i -Cζ i , the error model is:

[0129]

[0130] in

[0131]

[0132] Step 222, constructing a performance index function related to the error state and the control law;

[0133] Based on the set tracking error state e, the performance index function is defined as:

[0134]

[0135] In the formula Meet L i (0, 0) = 0, P i >0 and Q i >0 is a symmetric positive definite matrix, allowing control u i ∈U(Ω) is piecewise continuous, satisfying u i (0) = 0 and during the rest time T maxInternally stabilized connected vehicle error system.

[0136] Step 223, define the Hamiltonian function and propose the general form of the optimal control law;

[0137] In order to explore the optimal control law for the multi-UAV error system to achieve stability, the Hamiltonian function is defined:

[0138]

[0139] in Represents the optimal value function V i (e i )About e i Find the partial derivative and transpose; the optimal value function is solved by the equation It is obtained and expressed as:

[0140]

[0141] Optimal Control Law for:

[0142]

[0143] Among them B T Represents the transpose of the coefficient matrix B of the connected vehicle system. C T represents the transpose of the networked vehicle system output matrix C. Step 224, propose an event triggering rule and an event triggering optimal control law for achieving optimal control within a fixed time.

[0144] set up is the triggering time sequence of the i-th error state, s represents the s-th triggering time, is the observation error, Indicates the trigger time The tracking error value at in is the sth trigger interval of the ith error state. Under the event trigger mechanism, the event-triggered optimal control law is expressed as:

[0145]

[0146] The trigger time sequence is determined by the following event trigger rules:

[0147]

[0148] Where 0<ω1<1 is a normal number, λmax(Qi) represents the maximum eigenvalue of the matrix Qi, λmin(Pi) represents the minimum eigenvalue of the matrix Pi, and λ min (Q i ) represents the matrix Qi The minimum eigenvalue, L ui yes The Lipschitz constant satisfied.

[0149] Step 3, based on event-triggered optimal control, an online algorithm based on reinforcement learning is used to determine the weight vector to approximate the optimal control law;

[0150] Since it is impossible to accurately solve the value function to obtain the event-triggered optimal control law, an online algorithm based on reinforcement learning is proposed to approximate the optimal control law. The specific steps include the following:

[0151] Step 31, constructing an approximate value function of a judgment neural network;

[0152] , the approximate value function and gradient of the judging neural network are expressed as:

[0153]

[0154]

[0155] In the formula represents the weight vector, represents the activation function, is the number of neurons, ∈i is the approximation error, and the upper bound is ∈ im .

[0156] Step 32, estimating the value function and proposing the corresponding optimal control law;

[0157] Since the weight vector W i Unknown, let the estimate be The value function is expressed as:

[0158]

[0159] in Yes V i (e i ), and then the optimal control strategy can be obtained, which is expressed as:

[0160]

[0161] Based on the estimated value function and the event-triggered optimal control law, the estimate of the Hamiltonian function is expressed as:

[0162]

[0163] Step 33, define the weight error vector, Bellman function and error E i ;

[0164] Define the weight vector error separately Bellman Error And function E i for

[0165]

[0166]

[0167] in express In t l The residual function at time, η il Represents η i In t l The value at time t l For time series The elements satisfy 0≤t l , ..., t s <c,s>0。

[0168] Step 34, determine the weight vector update rule and pause time;

[0169] In order to accurately estimate the weight vector The learning law is α The update rule is

[0170]

[0171] Based on the fixed time stability theory, the stable dwell time of the tracking error model is:

[0172]

[0173] in is a constant, is a constant, r1 is a constant, is a normal number, is a constant, Represents the matrix Y i =[η i1 , η i2 , ..., η ir ], is a constant, and τ1 is a positive constant.

[0174] The present invention is further described below in conjunction with specific simulations.

[0175] Select parameter m = 1000kg, g=9.8m / s 2 , m a =1.3kg / m 3 , S a =3.1m 2 , dc =0.5, v w =2m / s, T=0.2s. The initial position of the leading vehicle is set to 15m. The initial positions of the following vehicles 1-4 are 9m, 8m, 5m, and 2m respectively. The initial speed of all vehicles is 5m / s. The communication structure of the vehicle platoon is as follows: Figure 1 As shown. The initial positions of virtual vehicles 1-4 are set to 10m, 6m, 8m, 9m, and the initial speeds are set to 2m / s, 3m / s, 2m / s, and 4m / s, respectively. The ideal distance between virtual vehicle $i$ and the leading vehicle is set to 2im. ρ1=1.5, K1=diag{3.05,2.053,1.97}, For the tracking controller, the cost function parameters are set as, P1 = 0.19, P2 = 0.14, P3 = 0.12, P4 = 0.14, Q1 = 0.6061, Q2 = 0.4, Q3 = 0.3534, Q4 = 0.3788, Activation Function Learning law α = 0.95, ω1 = 0.26, L1 = 0.67, L2 = 0.95, L3 = 0.96, L4 = 0.95, r2 = 0.5. Under the above parameters, the rest time can be calculated to be T2 = 7.05. Figure 2-4 The position, velocity and acceleration trajectory changes of the leader vehicle and the virtual vehicle under DoS attack are given respectively. According to the set controller parameters, the tracking pause time can be calculated as T max =8.6153, the error trajectory between the following vehicle and the virtual vehicle is as follows Figure 5-7 The triggering time sequence generated under the event triggering mechanism can be seen as Figure 8 The cost function curve can be seen Fig. 9 .

[0176] The above-described embodiments of the present application do not constitute a limitation on the protection scope of the present application.

Claims

1. A fixed-time optimal control method for intelligent connected vehicles against DoS attacks based on a hierarchical structure, characterized in that: The method comprises: Step 1: construct an intelligent networked vehicle system model; the intelligent networked vehicle system model includes a leading vehicle and a following vehicle; Step 2: Design a hierarchical optimal control method based on the mathematical model of the power of intelligent connected vehicles; The layers include virtual reference signal generation layer and tracking control layer; the virtual reference signal generation layer integrates the resilience algorithm and distributed algorithm under attack to resist the impact of DoS attacks; the tracking control layer introduces event trigger mechanism to the optimal control strategy to balance the relationship between communication computing resources and system performance optimization; Step 3: Based on event-triggered optimal control, an online algorithm based on reinforcement learning is used to determine the weight vector to approximate the optimal control law.

2. The method according to claim 1, characterized in that Step 1: Build a smart connected vehicle system model; including: The longitudinal dynamics equation of the i-th, i=1,2,...,N intelligent connected vehicles is described as: where p i represents the position of vehicle i, represents the speed of vehicle i, represents the acceleration of vehicle i, F i e represents the vehicle driving force, and the dynamic equation is expressed as: Where u i represents the throttle input of vehicle i, represents the gravity component of vehicle i parallel to the road surface, represents air resistance. Assuming that all vehicles are moving in the same direction, sig(v i +v w )=1; m represents the vehicle weight, represents the body resistance of vehicle i, g represents the acceleration due to gravity, represents the angle between the plane of the i-th vehicle and the road slope, m a Represents the air density, S a represents the cross-sectional area of ​​the vehicle, d c represents the air resistance coefficient, v w represents the wind speed, T represents the inertia time of the power transmission system; Let x i =[p i ,v i ,a i ] T is the state vector of the following connected vehicle, x0 is the nonlinear function of the leading connected vehicle, f(x0) is the nonlinear function of the leading connected vehicle, is a nonlinear function that follows the connected car. is the external disturbance of the following connected vehicle, ω0 represents the external disturbance of the leader connected vehicle, and the system models of the leading vehicle and the following vehicle i are expressed as: and in and is the coefficient matrix, y i and y0 represent the output states of the following vehicle and the leading vehicle respectively, is the output matrix.

3. The method according to claim 1, characterized in that: Step 2: Based on the mathematical model of the powertrain of intelligent connected vehicles, a hierarchical optimal control method is designed, including: Step 21, constructing a virtual reference signal generation layer; Step 22, construct a tracking control layer. The tracking control layer is used to formulate an optimal control plan to ensure that the reference signal is tracked within a fixed time and the overall performance index of the system is optimized.

4. The method according to claim 3, characterized in that Step 21, constructing a virtual reference signal generation layer; comprising: The DoS attack signal is defined as: Where k represents the number of attacks, t ak represents the time when the attack signal is activated, τ k represents the attack residence time, t a(k+1) represents the end time of the kth attack, A k =[t ak ,t k ),t k =t ak +τ k Indicates the attack interval; The virtual reference signal is designed as follows: where K1 and K2 are gain matrices of moderate dimension, is the indicator function, ρ1 is a normal number satisfying is a positive constant, V1 is the Lyapunov function designed to determine the stability of the implementation; a ij The adjacency matrix A = (a ij )∈R N×N The element of ij >0 means that the following connected vehicle i can obtain status information from the following connected vehicle j, otherwise a ij =0; N i represents the set of connected vehicles that have communication connections with the i-th connected vehicle; d i Indicates the communication connection between the ith follower connected vehicle and the leader connected vehicle. When the leader and the ith follower connected vehicle are connected, d i >0, otherwise d i =0; represents the elements of the adjacency matrix under the attack signal, represents the communication connection between the leader and the i-th following connected vehicle under the attack signal; Based on the reference signal, the time for the reference signal to be consistent with the fixed time of the leading connected vehicle is calculated as: Where γ is the state convergence rate, ρ1 is a positive constant satisfying is a normal number, T 21 is the minimum positive solution of γ(ρ1+Q1-1)ξ1t=exp{γ1(ρ1+Q1-1)ξt}, T 22 yes The minimum correct solution of A constant limiting the total duration of a DoS attack.

5. The method according to claim 3, characterized in that: Step 22: Construct a tracking control layer. The tracking control layer is used to formulate an optimal control plan to ensure that the reference signal is tracked within a fixed time and the system comprehensive performance index is optimized, including: Step 221, constructing a tracking error model; Based on the designed virtual reference signal and the dynamic model of the following connected vehicle, the tracking error state is defined as e i =Cx i -Cζ i , the error model is: in Step 222, construct a performance index function related to the error state and the control law: Based on the set tracking error state e i , define the performance index function as: In the formula Meet L i (0, 0) = 0, P i >0 and Q i >0 is a symmetric positive definite matrix, allowing control u i ∈U(Ω) is piecewise continuous, satisfying u i (0) = 0 and during the rest time T max Internally stabilize the error system of the connected vehicle; Step 223, define the Hamiltonian function and propose the general form of the optimal control law: Define the Hamiltonian function: in Represents the optimal value function V i (e i )About e i Find the partial derivative and transpose; the optimal value function is solved by the equation It is obtained and expressed as: Optimal Control Law for: Among them B T represents the transpose of the coefficient matrix B of the connected vehicle system; C T represents the transpose of the output matrix C of the connected vehicle system; Step 224, propose an event triggering rule and an event triggering optimal control law for achieving optimal control within a fixed time: set up is the triggering time sequence of the i-th error state, s represents the s-th triggering time, is the observation error, Indicates the trigger time The tracking error value at in is the sth trigger interval of the ith error state. Under the event trigger mechanism, the event-triggered optimal control law is expressed as: The trigger time sequence is determined by the following event trigger rules: Among them, 0<ω1<1 is a positive constant, λ max (Q i ) represents the matrix Q i The maximum eigenvalue of min (P i ) represents the matrix P i The minimum eigenvalue of min (Q i ) represents the matrix Q i The minimum eigenvalue, L ui yes The Lipschitz constant satisfied.

6. The method according to claim 1, characterized in that Step 3, based on event-triggered optimal control, an online algorithm based on reinforcement learning is used to determine the weight vector to approximate the optimal control law; include: Step 31, constructing an approximate value function of a judgment neural network; Step 32, estimating the value function and proposing the corresponding optimal control law; Step 33, define the weight error vector, Bellman function and error E i ; Step 34, determine the weight vector update rule and rest time.

7. The method according to claim 6, characterized in that Step 31, constructing an approximate value function of a judgment neural network; including: The approximate value function and gradient of the judging neural network are expressed as: In the formula represents the weight vector, represents the activation function, is the number of neurons, ∈ i is the approximation error, and its upper bound is ∈ im .

8. The method according to claim 6, characterized in that Step 32, estimating the value function and proposing the corresponding optimal control law, including: Since the weight vector W i Unknown, let the estimate be The value function is expressed as: in Yes V i (e i ), and then the optimal control strategy can be obtained, which is expressed as: Based on the estimated value function and the event-triggered optimal control law, the estimate of the Hamiltonian function is expressed as:

9. The method according to claim 6, characterized in that Step 33, define the weight error vector, Bellman function and error E i ; include: Define the weight vector error separately Bellman Error And function E i for in express In t l The residual function at time, η il Represents η i In t l The value at time t l For time series The elements satisfy 0≤t l ,…,t s <t,s> 0.

10. The method according to claim 6, characterized in that Step 34, determining the weight vector update rule and the rest time; including: In order to accurately estimate the weight vector The learning law is α The update rule is Based on the fixed time stability theory, the stable dwell time of the tracking error model is: in is a constant, is a constant, r1 is a constant, is a normal number, is a constant, Represents the matrix Y i =[η i1 ,η i2 ,...,η ir ], is a constant, and τ1 is a positive constant.

Citation Information

Patent Citations

  • Elastic event trigger control method and system for vehicle autonomous driving

    CN112685835A

  • Vehicle queue event trigger control method under wrong data injection attack

    CN116800501A

  • Event trigger control method for vehicle queue under denial of service attack

    CN117896730A

  • Multi-unmanned aerial vehicle event triggering formation control method with switching topology under DoS attack

    CN118331327A

  • Non-singular finite-time control method and system for dynamic positioning of unmanned boat with prescribed performance

    US11780551B1

Cited By

  • Fixed-time vehicle cooperative control method capable of keeping connectivity

    CN120044852A

  • Unmanned vehicle safety control method and system based on derivative perception reinforcement learning

    CN122308059A

  • Derivative-aware reinforcement learning based safe control method and system for unmanned vehicle

    CN122308059B