Flight trajectory completion and prediction method based on time-frequency analysis

Through a method based on time-frequency analysis, the encoder enhanced pre-training strategy and the wavelet attention mechanism are used to solve the problem of insufficient trajectory prediction performance due to missing data in the traditional model, and achieve efficient completion and prediction of flight trajectories, significantly Improved air traffic management reliability and efficiency.

CN119339584AActive Publication Date: 2025-01-21SICHUAN UNIV
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
CN202411440239.0
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-10-15
Publication Date
2025-01-21
Estimated Expiration
2044-10-15

AI Technical Summary

Technical Problem

Traditional aircraft trajectory sequence prediction models rely on complete data sets during training, but there are often missing data in actual flight data, which limits the reliability and performance of air traffic management tasks.

Method used

The flight trajectory completion and prediction method based on time-frequency analysis is adopted, and the encoder enhanced pre-training strategy, wavelet attention and loss function are used to construct the backbone network and reconstruction network to achieve integrated completion and prediction of flight trajectory.

Benefits of technology

In the case of missing input sequences, the accuracy and reliability of flight trajectory prediction are significantly improved, and the application performance in real scenarios is improved.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119339584A_ABST
    Figure CN119339584A_ABST
Patent Text Reader

Abstract

The invention provides a flight trajectory completion and prediction method based on time-frequency analysis, which completes completion of flight trajectories and prediction of future trajectories by analyzing aircraft trajectory data. This process aims to improve the efficiency of flight management and operation, in particular when handling aircraft trajectory missing and predicting future flight paths. The flight trajectory complementing and predicting method based on time-frequency analysis is provided for solving the problems that aircraft trajectory data has complex time-frequency characteristics and partial data are missing. For time and frequency domain features of an aircraft trajectory, a flight trajectory reconstruction model is introduced, and the model comprises a backbone network and a reconstruction network. The backbone network is responsible for feature extraction of input data, and the reconstruction network guides a model to pay more attention to time features and frequency domain features of an aircraft trajectory through the trajectory reconstruction module and the frequency domain reconstruction module, so that the trajectory reconstruction precision is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The invention relates to the field of air traffic management, and in particular to a flight trajectory completion and prediction method based on time-frequency analysis. Background Art

[0002] In the field of air traffic, trajectory prediction is a key technology that supports air traffic management, including flight delay prediction, fuel consumption prediction, and flight trajectory prediction. Accurate trajectory prediction will greatly improve the efficiency of air traffic controllers in real-time availability management and further ensure the safety of aircraft. However, the traditional aircraft trajectory sequence prediction model uses a complete aircraft trajectory sequence as the data set source during training. At the same time, there will be a lot of missing data in the real-time collection of actual flight data, which in turn limits the reliability and performance of downstream air traffic control tasks. Summary of the invention

[0003] The purpose of the present invention is to study the integrated flight trajectory completion and prediction method for the common trajectory loss problem in air traffic control, propose an encoder enhanced pre-training strategy, wavelet attention and loss function, realize integrated prediction and completion, strive to ensure the flight trajectory prediction performance when there are missing input sequences, and improve the usability of the results in real scenarios.

[0004] In order to achieve the above object, the technical solution adopted by the present invention is:

[0005] A flight trajectory completion and prediction method based on time-frequency analysis includes the following steps:

[0006] S1: Obtain the original aircraft trajectory sequence-random masked trajectory sequence data pair to generate the original data set;

[0007] S2: pre-process the collected aircraft trajectory data and divide it into training set, validation set and test set; S3: construct a flight trajectory reconstruction model, including a backbone network and a reconstruction network;

[0008] The backbone network is used to perform feature processing on the input data, and the reconstruction network is used to guide the model to pay more attention to the time characteristics and frequency domain characteristics of the aircraft trajectory; the backbone network includes a multi-layer perceptron and an encoder module; the reconstruction network includes a trajectory reconstruction module and a frequency domain reconstruction module;

[0009] S4: Pre-train the flight trajectory reconstruction model, introduce the mean square error, form a new joint loss function, train the flight trajectory reconstruction model, and retain the weight of the best model;

[0010] S5: Based on the flight trajectory reconstruction model, a flight trajectory prediction model is constructed. Specifically, for the flight trajectory reconstruction model, the backbone network is retained, the trajectory reconstruction module in the reconstruction network is removed, and a discrete wavelet transform module, a decoder group and an inverse discrete wavelet transform module are newly designed;

[0011] S6: Set the loss function, train the flight trajectory prediction model, and retain the weight of the best model;

[0012] S7: Test the flight trajectory reconstruction model, input the aircraft sequence data with missing points, and realize the integrated completion and prediction of flight trajectories.

[0013] As a preferred embodiment of the present invention, a flight trajectory completion and prediction method based on time-frequency analysis is characterized in that the encoder in step 3 is:

[0014] The encoder is composed of Transformer modules. After the preprocessed data is passed into the multi-layer perceptron, V is obtained. V is then passed to the Transformer input layer. After the attention mechanism and feedforward neural network module, a high-dimensional matrix F1 is obtained. Specifically, there are the following data processing steps:

[0015] S3-1: Flatten the matrix data into a vector sequence. Connect the elements in the matrix in row order to form a one-dimensional vector sequence;

[0016] The input matrix is ​​V, and the flattened vector sequence is M;

[0017] M=[V[0,0],V[0,1],…,V[0,n-1],V[1,0],V[1,1],…V[1,n-1],…,V[m-1,0],V[m-1,1],…,V[m-1,n-1]] (1)

[0018] Among them, m represents the number of rows of the matrix, and n represents the number of columns of the matrix;

[0019] S3-2: Add positional encoding to each element in the matrix in the Transformer model, using sine / cosine positional encoding.

[0020] Let the position code be d,

[0021]

[0022] Among them, pos represents the position of the token in the sequence. If the sequence length is L, then pos = 0, 1, ..., L-1; d is the position vector of the token, d(pos, 2i) represents the i-th element in this position vector, i represents odd dimensions, 2i represents even dimensions, and d modelRepresents the dimension of the token (that is, the dimension of each vector in our sequence);

[0023] S3-3: Add the flattened matrix data to the positional encoding element-wise and perform a bitwise operation with the attention mask to obtain the input vector representation of the encoder.

[0024] Let the summed vector sequence be X, the attention mask be M_mask, and x be the masked vector sequence.

[0025]

[0026] Among them, * represents bitwise operation;

[0027] S3-4: The input vector representation is fed into the encoder and decoder of the Transformer model for forward propagation. The model performs self-attention calculations based on the positions and relationships of elements in the sequence to generate context-aware representations and outputs.

[0028] Assume that the input vector is represented as X, the forward propagation of the encoder is Encoder(X), and the forward propagation of the decoder is Decoder(X).

[0029]

[0030] S3-5: Use linear transformation method to convert the output vector into the target high-dimensional matrix.

[0031] Let the weight matrix of the linear transformation be W and the output vector be F1.

[0032] F1=decoder_output*W (5)

[0033] Here, * indicates matrix multiplication.

[0034] As a preferred embodiment of the present invention, a flight trajectory completion and prediction method based on time-frequency analysis is characterized in that the trajectory reconstruction module and the frequency domain reconstruction module in step S3 are:

[0035] The trajectory reconstruction module is composed of LSTM modules; the frequency domain reconstruction module is composed of self-attention modules. Specifically, there are the following steps:

[0036] First, pass F1 into the input layer of the trajectory reconstruction module to obtain P′ (1) , that is, P′ (1) =LSTM(F1);

[0037] Secondly, F1 is passed into the input layer of the frequency domain reconstruction module to obtain F2; at the same time, the real trajectory vector P is subjected to discrete Fourier transform to obtain F3 (F3 = FFT (P N-M:N-1)),

[0038] The formula for discrete Fourier transform is:

[0039]

[0040] Where X k is the transformed complex sequence, k = 0, 1, ..., N-1 represents different frequency components in the frequency domain, i is the imaginary unit, x n is the sampled analog signal, and is the rotation factor;

[0041] The output of the fast Fourier transform will be a complex sequence representing the individual frequency components in the frequency domain, that is,

[0042]

[0043] Among them, i represents the frequency index and j represents the feature dimension;

[0044] As a preferred embodiment of the present invention, a flight trajectory completion and prediction method based on time-frequency analysis is characterized in that the aircraft reconstruction model training in step S4 is specifically as follows:

[0045] S4-1: Set the loss function with mean square error (MSE);

[0046] S4-2: According to step 1 described in claim 3, for the trajectory reconstruction module, through the real trajectory sequence P and P′ (1) As the loss function, it is marked as L1, L1 = MSE (P, P ′ (1) );

[0047] S4-3: According to step 2 described in claim 3, for the frequency domain reconstruction module, the real trajectory vector P is subjected to discrete Fourier transform to obtain F3 (F3 = FFT (P N-M:N-1 )), the loss function is obtained by F2 and F3, denoted as L2, L2 = MSE (F2, F3);

[0048] S4-4: Jointly optimize the multilayer perceptron, encoder, trajectory reconstruction module and frequency domain reconstruction module, and set the joint loss function L 重建 =L1+L2 for optimization training and save the weight of the optimal aircraft reconstruction model;

[0049] As a preferred embodiment of the present invention, according to the integrated flight trajectory completion and prediction method based on wavelet time-frequency analysis described in step 4, it is characterized in that the aircraft prediction model in step S5 is specifically changed as follows:

[0050] First, for the reconstruction network of the aircraft reconstruction module, the trajectory reconstruction module in the network is removed, and a convolution layer is added after the self-attention module in the frequency domain reconstruction module. At the same time, the new frequency domain reconstruction module corresponds one-to-one to each decoder in the decoder group.

[0051] Secondly, for the backbone network of the aircraft reconstruction model, a discrete wavelet transform module, a decoder group and an inverse discrete wavelet transform module are added;

[0052] Finally, the serial order of the overall model is: discrete wavelet transform module, multi-layer perceptron, encoder, frequency domain reconstruction module, decoder, inverse discrete wavelet transform module;

[0053] As a preferred solution of the present invention, a flight trajectory completion and prediction method based on time-frequency analysis is characterized in that the S5 aircraft prediction model specifically processes the data stream as follows:

[0054] S5-1: Input the processed aircraft trajectory sequence, and after passing through the multi-layer perceptron, encoder, and frequency domain reconstruction module, obtain F2 of step 2 in claim 3, and obtain F5 after dimensionality increase processing of F2. Among them, the dimension of F5 is the same as the matrix dimension D in step S2-1 in claim 2;

[0055] S5-2: F5 passes through the self-attention module in the decoder, and the self-attention calculation formula is used to substitute the above-obtained F5 into Q, and F1 into K and V respectively, and F6 is calculated; the self-attention formula is as follows:

[0056] F6 = Self-Attention(F5, F1, F1) (8) S5-3: Since multiple decoders are designed, each corresponding to a wavelet component of different frequencies, it is assumed here that for the i+1th decoder, F6 is input into the convolution module of the decoder to obtain F7. i+1 ;

[0057] Among them, the convolution operation is used to embed the enhanced trajectory into F6, and the formula is expressed as:

[0058] F7 i =σ(Convld(F6)) (9)

[0059] Among them, F7 i+1 The time dimension of is determined by the resolution of the wavelet component corresponding to the i+1th decoder, where the length of the wavelet component is calculated as follows:

[0060]

[0061] h L =h L-1 (12)

[0062] Among them, L is the level of wavelet analysis, l is half of the wavelet filter length, M is the number of historical trajectory points, and WTC i Represents wavelet components of different frequencies, Represents high frequency WTC L-i The length of time. L Represents the time length of low-frequency WTC0;

[0063] S5-4: F7 i+1 As the wavelet component at a certain resolution, at this time, let the final wavelet component obtained by different decoders be F;

[0064] As a preferred embodiment of the present invention, a flight trajectory completion and prediction method based on time-frequency analysis is characterized in that the training of the S6 aircraft prediction model, the specific loss function is set as:

[0065] S6-1: Find the missing sequence points by extension and downsampling, and give them higher weights. Set the loss function L 预测 for:

[0066]

[0067] Where k represents the kth WTC, h L-k Representing WTC k Length, It is WTC k The estimated value of the jth attribute of the ith element of is the true value, It is a custom weight value, which completes the overall training of the model by resetting the loss function.

[0068] S6-2: The corresponding pre-processed original trajectory sequence P is subjected to discrete wavelet transformation to obtain wavelet component F8, and F and F8 described in S5-4 of claim 6 are used as prediction loss function L 预测 ,After the overall training of the model, the most suitable parameters for the model are found.

[0069] As a preferred embodiment of the present invention, a flight trajectory completion and prediction method based on time-frequency analysis is characterized in that the test in step S7 is specifically as follows:

[0070] First, input the aircraft trajectory sequence data P containing missing points l ;

[0071] Secondly, P l After passing through the model, the trajectory is completed and a complete trajectory sequence P containing the next time step is output c .

[0072] Preferably, an integrated flight trajectory completion and prediction method based on a flight trajectory prediction method of wavelet time-frequency analysis comprises at least one processor, and a memory communicatively connected to the at least one processor; the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute any one of the above methods.

[0073] In summary, due to the adoption of the above technical solution, the beneficial effects of the present invention are:

[0074] 1. By introducing the encoder enhancement pre-training strategy and wavelet attention mechanism, the model can better capture the time and frequency characteristics of flight trajectories, and can effectively improve the prediction accuracy of flight trajectories even when there are missing input sequences.

[0075] 2. The method of the present invention realizes the functions of flight trajectory completion and prediction in the same model, solves the challenge brought by trajectory loss in traditional methods, and provides a more comprehensive and consistent solution.

[0076] 3. By designing a trajectory reconstruction module and a frequency domain reconstruction module, and combining pre-training and joint training, the model can more effectively fill in the missing data, thereby reducing the impact of trajectory loss on the overall prediction performance.

[0077] 4. The present invention is not only suitable for trajectory prediction under ideal conditions, but can also ensure the reliability and accuracy of trajectory prediction in real application scenarios, significantly improving the practical applicability of the technical solution.

[0078] 5. The present invention adopts discrete wavelet transform (DWT) and inverse discrete wavelet transform (IDWT) modules to optimize the computational efficiency of the model while maintaining high-precision prediction, ensuring its operability in large-scale data processing.

[0079] 6. By jointly optimizing the trajectory reconstruction loss function and the frequency domain reconstruction loss function, the model can better capture the characteristics of the input data in the time and frequency domains, effectively improving the overall performance of the model. BRIEF DESCRIPTION OF THE DRAWINGS

[0080] The present invention will be described in more detail below based on embodiments and with reference to the accompanying drawings, wherein:

[0081] Figure 1 This is a structural diagram of the flight trajectory reconstruction model of the method proposed in the present invention;

[0082] Figure 2 This is a structural diagram of the flight trajectory prediction model of the method proposed in the present invention; DETAILED DESCRIPTION

[0083] In order to make the purpose, technical solution and advantages of the embodiment of the present invention clearer, the technical solution of the embodiment of the present invention will be clearly and completely described below in conjunction with the drawings of the embodiment of the present invention. Obviously, the described embodiment is a part of the embodiment of the present invention, not all of the embodiments. Based on the described embodiment of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0084] The present invention is further described below in conjunction with the accompanying drawings and embodiments.

[0085] A flight trajectory completion and prediction method based on time-frequency analysis, characterized in that it includes the following steps:

[0086] S1: Collect aircraft trajectory sequence data;

[0087] The original aircraft trajectory dataset is derived from the multi-source secondary surveillance radar (SSR) and automatic dependent surveillance-broadcast (ADS-B) in China's actual ATC system;

[0088] S2: Preprocess the collected aircraft trajectory data and divide it into training set, validation set and test set;

[0089] The raw data was preprocessed by data verification, multi-source data analysis, track point and flight registration, multi-source data alignment, data filtering and fusion, and the timestamp, position and speed attributes in the three-dimensional earth space were analyzed using the raw binary data to obtain the data set text collection;

[0090] Assume that n-1 preprocessed track data are used for prediction, and a sliding window with a window size of n is used with a step size of 1 track point to intercept the track data as a data pair, which consists of the observation values ​​of the first n-1 track points;

[0091] By random masking, a sequence of aircraft trajectories with a missing point is obtained, and then the completed sequence of aircraft trajectories is obtained by interpolation, and the corresponding two sequences are taken as a sequence group;

[0092] The dataset is divided into training set, validation set and test set according to 9:1:1;

[0093] S3: Construct a flight trajectory reconstruction model, including a backbone network and a reconstruction network; the backbone network is used to perform feature processing on the input data, and the reconstruction network is used to guide the model to pay more attention to the time characteristics and frequency domain characteristics of the aircraft trajectory;

[0094] The backbone network includes a multi-layer perceptron and an encoder module; the reconstruction network includes a trajectory reconstruction module and a frequency domain reconstruction module;

[0095] First, a multi-layer perceptron is constructed. The multi-layer perceptron consists of two convolutional layers and a nonlinear layer. The convolutional layer is used to extract local features of the input data. The nonlinear layer introduces nonlinear transformations through activation functions to enhance the model's ability to express complex features. In this way, the multi-layer perceptron can extract deep features from the aircraft trajectory data layer by layer, providing effective feature representation for subsequent reconstruction and prediction.

[0096] Specifically, the multilayer perceptron consists of two convolutional layers and a nonlinear layer. The original data with a dimension of 2048x10x6 is input into the multilayer perceptron to obtain feature-enlarged data with a dimension of 2048x10x64 as the input of the encoder.

[0097] Next, we construct an encoder, which consists of a Transformer layer. The Transformer layer captures the temporal dependencies in the aircraft trajectory data through a self-attention mechanism, which can effectively model long-distance dependency information. The encoder's self-attention mechanism allows the model to flexibly focus on important trajectory features between different time steps while reducing the interference of irrelevant information. In this way, the encoder can better extract the temporal patterns and potential features in the aircraft trajectory data, providing a more accurate input representation for subsequent trajectory reconstruction and prediction.

[0098] Next, we construct the trajectory reconstruction module and the frequency domain reconstruction module. The trajectory reconstruction module is composed of LSTM modules, which are mainly used to process the temporal characteristics of the aircraft trajectory. The LSTM module captures the long-term and short-term dependencies of the trajectory sequence through its internal memory unit, and can effectively deal with the missing points and discontinuities in the trajectory, thereby achieving high-precision trajectory completion.

[0099] The frequency domain reconstruction module is composed of a self-attention module, which mainly processes the frequency domain features of the trajectory data. Through the self-attention mechanism, the frequency domain reconstruction module can capture the correlation between different frequency components in the frequency dimension, highlight important frequency features, and suppress irrelevant noise frequencies. In this way, the model can more comprehensively understand the changes in the aircraft trajectory in the frequency domain and improve the accuracy and robustness of the overall trajectory reconstruction.

[0100] Specifically, the trajectory reconstruction module and the frequency domain reconstruction module are composed of: the trajectory reconstruction module is composed of an LSTM module; the frequency domain reconstruction module is composed of a self-attention module. Specifically, there are the following steps:

[0101] 1) Pass F1 into the input layer of the trajectory reconstruction module to obtain P′ (1) , that is, P′ (1) =LSTM(F1);

[0102] 2) Pass F1 into the input layer of the frequency domain reconstruction module to obtain F2; at the same time, perform discrete Fourier transform on the true trajectory vector P to obtain F3 (F3 = FFT (P N-M:N-1 )), where the formula for discrete Fourier transform is:

[0103]

[0104] Where X k is the transformed complex sequence, k = 0, 1, ..., N-1 represents different frequency components in the frequency domain, i is the imaginary unit, x n is the sampled analog signal, and is the rotation factor;

[0105] The output of the fast Fourier transform will be a complex sequence representing the individual frequency components in the frequency domain, that is,

[0106]

[0107] Among them, i represents the frequency index and j represents the feature dimension;

[0108] S4: Pre-train the flight trajectory reconstruction model, introduce the mean square error, form a new joint loss function, train the flight trajectory reconstruction model, and retain the weight of the best model;

[0109] The specific steps for aircraft trajectory reconstruction model training are as follows:

[0110] Set the loss function with mean square error (MSE);

[0111] For the trajectory reconstruction module, the real trajectory sequences P and P′(1) are used as the loss function, which is denoted as L1, L1=MSE(P, P′(1));

[0112] For the frequency domain reconstruction module, the real trajectory vector P is subjected to discrete Fourier transform to obtain F3 (F3 = FFT (P N-M:N-1 )), the loss function is obtained by F2 and F3, denoted as L2, L2 = MSE (F2, F3);

[0113] Jointly optimize the multi-layer perceptron, encoder, trajectory reconstruction module and frequency domain reconstruction module, and set the joint loss function L 重建 =L1+L2 for optimization training and save the weight of the optimal aircraft reconstruction model;

[0114] S5: Based on the flight trajectory reconstruction model, a flight trajectory prediction model is constructed. Specifically, for the flight trajectory reconstruction model, the backbone network is retained, the trajectory reconstruction module in the reconstruction network is removed, and a discrete wavelet transform module, a decoder group and an inverse discrete wavelet transform module are newly designed;

[0115] The specific steps for changing the aircraft prediction model are:

[0116] 1) For the reconstruction network of the aircraft reconstruction module, the trajectory reconstruction module in the network is removed, and a convolution layer is added after the self-attention module in the frequency domain reconstruction module. At the same time, the new frequency domain reconstruction module corresponds one-to-one to each decoder in the decoder group;

[0117] 2) For the backbone network of the aircraft reconstruction model, add a discrete wavelet transform module, a decoder group and an inverse discrete wavelet transform module;

[0118] 3) The serial order of the overall model is: discrete wavelet transform module, multi-layer perceptron, encoder, frequency domain reconstruction module, decoder, inverse discrete wavelet transform module;

[0119] S6: Set the loss function, train the flight trajectory prediction model, and retain the weight of the best model;

[0120] The loss function is specifically set as follows:

[0121] 1) Find the missing sequence points by extension and downsampling, and give them higher weights. Set the loss function L 预测 for:

[0122]

[0123]

[0124] Where k represents the kth WTC, h L-k Representing WTC k Length, It is WTC k The estimated value of the jth attribute of the ith element of is the true value, It is a custom weight value, which completes the overall training of the model by resetting the loss function.

[0125] 2) The corresponding pre-processed original trajectory sequence P is subjected to discrete wavelet transformation to obtain wavelet component F8, and F and F8 described in S5-4 of claim 6 are used as prediction loss function L 预测 ,After the overall training of the model, the most suitable parameters for the model are found.

[0126] S7: Test the flight trajectory reconstruction model, input the aircraft sequence data with missing points, and realize the integrated completion and prediction of flight trajectory;

[0127] The test is as follows:

[0128] 1) Input the aircraft trajectory sequence data P containing missing pointsl ;

[0129] 2) P l After passing through the model, the trajectory is completed and a complete trajectory sequence P containing the next time step is output c .

Claims

1. A flight trajectory completion and prediction method based on time-frequency analysis, characterized in that: The following steps are involved: S1: Collect aircraft trajectory sequence data; S2: Preprocess the collected aircraft trajectory data and divide it into training set, validation set and test set; S3: construct a flight trajectory reconstruction model, including a backbone network and a reconstruction network; The backbone network is used to perform feature processing on the input data, and the reconstruction network is used to guide the model to pay more attention to the time characteristics and frequency domain characteristics of the aircraft trajectory; the backbone network includes a multi-layer perceptron and an encoder module; the reconstruction network includes a trajectory reconstruction module and a frequency domain reconstruction module; S4: Pre-train the flight trajectory reconstruction model, introduce the mean square error, form a new joint loss function, train the flight trajectory reconstruction model, and retain the weight of the best model; S5: Based on the flight trajectory reconstruction model, a flight trajectory prediction model is constructed; wherein, for the flight trajectory reconstruction model, the backbone network is retained, the trajectory reconstruction module in the reconstruction network is removed, and a discrete wavelet transform module, a decoder group and an inverse discrete wavelet transform module are newly designed; S6: Set the loss function, train the flight trajectory prediction model, and retain the weight of the best model; S7: Test the flight trajectory reconstruction model, input the aircraft sequence data with missing points, and realize the integrated completion and prediction of flight trajectories.

2. A flight trajectory completion and prediction method based on time-frequency analysis, characterized in that: The encoder in step S3 is: The encoder is composed of Transformer modules. After the preprocessed data is passed into the multi-layer perceptron, V is obtained. V is then passed to the Transformer input layer. After the attention mechanism and feedforward neural network module, a high-dimensional matrix F1 is obtained. Specifically, there are the following data processing steps: S3-1: Flatten the matrix data into a vector sequence. Connect the elements in the matrix in row order to form a one-dimensional vector sequence; The input matrix is ​​V, and the flattened vector sequence is M; M=[V[0,0],V[0,1],...,V[0,n-1],V[1,0],V[1,1],...V[1,n-1],...,V[m-1,0],V[m-1,1],...,V[m-1,n-1]](1)where m represents the number of rows and n represents the number of columns of the matrix; S3-2: Add position encoding to each element in the matrix in the Transformer model, using sine / cosine position encoding; Let the position code be d, Among them, pos represents the position of the token in the sequence. If the sequence length is L, then pos = 0, 1, ..., L-1; d is the position vector of the token, d(pos, 2i) represents the i-th element in this position vector, i represents odd dimensions, 2i represents even dimensions, and d model Represents the dimension of the token, that is, the dimension of each vector in our sequence; S3-3: Add the flattened matrix data to the positional encoding element-wise and perform a bitwise operation with the attention mask to obtain the input vector representation of the encoder; Let the summed vector sequence be X, the attention mask be M_mask, and x be the masked vector sequence; Among them, * represents bitwise operation; S3-4: The input vector representation is fed into the encoder and decoder of the Transformer model for forward propagation; the model performs self-attention calculations based on the positions and relationships of elements in the sequence to generate context-aware representations and outputs; Assume that the input vector is represented as X, the forward propagation of the encoder is Encoder(X), and the forward propagation of the decoder is Decoder(X); S3-5: Use linear transformation method to convert the output vector into the target high-dimensional matrix; Let the weight matrix of the linear transformation be W and the output vector be F1; F1=decoder_output*W (5) Here, * indicates matrix multiplication.

3. A flight trajectory completion and prediction method based on time-frequency analysis, characterized in that: The trajectory reconstruction module and the frequency domain reconstruction module in step S3 are: The trajectory reconstruction module is composed of LSTM modules; the frequency domain reconstruction module is composed of self-attention modules. Specifically, there are the following steps: 1) Pass F1 into the input layer of the trajectory reconstruction module to obtain P′ (1) , that is, P′ (1) =LSTM(F1); 2) Pass F1 into the input layer of the frequency domain reconstruction module to obtain F2; at the same time, perform discrete Fourier transform on the true trajectory vector P to obtain F3 (F3 = FFT (P N-M:N-1 )), where the formula for discrete Fourier transform is: Where X k is the transformed complex sequence, k = 0, 1, ..., N-1 represents different frequency components in the frequency domain, i is the imaginary unit, x n is the sampled analog signal, and is the rotation factor; The output of the fast Fourier transform will be a complex sequence representing the individual frequency components in the frequency domain, that is, Among them, i represents the frequency index and j represents the feature dimension.

4. A flight trajectory completion and prediction method based on time-frequency analysis, characterized in that: The specific training for the aircraft reconstruction model in step S4 is as follows: S4-1: Set the loss function with mean square error MSE; S4-2: According to step 1 described in claim 3, for the trajectory reconstruction module, through the real trajectory sequence P and P′ (1) As the loss function, it is marked as L1, L1 = MSE (P, P ′ (1) ); S4-3: According to step 2 described in claim 3, for the frequency domain reconstruction module, the real trajectory vector P is subjected to discrete Fourier transform to obtain F3, F3 = FFT (P N-M:N-1 ), the loss function is obtained by F2 and F3, denoted as L2, L2 = MSE (F2, F3); S4-4: Jointly optimize the multilayer perceptron, encoder, trajectory reconstruction module and frequency domain reconstruction module, and set the joint loss function L 重建 =L1+L2 for optimization training and save the weights of the optimal aircraft reconstruction model.

5. A flight trajectory completion and prediction method based on time-frequency analysis, characterized in that: The specific steps for changing the aircraft prediction model in S5 are as follows: 1) For the reconstruction network of the aircraft reconstruction module, the trajectory reconstruction module in the network is removed, and a convolution layer is added after the self-attention module in the frequency domain reconstruction module. At the same time, the new frequency domain reconstruction module corresponds one-to-one to each decoder in the decoder group; 2) For the backbone network of the aircraft reconstruction model, add a discrete wavelet transform module, a decoder group and an inverse discrete wavelet transform module; 3) The serial order of the overall model is: discrete wavelet transform module, multi-layer perceptron, encoder, frequency domain reconstruction module, decoder, inverse discrete wavelet transform module.

6. A flight trajectory completion and prediction method based on time-frequency analysis, characterized in that: The S5 aircraft prediction model specifically processes the data stream as follows: S5-1: Input the processed aircraft trajectory sequence, and after passing through the multi-layer perceptron, encoder, and frequency domain reconstruction module, obtain F2 of step 2 in claim 3, and obtain F5 after dimensionality upgrading of F2; wherein the dimension of F5 is the same as the matrix dimension D in step S2-1 in claim 2; S5-2: F5 passes through the self-attention module in the decoder, and the self-attention calculation formula is used to substitute the above-obtained F5 into Q, and F1 into K and V respectively, and F6 is calculated; the self-attention formula is as follows: F6=Self-Attention(F5,F1,F1) (8) S5-3: Since multiple decoders are designed, each corresponding to a wavelet component of different frequencies, it is assumed here that for the i+1th decoder, F6 is input into the convolution module of the decoder to obtain F7. i+1 ; Among them, the convolution operation is used to embed the enhanced trajectory into F6, and the formula is expressed as: F7 i =σ(Convld(F6)) (9) Among them, F7 i+1 The time dimension of is determined by the resolution of the wavelet component corresponding to the i+1th decoder, The calculation formula of the length of the wavelet component is as follows: h L =h L-1 (12) Among them, L is the level of wavelet analysis, l is half of the wavelet filter length, M is the number of historical trajectory points, and WTC i Represents wavelet components of different frequencies, Represents high frequency WTC L-i The length of time; h L Represents the time length of low-frequency WTC0; S5-4: F7 i+1 As a wavelet component at a certain resolution, at this time, assume that the final wavelet component obtained by different decoders is F.

7. A flight trajectory completion and prediction method based on time-frequency analysis, characterized in that: The specific loss function for training the S6 aircraft prediction model is set as: S6-1: Find the missing sequence points by extension and downsampling, and give them higher weights; set the loss function L 预测 for: Where k represents the kth WTC, h L-k Representing WTC k Length, It is WTC k The estimated value of the jth attribute of the ith element of is the true value, It is a custom weight value, which completes the overall training of the model by resetting the loss function; S6-2: The corresponding pre-processed original trajectory sequence P is subjected to discrete wavelet transformation to obtain wavelet component F8, and F and F8 described in S5-4 of claim 6 are used as prediction loss function L 预测 ,After the overall training of the model, the most suitable parameters for the model are found.

8. A flight trajectory completion and prediction method based on time-frequency analysis, characterized in that: The test in step S7 is specifically as follows: 1) Input the aircraft trajectory sequence data P containing missing points l ; 2) P l After passing through the model, the trajectory is completed and a complete trajectory sequence P containing the next time step is output c .

9. A flight trajectory completion and prediction method based on time-frequency analysis, characterized in that: It includes at least one processor and a memory communicatively connected to the at least one processor; the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the method described in any one of claims 1 to 8.

Citation Information

Patent Citations

  • Data processing method for generating flight path of flight, electronic equipment and medium

    CN113240212A

  • Track completion prediction method and device considering airspace situation and local optimization

    CN116543603A

  • Track prediction method in autonomous operation mode based on time-frequency analysis

    CN118645017A

  • SUPERVISION DEVICE FOR AN AIRCRAFT, SUPERVISION SYSTEM, SUPERVISION METHOD AND ASSOCIATED COMPUTER PROGRAM PRODUCT

    FR3013117A1

  • Systems and methods for shared cross-modal trajectory prediction

    US20210286371A1