Non-cooperative target behavior recognition method and system based on privilege information and attention mechanism

Through deep neural networks based on privileged information and attention mechanisms, the problem that traditional methods are difficult to identify complex motion patterns is solved, and non-cooperative target behavior recognition with high accuracy and strong generalization capabilities is achieved.

CN119888845APending Publication Date: 2025-04-25NANJING UNIV OF AERONAUTICS & ASTRONAUTICS
View PDF 0 Cites 3 Cited by

Patent Information

Application Number
CN202411878135.8
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-12-19
Publication Date
2025-04-25

AI Technical Summary

Technical Problem

Traditional non-cooperative target behavior recognition methods are difficult to accurately model complex motion patterns, single-modal image data information is insufficient, and there are limitations in multimodal data acquisition and processing, resulting in a decrease in recognition accuracy and limited generalization ability.

Method used

A deep neural network based on privileged information and attention mechanism is adopted to train the deep neural network through the training data set to generate a fusion of pseudo-depth image and RGB image features, and a self-attention mechanism is used to output non-cooperative target behavior category tags.

Benefits of technology

It significantly improves the accuracy of recognition of non-cooperative target behavior patterns, improves the adaptability and generalization capabilities of the model in complex scenarios, and ensures that efficient identification performance can be maintained in dynamic and changeable non-cooperative target environments.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119888845A_ABST
    Figure CN119888845A_ABST
Patent Text Reader

Abstract

The invention discloses a non-cooperative target behavior recognition method and system based on privilege information and an attention mechanism. The method comprises the following steps: selecting a plurality of RGB images containing space targets and corresponding depth images from a target behavior pattern library as a training data set; constructing a deep neural network based on privilege information and an attention mechanism, and training the deep neural network through the training data set to obtain a behavior recognition model; obtaining an RGB image of the non-cooperative target, generating a pseudo-depth image from the RGB image of the non-cooperative target through the behavior recognition model, extracting feature representations of the RGB image and the pseudo-depth image, and performing fusion to obtain a fused feature representation; and outputting a non-cooperative target behavior category label through a self-attention mechanism according to the feature representation of the RGB image and the fused feature representation, thereby realizing non-cooperative target behavior recognition. The depth image is introduced as privilege information, complementarity among multi-mode data is fully utilized, and the recognition accuracy of the non-cooperative target behavior mode is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to target behavior recognition, and in particular to a non-cooperative target behavior recognition method and system based on privileged information and attention mechanism. Background Art

[0002] With the rapid development of aerospace technology and artificial intelligence, non-cooperative target behavior recognition has important research significance and practical value in space target monitoring, orbit maintenance and defense systems. However, due to the lack of communication and cooperation capabilities, non-cooperative targets are usually unpredictable, and their behavior pattern recognition faces the following technical difficulties: the relative motion of spacecraft is significantly affected by orbital dynamics, the trajectory morphology is diverse and disturbed by the space environment, which makes it difficult for traditional behavior recognition methods to accurately model complex motion patterns; single-modal image data (such as RGB images) has insufficient information when capturing the global features of the target, and although multi-modal data (such as depth images) can provide supplementary information, its acquisition and processing have certain limitations in practical applications. When facing dynamic and complex scenes, traditional behavior recognition algorithms often have reduced recognition accuracy and limited generalization ability due to insufficient model expression ability or incomplete feature extraction. Summary of the invention

[0003] Purpose of the invention: In view of the above shortcomings, the present invention provides a highly accurate non-cooperative target behavior recognition method and system based on privileged information and attention mechanism.

[0004] Technical solution: To solve the above problems, the present invention adopts a non-cooperative target behavior recognition method based on privileged information and attention mechanism, which includes the following steps:

[0005] (1) Select several RGB images containing spatial targets and corresponding depth images from the target behavior pattern library as training data sets;

[0006] (2) Construct a deep neural network based on privileged information and attention mechanism, train the deep neural network through the training data set, and obtain a trained behavior recognition model;

[0007] (3) Obtain an RGB image of the non-cooperative target, generate a pseudo-depth image from the RGB image of the non-cooperative target through a mapping function using the trained behavior recognition model, extract the feature representations of the RGB image and the pseudo-depth image, and fuse them to obtain a fused feature representation; output the non-cooperative target behavior category label through the self-attention mechanism using the feature representation of the RGB image and the fused feature representation to realize non-cooperative target behavior recognition.

[0008] Furthermore, the specific process of training the deep neural network through the training data set includes:

[0009] For an RGB image containing a spatial target and a corresponding depth image, a pseudo depth image is generated from the RGB image through a mapping function; feature representations of the target's RGB image, depth image and pseudo depth image are extracted; the feature representations of the RGB image and the depth image are fused to obtain a fused feature representation, the error between the feature representations of the depth image and the pseudo depth image is defined as a generation loss, the error between the fused feature representation and the feature representation of the RGB image is defined as a consistency loss, and the network parameters of the deep neural network are trained by constraining the generation loss and the consistency loss.

[0010] Furthermore, the deep neural network model based on privileged information and attention mechanism includes an input layer, a hidden layer and an output layer;

[0011] The input layer receives the feature representation and fusion feature representation of the RGB image;

[0012] The hidden layer includes a bidirectional recurrent neural network and a self-attention mechanism, wherein the bidirectional recurrent neural network captures the forward and backward time series of the input sequence, and the self-attention mechanism captures the global feature dependency of the output sequence of the bidirectional recurrent neural network and assigns different importance weights to the features;

[0013] The output layer maps the output of the hidden layer to a non-cooperative target behavior category label through a fully connected network and a classifier.

[0014] Furthermore, the bidirectional recurrent neural network BiLSTM captures the forward and backward time series calculation process of the input sequence as follows:

[0015] Given an input sequence X = {x1, x2, ..., x T}, the bidirectional recurrent neural network calculates the forward hidden state and the backward hidden state

[0016]

[0017] In the formula, LSTM(·) represents the long short-term memory network unit, which updates the hidden state of the current time step through the input sequence and hidden state. Represents the sequential information from time step 1 to the current time step t, Represents the reverse order information from time step 1 to the current time step t, represents the sequential information from time step 1 to time step t-1, Represents the reverse order information from time step 1 to time step t+1;

[0018] The final output combines the states before and after:

[0019]

[0020] In the formula, h t represents the comprehensive hidden state at time step t, and [;] represents the vector concatenation operation.

[0021] Furthermore, the self-attention mechanism captures the global feature dependency of the bidirectional recurrent neural network output sequence and assigns different importance weights to the features. The calculation process is as follows:

[0022] For the output of BiLSTM H = {h1,h2,…,h T} perform linear transformation to obtain the query matrix Q, key matrix K and value matrix V respectively:

[0023] Q=HW Q ,K=HW K ,V=HW V

[0024] Where W Q , W K , W V represents the learnable parameter matrix;

[0025] Use the dot product method to calculate the attention weights:

[0026]

[0027] Where, d k Represents the dimension of the key vector, used to scale the dot product result, and softmax is used to normalize the weight;

[0028] The weighted sum of the value matrix V is obtained to obtain the new attention feature representation:

[0029] Z=AV

[0030] Where Z represents the global feature representation of the final output of the hidden layer.

[0031] Furthermore, the output layer specifically includes:

[0032] Fully connected layer: maps the global feature representation Z to the classifier input dimension:

[0033] z=ReLU(ZW FC +b FC )

[0034] Where ReLU(·) represents the rectified linear unit activation function, W FC and b FC Represents full connection parameters;

[0035] Classifier: Use the softmax function to generate predicted probability distribution:

[0036]

[0037] Where W cls and b cls Represents the classifier parameters, and finally outputs the non-cooperative target behavior category

[0038] Furthermore, the non-cooperative target behavior categories include:

[0039] Rendezvous: The trajectories of the target and reference spacecraft tend to gradually approach each other, eventually reaching a space encounter;

[0040] Relative stillness: The target remains stationary in relative position, with no significant trajectory deviation;

[0041] Oscillation: The target moves around the reference spacecraft in a periodic pattern, including linear oscillation and nonlinear oscillation;

[0042] Fly-by: The target moves along a trajectory around the reference spacecraft, including elliptical fly-by, water drop fly-by, circular fly-by, controlled fly-by and spiral fly-by;

[0043] Flyby: The target quickly passes through the area around the reference spacecraft, including apsidal flyby, straight-line flyby and water drop flyby;

[0044] Hovering: The target is in a relatively static state with a certain trajectory deviation, including elliptical hovering and water drop hovering.

[0045] The present invention also adopts a non-cooperative target behavior recognition system based on privileged information and attention mechanism, comprising:

[0046] A data acquisition module is used to select a number of RGB images containing space targets and corresponding depth images from the target behavior pattern library as training data sets;

[0047] The model building module is used to build a deep neural network based on privileged information and attention mechanism, and train the deep neural network through the training data set to obtain a trained behavior recognition model;

[0048] The recognition module is used to obtain the RGB image of the non-cooperative target, generate a pseudo-depth image from the RGB image of the non-cooperative target through a mapping function using the trained behavior recognition model, extract the feature representations of the RGB image and the pseudo-depth image, and fuse them to obtain a fused feature representation; the feature representation of the RGB image and the fused feature representation are used to output the non-cooperative target behavior category label through the self-attention mechanism to realize non-cooperative target behavior recognition.

[0049] The present invention also adopts a computer device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that the processor implements the steps of the above method when executing the computer program.

[0050] The present invention also adopts a computer-readable storage medium on which a computer program is stored, characterized in that the computer program implements the steps of the above method when executed by a processor.

[0051] Beneficial effects: Compared with the prior art, the significant advantage of the present invention is that by introducing the depth image as privileged information, a correlation model between the depth image and the unimodal image features is constructed, and the complementarity between multimodal data is fully utilized to effectively make up for the problem of insufficient information in the traditional unimodal recognition method, and the recognition accuracy of the behavior patterns of non-cooperative targets is greatly improved. The deep neural network combined with the attention mechanism can dynamically focus on key behavioral features, reduce the interference of redundant information, improve the adaptability and generalization ability of the model in complex scenarios, and enable it to maintain efficient recognition performance in a dynamic and changeable non-cooperative target environment. Through the construction of a relative motion dynamics model and a behavior pattern library, the present invention accurately models the behavior patterns of non-cooperative targets under physical constraints, providing a solid theoretical basis for recognition, especially in complex trajectories and dynamic environments, the accuracy of behavior pattern recognition is significantly optimized. BRIEF DESCRIPTION OF THE DRAWINGS

[0052] Figure 1 It is a schematic diagram of the principle structure of the non-cooperative target behavior recognition system of the present invention. DETAILED DESCRIPTION

[0053] like Figure 1 As shown, a non-cooperative target behavior recognition method based on privileged information and attention mechanism in this embodiment specifically includes the following steps:

[0054] Step 1: Establish a relative motion dynamics model and construct a target behavior pattern library;

[0055] Step 1.1, in order to more accurately describe the close-range relative motion behavior of spacecraft in space, a dynamic model based on space relative motion is established. The model uses the reference spacecraft as the reference coordinate point, introduces the improved dynamic equation, and combines multiple behavior patterns to build a target behavior pattern library.

[0056] The local orbital coordinate system (LOF) is used, with the center of mass of the reference spacecraft as the coordinate origin, and the coordinate axes are defined as follows: X-axis (trajectory tangential axis): along the direction of the reference spacecraft; Z-axis (trajectory normal axis): perpendicular to the orbital plane, consistent with the direction of the orbital momentum; Y-axis (trajectory lateral axis): perpendicular to the XZ plane and follows the right-hand rule.

[0057] The dynamic equation of relative motion is modeled based on the improved CW (Clohessy-Wiltshire) equation, which is suitable for various orbital forms. The basic equation is:

[0058]

[0059] Where x represents the relative position of the target spacecraft relative to the reference spacecraft along the X-axis (trajectory tangential axis), y represents the relative position of the target spacecraft relative to the reference spacecraft along the Y-axis (trajectory lateral axis), z represents the relative position of the target spacecraft relative to the reference spacecraft along the Z-axis (trajectory normal axis), n represents the orbital angular velocity of the reference spacecraft, and F is x 、F y 、F z Represents the control force or external force component acting on the target spacecraft.

[0060] Step 1.2, in order to comprehensively characterize the relative motion behavior of the spacecraft, it is divided into six basic behavior modes and several subtypes based on the trajectory morphology and target motion intention:

[0061] (1) Rendezvous: The trajectories of the target and reference spacecraft tend to gradually approach each other and eventually meet in space. This is used to describe docking or close-range observation scenarios.

[0062] (2) Relative stillness: The target remains stationary in relative position with no significant trajectory deviation. This is suitable for describing situations where the target is under observation or briefly hovering.

[0063] (3) Oscillation: The target moves around the reference spacecraft in a periodic pattern. It can be divided into two categories: linear oscillation and nonlinear oscillation. It usually occurs in scenarios where the trajectory is disturbed but remains stable.

[0064] (4) Flyby: The target moves along a trajectory around the reference spacecraft, including the following five subtypes: elliptical flyby, droplet flyby, circular flyby, controlled flyby, and spiral flyby.

[0065] (5) Flyby: The target passes quickly through the area around the reference spacecraft. It is usually used to describe the behavior of short-term high-dynamic interactions. It includes the following three subtypes: arch flyby, straight flyby and droplet flyby.

[0066] (6) Hovering: The target is in a relatively static state with a certain trajectory deviation. It is mainly used in scenarios of long-term observation or relative position adjustment. It includes the following two subtypes: elliptical hovering and water droplet hovering.

[0067] Several RGB images containing spatial targets and corresponding depth images are selected from the target behavior pattern library as training data sets.

[0068] Step 2: Treat the depth image as privileged information and model its association with unimodal image features;

[0069] In the target behavior recognition task, depth images, as privileged information, can effectively capture the geometric and morphological information of spatial targets, and are complementary to the features of single-modal RGB images (hereinafter referred to as RGB images). In order to achieve the fusion of depth image and RGB image features, the following modeling steps are proposed:

[0070] (1) Privileged Information Mapping Model

[0071] Let the input RGB image be I RGB , the corresponding depth image is I D During the training phase, the mapping function Generate a deep image representation from an RGB image:

[0072]

[0073] In the formula, θ priv represents the parameters of the privileged information extraction network, Represents the depth image predicted from the RGB image. Generated depth image It is regarded as privileged information and used as one of the inputs of the decoder network to improve the semantic quality of the generated deep features and the recognition performance of unimodal images.

[0074] Depth Image The deep features The extraction can be expressed as:

[0075]

[0076] In the formula, g dec (·) represents the decoder network, Θ represents the parameters of the decoder network, Represents the features extracted from the generated depth image for subsequent tasks.

[0077] (2) Multimodal feature extraction and fusion

[0078] The encoder-decoder structure is used to extract feature representations of RGB images and depth images:

[0079]

[0080] In the formula, ε RGB and ε D denote the feature encoders of RGB image and depth image respectively, θ E_RGB and θ E_D Represents its parameters.

[0081] Next, the association between RGB features and depth features is established through the fusion module:

[0082]

[0083] In the formula, represents the feature fusion function, θ fuse Indicates its parameters.

[0084] (3) Modeling the relationship between privileged information and unimodal images

[0085] In the decoder network, the input RGB features F are combined RGB And the generated deep features The semantic quality of the generated deep features is optimized through constraints. The generated loss function is defined to measure the true deep features F RGB And the generated deep features The error between:

[0086]

[0087] Through this generation loss, the decoder network is able to enhance the semantic consistency of the generated features and provide high-quality input for subsequent classification tasks.

[0088] (4) Multimodal consistency optimization

[0089] To further improve the representation ability of features, multimodal consistency constraints are added. Definition of consistency loss To constrain the similarity between the fusion features and the original features:

[0090]

[0091] In the formula, represents the consistency optimization module, θ cons Indicates its parameters.

[0092] Through the above model, the intrinsic connection between privileged information (depth image) and unimodal RGB image is systematically modeled, further providing high-quality input features for subsequent attention mechanism optimization and classification tasks.

[0093] Step 3: Design a deep neural network behavior pattern recognition method based on attention mechanism.

[0094] Step 3.1, in order to further improve the performance of non-cooperative target behavior pattern recognition, a deep neural network model is constructed, which is divided into three modules: input layer, hidden layer and output layer.

[0095] Step 3.2, design the input layer:

[0096] The input layer is responsible for receiving the unimodal RGB image IRGB The high-level semantic features and the fused privileged information features F fused .

[0097] The input vector is defined as:

[0098] X=[F RGB ,F fused ] (8)

[0099] In the formula, F RGB Represents the feature vector of the RGB image, F fused Represents the fusion representation of deep image features and RGB features generated by the privileged information module.

[0100] Step 3.3, design the hidden layer:

[0101] The hidden layers include a bidirectional recurrent neural network (BiLSTM) and a self-attention mechanism (SA) in a deep neural network.

[0102] Step 3.3.1, design the BiLSTM network:

[0103] The bidirectional LSTM network can capture both forward and backward time series information and is more suitable for learning complex sequence features in behavioral pattern recognition. The calculation process is as follows:

[0104] Given an input sequence X = {x1, x2, ..., x T}, bidirectional LSTM calculates the forward hidden state and the backward hidden state

[0105]

[0106] In the formula, LSTM(·) represents the long short-term memory network unit, which updates the hidden state of the current time step through the input sequence and hidden state. Represents the sequential information from time step 1 to the current time step t, Represents the reverse order information from time step 1 to the current time step t, represents the sequential information from time step 1 to time step t-1, Represents the reverse order information from time step 1 to time step t+1;

[0107] The final output combines the states before and after:

[0108]

[0109] In the formula, h t represents the comprehensive hidden state at time step t, and [;] represents the vector concatenation operation.

[0110] Step 3.3.2, design the self-attention (SA) mechanism:

[0111] A self-attention mechanism is added to BiLSTM to capture global feature dependencies and assign different importance weights to features. The calculation process is as follows:

[0112] (1) Feature Mapping

[0113] For BiLSTM output H = {h1,h2,...,h T} perform linear transformation to obtain the query matrix Q, key matrix K and value matrix V respectively:

[0114] Q=HW Q , K=HW K , V=HW V (11)

[0115] Where W Q , W K , W V represents the learnable parameter matrix.

[0116] (2) Attention score calculation

[0117] Use the dot product method to calculate the attention weights:

[0118]

[0119] Where, d k Indicates the dimension of the key vector, used to scale the dot product result, and softmax is used to normalize the weights.

[0120] (3) Weighted summation

[0121] The weighted sum of the value matrix V is obtained to obtain the new attention feature representation:

[0122] Z=AV (13)

[0123] Where Z represents the global feature representation of the final output of the hidden layer, which fully integrates the important temporal and global features in the input sequence.

[0124] Step 3.4, design the output layer:

[0125] The output layer maps the high-level semantic features extracted by the hidden layer into the target behavior category label through a fully connected network and a classifier.

[0126] (1) Fully connected layer

[0127] Map the attention feature Z to the classifier input dimension:

[0128] z=ReLU(ZWFC +b FC ) (14)

[0129] Where ReLU(·) represents the Rectified Linear Unit activation function, W FC and b FC Represents full connection parameters;

[0130] (2) Classifier

[0131] Use the softmax function to generate the predicted probability distribution:

[0132]

[0133] Where W cls and b cls Represents the classifier parameters, and finally outputs the target behavior category

[0134] The deep neural network is trained using the training data set to obtain a trained behavior recognition model.

[0135] Step 4: Acquire the RGB image of the non-cooperative target in real time, generate a pseudo-depth image from the RGB image of the non-cooperative target through a mapping function using the trained behavior recognition model, extract the feature representations of the RGB image and the pseudo-depth image, and fuse them to obtain a fused feature representation; output the non-cooperative target behavior category label through a bidirectional recurrent neural network and a self-attention mechanism to realize non-cooperative target behavior recognition.

[0136] Through the above model architecture design, the behavior pattern recognition system fully utilizes the advantages of privileged information and attention mechanism, significantly improves the accuracy and generalization ability of the non-cooperative target behavior recognition method based on privileged information and attention mechanism in non-cooperative target behavior pattern recognition tasks, and provides a more efficient and robust solution for behavior recognition in complex scenarios.

Claims

1. A non-cooperative target behavior recognition method based on privileged information and attention mechanism, characterized in that: The following steps are involved: (1) Select several RGB images containing spatial targets and corresponding depth images from the target behavior pattern library as training data sets; (2) Construct a deep neural network based on privileged information and attention mechanism, train the deep neural network through the training data set, and obtain a trained behavior recognition model; (3) Obtain an RGB image of the non-cooperative target, generate a pseudo-depth image from the RGB image of the non-cooperative target through a mapping function using the trained behavior recognition model, extract feature representations of the RGB image and the pseudo-depth image, and fuse them to obtain a fused feature representation; The feature representation of the RGB image and the fused feature representation are used to output the non-cooperative target behavior category label through the self-attention mechanism to achieve non-cooperative target behavior recognition.

2. The non-cooperative target behavior recognition method according to claim 1, characterized in that: The specific process of training the deep neural network through the training data set includes: For an RGB image containing a spatial target and a corresponding depth image, a pseudo depth image is generated from the RGB image through a mapping function; feature representations of the target's RGB image, depth image and pseudo depth image are extracted; the feature representations of the RGB image and the depth image are fused to obtain a fused feature representation, the error between the feature representations of the depth image and the pseudo depth image is defined as a generation loss, the error between the fused feature representation and the feature representation of the RGB image is defined as a consistency loss, and the network parameters of the deep neural network are trained by constraining the generation loss and the consistency loss.

3. The non-cooperative target behavior recognition method according to claim 2, characterized in that: The deep neural network model based on privileged information and attention mechanism includes an input layer, a hidden layer and an output layer; The input layer receives the feature representation and fusion feature representation of the RGB image; The hidden layer includes a bidirectional recurrent neural network and a self-attention mechanism, wherein the bidirectional recurrent neural network captures the forward and backward time series of the input sequence, and the self-attention mechanism captures the global feature dependency of the output sequence of the bidirectional recurrent neural network and assigns different importance weights to the features; The output layer maps the output of the hidden layer to a non-cooperative target behavior category label through a fully connected network and a classifier.

4. The non-cooperative target behavior recognition method according to claim 3, characterized in that: The bidirectional recurrent neural network BiLSTM captures the forward and backward time series calculation process of the input sequence as follows: Given an input sequence X = {x1, x2, ..., x T }, the bidirectional recurrent neural network calculates the forward hidden state and the backward hidden state In the formula, LSTM(·) represents the long short-term memory network unit, which updates the hidden state of the current time step through the input sequence and hidden state. Represents the sequential information from time step 1 to the current time step t, Represents the reverse order information from time step 1 to the current time step t, represents the sequential information from time step 1 to time step t-1, Represents the reverse order information from time step 1 to time step t+1; The final output combines the states before and after: In the formula, h t represents the comprehensive hidden state at time step t, and [;] represents the vector concatenation operation.

5. The non-cooperative target behavior recognition method according to claim 4, characterized in that: The self-attention mechanism captures the global feature dependencies of the bidirectional recurrent neural network output sequence and assigns different importance weights to the features. The calculation process is as follows: For the output of BiLSTM H = {h1,h2,…,h T } perform linear transformation to obtain the query matrix Q, key matrix K and value matrix V respectively: Q=HW Q ,K=HW K ,V=HW V Where W Q , W K , W V represents the learnable parameter matrix; Use the dot product method to calculate the attention weights: Where, d k Represents the dimension of the key vector, used to scale the dot product result, and softmax is used to normalize the weight; The weighted sum of the value matrix V is obtained to obtain the new attention feature representation: Z=AV Where Z represents the global feature representation of the final output of the hidden layer.

6. The non-cooperative target behavior recognition method according to claim 5, characterized in that: The output layer specifically includes: Fully connected layer: maps the global feature representation Z to the classifier input dimension: z=ReLU(ZW FC +b FC ) Where ReLU(·) represents the rectified linear unit activation function, W FC and b FC Represents full connection parameters; Classifier: Use the softmax function to generate predicted probability distribution: Where W cls and b cls Represents the classifier parameters, and finally outputs the non-cooperative target behavior category 7. The non-cooperative target behavior recognition method according to claim 6, characterized in that: The non-cooperative target behavior categories include: Rendezvous: The trajectories of the target and reference spacecraft tend to gradually approach each other, eventually reaching a space encounter; Relative stillness: The target remains stationary in relative position, with no significant trajectory deviation; Oscillation: The target moves around the reference spacecraft in a periodic pattern, including linear oscillation and nonlinear oscillation; Fly-by: The target moves along a trajectory around the reference spacecraft, including elliptical fly-by, water drop fly-by, circular fly-by, controlled fly-by and spiral fly-by; Flyby: The target quickly passes through the area around the reference spacecraft, including apsidal flyby, straight-line flyby and water drop flyby; Hovering: The target is in a relatively static state with a certain trajectory deviation, including elliptical hovering and water drop hovering.

8. A non-cooperative target behavior recognition system based on privileged information and attention mechanism, characterized in that: include: A data acquisition module is used to select a number of RGB images containing space targets and corresponding depth images from the target behavior pattern library as training data sets; The model building module is used to build a deep neural network based on privileged information and attention mechanism, and train the deep neural network through the training data set to obtain a trained behavior recognition model; The recognition module is used to obtain the RGB image of the non-cooperative target, generate a pseudo-depth image from the RGB image of the non-cooperative target through a mapping function using the trained behavior recognition model, extract feature representations of the RGB image and the pseudo-depth image, and fuse them to obtain a fused feature representation; The feature representation of the RGB image and the fused feature representation are used to output the non-cooperative target behavior category label through the self-attention mechanism to achieve non-cooperative target behavior recognition.

9. A computer device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 7 are implemented.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.

Citation Information

Cited By

  • Target behavior recognition method and device and medium

    CN120853266A

  • A target behavior recognition method, device and medium

    CN120853266B

  • Random network prediction method fusing attention mechanism and privilege information

    CN121169149A