Measurement and control link self-adaption method based on strategy evolution

Abstract

The invention provides a measurement and control link self-adaption method based on strategy evolution, and belongs to the technical field of spatial information transmission and spacecraft measurement and control. The method is applied to a satellite-ground adaptive measurement and control link, and each component can be independently optimized and expanded under the condition of not influencing an overall adaptive flow processing structure; under the condition that satellite-ground equipment and an application scene are fixed, the method has the capability of further optimizing the adaptive efficiency by improving and optimizing a strategy set; and the switching action of the standardized single serial process is very convenient for the specific realization of the equipment. According to the method, the application requirements of complex, time-varying and resistant satellite-ground measurement and control link working scenes in the future can be well responded, and the link self-adaption efficiency is effectively improved.

Description

Technical Field

[0001] The present invention belongs to the field of space information transmission and spacecraft measurement and control technology, and in particular relates to a measurement and control link adaptation method based on strategy evolution. Background Art

[0002] The satellite-to-ground measurement and control link is the lifeline of satellites in orbit, and needs to provide satellites with highly reliable, highly available, and high-performance tracking, measurement, and telemetry and remote control support. Since the satellite-to-ground link is in an open space, facing the complex and time-varying space electromagnetic environment filled with intentional and unintentional interference in the future, it is very necessary and urgent to improve the anti-interference capability of the satellite-to-ground measurement and control link. There are various methods for link anti-interference. Among them, configuring a link state with multi-level anti-interference performance, analyzing interference perception, and adaptively adjusting the measurement and control link state is an effective method that can achieve both anti-interference and measurement and control support performance.

[0003] At present, in order to facilitate the coordinated work of satellite and ground downlink linkage and the implementation of engineering, the adaptation of the measurement and control link is mainly based on engineering experience to set the threshold, through a series of predetermined state parameter judgments, and according to the judgment results, drive each part of the satellite and ground equipment step by step to complete the process of link state adjustment. For example, a typical process is: when the satellite measurement and control equipment detects an uplink locking anomaly, it will first determine whether it is interfered. If the locking anomaly is caused by interference, it will determine the intensity of the interference and send the relevant situation to the ground measurement and control equipment. The ground measurement and control equipment will feedback to the satellite after confirming the status, and then adjust the link status under the unified agreement of the ground measurement and control equipment. Although this method is simple and easy to implement, it has obvious shortcomings in meeting the subsequent complex and multi-scenario adaptive requirements. First, there are many state parameters in complex scenarios, and the branches of state judgment increase exponentially, making the process execution complexity uncontrollable. Second, the judgment and link adaptive adjustment actions are intertwined with each other, and there is a great risk of loops and interruptions that cannot be executed due to insufficient design. Third, the scenarios adapted by the state parameters and adaptive processes are solidified, and can only guarantee the adaptive performance in specific scenarios. Fourth, once the design parameters are determined, it is difficult to adjust them. Even if some parameters are expanded, the entire process will be affected, and the scalability is seriously insufficient. That is, the main problem is that the adaptive performance of traditional methods is related to specific scenarios, the execution process is complex, and the scalability is poor. Therefore, there is an urgent need for a link adaptive method that can well respond to the future complex, time-varying, and confrontational satellite-to-ground measurement and control link working scenario application requirements. The execution process does not change or improve with the changes in the scenario and the increase in the complexity of the scenario. It can be upgraded and easily expanded, and can achieve better adaptive performance under different scenario requirements. Summary of the invention

[0004] To solve the above technical problems, the present invention proposes an adaptive scheme for a measurement and control link based on policy evolution. On the measurement and control link that realizes adaptability based on feedback state transmission, the "policy" is proposed and defined as the core element that determines the degree of compliance between the result of the measurement and control link adaptability and the external electromagnetic environment, mission requirements, etc., that is, the adaptive efficiency. The evolution of the policy and the link adaptive model driven by the "policy" are used to optimize the adaptive efficiency of the measurement and control link.

[0005] The first aspect of the present invention proposes a method for adapting a measurement and control link based on policy evolution, and the method includes:

[0006] Step S1, state acquisition;

[0007] Collect state information related to the adaptability of the link state and the external working environment. The state information includes: spectrum sensing information, spectrum sensing information, mission requirement information, and scene association information;

[0008] Step S2, comprehensive judgment;

[0009] Based on the collected state information, different associated information parameters are screened to perform two judgments: whether to adjust the link state and the target state of the link state adjustment;

[0010] Step S3, state adjustment;

[0011] According to the target state of the link state adjustment, switch from the current link working state to the target working state, and re - establish the space - to - ground measurement and control link;

[0012] Step S4, efficiency evaluation;

[0013] Take the adaptability between the link state before and after the state adjustment and the external environment of the scene, the measurement and control performance supported by the link, and the success rate of the adjustment process as the characteristics representing the link adaptive efficiency, perform quantitative processing, and evaluate the link adaptive efficiency through the quantitative value;

[0014] Among them, state acquisition, comprehensive judgment, and state adjustment are online execution process loops, and state acquisition, comprehensive judgment, and efficiency evaluation are offline improvement process loops.

[0015] According to the method of the first aspect of the present invention, in step S1, the state information is used to characterize the adaptation of the current link working state to the current external environment of the scene, and to determine the optimal link state required by the external environment of the scene for the current and subsequent periods of time; among them:

[0016] The spectrum sensing information includes: the monitored spectrum state within the receiving band, the interference detection and processing state, and the interference parameter state;

[0017] The spectrum sensing information includes: reception status, transmission status, current link operating parameters, basic system performance, and link device health status;

[0018] The mission requirement information includes: mission plan, mission execution progress, and expected execution results;

[0019] The scenario association information includes: uplink and downlink link establishment plan, inbound and outbound status, and other external support information.

[0020] According to the method of the first aspect of the present invention, in step S2:

[0021] Judging whether to adjust the link state refers to: judging whether the current link operating state is adapted to the current scenario external environment; whether it is necessary to adjust the link state to obtain the expected normal state of the link;

[0022] Judging the target state of the link state adjustment refers to: judging which state in the set of states supported by the link should be selected as the target state to achieve the optimal match with the external environment requirements of the current scenario.

[0023] According to the method of the first aspect of the present invention, in the method, the offline improved process loop composed of state acquisition, comprehensive decision-making, and effectiveness evaluation is used to realize the adaptive dynamic evolution of the TT&C link with the change of scenario requirements. By constructing an evolvable decision-making machine based on state mapping, the mapping function of the improved decision-making machine is driven by effectiveness evaluation to adjust the input state parameters, so as to obtain better adaptive effectiveness under specific scenarios.

[0024] According to the method of the first aspect of the present invention, the evolvable decision-making machine based on state mapping includes: an input parameter set, an output parameter set, a policy set, and a decision-making unit; where:

[0025] The input parameter set refers to the set of parameters used for comprehensive decision-making from the state information. When the parameters in the state information change, the parameters in the input parameter set also change accordingly;

[0026] The output parameter set refers to the set of parameters output by the decision-making machine for link state adjustment, and only includes the parameter indicating whether to adjust and the target link state parameter. The target link state parameter is selected from the set of link states supported by the TT&C link ground and space equipment currently in operation;

[0027] The policy set refers to the set indicating the mapping relationship between the input parameter set and the output parameter set, that is, the set of mapping functions; the policy set contains one or more policies, one policy contains a group of mapping functions, the mapping functions of different policies are different, and different policies correspond to different application scenarios and mission objectives;

[0028] The decision-making unit selects the corresponding policy from the policy set based on the application scenario according to the parameters in the input parameter set, retrieves the matching mapping function, and calculates the output parameter set.

[0029] According to the method of the first aspect of the present invention, in the method, state adjustment is performed according to the output parameter set of the decision-making machine, which specifically includes:

[0030] Establish a standard state transition action set: Establish and define a standard state transition action set that traverses all possible states.

[0031] Establish a mapping between states and actions: Establish a unique mapping between the current link state and the target link state under each group of specific scenarios and the actions in the standard state transition action set.

[0032] Switching action: According to the output parameter set of the comprehensive decision-making, combined with the current other working states, map and extract the standard state transition actions and execute them.

[0033] According to the method of the first aspect of the present invention, in the method, the state adjustment is divided into a state synchronization process and a switching action process. The actions in the state synchronization process are related to the satellite master control state and the current link communication state, and the switching action process is related to the current link state and the target link state; the standard state transition action set is a multiple matrix that traverses four-dimensional parameters, and the number of actions is the product of the number of parameters.

[0034] The second aspect of the present invention proposes an adaptive measurement and control link system based on policy evolution, and the system includes:

[0035] A state acquisition module, configured to:

[0036] Collect state information related to the adaptability of the link state and the external working environment. The state information includes: spectrum sensing information, spectrum sensing information, task requirement information, and scenario association information;

[0037] A comprehensive decision-making module, configured to:

[0038] Based on the collected state information, screen different associated information parameters to perform two decisions: whether to adjust the link state and the target state of the link state adjustment;

[0039] A state adjustment module, configured to:

[0040] According to the target state of the link state adjustment, switch from the current link working state to the target working state and re-establish the satellite-ground measurement and control link;

[0041] An effectiveness evaluation module, configured to:

[0042] The adaptability between the link state before and after state adjustment and the external environment of the scenario, the measurement and control performance supported by the link, and the success rate of the adjustment process are used as the characteristics representing the adaptive efficiency of the link, and are quantitatively processed. The adaptive efficiency of the link is evaluated through the quantitative value.

[0043] Among them, state acquisition, comprehensive judgment, and state adjustment are the online execution process loops, and state acquisition, comprehensive judgment, and efficiency evaluation are the offline improvement process loops.

[0044] The third aspect of the present invention discloses an electronic device. The electronic device includes a memory and a processor. The memory stores a computer program. When the processor executes the computer program, a measurement and control link adaptive method based on policy evolution in the first aspect of the present disclosure is implemented.

[0045] The fourth aspect of the present invention discloses a computer-readable storage medium. A computer program is stored on the computer-readable storage medium. When the computer program is executed by a processor, a measurement and control link adaptive method based on policy evolution in the first aspect of the present disclosure is implemented.

[0046] In summary, the present invention is directed to the complex, dynamic, and time-varying electromagnetic environment of the space-ground measurement and control link, as well as the changing measurement and control link support requirements under different application scenarios, to improve the application efficiency of the space-ground adaptive measurement and control link under the changing electromagnetic environment and application scenario requirements. A method is proposed to define "policy" as the core element that determines the compliance degree of the adaptive result of the measurement and control link with the external electromagnetic environment, task requirements, etc. on the measurement and control link that realizes adaptation based on feedback state transmission, construct an evolvable decision-making machine based on state mapping, utilize the evolution of the policy, and realize the optimization of the adaptive efficiency of the measurement and control link through the "double-loop" adaptive structure model of the link driven by "policy". The present invention is applied to the space-ground adaptive measurement and control link. Each component can be independently optimized and expanded without affecting the overall adaptive process disposal structure; when the space-ground equipment and application scenarios are fixed, it has the ability to further optimize the adaptive efficiency by improving and optimizing the policy set; the switching action of the standardized single serial process is very convenient for the specific implementation of the equipment. This method can well respond to the application requirements of future complex, time-varying, and adversarial space-ground measurement and control link working scenarios, and effectively improve the adaptive efficiency of the link. Description of the Drawings

[0047] In order to more clearly illustrate the specific embodiments of the present invention or the technical solutions in the prior art, the following will briefly introduce the drawings required for the description of the specific embodiments or the prior art. Obviously, the following drawings are some embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0048] Figure 1 Schematic diagram of a dual-loop adaptive process according to an embodiment of the present invention.

[0049] Figure 2 Schematic diagram of an evolvable decision-making machine structure based on state mapping according to an embodiment of the present invention. Detailed implementation manners

[0050] To make the objectives, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part rather than all of the embodiments of the present invention. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts shall fall within the protection scope of the present invention.

[0051] The present invention is based on a satellite TT&C link with state feedback and various link state performances, mainly including three stages of design, forming a link adaptive ability that can be flexibly upgraded and expanded and has better efficiency in different scenarios.

[0052] I. Construct a structured model of the satellite-ground TT&C link adaptive process.

[0053] In the traditional approach to the adaptability of the TT&C link, the inflexible solidification of performance and processes is mainly due to the mutual intersection of state judgment and process execution, as well as the rule preset based on engineering experience. Therefore, the present invention proposes a new "dual-loop" adaptive structured model for the TT&C link that decouples state judgment from link state adjustment and combines preset rules with post-execution effects. This model consists of four parts: state acquisition, comprehensive judgment, state adjustment, and efficiency evaluation, as Figure 1 shown.

[0054] a) State acquisition

[0055] Collection and aggregation of state information related to the adaptability of the link state and the external working environment. Classified by function type, it mainly includes the following four categories:

[0056] Spectrum sensing information category: receiving in-band monitoring spectrum status, interference detection and processing status, interference parameter status, etc.

[0057] Link working state category: receiving state, transmitting state, current link working parameters, system basic performance, link device health status, etc.

[0058] Task requirement information category: task plan, task execution progress, execution result expectation, etc.

[0059] Scene-related information categories: uplink and downlink connection establishment plans, inbound and outbound status, other external support information, etc.

[0060] Among them, the link working status categories and scene-related information categories mainly characterize the adaptation of the current link working status to the current scene external environment, and the interference perception information categories, link working status, and task requirement information categories mainly determine the optimal link status required for the current and subsequent periods of the scene external environment.

[0061] b) Comprehensive decision-making

[0062] Based on all the status, requirements and other information obtained from the status acquisition, different associated information parameters are screened, and comprehensive decision-making is carried out on the following two aspects:

[0063] Whether the link status needs to be adjusted: that is, to judge whether the current link working status is adapted to the current scene external environment; whether it is necessary to adjust the link status to obtain the expected normal status of the link.

[0064] The target status of the link status adjustment: that is, to judge which status should be selected from the set of statuses supported by the link to achieve the optimal match with the external environment requirements of the current scene.

[0065] c) Status adjustment

[0066] When the decision result of "whether the link status needs to be adjusted" output by the comprehensive decision-making is "yes", according to the "target status of the link status adjustment" output by the comprehensive decision-making, following the specified execution process, switch from the current link working status to the target working status, and re-establish the space-ground TT&C link. No status judgment actions are taken during the execution process of the status adjustment.

[0067] d) Performance evaluation

[0068] Quantitative processing and calculation are carried out on the characteristics that can characterize the link self-adaptive performance, such as the adaptation degree between the link status and the scene external environment before and after the status adjustment, the TT&C performance supported by the link, and the success rate of the adjustment process. The self-adaptive performance of the link is evaluated for its quality through the quantitative value, which supports the improvement and upgrade of the core element determining the self-adaptive performance - the comprehensive decision-making based on the status acquisition parameters.

[0069] The four parts of status acquisition, comprehensive decision-making, status adjustment, and performance evaluation are in a sequential order in the process and actually form two process loops. Among them, status acquisition, comprehensive decision-making, and status adjustment are the online execution process loop, and status acquisition, comprehensive decision-making, and performance evaluation are the offline improvement process loop.

[0070] II. Evolvable decision-making machine based on state mapping

[0071] The loop improvement process consisting of state acquisition, comprehensive decision-making, and effectiveness evaluation is the core process for achieving the dynamic evolution of the measurement and control link adaptively according to scenario requirements. Its mechanism is to construct an evolvable decision-making machine based on state mapping. The effectiveness evaluation drives the mapping function of the improvement decision-making machine and even adjusts the input state parameters, so as to obtain better adaptive effectiveness in a specific scenario.

[0072] The evolvable decision-making machine based on state mapping includes four parts, as shown in the appendix Figure 2 。

[0073] a) Input parameter set

[0074] A set of parameters extracted from state acquisition that can be used for decision-making processing. This parameter set generally does not exceed the parameters of state acquisition; when the parameters in state acquisition change, the input parameter set also changes accordingly; the input parameter set generally corresponds to the application scenario and task objectives.

[0075] b) Output parameter set

[0076] A set of parameters that can be directly used for state adjustment output by the decision-making machine, including only whether to adjust the parameters (Boolean variable) and the target link state parameters. The target link state parameters are selected from the set of link states supported by the ground and space equipment of the current working measurement and control link.

[0077] c) Policy set

[0078] A set indicating the mapping relationship between the input parameter set and the output parameter set, that is, the mapping function set. The policy set contains one or more policies. A policy contains a set of mapping functions, and the mapping functions of different policies are different. Generally, different policies correspond to different application scenarios and task objectives.

[0079] d) Decision-making unit

[0080] According to the parameters in the input parameter set, select the corresponding policy from the policy set according to the application scenario, retrieve the appropriate mapping function, and calculate the output parameter set.

[0081] The policy, that is, the mapping function group, determines the state of the output parameter set under the same input parameter set, which also determines the final adaptive effectiveness. The evaluation parameters obtained through effectiveness evaluation can be used to improve the mapping function group using reinforcement learning methods or supervised learning methods based on engineering experience reasoning, obtain better policies, and thus obtain better adaptive effectiveness.

[0082] The set of input parameters is also the main factor affecting the state of the set of output parameters. Expanding or adjusting the parameters can also improve the adaptive efficiency. The set of input parameters is closely related to the state of the space-ground link equipment and the application scenario. Once the state of the space-ground equipment and the application scenario is determined, the set of input parameters is also determined. At this time, the efficiency improvement is mainly achieved through improving the strategy.

[0083] III. Standard Action Control in the State Adjustment Process

[0084] According to the set of output parameters of the decision-making machine, the state adjustment can be implemented. The following implementation method is adopted in this method:

[0085] a) Establish a set of standard state transition actions. Establish and specify a set of standard state transition actions that traverse all possible states.

[0086] b) Establish a mapping between states and actions. Establish a unique mapping between the current link state and the target link state in each specific scenario and the actions in the set of standard state transition actions.

[0087] b) Switching action. According to the set of output parameters of the comprehensive decision-making, combined with the current other working states, map and extract the standard state transition actions and execute them.

[0088] It should be noted that for the space-ground collaborative control link adjustment of the adaptive link with feedback, the state adjustment process can be divided into a state synchronization process and a switching action process. The actions in the state synchronization process are related to the main control state of the satellite and the current link communication state, and the switching action process is related to the current link state and the target link state. The entire set of standard state transition actions is a multiple matrix that traverses four-dimensional parameters, and the number of actions is the simple product of the number of parameters. For example, the link supports a total of 6 switchable states, 2 main control states of the satellite (satellite main control or ground main control), and 4 link communication states (both up and down are connected, both up and down are disconnected, up is connected and down is disconnected, up is disconnected and down is connected). The total number of standard state transition actions is 240 (excluding the state transitions with unchanged link states).

[0089] Adopting the method of standard action control, the difference in the entire state adjustment process only depends on the set of output parameters and the established current working state. All the execution actions are preset, and there is no state judgment and uncertainty during the action process, completely decoupling the judgment process and the execution process.

[0090] In order to achieve the evolvability and easy expansion of the adaptive efficiency of the measurement and control link to adapt to the changing and complex scenario application environment, this method proposes to completely decouple the three necessary actions of state acquisition, handover decision-making, and adjustment actions in an adaptive manner, converge all the parameters related to adaptation to state acquisition, solidify the adjustment actions into a single serial process and standardize them, and connect the input state and adjustment actions through the handover decision-making driven by the policy set. Each part of this method can be optimized and expanded independently without affecting the structure of the adaptive process handling; in the case of fixed space-ground equipment and application scenarios, the adaptive efficiency can be further optimized by improving and optimizing the policy set; the standardized single serial process handover actions are also convenient for the specific implementation of the equipment. This method can well respond to the application requirements of future complex, time-varying, and adversarial space-ground measurement and control link working scenarios, and effectively improve the efficiency of link adaptation.

[0091] IV. Specific Examples

[0092] Take a measurement and control link for a low-Earth orbit satellite with six switchable states in the face of a sudden malicious interference scenario as an example.

[0093] The First Stage: State Acquisition

[0094] 1. State Collection

[0095] This method requires the satellite part and the ground equipment part to collect relevant states respectively. The parameter categories for state acquisition in the satellite part and the ground equipment part are the same. Due to their different environments, processing capabilities, and link support roles, the specific state acquisition parameters are different. The detailed parameters of various categories for state acquisition in the satellite part and the ground equipment part are shown in Table 1.

[0096] Table 1 State Acquisition Parameters of the Satellite Part and the Ground Equipment Part

[0097]

[0098]

[0099] Generally, the state acquisition parameters of the ground equipment part are more than those of the satellite part because the ground equipment has more computing power and needs to consider the comprehensiveness of the satellite part's state in the setting.

[0100] It should be emphasized that the spectrum sensing information and link working state information collected should have certain time characteristics, that is, they should include continuously updated real-time state information and historical state information over a certain period of time.

[0101] 2. Preprocessing of Parameters

[0102] The parameters in Table 1 can be classified into directly used parameters and parameters that need to be processed before use. Directly used parameters are those that can be directly involved in subsequent comprehensive judgment after being originally obtained, such as received signal power, presence or absence of abnormal interference signals, reception lock status, link information rate, inbound / outbound status, etc. Parameters that need to be processed before use are those that require reprocessing of the original data to participate in subsequent work, such as received in-band spectrum, satellite mission plan, link work plan, etc.

[0103] The preprocessing of parameters is to preprocess the parameters that need to be processed before use to form parameters that can directly participate in subsequent judgment calculations, and together with the directly used parameters, they form the total set of input parameters.

[0104] The parameters that need to be processed before use and the target parameters after processing are as follows:

[0105] Satellite / ground received in-band spectrum → presence or absence of interference signals, interference signal frequency band, intensity, pattern, residence duration, and period

[0106] Satellite mission plan → start and end times of remote control

[0107] On-board high-bitrate transmission requirement → amount of high-speed telemetry data to be sent, and start and end times of TT&C mission plan → start and end times of remote control

[0108] Upward remote control data transmission requirement → amount of remote control data to be sent, and start and end times of link work plan → start and end times of equipment tracking

[0109] Device preset working mode → initialized basic link parameters

[0110] External electromagnetic environment monitoring information → frequency band, intensity, residence duration, and period of external environmental interference signals

[0111] 3. Parameter classification

[0112] After completing the preprocessing of parameters, it is necessary to classify and process the various collected parameters to facilitate different calculations with the parameters as input according to categories and support subsequent judgment calculations.

[0113] The parameters can be divided into the following four types:

[0114] Boolean parameters: including presence or absence of abnormal interference signals, satellite / ground reception lock status, device health status, satellite launch status.

[0115] Real number parameters: including satellite / ground received signal power, upward / downward interference signal intensity, residence duration, and period, upward / downward received interference-to-signal ratio, satellite / ground reception system performance parameters, satellite launch power, amount of remote control / high-speed telemetry data to be sent.

[0116] Integer parameters: Use integers to represent certain fixed states or parameters, including: uplink / downlink interference signal patterns, basic parameters such as uplink / downlink working regime / frequency / bandwidth / information rate, and initialized basic link parameters.

[0117] Interval parameters: An array identified by including one or more data intervals, including: uplink / downlink interference signal frequency bands, start and end times of remote control, start and end times of device tracking, start and end times of high-speed telemetry to be sent, start and end times of remote control to be sent.

[0118] It should be noted that if more state parameters need to be extended and added, according to the above steps, collect the parameters, perform preprocessing and classification of the parameters, and then the state parameters can participate in the subsequent decision calculations.

[0119] The second stage: Comprehensive decision

[0120] 1. Determine the output parameters

[0121] Based on all the information such as states and requirements obtained from the states, screen different associated information parameters, and conduct comprehensive decisions on the following two aspects:

[0122] Whether the link state needs to be adjusted: That is, judge whether the current link working state is suitable for the current scenario's external environment and whether it is necessary to adjust the link state to obtain the expected normal state of the link.

[0123] The target state of link state adjustment: That is, judge which state should be selected from the set of states supported by the link to achieve the optimal match with the external environment requirements of the current scenario.

[0124] Therefore, the output parameters include two categories in total:

[0125] The first category is boolean parameters: That is, whether the link state needs to be adjusted currently

[0126] The second category is integer parameters: That is, the basic target link states, including uplink / downlink working regime / frequency / bandwidth / information rate, etc.

[0127] 2. Determine the weighting function

[0128] According to the types of different input parameters, different weighting functions are used for weight calculation. Specifically:

[0129] Boolean weighting function: B(I, b) = I b , where I is the weight value and b is the input boolean parameter value.

[0130] Real number weighting function: R(I, r) = I × r, where I is the weight value and r is the input real number parameter value.

[0131] Integer weighting function: I(I, i) = I × i, where I is the weight value and i is the input integer parameter value.

[0132] Interval weighting function: RAN(I, ran) = I com(ran,con) , where I is the weight value and ran is the input interval parameter value. com(ran, con) is a comparison function with a boolean variable output (i.e., 0 or 1), and con is a given constant value or interval. That is, when con overlaps with any interval in ran, com() outputs 1; otherwise, it outputs 0. In this method, con has two values, one is a given frequency band (the working frequency band of the current link), and the other is a time value (the time when the decision occurs).

[0133] 3. Calculate the mapping function

[0134] The mapping relationship between the input parameter set and the output parameter set, that is, the mapping function. Once the mapping function is determined, different output parameters can be obtained through different input parameters, that is, it is determined whether the link state needs to be adjusted and the target state of the link state adjustment.

[0135] Generally, 2 mapping functions form a group, which are respectively:

[0136] Mapping function for whether to switch:

[0137] where j, k, l are all natural numbers, and n, m, o are the numbers of boolean, real, and integer input parameters involved in whether to switch respectively. B(I j , b j ) old is the weighting function of the historical boolean parameter involved in the calculation (the same for others).

[0138] Target state mapping function:

[0139] where j, k, l, m are all natural numbers, and n, m, o, p are the numbers of boolean, real, integer, and interval input parameters involved in whether to switch respectively.

[0140] 4. Select a strategy based on the task scenario

[0141] A strategy contains a group of mapping functions, and the mapping functions of different strategies are different. According to different application scenarios and task objectives, different strategies, that is, mapping functions, are selected.

[0142] The differences in the mapping functions are mainly reflected in the selection of the input parameter set and the weighting value.

[0143] Taking the scenario where the TT&C link of a low-earth orbit satellite is suddenly and maliciously interfered as an example, two types of mission objectives are set, namely, better transmission performance of the TT&C link (usually) and better robustness performance of the TT&C link (in case of emergency). Thus, a policy set consisting of two policies is set, namely, Policy 1: Normal Policy and Policy 2: Emergency Policy.

[0144] Policy 1 requires better transmission performance and pays more attention to the accurate determination of interference situations, the accurate estimation of the transceiver performance of the system, and the maximized response to the requirements of the mission plan. Therefore, various parameters of the interference signal, link performance, mission requirements and plans, etc. should be extracted with emphasis, and the weight of parameter participation in the decision should be increased.

[0145] Policy 2 requires better robustness performance and pays more attention to whether the current link is stable and whether the selected target state can ensure stability. Therefore, the interference intensity parameter, the link working state parameter, and the relevant historical states should be extracted with emphasis, and the weight of parameter participation in the decision should be increased.

[0146] Based on the above scenario, according to the expert engineering knowledge and experience, the initial assignment calculation of the mapping function between the input parameter set and the output parameter can be completed; then, the evaluation parameters obtained through the effectiveness evaluation can be used to improve the mapping function group using the reinforcement learning method or the supervised learning method based on engineering experience reasoning, so as to obtain a better policy and thus a better adaptive effectiveness.

[0147] 5. Space-ground collaborative decision-making

[0148] Due to the asymmetry of space-ground state acquisition, there must be certain differences between the space-ground policies, that is, the mapping functions. In order to achieve space-ground collaborative link establishment, it is necessary to ensure the consistency of the output parameters executed by the space and the ground. Therefore, the space-ground collaborative decision-making follows the following principles:

[0149] The satellite and the ground make decisions independently and synchronously according to their own policies;

[0150] When the uplink is disturbed, the satellite's decision output is the main one, and the ground accepts the control and executes synchronously; when the downlink is disturbed, the ground's decision output is the main one, and the satellite accepts the control and executes synchronously; the default state is that the satellite's comprehensive decision output is the main one;

[0151] The ground can configure and change the default state with the satellite's decision as the main one;

[0152] The ground synchronously loads the satellite's policy for use in special cases.

[0153] The satellite and the ground start the decision-making in two ways: periodic triggering and event triggering. Due to the large differences in the update rates among different parameters for state acquisition, regardless of whether it is periodic triggering or event triggering, the selected input parameters use the most recently updated state. When starting the decision-making, the satellite and the ground calculate the output parameter set according to the policy, where:

[0154] According to the calculated value of MAP(b j ,r k ,i l ), adj judge whether to switch.

[0155] According to the calculated value of MAP(b j ,r k ,i l ,ran m ), tag judge the target state of the switch. Among them, the target state is only all the states supported by the system.

[0156] The third stage: state adjustment

[0157] For this TT&C link, the link supports a total of 6 switchable states (3 modulation states, namely BPSK, DSSS-BPSK, DSSS-FH-BPSK, and 2 information rates for each state), a total of 2 satellite / ground master control states (satellite master control or ground master control), and 4 link communication states (both up and down links are connected, both up and down links are disconnected, up link is connected and down link is disconnected, up link is disconnected and down link is connected). The total number of standard state transition actions is 6 * 5 * 2 * 4 = 240 (6 states switch with each other, a total of 30).

[0158] The 2 satellite / ground master control states and the 4 link communication states determine the execution of the satellite-ground state synchronization process. There are the following execution cases:

[0159] a) Both the up and down links are connected:

[0160] According to the satellite / ground master control situation, the satellite / ground respectively sends the output parameter set to the ground / satellite through the down / up link to achieve state synchronization;

[0161] b) The up link is connected and the down link is disconnected:

[0162] When the satellite is in master control, the ground first configures to prohibit the satellite from being in master control, thus changing to ground master control, and then the ground sends the output parameter set to the satellite through the up link to achieve state synchronization; when the ground is in master control, directly implement state synchronization;

[0163] c) The up link is disconnected and the down link is connected:

[0164] When the satellite is in the master control mode, the satellite sends the output parameter set to the ground through the downlink to achieve status synchronization; when the ground is in the master control mode, the ground strategy supports judging and making decisions on the satellite's reception of the uplink situation. At this time, it normally receives the output parameters sent by the satellite and performs status synchronization.

[0165] d) Both the uplink and downlink are disconnected:

[0166] The satellite and the ground cannot perform status synchronization through the uplink and downlink. At this time, after the satellite and the ground wait for a specified period of time during the disconnection, they execute the same strategy according to the most recent satellite status parameters (the ground is loaded with the satellite strategy set) to enter the same target state and establish the uplink; then, the complete adaptive process is executed again.

[0167] The link supports 6 states, including various situations with different information rates under various link systems. It is divided into the following two execution situations:

[0168] a) Transfer between the same system with different information rates

[0169] Under the same system, the uplink and downlink can work independently of each other. At this time, both the satellite and the ground compare the current link state with the target link state. When the link state parameters in a certain direction are different, only the link state in that direction is switched and a new link is established, while the link in the other direction remains unchanged.

[0170] b) Transfer between different systems

[0171] For the switch between different systems, the uplink and downlink must be switched synchronously. At this time, once both the satellite and the ground obtain that the target link state is different from the current link state in terms of the system, the uplink and downlink synchronously switch states and establish a new link.

[0172] It should be noted that all switching actions need to be executed immediately, and a switching execution threshold is set (based on "new link establishment time + status synchronization time + margin"). If the threshold is exceeded, subsequent handling is carried out according to the occurrence of an anomaly. At the same time, during the state switching action, no new output parameter set is executed to ensure the integrity of the process without being interrupted abnormally.

[0173] The fourth stage: Performance evaluation

[0174] The performance evaluation is implemented offline. The ground part collects and collates data such as the status data of the satellite and the ground before and after adaptive link establishment, the link establishment process data, the TT&C performance data after link switching, the link establishment success rate and timeliness, etc., to quantitatively evaluate the link adaptive performance.

[0175] Under different scenarios, the quantization evaluation parameters are used to adjust the weighting values within different mapping functions to support the improvement of strategies for different application objectives. For example, if the measurement and control performance data after switching is more important for the improvement of Strategy 1 (normal strategy), the mapping function should be adjusted so that this data can be improved after the strategy improvement. Similarly, the link establishment success rate is more important for the improvement of Strategy 2 (emergency strategy), and it can be adjusted accordingly.

[0176] In summary, the present invention constructs a structured model for the adaptive process of the space-ground measurement and control link, forming a "double loop" of the execution process loop and the performance improvement process loop, decoupling the state judgment and the link state adjustment, and combining the preset rules with the execution aftereffect, which can effectively solve the problem of the mutual intersection of the state judgment and the process execution process in the traditional adaptive implementation process, and the inflexible solidification of performance and process.

[0177] The present invention proposes an evolvable decision-making machine based on state mapping, which can be driven by the effectiveness evaluation to improve the mapping function of the decision-making machine and even adjust the input state parameters, realizing the evolvability and scalability of the adaptive effectiveness, and obtaining better adaptive effectiveness in specific scenarios.

[0178] The present invention proposes a standard action control for the state adjustment process, which matches the switching action executed according to the judgment output parameters, and the device implementation is simple and convenient.

[0179] The present invention proposes to completely decouple the three necessary actions of state acquisition, switching decision-making, and adjustment action adaptively, completely converge the relevant parameters of adaptation to state acquisition, solidify the adjustment action into a single serial process and standardize it, and realize the connection between the input state and the adjustment action through the switching decision-making driven by the strategy set. The present invention has the ability to independently optimize and expand each component without affecting the structure of the adaptive process; under the condition of solidifying the space-ground equipment and application scenarios, it has the ability to further optimize the adaptive effectiveness by improving and optimizing the strategy set; the switching action of the standardized single serial process is very convenient for the specific implementation of the device. This method can well respond to the application requirements of future complex, time-varying, and adversarial space-ground measurement and control link working scenarios, and effectively improve the effectiveness of link adaptation.

[0180] Please note that the technical features of the above embodiments can be combined arbitrarily. For the sake of concise description, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, it should be considered as within the scope described in this specification. The above embodiments only express several implementation manners of the present application, and the description is relatively specific and detailed, but it should not be construed as a limitation on the scope of the invention patent. It should be noted that for those of ordinary skill in the art, without departing from the concept of the present application, several modifications and improvements can still be made, and these all belong to the protection scope of the present application. Therefore, the protection scope of the patent of the present application shall be subject to the appended claims.

Claims

1. A measurement and control link adaptation method based on strategy evolution, characterized in that: The method comprises: Step S1, status acquisition; Collect status information related to link status and adaptability to external working environment, including spectrum sensing information, task requirement information, and scene association information; Step S2, comprehensive judgment; Based on the collected state information, different associated information parameters are screened to perform two decisions: whether to adjust the link state and the target state of the link state adjustment; Step S3: state adjustment; According to the target state of the link state adjustment, switching from the current link working state to the target working state, and re-establishing the satellite-to-ground measurement and control link; Step S4, performance evaluation; The adaptability between the link state before and after the state adjustment and the external environment of the scene, the measurement and control performance supported by the link, and the success rate of the adjustment process are used as features to characterize the link adaptation effectiveness, and quantitative processing is performed to evaluate the link adaptation effectiveness through quantitative values. Among them, state acquisition, comprehensive judgment, and state adjustment are an online execution process cycle, and state acquisition, comprehensive judgment, and performance evaluation are an offline improvement process cycle.

2. The method for adaptive measurement and control link based on strategy evolution according to claim 1, characterized in that: In step S1, the state information is used to characterize the adaptability of the current link working state to the current scene external environment, and to determine the optimal link state required by the scene external environment in the current and subsequent period of time; wherein: Spectrum sensing information includes: receiving in-band monitoring spectrum status, interference detection processing status, and interference parameter status; Spectrum sensing information includes: receiving status, transmitting status, current link operating parameters, basic system performance, and link equipment health status; Task requirement information includes: task plan, task execution progress, and expected execution results; Scenario-related information includes: uplink and downlink link establishment plans, inbound and outbound status, and other external support information.

3. The measurement and control link adaptation method based on strategy evolution according to claim 2 is characterized in that: In step S2: Determining whether to adjust the link state refers to: determining whether the current link working state is compatible with the current external environment; whether the link state must be adjusted to obtain the expected normal state of the link; Determining the target state of the link state adjustment refers to determining which state to select as the target state in the state set supported by the link to achieve the best match with the external environment requirements of the current scene.

4. The method for adaptive measurement and control link based on strategy evolution according to claim 1, characterized in that: In the method, the offline improvement process cycle consisting of state acquisition, comprehensive judgment, and performance evaluation is used to realize the dynamic evolution of the measurement and control link adaptation according to the scenario requirements. By constructing an evolvable decision machine based on state mapping, the mapping function of the decision machine is improved by performance evaluation, and the input state parameters are adjusted to obtain better adaptive performance in specific scenarios.

5. The measurement and control link adaptation method based on strategy evolution according to claim 4 is characterized in that: The evolvable decision machine based on state mapping includes: an input parameter set, an output parameter set, a strategy set, and a decision unit; wherein: The input parameter set refers to a parameter set used for comprehensive judgment from the state information. When the parameters in the state information change, the parameters in the input parameter set also change accordingly. The output parameter set refers to the parameter set output by the decision machine for state adjustment, which only includes parameters that characterize whether to make adjustments and target link state parameters. The target link state parameters are selected from the link state set supported by the satellite and ground devices of the current measurement and control link. A strategy set refers to a set that indicates the mapping relationship between an input parameter set and an output parameter set, that is, a mapping function set. A strategy set contains one or more strategies. A strategy contains a set of mapping functions. Different strategies have different mapping functions. Different strategies correspond to different application scenarios and task objectives. The decision unit selects a corresponding strategy from the strategy set based on the application scenario according to the parameters in the input parameter set, calls the matching mapping function, and calculates the output parameter set.

6. The measurement and control link adaptation method based on strategy evolution according to claim 5 is characterized in that: In the method, state adjustment is performed according to the output parameter set of the decision machine, specifically including: Establish a standard state transition action set: Establish and define a standard state transition action set that traverses all possible states. Establish state and action mapping: Establish a unique mapping between the current link state and target link state in each specific scenario and the actions in the standard state transition action set. Switching action: Based on the output parameter set of the comprehensive decision and combined with other current working states, the standard state transition action is mapped and extracted and executed.

7. The measurement and control link adaptation method based on strategy evolution according to claim 6 is characterized in that: In the method, the state adjustment is divided into a state synchronization process and a switching action process. The action of the state synchronization process is related to the satellite-ground master control state and the current link communication state. The switching action process is related to the current link state and the target link state. The standard state transition action set is a multiple matrix traversing four-dimensional parameters, and the number of actions is the product of the number of parameters.

8. A measurement and control link adaptive system based on strategy evolution, characterized in that: The system comprises: The status acquisition module is configured as follows: Collect status information related to link status and adaptability to external working environment, including spectrum sensing information, task requirement information, and scene association information; The comprehensive decision module is configured as follows: Based on the collected state information, different associated information parameters are screened to perform two decisions: whether to adjust the link state and the target state of the link state adjustment; The state adjustment module is configured as follows: According to the target state of the link state adjustment, switching from the current link working state to the target working state, and re-establishing the satellite-to-ground measurement and control link; The performance evaluation module is configured as follows: The adaptability between the link state before and after the state adjustment and the external environment of the scene, the measurement and control performance supported by the link, and the success rate of the adjustment process are used as features to characterize the link adaptation effectiveness, and quantitative processing is performed to evaluate the link adaptation effectiveness through quantitative values. Among them, state acquisition, comprehensive judgment, and state adjustment are an online execution process cycle, and state acquisition, comprehensive judgment, and performance evaluation are an offline improvement process cycle.

9. An electronic device, characterized in that: The electronic device includes a memory and a processor, the memory stores a computer program, and when the processor executes the computer program, a measurement and control link adaptation method based on strategy evolution as described in any one of claims 1-7 is implemented.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by the processor, the measurement and control link adaptation method based on strategy evolution described in any one of claims 1 to 7 is implemented.

Images