A satellite network controller deployment method and system based on satellite communication

Abstract

The present invention relates to the field of intelligent decision-making technology, and discloses a satellite network controller deployment method based on satellite communication, including: generating an initial layout of a satellite network controller, calculating the layout coverage of the initial layout, and calculating the coverage balance of the initial layout; selecting a layout to be optimized from a standard layout, calculating the transmission delay of the layout to be optimized, calculating the controller load of the layout to be optimized using traffic data, and analyzing the packet loss of the layout to be optimized; constructing a state space of a satellite network controller, normalizing the standard layout, and constructing an action space of a satellite network controller using the normalized layout; analyzing the state transfer reward of the satellite network controller, determining the initial state of the satellite network controller using the state transfer reward, obtaining a target layout corresponding to the initial state from the normalized layout, and determining the final layout of the satellite network controller from the target layout. The present invention can realize the dynamic deployment of a satellite network controller.

Description

Technical Field

[0001] The invention relates to a satellite network controller deployment method and system based on satellite communication, belonging to the technical field of intelligent decision making. Background Art

[0002] With the advancement of globalization, people's demand for communication is no longer limited to areas covered by ground networks. Satellite communications can achieve global coverage and provide reliable communication services for remote areas, oceans, aviation and other fields. Secondly, with the development of technologies such as big data, cloud computing, and the Internet of Things, people's demand for communication capacity continues to increase. Satellite communications have the characteristics of high bandwidth and large capacity, and can meet the growing communication needs. In natural disasters, emergencies and other situations, ground communication networks may be destroyed, and satellite communications have the advantage of not being affected by ground disasters. They can quickly establish emergency communication networks to ensure the smooth progress of rescue work. Therefore, satellite network controllers were born. Satellite network controllers can manage satellite communications. However, when satellite network controllers are managed, the satellite network controllers' own receiving and sending capabilities also affect satellite communications, such as the delay in sending and receiving data, the ability to handle loads, and the ability to handle packet loss.

[0003] At present, there are many solutions for satellite network controllers, most of which pre-calculate the receiving and transmitting capabilities of satellite network controllers at different deployment locations, so as to select the best performing location to deploy the satellite network controller. However, when it is necessary to move the coordinates of the controller that has been deployed, for example, from coordinate A to coordinate B, coordinate B is a coordinate with good performance, but in the process of moving from coordinate A to coordinate B, coordinate B may not be the coordinate with the best performance. Therefore, the performance of coordinate C and coordinate D experienced in the process of moving from coordinate A to coordinate B is not necessarily better than coordinate B, but the performance of coordinate C and coordinate D is superimposed on coordinate B. Therefore, moving coordinate A to coordinate C and then from coordinate C to coordinate D has achieved the best performance deployment. Therefore, a solution is urgently needed to realize the dynamic deployment of satellite network controllers. Summary of the invention

[0004] The present invention provides a satellite network controller deployment method and system based on satellite communication, the main purpose of which is to realize the dynamic deployment of the satellite network controller.

[0005] To achieve the above object, the present invention provides a satellite network controller deployment method based on satellite communication, comprising:

[0006] Generate an initial layout of a satellite network controller, calculate a layout coverage rate of the initial layout, and calculate a coverage balance degree of the initial layout, and select a standard layout of the satellite network controller from the initial layout according to the layout coverage rate and the coverage balance degree;

[0007] Selecting a layout to be optimized from the standard layouts, collecting path data, flow data, and packet loss data under the layout to be optimized, calculating the transmission delay of the layout to be optimized using the path data, calculating the controller load of the layout to be optimized using the flow data, and analyzing the packet loss situation of the layout to be optimized based on the flow data and the packet loss data;

[0008] The state space of the satellite network controller is constructed by using the layout to be optimized, the transmission delay, the controller load and the packet loss situation, the standard layout is normalized to obtain a normalized layout, and the action space of the satellite network controller is constructed by using the normalized layout;

[0009] Analyzing a state transition reward of the satellite network controller according to the state space and the action space, determining an initial state of the satellite network controller using the state transition reward, acquiring a target layout corresponding to the initial state from the normalized layout, and determining a final layout of the satellite network controller from the target layout;

[0010] The final layout is used to perform controller deployment on the satellite network controller to obtain a controller deployment result of the satellite network controller.

[0011] Optionally, calculating the layout coverage of the initial layout includes:

[0012] extracting a satellite network controller in the initial layout;

[0013] Acquire a network switch that communicates with the satellite network controller;

[0014] Querying the coverage of the satellite network controller;

[0015] According to the initial layout, identifying whether the network switch exists within the coverage area;

[0016] When the network switch exists within the coverage range, determining a covered switch among the network switches;

[0017] Selecting an uncovered switch among the network switches by using the covered switch;

[0018] According to the covered switches and the uncovered switches, the layout coverage of the initial layout is calculated using the following formula:

[0019] ;

[0020] in, represents the layout coverage, Indicates the number of covered switches. Indicates the number of uncovered switches.

[0021] Optionally, the calculating the coverage balance of the initial layout includes:

[0022] Acquire the covered switches of each satellite network controller in the initial layout to obtain the target switch;

[0023] According to the target switch, the coverage balance of the initial layout is calculated using the following formula:

[0024] ;

[0025] ;

[0026] ;

[0027] in, Indicates coverage balance. Indicates The number of target switches for each satellite network controller, express indivual The maximum value in Express The result after minimization is: Indicates the number of satellite network controllers, express The mean of express .

[0028] Optionally, analyzing the packet loss situation of the layout to be optimized based on the traffic data and the packet loss data includes:

[0029] Based on the traffic data and the packet loss data, the packet loss ratio of the layout to be optimized is calculated using the following formula:

[0030] ;

[0031] in, Indicates the packet loss ratio, Indicates the first A satellite network controller and The data transmission rate between the covered switches is Indicates the flow data The covered switch sends the The traffic of satellite network controllers, represents the number of satellite network controllers in the layout to be optimized, Indicates the number of lost packets The covered switch sends the Packet loss traffic of satellite network controllers, Indicates that the layout to be optimized belongs to The number of covered switches within the coverage area of ​​each satellite network controller;

[0032] The packet loss ratio is used as the packet loss situation of the layout to be optimized.

[0033] Optionally, constructing the state space of the satellite network controller by using the layout to be optimized, the transmission delay, the controller load and the packet loss situation includes:

[0034] Obtaining a standard layout corresponding to the layout to be optimized;

[0035] Querying the remaining layouts in the standard layout except the layout to be optimized;

[0036] The layout to be optimized, the transmission delay, the controller load and the packet loss situation are used as the state to be optimized of the satellite network controller;

[0037] Respectively obtain a transmission delay range, a controller load range, and a packet loss range corresponding to the transmission delay, the controller load, and the packet loss situation;

[0038] Generate the transmission delay, controller load and packet loss situation corresponding to the remaining layout within the transmission delay range, the controller load range and the packet loss situation range respectively;

[0039] The remaining layout and the transmission delay, controller load and packet loss corresponding to the remaining layout are used as the remaining state of the satellite network controller;

[0040] The state to be optimized and the remaining state are used to generate the state space of the satellite network controller.

[0041] Optionally, the step of normalizing the standard layout to obtain a normalized layout includes:

[0042] Obtaining the layout to be optimized and the remaining layouts in the standard layout;

[0043] Arranging the remaining layouts based on the distance between the remaining layouts and the layout to be optimized to obtain a first layout sequence;

[0044] Arranging the layout to be optimized and the first layout sequence to obtain a second layout sequence;

[0045] The sequence interval of the second layout sequence is calculated using the following formula:

[0046] ;

[0047] in, represents the sequence interval, Indicates the starting number of the second layout sequence. Indicates the end number of the second layout sequence. represents the number of intervals in the sequence, Indicated in and under the control of The maximum value of

[0048] According to the sequence interval, the normalized layout of the layout to be optimized is selected from the second layout sequence.

[0049] Optionally, the step of constructing the action space of the satellite network controller by using the standardized layout includes:

[0050] Obtaining controller coordinates of each satellite network controller in the normalized layout;

[0051] Calculating the shortest coordinate distance between the controller coordinates of every two normalized layouts in the normalized layout;

[0052] Deduplication processing is performed on the shortest coordinate distance to obtain a deduplication coordinate distance;

[0053] The action space of the satellite network controller is generated using the deduplicated coordinate distance.

[0054] Optionally, analyzing the state transition reward of the satellite network controller according to the state space and the action space includes:

[0055] According to the state space and the action space, the state transition model corresponding to the satellite network controller is constructed using the following formula:

[0056] ;

[0057] in, , represents the state transition model, Representing the state space The state in Representing the action space Actions in

[0058] According to the state transition model, the state value model corresponding to the satellite network controller is constructed using the following formula:

[0059] ;

[0060] in, represents the state value model, represents the state transition model, Represents the reward value, represents the discount factor, Indicates status Execute an action After reaching the state The state transition probability, express The corresponding state value model;

[0061] The action value model corresponding to the satellite network controller is constructed using the following formula:

[0062] ;

[0063] in, represents the action-value model, Represents the reward value, represents the discount factor, Indicates status Execute an action After reaching the state The state transition probability, Indicates arrival status Then perform the action The probability of express The corresponding action-value model;

[0064] When both the state value model and the action value model are maximum values, the state transfer rewards corresponding to the state value model and the action value model are obtained.

[0065] Optionally, determining the final layout of the satellite network controller from the target layout includes:

[0066] Constructing an action set and a state set of the target layout;

[0067] Calculating a state value function value of the target layout according to the state set;

[0068] Calculating the action value function value of the target layout according to the action set and the state set;

[0069] Calculate the reward value under the state value function value and the action value function value;

[0070] The reward value is used to determine a final layout of the satellite network controller from the target layout.

[0071] In order to solve the above problems, the present invention also provides a satellite network controller deployment system based on satellite communication, the system comprising:

[0072] A layout selection module, used to generate an initial layout of a satellite network controller, calculate a layout coverage rate of the initial layout, and calculate a coverage balance degree of the initial layout, and select a standard layout of the satellite network controller from the initial layout according to the layout coverage rate and the coverage balance degree;

[0073] a packet loss analysis module, configured to select a layout to be optimized from the standard layout, collect path data, flow data and packet loss data under the layout to be optimized, calculate the transmission delay of the layout to be optimized using the path data, calculate the controller load of the layout to be optimized using the flow data, and analyze the packet loss situation of the layout to be optimized based on the flow data and the packet loss data;

[0074] A space construction module, configured to construct a state space of the satellite network controller by using the layout to be optimized, the transmission delay, the controller load and the packet loss situation, perform layout normalization on the standard layout to obtain a normalized layout, and construct an action space of the satellite network controller by using the normalized layout;

[0075] a layout determination module, configured to analyze a state transition reward of the satellite network controller according to the state space and the action space, determine an initial state of the satellite network controller using the state transition reward, obtain a target layout corresponding to the initial state from the normalized layout, and determine a final layout of the satellite network controller from the target layout;

[0076] The controller deployment module is used to perform controller deployment on the satellite network controller using the final layout to obtain a controller deployment result of the satellite network controller.

[0077] Compared with the problems described in the background technology, the embodiment of the present invention calculates the layout coverage of the initial layout to analyze whether the satellite network controller covers enough network switches. Furthermore, the embodiment of the present invention calculates the coverage balance of the initial layout to detect whether the number of switches covered by each satellite network controller is balanced to avoid overloading of a certain satellite network controller. Furthermore, the embodiment of the present invention analyzes the packet loss situation of the layout to be optimized based on the traffic data and the packet loss data to use the packet loss situation as a basis for whether to select a certain controller layout. The embodiment of the present invention constructs the state space of the satellite network controller by using the layout to be optimized, the transmission delay, the controller load and the packet loss situation, so that when the state of the satellite network controller is subsequently transferred, the transferred state is derived from the state space, so that the state space is convenient for subsequent calculation of all The probability of transition between states. Further, the embodiment of the present invention performs layout normalization on the standard layout, so as to select part of the layout from the standard layout at fixed intervals for subsequent reward value calculation, and selects the layout with good performance based on the reward value, and continues to select the neighborhood layout of the layout with good performance, so as to reduce the complexity of the first round of reward value calculation process. Further, the embodiment of the present invention constructs the action space of the satellite network controller by using the normalized layout, so as to use the movement of the coordinates between each layout as the action of state transfer. The embodiment of the present invention analyzes the state transfer reward of the satellite network controller according to the state space and the action space, so as to identify the feedback value of different state transfers and the feedback value under different actions, so that when the feedback value is the largest, the original normalized layout can be adjusted according to the state transfer path and action change path corresponding to the feedback value, and finally realize the dynamic change of the layout. Therefore, the satellite network controller deployment method based on satellite communication proposed by the present invention can realize the dynamic deployment of the satellite network controller. BRIEF DESCRIPTION OF THE DRAWINGS

[0078] Figure 1 A schematic diagram of a flow chart of a satellite network controller deployment method based on satellite communication provided by an embodiment of the present invention;

[0079] Figure 2 A schematic diagram of modules for implementing the satellite network controller deployment method based on satellite communication provided by an embodiment of the present invention.

[0080] The purpose, features and advantages of the present invention will be further described with reference to the accompanying drawings in conjunction with the embodiments. DETAILED DESCRIPTION

[0081] It should be understood that the specific embodiments described herein are only used to explain the present invention, and are not used to limit the present invention.

[0082] The embodiment of the present application provides a satellite network controller deployment method based on satellite communication. The execution subject of the satellite network controller deployment method based on satellite communication includes but is not limited to at least one of the electronic devices such as a server and a terminal that can be configured to execute the method provided by the embodiment of the present application. In other words, the satellite network controller deployment method based on satellite communication can be executed by software or hardware installed on a terminal device or a server device. The server includes but is not limited to: a single server, a server cluster, a cloud server or a cloud server cluster, etc.

[0083] Embodiment 1:

[0084] Reference Figure 1 FIG. 1 is a flow chart of a satellite network controller deployment method based on satellite communication provided by an embodiment of the present invention. In this embodiment, the satellite network controller deployment method based on satellite communication includes:

[0085] S1. Generate an initial layout of a satellite network controller, calculate the layout coverage of the initial layout, and calculate the coverage balance of the initial layout. According to the layout coverage and the coverage balance, select a standard layout of the satellite network controller from the initial layout.

[0086] In the embodiment of the present invention, the satellite network controller refers to a device for managing and controlling a satellite communication network, and the initial layout refers to a set of multiple controllers randomly generated and distributed in different locations.

[0087] Furthermore, an embodiment of the present invention calculates the layout coverage of the initial layout to analyze whether the satellite network controller covers enough network switches, wherein the layout coverage refers to the degree of network switches covered by the satellite network controller within the maximum coverage range, and the network switch refers to a network device used to connect multiple devices and forward data between them, and is mainly used to receive data from other devices and forward it to the satellite network controller, and at the same time receive data from the satellite network controller and forward it to other devices.

[0088] In one embodiment of the present invention, the calculation of the layout coverage of the initial layout includes: extracting the satellite network controller in the initial layout; acquiring the network switch communicating with the satellite network controller; querying the coverage of the satellite network controller; identifying whether the network switch exists within the coverage according to the initial layout; when the network switch exists within the coverage, determining the covered switches among the network switches; selecting uncovered switches among the network switches using the covered switches; and calculating the layout coverage of the initial layout using the following formula according to the covered switches and the uncovered switches:

[0089] ;

[0090] in, represents the layout coverage, Indicates the number of covered switches. Indicates the number of uncovered switches.

[0091] Optionally, the process of identifying whether the network switch exists within the coverage range based on the initial layout refers to determining the coordinates of each satellite network controller using the initial layout, and knowing the area covered by each satellite network controller through the coverage range. At the same time, the coordinates of the network switch are queried to identify whether the coordinates of the network switch are in the area covered by the satellite network controller.

[0092] Furthermore, the embodiment of the present invention calculates the coverage balance of the initial layout to detect whether the number of switches covered by each satellite network controller is balanced, thereby avoiding the overload of a satellite network controller.

[0093] The coverage balance refers to the balance of the number of switches covered by each satellite network controller.

[0094] In one embodiment of the present invention, the calculation of the coverage balance of the initial layout includes: obtaining the covered switches of each satellite network controller in the initial layout to obtain the target switch; and calculating the coverage balance of the initial layout according to the target switch using the following formula:

[0095] ;

[0096] ;

[0097] ;

[0098] in, Indicates coverage balance. Indicates The number of target switches for each satellite network controller, express indivual The maximum value in Express The result after minimization is: Indicates the number of satellite network controllers, express The mean of express .

[0099] Furthermore, in an embodiment of the present invention, the standard layout refers to an initial layout in which the layout coverage is greater than a preset layout coverage threshold and the coverage balance is greater than a preset coverage balance threshold.

[0100] S2. Select a layout to be optimized from the standard layout, collect path data, flow data and packet loss data under the layout to be optimized, use the path data to calculate the transmission delay of the layout to be optimized, use the flow data to calculate the controller load of the layout to be optimized, and analyze the packet loss situation of the layout to be optimized based on the flow data and the packet loss data.

[0101] In an embodiment of the present invention, the layout to be optimized refers to any layout in the standard layout. Furthermore, the path data refers to the distance length between the satellite network controller and the network switch in the layout to be optimized, the traffic data refers to the amount of traffic transmitted between the satellite network controller and the network switch, and the packet loss data refers to the number of times packet loss occurs.

[0102] Optionally, the process of using the path data to calculate the transmission delay of the layout to be optimized refers to the process of calculating the duration using the path data and the propagation speed, wherein the transmission delay refers to the one-way propagation delay between the satellite network controller and the network switch.

[0103] Optionally, the process of calculating the controller load of the layout to be optimized using the traffic data refers to counting the total amount of traffic received by the satellite network controller in the layout to be optimized within a unit time length to obtain the controller load.

[0104] Furthermore, the embodiment of the present invention analyzes the packet loss situation of the layout to be optimized based on the traffic data and the packet loss data, so as to use the packet loss situation as a basis for whether to select a certain controller layout.

[0105] The packet loss situation refers to the ratio between the number of lost packets and the total number of sent data.

[0106] In one embodiment of the present invention, the analyzing the packet loss situation of the layout to be optimized based on the traffic data and the packet loss data includes: calculating the packet loss ratio of the layout to be optimized based on the traffic data and the packet loss data using the following formula:

[0107] ;

[0108] in, Indicates the packet loss ratio, Indicates the first A satellite network controller and The data transmission rate between the covered switches is Indicates the flow data The covered switch sends the The traffic of satellite network controllers, represents the number of satellite network controllers in the layout to be optimized, Indicates the number of lost packets The covered switch sends the Packet loss traffic of satellite network controllers, Indicates that the layout to be optimized belongs to The number of covered switches within the coverage area of ​​each satellite network controller;

[0109] The packet loss ratio is used as the packet loss situation of the layout to be optimized.

[0110] S3. Construct the state space of the satellite network controller using the layout to be optimized, the transmission delay, the controller load and the packet loss situation, normalize the standard layout to obtain a normalized layout, and construct the action space of the satellite network controller using the normalized layout.

[0111] The embodiment of the present invention constructs the state space of the satellite network controller by utilizing the layout to be optimized, the transmission delay, the controller load and the packet loss situation, so that when the state of the satellite network controller is subsequently transferred, the states that are transferred all originate from the state space, so the state space facilitates the subsequent calculation of the transition probability between all states.

[0112] The state space refers to a set containing all states.

[0113] In one embodiment of the present invention, the state space of the satellite network controller is constructed by using the layout to be optimized, the transmission delay, the controller load and the packet loss situation, including: obtaining a standard layout corresponding to the layout to be optimized; querying the remaining layouts except the layout to be optimized in the standard layout; using the layout to be optimized, the transmission delay, the controller load and the packet loss situation as the state to be optimized of the satellite network controller; respectively obtaining the transmission delay range, controller load range and packet loss range corresponding to the transmission delay, the controller load and the packet loss situation; respectively generating the transmission delay, controller load and packet loss situation corresponding to the remaining layout within the transmission delay range, the controller load range and the packet loss situation range; using the remaining layout and the transmission delay, controller load and packet loss situation corresponding to the remaining layout as the remaining state of the satellite network controller; and generating the state space of the satellite network controller using the state to be optimized and the remaining state.

[0114] Among them, the transmission delay range refers to the maximum interval of the transmission delay, the controller load range refers to the maximum interval of the controller load, the packet loss range refers to the maximum interval of the packet loss situation, and the transmission delay, controller load and packet loss situation corresponding to the remaining layout are all randomly generated data within the transmission delay range, the controller load range and the packet loss situation range.

[0115] Furthermore, the embodiment of the present invention normalizes the standard layout so as to select part of the layout from the standard layout at fixed intervals for subsequent reward value calculation, selects a layout with good performance based on the reward value, and continues to select the neighborhood layout of the layout with good performance, thereby reducing the complexity of the first round of reward value calculation process.

[0116] It should be noted that the neighborhood layout of this well-performing layout is not within the normalized layout. For example, the standard layout sequence is 123456, and 135 is selected in sequence at fixed intervals as the normalized layout. For 1, 2 is the neighborhood layout of 1, 4 is the neighborhood layout of 3, and 6 is the neighborhood layout of 5. In other words, the neighborhood layout is a layout within a fixed interval that starts with the normalized layout.

[0117] In one embodiment of the present invention, the step of normalizing the standard layout to obtain a normalized layout includes: obtaining a layout to be optimized and a remaining layout in the standard layout; arranging the remaining layout based on a distance between the remaining layout and the layout to be optimized to obtain a first layout sequence; arranging the layout to be optimized and the first layout sequence to obtain a second layout sequence; and calculating a sequence interval of the second layout sequence using the following formula:

[0118] ;

[0119] in, represents the sequence interval, Indicates the starting number of the second layout sequence. Indicates the end number of the second layout sequence. represents the number of intervals in the sequence, Indicated in and under the control of The maximum value of

[0120] According to the sequence interval, the normalized layout of the layout to be optimized is selected from the second layout sequence.

[0121] Optionally, the process of arranging the remaining layouts based on the distance between the remaining layouts and the layout to be optimized to obtain a first layout sequence refers to arranging the remaining layouts in ascending order based on the distance between the remaining layouts and the layout to be optimized. Further, the process of arranging the layout to be optimized and the first layout sequence refers to arranging the layout to be optimized in front of the first layout sequence, that is, the layout to be optimized is the starting point of the second layout sequence.

[0122] Furthermore, the embodiment of the present invention constructs the action space of the satellite network controller by utilizing the standardized layout, so as to use the movement of coordinates between each layout as the action of state transfer.

[0123] The action space refers to a set of distances of coordinate changes between every two controller coordinates of a normalized layout.

[0124] In one embodiment of the present invention, the use of the normalized layout to construct the action space of the satellite network controller includes: obtaining the controller coordinates of each satellite network controller in the normalized layout; calculating the shortest coordinate distance between every two controller coordinates of the normalized layout; deduplicating the shortest coordinate distance to obtain a deduplicated coordinate distance; and generating the action space of the satellite network controller using the deduplicated coordinate distance.

[0125] S4. Analyze the state transition reward of the satellite network controller according to the state space and the action space, determine the initial state of the satellite network controller using the state transition reward, obtain the target layout corresponding to the initial state from the normalized layout, and determine the final layout of the satellite network controller from the target layout.

[0126] The embodiment of the present invention analyzes the state transition reward of the satellite network controller according to the state space and the action space to identify the feedback values ​​of different state transitions and the feedback values ​​under different actions. Therefore, when the feedback value is maximum, the original normalized layout can be adjusted according to the state transition path and action change path corresponding to the feedback value, thereby finally realizing dynamic changes of the layout.

[0127] The state transition reward refers to the reward for taking different actions when transitioning between different states.

[0128] In one embodiment of the present invention, analyzing the state transition reward of the satellite network controller according to the state space and the action space includes: constructing a state transition model corresponding to the satellite network controller according to the state space and the action space using the following formula:

[0129] ;

[0130] in, , represents the state transition model, Representing the state space The state in Representing the action space Actions in

[0131] According to the state transition model, the state value model corresponding to the satellite network controller is constructed using the following formula:

[0132] ;

[0133] in, represents the state value model, represents the state transition model, Represents the reward value, represents the discount factor, Indicates status Execute an action After reaching the state The state transition probability, express The corresponding state value model;

[0134] The action value model corresponding to the satellite network controller is constructed using the following formula:

[0135] ;

[0136] in, represents the action-value model, Represents the reward value, represents the discount factor, Indicates status Execute an action After reaching the state The state transition probability, Indicates arrival status Then perform the action The probability of express The corresponding action-value model;

[0137] When both the state value model and the action value model are maximum values, the state transfer rewards corresponding to the state value model and the action value model are obtained.

[0138] It should be noted that , , , , , , are all known parameters obtained through training. The specific training process is to calculate the corresponding action value function and state value function of the historical training data, and calculate the loss between the calculated function value and the true value. For example, the optimization algorithm such as the gradient descent algorithm is used to calculate some fixed parameters. It is the value calculated based on the state and action of the previous round in the continuous cycle. Furthermore, the state transfer reward is .

[0139] Optionally, the process of using the state transition reward to determine the initial state of the satellite network controller refers to obtaining the state corresponding to the state transition reward, and querying whether there is a layout that meets this state in the original normalized layout, and taking the state corresponding to this layout as the initial state. When no state is found, querying a layout with high similarity.

[0140] Furthermore, in an embodiment of the present invention, the target layout refers to a layout that includes the layout corresponding to the initial state and a neighborhood layout of the layout corresponding to the initial state.

[0141] In one embodiment of the present invention, determining the final layout of the satellite network controller from the target layout includes: constructing an action set and a state set of the target layout; calculating the state value function value of the target layout based on the state set; calculating the action value function value of the target layout based on the action set and the state set; calculating the reward value under the state value function value and the action value function value; and determining the final layout of the satellite network controller from the target layout using the reward value.

[0142] It should be noted that the principle of determining the final layout of the satellite network controller from the target layout is similar to the aforementioned principle of analyzing the state transition reward of the satellite network controller based on the state space and the action space, and will not be further elaborated here.

[0143] S5. Perform controller deployment on the satellite network controller using the final layout to obtain a controller deployment result of the satellite network controller.

[0144] Optionally, the process of performing controller deployment on the satellite network controller using the final layout to obtain a controller deployment result of the satellite network controller refers to adjusting the layout to be optimized of the satellite network controller to the final layout.

[0145] Compared with the problems described in the background technology, the embodiment of the present invention calculates the layout coverage of the initial layout to analyze whether the satellite network controller covers enough network switches. Furthermore, the embodiment of the present invention calculates the coverage balance of the initial layout to detect whether the number of switches covered by each satellite network controller is balanced to avoid overloading of a certain satellite network controller. Furthermore, the embodiment of the present invention analyzes the packet loss situation of the layout to be optimized based on the traffic data and the packet loss data to use the packet loss situation as a basis for whether to select a certain controller layout. The embodiment of the present invention constructs the state space of the satellite network controller by using the layout to be optimized, the transmission delay, the controller load and the packet loss situation, so that when the state of the satellite network controller is subsequently transferred, the transferred state is derived from the state space, so that the state space is convenient for subsequent calculation of all The probability of transition between states. Further, the embodiment of the present invention performs layout normalization on the standard layout, so as to select part of the layout from the standard layout at fixed intervals for subsequent reward value calculation, and selects the layout with good performance based on the reward value, and continues to select the neighborhood layout of the layout with good performance, so as to reduce the complexity of the first round of reward value calculation process. Further, the embodiment of the present invention constructs the action space of the satellite network controller by using the normalized layout, so as to use the movement of the coordinates between each layout as the action of state transfer. The embodiment of the present invention analyzes the state transfer reward of the satellite network controller according to the state space and the action space, so as to identify the feedback value of different state transfers and the feedback value under different actions, so that when the feedback value is the largest, the original normalized layout can be adjusted according to the state transfer path and action change path corresponding to the feedback value, and finally realize the dynamic change of the layout. Therefore, the satellite network controller deployment method based on satellite communication proposed by the present invention can realize the dynamic deployment of the satellite network controller.

[0146] Embodiment 2:

[0147] like Figure 2 Shown is a functional module diagram of a satellite network controller deployment system based on satellite communication according to the present invention.

[0148] The satellite network controller deployment system 200 based on satellite communication of the present invention can be installed in an electronic device. According to the functions to be implemented, the satellite network controller deployment system based on satellite communication can include a layout selection module 201, a packet loss analysis module 202, a space construction module 203, a layout determination module 204 and a controller deployment module 205. The module of the present invention can also be called a unit, which refers to a series of computer program segments that can be executed by a processor of an electronic device and can complete fixed functions, which are stored in the memory of the electronic device.

[0149] In the embodiment of the present invention, the functions of each module / unit are as follows:

[0150] The layout selection module 201 is used to generate an initial layout of the satellite network controller, calculate the layout coverage of the initial layout, and calculate the coverage balance of the initial layout, and select the standard layout of the satellite network controller from the initial layout according to the layout coverage and the coverage balance;

[0151] The packet loss analysis module 202 is used to select a layout to be optimized from the standard layout, collect path data, flow data and packet loss data under the layout to be optimized, calculate the transmission delay of the layout to be optimized using the path data, calculate the controller load of the layout to be optimized using the flow data, and analyze the packet loss situation of the layout to be optimized based on the flow data and the packet loss data;

[0152] The space construction module 203 is used to construct the state space of the satellite network controller by using the layout to be optimized, the transmission delay, the controller load and the packet loss situation, perform layout normalization on the standard layout to obtain a normalized layout, and construct the action space of the satellite network controller by using the normalized layout;

[0153] The layout determination module 204 is used to analyze the state transition reward of the satellite network controller according to the state space and the action space, determine the initial state of the satellite network controller using the state transition reward, obtain the target layout corresponding to the initial state from the normalized layout, and determine the final layout of the satellite network controller from the target layout;

[0154] The controller deployment module 205 is used to perform controller deployment on the satellite network controller using the final layout to obtain a controller deployment result of the satellite network controller.

[0155] In detail, the modules in the satellite network controller deployment system 200 based on satellite communication in the embodiment of the present invention are used in the same manner as described above. Figure 1 The satellite network controller deployment method based on satellite communication described in the present invention has the same technical means and can produce the same technical effects, so it will not be repeated here.

[0156] It is obvious to those skilled in the art that the present invention is not limited to the details of the above exemplary embodiments, and that the present invention can be implemented in other specific forms without departing from the spirit or essential characteristics of the present invention.

[0157] Finally, it should be noted that the above embodiments are only used to illustrate the technical solution of the present invention rather than to limit it. Although the present invention has been described in detail with reference to the preferred embodiments, those skilled in the art should understand that the technical solution of the present invention can be modified or replaced by equivalents without departing from the spirit and scope of the technical solution of the present invention.

Claims

1. A satellite network controller deployment method based on satellite communication, characterized in that: The method comprises: Generate an initial layout of a satellite network controller, calculate a layout coverage rate of the initial layout, and calculate a coverage balance degree of the initial layout, and select a standard layout of the satellite network controller from the initial layout according to the layout coverage rate and the coverage balance degree; Selecting a layout to be optimized from the standard layouts, collecting path data, flow data, and packet loss data under the layout to be optimized, calculating the transmission delay of the layout to be optimized using the path data, calculating the controller load of the layout to be optimized using the flow data, and analyzing the packet loss situation of the layout to be optimized based on the flow data and the packet loss data; The state space of the satellite network controller is constructed by using the layout to be optimized, the transmission delay, the controller load and the packet loss situation, the standard layout is normalized to obtain a normalized layout, and the action space of the satellite network controller is constructed by using the normalized layout; Analyzing a state transition reward of the satellite network controller according to the state space and the action space, determining an initial state of the satellite network controller using the state transition reward, acquiring a target layout corresponding to the initial state from the normalized layout, and determining a final layout of the satellite network controller from the target layout; The final layout is used to perform controller deployment on the satellite network controller to obtain a controller deployment result of the satellite network controller.

2. The satellite network controller deployment method based on satellite communication according to claim 1, characterized in that: The calculating the layout coverage of the initial layout includes: extracting a satellite network controller in the initial layout; Acquire a network switch that communicates with the satellite network controller; Querying the coverage of the satellite network controller; According to the initial layout, identifying whether the network switch exists within the coverage area; When the network switch exists within the coverage range, determining a covered switch among the network switches; Selecting an uncovered switch among the network switches by using the covered switch; According to the covered switches and the uncovered switches, the layout coverage of the initial layout is calculated using the following formula: ； in, represents the layout coverage, Indicates the number of covered switches. Indicates the number of uncovered switches.

3. The satellite network controller deployment method based on satellite communication according to claim 1, characterized in that: The calculating the coverage balance of the initial layout includes: Acquire the covered switches of each satellite network controller in the initial layout to obtain the target switch; According to the target switch, the coverage balance of the initial layout is calculated using the following formula: ； ； ； in, Indicates coverage balance. Indicates The number of target switches for each satellite network controller, express indivual The maximum value in Express The result after minimization is: Indicates the number of satellite network controllers, express The mean of express .

4. The satellite network controller deployment method based on satellite communication according to claim 1, characterized in that: The analyzing the packet loss situation of the layout to be optimized based on the traffic data and the packet loss data includes: Based on the traffic data and the packet loss data, the packet loss ratio of the layout to be optimized is calculated using the following formula: ； in, Indicates the packet loss ratio, Indicates the first A satellite network controller and The data transmission rate between the covered switches is Indicates the flow data The covered switch sends the The traffic of satellite network controllers, represents the number of satellite network controllers in the layout to be optimized, Indicates the number of lost packets The covered switch sends the Packet loss traffic of satellite network controllers, Indicates that the layout to be optimized belongs to The number of covered switches within the coverage area of ​​each satellite network controller; The packet loss ratio is used as the packet loss situation of the layout to be optimized.

5. The satellite network controller deployment method based on satellite communication according to claim 1, characterized in that: The constructing the state space of the satellite network controller by using the layout to be optimized, the transmission delay, the controller load and the packet loss situation includes: Obtaining a standard layout corresponding to the layout to be optimized; Querying the remaining layouts in the standard layout except the layout to be optimized; The layout to be optimized, the transmission delay, the controller load and the packet loss situation are used as the state to be optimized of the satellite network controller; Respectively obtain a transmission delay range, a controller load range, and a packet loss range corresponding to the transmission delay, the controller load, and the packet loss situation; Generate the transmission delay, controller load and packet loss situation corresponding to the remaining layout within the transmission delay range, the controller load range and the packet loss situation range respectively; The remaining layout and the transmission delay, controller load and packet loss corresponding to the remaining layout are used as the remaining state of the satellite network controller; The state to be optimized and the remaining state are used to generate the state space of the satellite network controller.

6. The satellite network controller deployment method based on satellite communication according to claim 1, characterized in that: The step of normalizing the standard layout to obtain a normalized layout includes: Obtaining the layout to be optimized and the remaining layouts in the standard layout; Arranging the remaining layouts based on the distance between the remaining layouts and the layout to be optimized to obtain a first layout sequence; Arranging the layout to be optimized and the first layout sequence to obtain a second layout sequence; The sequence interval of the second layout sequence is calculated using the following formula: ； in, represents the sequence interval, Indicates the starting number of the second layout sequence. Indicates the end number of the second layout sequence. represents the number of intervals in the sequence, Indicated in and under the control of The maximum value of According to the sequence interval, the normalized layout of the layout to be optimized is selected from the second layout sequence.

7. The satellite network controller deployment method based on satellite communication according to claim 1, characterized in that: The step of constructing the action space of the satellite network controller by using the standardized layout includes: Obtaining controller coordinates of each satellite network controller in the normalized layout; Calculating the shortest coordinate distance between the controller coordinates of every two normalized layouts in the normalized layout; Deduplication processing is performed on the shortest coordinate distance to obtain a deduplication coordinate distance; The action space of the satellite network controller is generated using the deduplicated coordinate distance.

8. The satellite network controller deployment method based on satellite communication according to claim 1, characterized in that: Analyzing the state transfer reward of the satellite network controller according to the state space and the action space includes: According to the state space and the action space, the state transition model corresponding to the satellite network controller is constructed using the following formula: ； in, , represents the state transition model, Representing the state space The state in Representing the action space Actions in According to the state transition model, the state value model corresponding to the satellite network controller is constructed using the following formula: ； in, represents the state value model, represents the state transition model, Represents the reward value, represents the discount factor, Indicates status Execute an action After reaching the state The state transition probability, express The corresponding state value model; The action value model corresponding to the satellite network controller is constructed using the following formula: ； in, represents the action-value model, Represents the reward value, represents the discount factor, Indicates status Execute an action After reaching the state The state transition probability, Indicates arrival status Then perform the action The probability of express The corresponding action-value model; When both the state value model and the action value model are maximum values, the state transfer rewards corresponding to the state value model and the action value model are obtained.

9. The satellite network controller deployment method based on satellite communication according to claim 1, characterized in that: Determining the final layout of the satellite network controller from the target layout includes: Constructing an action set and a state set of the target layout; Calculating a state value function value of the target layout according to the state set; Calculating the action value function value of the target layout according to the action set and the state set; Calculate the reward value under the state value function value and the action value function value; The reward value is used to determine a final layout of the satellite network controller from the target layout.

10. A satellite network controller deployment system based on satellite communication, characterized in that: The system comprises: A layout selection module, used to generate an initial layout of a satellite network controller, calculate a layout coverage rate of the initial layout, and calculate a coverage balance degree of the initial layout, and select a standard layout of the satellite network controller from the initial layout according to the layout coverage rate and the coverage balance degree; a packet loss analysis module, configured to select a layout to be optimized from the standard layout, collect path data, flow data and packet loss data under the layout to be optimized, calculate the transmission delay of the layout to be optimized using the path data, calculate the controller load of the layout to be optimized using the flow data, and analyze the packet loss situation of the layout to be optimized based on the flow data and the packet loss data; A space construction module, configured to construct a state space of the satellite network controller by using the layout to be optimized, the transmission delay, the controller load and the packet loss situation, perform layout normalization on the standard layout to obtain a normalized layout, and construct an action space of the satellite network controller by using the normalized layout; a layout determination module, configured to analyze a state transition reward of the satellite network controller according to the state space and the action space, determine an initial state of the satellite network controller using the state transition reward, obtain a target layout corresponding to the initial state from the normalized layout, and determine a final layout of the satellite network controller from the target layout; The controller deployment module is used to perform controller deployment on the satellite network controller using the final layout to obtain a controller deployment result of the satellite network controller.

Images