Intelligent decision-making method, system and electronic equipment applied to cross-domain communication networking
By building an intelligent decision-making method for cross-domain communication networking, integrating radio, underwater acoustic, and laser communication methods, and using reinforcement learning models to optimize transmission strategies, the problem of low transmission efficiency in cross-domain communication is solved, and efficient data transmission between air, surface, and underwater nodes is achieved, which is suitable for ocean monitoring and ocean rescue.
Patent Information
- Application Number
- CN202411268450.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-11
- Publication Date
- 2025-09-26
- Estimated Expiration
- 2044-09-11
AI Technical Summary
Existing communication networking methods are difficult to meet the needs of cross-domain communication transmission in the air, on the surface, and underwater, and are unable to determine routing strategies with high transmission efficiency and strong real-time performance. In particular, in underwater and cross-surface communications, the transmission efficiency is low and the real-time performance is insufficient.
Build an intelligent decision-making method for cross-domain communication networking. By integrating radio, underwater acoustic, and laser communication methods and combining reinforcement learning models to optimize transmission strategy decisions, determine the target link, communication method, and rate, and achieve efficient data transmission between cross-domain communication nodes.
It improves the overall data transmission efficiency of cross-domain communication networking, ensures the robust transmission of information between air, surface and underwater nodes, and is suitable for applications such as ocean monitoring and ocean rescue.
Smart Images

Figure CN119211101B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of computer processing technology, and in particular to an intelligent decision-making method, system and electronic equipment applied to cross-domain communication networking. Background Art
[0002] As humanity continues to explore and develop the ocean, cross-domain communication networking, as a key link in the coordinated control of communication nodes and the interconnection of data and information, is of great significance for safeguarding and promoting the development of marine resources and the marine economy. However, cross-domain communication networking faces challenges such as multi-domain communication nodes, heterogeneous communication links, dynamic communication scenarios, and complex communication tasks. For example, in cross-surface and underwater communication scenarios, due to the presence of water as a medium, radio communication alone cannot meet communication transmission requirements.
[0003] At present, the communication decision-making method of communication networking can determine the routing strategy in a single domain or homogeneous communication network, but it is difficult to meet the cross-domain communication transmission needs of the air domain, surface domain and underwater domain, and it is impossible to determine a routing strategy with high transmission efficiency and strong real-time performance for the cross-domain communication network. Summary of the Invention
[0004] The present invention provides an intelligent decision-making method, system and electronic device for cross-domain communication networking, so as to determine a routing strategy with high transmission efficiency and strong real-time performance for cross-domain communication networking, thereby improving the overall data transmission efficiency of the cross-domain communication networking.
[0005] In a first aspect, the present invention provides an intelligent decision-making method for cross-domain communication networking, wherein the cross-domain communication networking includes multiple communication nodes in the air domain, the surface domain, and the underwater domain, and the communication mode between the communication nodes is a radio communication mode, a laser communication mode, or an underwater acoustic communication mode, including:
[0006] For each communication node in the cross-domain communication network, in the process of the communication node performing a data transmission task, the communication task data corresponding to the data transmission task, the link status data of the cross-domain communication network at the current moment, and the status data of each communication node are input into the transmission strategy decision model corresponding to the current moment, so as to obtain the target communication decision information of the communication node at the next moment; wherein, the target communication decision information includes: the target link, the target link communication mode and the target link communication rate; the transmission strategy decision model is determined after optimizing the transmission strategy decision model corresponding to the previous moment based on the communication information rights and interests attributes at the previous moment; the communication information rights and interests attributes are determined by the link communication feedback parameters corresponding to the communication node and the network feedback parameters corresponding to the cross-domain communication network after the communication node completes the data transmission task based on the historical communication decision information at the historical moment;
[0007] The transmission strategy of the communication node at the next moment is adjusted based on the target communication decision information, so that the communication node performs the data transmission task based on the transmission strategy at the next moment and takes the next moment as the current moment.
[0008] In a second aspect, an embodiment of the present invention further provides an intelligent decision-making system for cross-domain communication networking, wherein the cross-domain communication networking includes multiple communication nodes in the air domain, the surface domain, and the underwater domain, and the communication mode between the communication nodes is a radio communication mode, a laser communication mode, or an underwater acoustic communication mode. The system includes:
[0009] A target information determination module is used to input the communication task data corresponding to the data transmission task, the link status data of the cross-domain communication network at the current moment, and the status data of each communication node into the transmission strategy decision model corresponding to the current moment for each communication node in the cross-domain communication network during the process of the communication node performing the data transmission task, so as to obtain the target communication decision information of the communication node at the next moment; wherein the target communication decision information includes: the target link, the target link communication mode and the target link communication rate; the transmission strategy decision model is determined after optimizing the transmission strategy decision model corresponding to the previous moment based on the communication information rights and interests attributes at the previous moment; the communication information rights and interests attributes are determined by the link communication feedback parameters corresponding to the communication node and the networking feedback parameters corresponding to the cross-domain communication network after the communication node completes the data transmission task based on the historical communication decision information at the historical moment;
[0010] The target information adjustment module is used to adjust the transmission strategy of the communication node at the next moment based on the target communication decision information, so that the communication node performs the data transmission task based on the transmission strategy at the next moment and takes the next moment as the current moment.
[0011] In a third aspect, an embodiment of the present invention further provides an electronic device, the electronic device comprising:
[0012] one or more processors;
[0013] a storage system for storing one or more programs,
[0014] When one or more programs are executed by one or more processors, the one or more processors implement an intelligent decision-making method applied to cross-domain communication networking as described in any of the embodiments of the present invention.
[0015] The technical solution of the embodiment of the present invention is applied to a cross-domain communication network of multiple communication nodes in at least an air domain, a surface domain, and an underwater domain. The method includes: for each communication node in the cross-domain communication network, during the process of the communication node performing a data transmission task, inputting the communication task data corresponding to the data transmission task, the link status data of the cross-domain communication network at the current moment, and the status data of each communication node into a transmission strategy decision model corresponding to the current moment, thereby obtaining the target link, target link communication mode, and target link communication rate of the communication node at the next moment; adjusting the transmission strategy of the communication node at the next moment based on the target communication decision information, so that the communication node performs the data transmission task based on the transmission strategy at the next moment, and takes the next moment as the current moment. The technical solution provided by the embodiment of the present invention, for such complex communication scenarios of cross-domain communication networks, can determine a routing strategy with high transmission efficiency and strong real-time performance based on the task attributes of the transmission task, the real-time link information, and the real-time node information in the cross-domain communication network, thereby improving the overall data transmission efficiency of the cross-domain communication network.
[0016] It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present invention, nor is it intended to limit the scope of the present invention. Other features of the present invention will become readily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS
[0017] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.
[0018] Figure 1 This is a flowchart of an intelligent decision-making method applied to cross-domain communication networking provided according to the first embodiment of the present invention;
[0019] Figure 2 is a schematic diagram of a link communication method between communication nodes corresponding to different spatial domains according to an embodiment of the present invention;
[0020] Figure 3 This is a flowchart of an intelligent decision-making method for cross-domain communication networking provided in accordance with the second embodiment of the present invention;
[0021] Figure 4 is a schematic diagram of links associated with communication nodes involved in the second embodiment of the present invention;
[0022] Figure 5 Schematic diagram of the architecture of an intelligent decision-making method for cross-domain communication networking provided in accordance with the third embodiment of the present invention;
[0023] Figure 6 A schematic diagram of the structure of an intelligent decision-making system for cross-domain communication networking provided by an embodiment of the present invention;
[0024] Figure 7 The present invention provides a schematic structural diagram of an electronic device. DETAILED DESCRIPTION
[0025] In order to enable those skilled in the art to better understand the solutions of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the embodiments described are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts should fall within the scope of protection of the present invention.
[0026] It should be noted that the terms "first", "second", etc. in the description and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that the numbers used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.
[0027] Before introducing this solution, the application scenario of this solution can be introduced first. This embodiment is applicable to any situation where it is necessary to determine the communication strategy of each communication node in the cross-domain communication network. With the further exploration and development of the ocean by mankind, cross-domain communication networking, as a key link in the collaborative control of communication nodes and the networking and intercommunication of data information, is of great significance for ensuring and promoting the development of marine resources and marine economy. The so-called cross-domain communication networking refers to a communication network composed of communication nodes in different spatial domains. The cross-domain communication network includes at least multiple communication nodes in the air domain, the surface domain and the underwater domain. Among them, the communication node refers to the connection point in the cross-domain communication network, which can be a redistribution point or a communication endpoint, such as a server, a computer, a drone, a robot, etc.
[0028] More specifically, the multiple communication nodes include at least one air-domain communication node, at least one surface-domain communication node, and at least one underwater-domain communication node. This means that the cross-domain communication network includes multiple air-domain communication nodes operating in the air domain (e.g., drones flying in mid-air), multiple surface-domain communication nodes operating in the water domain (e.g., servers deployed on ships), and multiple underwater-domain communication nodes operating in the underwater domain (e.g., servers deployed underwater, underwater robots, anchor points in the sea, etc.). Communication between the communication nodes can be achieved through radio, laser, or underwater acoustic communication.
[0029] However, cross-domain communication networking faces challenges such as multi-domain communication nodes, heterogeneous communication links, dynamic communication scenarios, and complex communication tasks. For multi-domain communication networking between air, surface, and underwater communication nodes, traditional homogeneous single communication methods are difficult to meet the needs of cross-domain communication networking. This is mainly reflected in the following: 1) Radio communication uses electromagnetic wave transmission strategies to achieve high coverage and high transmission rate communications in the air, but electromagnetic waves attenuate significantly in water, making it difficult to meet the requirements of long-distance communication transmission across the surface or underwater; 2) Underwater acoustic communication uses sound wave transmission, which has relatively low transmission loss in water and is the main means of underwater wireless long-distance communication transmission, but the communication rate is very low; 3) Laser communication uses laser as a carrier for data transmission and is suitable for cross-surface communication.
[0030] Although traditional communication networking methods and systems can better solve the problems of single-domain or homogeneous communication networks, they are difficult to meet the cross-domain communication transmission needs in the air, on the surface, and underwater. For example, long-distance communication transmission across the surface and underwater cannot be achieved using only radio communication, and communication transmission in the air domain cannot be achieved using only underwater acoustic communication. Therefore, it is necessary to build a cross-domain communication networking solution for air-surface-underwater cross-domain communication, which is a hybrid heterogeneous combination of radio communication, underwater acoustic communication, and laser communication. In response to the above problems, this application integrates air, surface, and underwater cross-domain communication nodes, effectively integrates and gives play to the complementary advantages of the communication capabilities of the three heterogeneous communication links of radio, underwater acoustic, and laser communication, and builds a networking intelligent decision-making model for cross-domain communication scenarios and data transmission tasks, realizing cross-domain communication networking intelligent decision-making between underwater, surface, and air nodes, ensuring the resilience and interconnection of air domain communication networking and the robust transmission of information, thereby supporting application needs such as ocean monitoring and ocean rescue.
[0031] Example 1
[0032] Figure 1 This is an intelligent decision-making method applied to cross-domain communication networking provided in Example 1 of the present invention.
[0033] In this embodiment, the cross-domain communication website includes multiple communication nodes, and the processing method for each communication node is consistent. Here, any one of the communication nodes is taken as an example for description.
[0034] like Figure 1 As shown, the intelligent decision-making method applied to cross-domain communication networking includes:
[0035] S110. For each communication node in the cross-domain communication network, when the communication node performs a data transmission task, the communication task data corresponding to the data transmission task, the link status data of the cross-domain communication network at the current moment, and the status data of each communication node are input into the transmission strategy decision model corresponding to the current moment to obtain the target communication decision information of the communication node at the next moment.
[0036] Among them, a data transmission task refers to the process of transmitting data between a data source and a data sink through one or more links in accordance with appropriate procedures. This process is also called data communication, and its purpose is to realize the transmission and exchange of information between points. Communication task data is the characteristic description information corresponding to the data transmission task. For example, communication task data may include information such as task name, task type, and task priority. Whenever a data transmission task is generated, the communication task data corresponding to the data transmission task is determined. Link status data includes states such as the link starting node, link ending node, whether the link is failed, and link rate. Communication node status data mainly includes node type (air domain communication node, surface domain communication node, or underwater domain communication node), node function (sending, receiving, forwarding), node working mode (sending frequency, operating power), node physical properties (location information, longitude, latitude, altitude), and other information.
[0037] The target communication decision information refers to the information content (i.e., link, link communication mode, and link communication rate) on which a communication node will perform its data transmission task at the next moment, for a certain communication node. More specifically, the target communication decision information includes: the target link, the target link communication mode, and the target link communication rate. In data communication, a link refers to a communication line from one communication node to an adjacent communication node, with no other switching nodes between the two communication nodes. For a certain communication node, the adjacent communication node with which it has a direct communication connection is determined, that is, the link corresponding to it is determined. Link communication modes include radio communication, laser communication, or underwater acoustic communication. The link communication rate refers to the speed at which data is transmitted through a link in a computer network, also known as the data rate or bit rate. This rate is usually measured in bits per second (bps).
[0038] In this embodiment, the transmission strategy decision model is a reinforcement learning model that processes and analyzes communication task data, the current state data of each link in the cross-domain communication network, and the state data of each communication node, and outputs target communication decision information. In specific applications, the transmission strategy decision model can be updated in real time, meaning that model parameters within the transmission strategy decision model can be optimized. For example, model optimization methods may include adjusting parameters such as the number of hidden layer neurons, the learning rate, and the discount factor to improve the model's adaptability and learning efficiency, thereby achieving the purpose of model updating. Consequently, the target communication decision information determined by the real-time updated transmission strategy decision model has greater adaptability and higher accuracy.
[0039] The transmission strategy decision model is determined after optimizing the transmission strategy decision model corresponding to the previous moment based on the communication information rights and interests attributes at the previous moment. The communication information rights and interests attributes are determined by the link communication feedback parameters corresponding to the communication node and the networking feedback parameters corresponding to the cross-domain communication network after the communication node completes the data transmission task based on the historical communication decision information at the historical moment.
[0040] The communication information benefit attribute can be understood as the reward information determined by the communication node based on the link communication feedback parameters and networking feedback parameters after the communication node performed the data transmission task based on the target communication decision information at the previous moment. A historical moment is a moment before the current moment, for example, a historical moment is the moment before the current moment. Link communication feedback parameters can include link transmission delay information, link packet loss rate, and the target link rate corresponding to each link associated with the communication node. Networking feedback parameters include load balancing.
[0041] In this embodiment, the communication information rights and interests attributes can be determined based on the link communication feedback parameters corresponding to the communication node after the data transmission task is completed according to the historical communication decision information and the networking feedback parameters corresponding to the cross-domain communication network. Then, the model parameters of the transmission strategy decision model are optimized according to the communication information rights and interests attributes, thereby realizing the optimization process of the transmission strategy decision model.
[0042] In this embodiment, when a communication node begins executing a data transmission task, it can obtain an initial transmission strategy decision model, along with the communication task data corresponding to the data transmission task, the status data of each link in the cross-domain communication network at the current moment, and the status data of each communication node. This data can then be input into the initial transmission strategy decision model to obtain the communication node's target link, target link communication mode, and target link communication rate for the next moment. Subsequently, after completing the one-hop data transmission task based on the target link, target link communication mode, and target link communication rate, the communication node obtains the link communication feedback parameters corresponding to the communication node and the network feedback parameters corresponding to the cross-domain communication network. Communication information equity attributes are determined based on the link communication feedback parameters and the network feedback parameters. Furthermore, the model parameters of the transmission strategy decision model are optimized based on the communication information equity attributes to obtain a first transmission strategy decision model. This first transmission strategy decision model can be saved so that it can be recalled at the next control moment.
[0043] On this basis, the technical solution provided by this embodiment will be further described, with the second control moment as the current moment. At the second control moment, the transmission strategy decision model corresponding to the current moment is the first transmission strategy decision model optimized at the first control moment. The state data of each link and each communication node of the cross-domain communication network at the current moment (i.e., the second control moment) is obtained. Consequently, this link state data, communication node state data, and communication task data are input into the first transmission strategy decision model, which analyzes and processes this data and outputs the target communication decision information for the next moment (i.e., the third control moment). Based on the same communication information determination method, the target communication decision information for the communication nodes corresponding to the third control moment, the fourth control moment, ..., and the Nth control moment at the next moment can be determined.
[0044] More specifically, the transmission strategy decision model may include an action-value mapping layer and an action-decision layer. The action-value mapping layer is used to determine a value parameter corresponding to at least one preset action using a value function based on the communication task data, the link status data of the cross-domain communication network at the current moment (i.e., the second control moment), and the communication node status data. The action-decision layer is used to determine the target communication decision information to be ultimately executed based on the value parameters.
[0045] Optionally, inputting the communication task data corresponding to the data transmission task, the state data of each link of the cross-domain communication network at the current moment, and the state data of each communication node into the transmission strategy decision model corresponding to the current moment to obtain the target communication decision information of the communication node at the next moment may include:
[0046] S1101. Input the communication task data corresponding to the data transmission task, the link status data of the cross-domain communication network at the current moment, and the status data of each communication node into the action value mapping layer to obtain the value parameters corresponding to each preset execution action in the preset execution action set.
[0047] The preset execution action includes link information, a communication mode corresponding to the link, and a preset communication rate range corresponding to the communication mode.
[0048] In this embodiment, a preset execution action set can be pre-constructed, and the construction method of the preset execution action set includes: constructing a preset execution action set based on at least one link, at least one communication method, and at least one preset communication rate range corresponding to each communication method. That is, it can be understood that for a certain communication node, the communication node and each communication node except itself can determine a link, and the communication method corresponding to the link can be determined according to the node type corresponding to the communication node and the node type corresponding to the communication node that forms a link with it. More specifically, for a schematic diagram of the link communication method between communication nodes corresponding to different spatial domains, see Figure 2 ,like Figure 2 As shown, the link between an air-domain communication node corresponds to a radio communication method; the link between an air-domain communication node and a surface-domain communication node corresponds to a radio communication method; the link between an air-domain communication node and an underwater-domain communication node corresponds to a laser communication method; the link between a surface-domain communication node and a surface-domain communication node corresponds to a radio communication method; the link between a surface-domain communication node and an underwater-domain communication node corresponds to an underwater acoustic communication method; and the link between an underwater-domain communication node and an underwater-domain communication node corresponds to an underwater acoustic communication method. Because different communication methods correspond to different communication rate ranges, multiple preset communication rate ranges corresponding to each communication method can be pre-determined. Based on this, multiple combination strategies can be determined based on at least one link, at least one communication method, and at least one preset communication rate range corresponding to each communication method. Each combination strategy can be considered a preset execution action. Based on this, a preset execution action set including a large number of preset execution actions can be obtained.
[0049] For example, a communication node 1 is an air domain communication node, and another communication node 2 is an underwater domain communication node. Communication node 1 and communication node 2 correspond to link A, and the communication mode corresponding to link A is laser communication mode. The laser communication mode corresponds to five preset communication rate ranges: first level communication rate, second level communication rate, third level communication rate, fourth level communication rate, and fifth level communication rate. In this case, the preset execution action set may include at least the following: first preset action {link A, laser communication mode, first level communication rate}, second preset action {link A, laser communication mode, second level communication rate}, third preset action {link A, laser communication mode, third level communication rate}, fourth preset action {link A, laser communication mode, fourth level communication rate}, and fifth preset action {link A, laser communication mode, fifth level communication rate}. A cross-domain communication network includes a large number of communication nodes, and a large number of preset execution actions can be constructed based on the same method.
[0050] In this embodiment, the communication task data corresponding to the data transmission task, the link status data of the cross-domain communication network at the current moment, and the status data of each communication node can be input into the action value mapping layer, and the action value mapping layer can output the value parameters corresponding to each preset execution action.
[0051] Based on the above examples, the output of the action value mapping layer can be represented in the form of a vector, that is, {Q1, Q2, Q3, Q4, Q5, ..., QN}, where Q1 represents the value parameter corresponding to the first preset action, Q2 represents the value parameter corresponding to the second preset action, Q3 represents the value parameter corresponding to the third preset action, Q4 represents the value parameter corresponding to the fourth preset action, Q5 represents the value parameter corresponding to the fifth preset action, and QN represents the value parameter corresponding to the nth preset action.
[0052] S1102. Input each value parameter into the action decision layer to obtain a target value parameter that meets preset conditions.
[0053] Among them, the preset condition is to determine the maximum value parameter value as the target value parameter.
[0054] In this embodiment, the value parameters corresponding to the first preset action, the second preset action, the third preset action, the fourth preset action and the fifth preset action can be input into the action decision layer, and the action decision layer outputs the target value parameter, which is the maximum value parameter value.
[0055] S1103: Determine the target preset execution action corresponding to the target value parameter as the target link, target link communication mode, and target link communication rate of the communication node at the next moment.
[0056] Based on the above example, the value parameter Q5 has the largest value, Q5 is used as the target value parameter, and the fifth preset action is used as the target preset execution action, that is, the fifth preset action (i.e. link A, laser communication mode, fifth level communication rate) is determined as the target link, target link communication mode and target link communication rate of the communication node at the next moment.
[0057] S120. Adjust the transmission strategy of the communication node at the next moment based on the target communication decision information, so that the communication node performs the data transmission task based on the transmission strategy at the next moment, and takes the next moment as the current moment.
[0058] In this embodiment, based on the target communication decision information, the communication node's transmission strategy (i.e., link information, link communication mode, and link communication rate) at the next moment can be adjusted based on the target communication decision information, so that the communication node can perform the data transmission task based on the target link, target link communication mode, and target link communication rate at the next moment. Subsequently, the next moment is set as the current moment, and steps S110-S120 are repeated.
[0059] The technical solution of the embodiment of the present invention is applied to a cross-domain communication network of multiple communication nodes in at least an air domain, a surface domain, and an underwater domain. The method includes: for each communication node in the cross-domain communication network, during the process of the communication node performing a data transmission task, inputting the communication task data corresponding to the data transmission task, the link status data of the cross-domain communication network at the current moment, and the status data of each communication node into a transmission strategy decision model corresponding to the current moment, thereby obtaining the target link, target link communication mode, and target link communication rate of the communication node at the next moment; adjusting the transmission strategy of the communication node at the next moment based on the target communication decision information, so that the communication node performs the data transmission task based on the transmission strategy at the next moment, and takes the next moment as the current moment. The technical solution provided by the embodiment of the present invention, for such complex communication scenarios of cross-domain communication networks, can determine a routing strategy with high transmission efficiency and strong real-time performance based on the task attributes of the transmission task, the real-time link information, and the real-time node information in the cross-domain communication network, thereby improving the overall data transmission efficiency of the cross-domain communication network.
[0060] Example 2
[0061] Figure 3 This is a flowchart of an intelligent decision-making method for cross-domain communication networking provided in Example 2 of the present invention. Based on the above-mentioned embodiment, S110 is described in detail, wherein the technical terms that are the same as or corresponding to the above-mentioned embodiment are not repeated here.
[0062] like Figure 3 As shown, the method includes:
[0063] S210. After the communication node completes the data transmission task based on the historical communication decision information at the historical moment, obtain the link communication feedback parameter corresponding to the communication node and the networking feedback parameter corresponding to the cross-domain communication network.
[0064] The historical communication decision information is the target communication decision information corresponding to the communication node at the previous moment. The historical communication decision information may specifically include historical links, historical link communication modes, and historical link communication rates. Link communication feedback parameters include target transmission delay information, target packet loss rate, and target link rates corresponding to each link associated with the communication node. For example, the schematic diagram of each link associated with the communication node can be found in Figure 4 ,like Figure 4 As shown in the figure, there are four nodes: node 0, node 1, node 2 and node 3. Among them, the black-filled nodes 0 and 2 represent air domain communication nodes, the gray-filled node 3 represents the surface domain communication node, and the white-filled node 1 represents the underwater domain communication node. Figure 4 In the example, node 2 represents the communication node for which communication decision information needs to be determined. The other communication nodes associated with this communication node include node 0, node 1, and node 3. Therefore, the links associated with this communication node (i.e., node 2) include: link A corresponding to node 2 and node 0, link B corresponding to node 2 and node 1, and link C corresponding to node 2 and node 3. The target link rate corresponding to link A can be expressed as V1, the target link rate corresponding to link B can be expressed as V2, and the target link rate corresponding to link C can be expressed as V3.
[0065] The network feedback parameters include the target load balancing degree, which can be evaluated by calculating the sum of the standard deviations of the used bandwidths of all links in the cross-domain communication network.
[0066] In this embodiment, after the communication node completes the data transmission task based on the historical communication decision information at the historical moment, the network status of the cross-domain communication network has changed. At this time, the network feedback parameters corresponding to the cross-domain communication network and the link communication feedback parameters corresponding to the communication node can be extracted.
[0067] S220: Determine a target rate symmetry parameter based on each target link rate.
[0068] Considering the asymmetric links present in cross-domain communications, such as wireless communication links, which typically have higher transmission rates than underwater acoustic communication links, a rate symmetry parameter can be determined based on the asymmetric differences in links between nodes. The target rate symmetry parameter refers to the rate symmetry parameter corresponding to a specific communication node.
[0069] In this embodiment, a specific implementation manner of determining the target rate symmetry parameter based on each target link rate may include: determining the target rate symmetry parameter based on a ratio between each target link rate.
[0070] Based on the above examples, the ratio of the target link rate V1 corresponding to link A to the target link rate V2 corresponding to link B can be expressed as S1 = V1 / V2; the ratio of the target link rate V2 corresponding to link B to the target link rate V3 corresponding to link C can be expressed as S2 = V2 / V3; the ratio of the target link rate V1 corresponding to link A to the target link rate V3 corresponding to link C can be expressed as S3 = V1 / V3; and furthermore, the average of S1, S2 and S3 can be determined as the target rate symmetry parameter.
[0071] S230: Determine the communication information rights and interests attribute based on the target load balancing degree, the target transmission delay information, the target packet loss rate, and the target rate symmetry parameter.
[0072] In this embodiment, reward values corresponding to the target load balancing degree, target transmission delay information, target packet loss rate, and target rate symmetry parameter may be determined respectively, and then, the communication information rights attribute may be determined according to each reward value.
[0073] Optionally, based on the target load balancing degree, the target transmission delay information, the target packet loss rate, and the target rate symmetry parameter, the specific implementation steps of determining the communication information equity attribute may include:
[0074] (1) Determine the first equity attribute based on the mapping relationship between the target load balancing degree and the first reward value.
[0075] The first reward value mapping relationship includes a mapping relationship between the load balancing degree and the first preset reward value.
[0076] In this embodiment, the network load balancing is evaluated by calculating the sum of the standard deviations of the used bandwidth of all links in the cross-domain communication network, and a positively correlated reward mechanism is designed accordingly. Specifically, the first reward value mapping relationship can be understood as follows: the higher the load balancing degree, that is, the larger the sum of the standard deviations, the more uniform the load distribution of the network, and the correspondingly larger the reward value obtained. Conversely, the smaller the reward value, thereby promoting the balance of the network load. Based on this, the first equity attribute can be obtained according to the mapping relationship between the target load balancing degree and the first reward value.
[0077] (2) Determine the second equity attribute based on the mapping relationship between the target transmission delay information and the second reward value.
[0078] The second reward value mapping relationship includes a mapping relationship between the transmission delay and the second preset reward value.
[0079] In this embodiment, a reward mechanism is designed that is inversely proportional to transmission latency. The second reward value mapping relationship can be understood as follows: higher transmission latency corresponds to lower reward values; conversely, lower transmission latency corresponds to higher reward values, thereby seeking low-latency communication transmission paths. Based on this, the second equity attribute can be derived from the mapping relationship between the target load balancing degree and the second reward value.
[0080] (3) Determine the third equity attribute based on the mapping relationship between the target packet loss rate and the third reward value.
[0081] The third reward value mapping relationship includes a mapping relationship between a packet loss rate and a third preset reward value.
[0082] In this embodiment, packet loss events have a serious negative impact on the quality of communication transmission. When a packet loss event is detected, the corresponding packet loss negative reward mechanism will be triggered. The severity of the packet loss event will be weighted according to the priority and importance of the data packet or task. The third reward value mapping can be understood as follows: if a critical node loses important data, a larger negative reward will be given; and if ordinary data is lost at a non-critical node, although a negative reward will also be given, its value will be relatively small, thereby incentivizing network nodes to avoid packet loss, especially the loss of high-priority or important data. Based on this, the third equity attribute can be obtained according to the mapping relationship between the target packet loss rate and the third reward value.
[0083] (4) Determine the fourth equity attribute based on the mapping relationship between the target rate symmetry parameter and the fourth reward value.
[0084] The fourth reward value mapping relationship includes a mapping relationship between a rate symmetry parameter and a fourth preset reward value.
[0085] In this embodiment, taking into account the asymmetric links existing in cross-domain communications, such as the transmission rate of wireless links is usually higher than that of underwater acoustic links, a reward mechanism is designed based on the asymmetric differences of different links of nodes. That is, the fourth reward value mapping relationship can be understood as follows: when the asymmetric difference is close to 1, it indicates that the rates of the uplink and downlink links are relatively balanced, and a higher reward will be obtained at this time; and when the difference deviates significantly from 1, the reward value will be reduced, so as to avoid extreme differences in the rates of the uplink and downlink links. Based on this, the fourth equity attribute can be obtained according to the target rate symmetry parameter and the fourth reward value mapping relationship.
[0086] (5) Determine the rights and interests attribute of the communication information based on the first rights and interests attribute, the second rights and interests attribute, the third rights and interests attribute, and the fourth rights and interests attribute.
[0087] In this embodiment, the communication information equity attribute may be obtained by performing a weighted sum operation on the first equity attribute, the second equity attribute, the third equity attribute, and the fourth equity attribute.
[0088] S240: Based on the communication information rights and interests attribute, optimize the model parameters of the transmission strategy decision model corresponding to the previous moment to obtain the transmission strategy decision model corresponding to the current moment.
[0089] In this embodiment, the model parameters of the transmission policy decision model may be optimized once at every preset control moment, or may be optimized once at every control moment. The specific implementation method for optimizing the model parameters of the transmission policy decision model may be: using the communication information equity attribute as a reward value in reinforcement learning technology, calculating a target Q value using the Bellman equation and the reward value, and updating the model parameters in the transmission policy decision model by minimizing the difference between the predicted Q value (i.e., the target communication decision information output by the transmission policy decision model at the previous moment) and the target Q value.
[0090] In this embodiment, the communication information benefit attributes can be determined by combining rewards per time step (for example, real-time calculation and assignment of rewards such as transmission delay at each time step), time segment rewards (for example, cumulative rewards at certain key time points or after multiple time steps), event-triggered rewards (for example, negative rewards triggered by events such as packet loss), and sparse rewards (scoring the overall network quality). Furthermore, the reward is composed of multiple regularized sub-rewards (primarily transmission delay sub-rewards, network load balancing sub-rewards, packet loss event sub-rewards, and link asymmetry difference sub-rewards). Each sub-reward function is designed using a linear, nonlinear, or multi-parameter function based on the specific situation.
[0091] S250. For each communication node in the cross-domain communication network, when the communication node performs a data transmission task, the communication task data corresponding to the data transmission task, the link status data of the cross-domain communication network at the current moment, and the status data of each communication node are input into the transmission strategy decision model corresponding to the current moment to obtain the target link, target link communication mode and target link communication rate of the communication node at the next moment.
[0092] The communication task data also includes task category information, and the task category information is a data transmission communication task, a control information communication task, a status information communication task, or a fault alarm information communication task.
[0093] In this embodiment, the task category information corresponding to the data transmission task can be determined based on the data flow carried by the data transmission task. For example, the data flow is classified into raw data, control information, status information, and fault alarm information according to the data type. Each type of data can be further subdivided. For example, raw data can be divided into text, voice, image, and video, while control information, status information, and fault alarm information can be divided into system level, device level, board level, and unit level. Based on supervised machine learning, a network such as a convolutional neural network (CNN) is used to extract features, and a classification model is constructed using a classifier such as Extreme Gradient Boosting (XGBoost) to determine the task category information corresponding to the data transmission task based on the data flow of the data transmission task. Different task categories correspond to different communication service priority levels. For example, queue-based priority management can be used to manage multiple data transmission tasks of different task categories.
[0094] S260: Determine target communication rate information based on the task category information in the communication task data and a preset mapping relationship between the task category and the rate, so as to update the target link communication rate based on the target communication rate information.
[0095] In this embodiment, a preset mapping relationship between task categories and transmission rates can be predefined. In particular, for different link transmission modes, three preset mapping relationships between task categories and rates can be predefined respectively. Specifically, for the radio communication mode, the first wireless transmission rate corresponding to the data transmission communication task, the second wireless transmission rate corresponding to the control information communication task, the third wireless transmission rate corresponding to the status information communication task category, and the fourth wireless transmission rate corresponding to the fault alarm information communication task can be predetermined; for the laser communication mode, the first laser transmission rate corresponding to the data transmission communication task, the second laser transmission rate corresponding to the control information communication task, the third laser transmission rate corresponding to the status information communication task category, and the fourth laser transmission rate corresponding to the fault alarm information communication task can be predetermined; for the laser electrical communication mode, the first laser transmission rate corresponding to the data transmission communication task, the second laser transmission rate corresponding to the control information communication task, the third laser transmission rate corresponding to the status information communication task category, and the fourth laser transmission rate corresponding to the fault alarm information communication task can be predetermined. The second laser transmission rate, the third laser transmission rate corresponding to the status information communication task category, and the fourth laser transmission rate corresponding to the fault alarm information communication task can be predetermined for the underwater acoustic communication mode. The first underwater acoustic transmission rate corresponding to the data transmission communication task, the second underwater acoustic transmission rate corresponding to the control information communication task, the third underwater acoustic transmission rate corresponding to the status information communication task category, and the fourth underwater acoustic transmission rate corresponding to the fault alarm information communication task can be predetermined for the underwater acoustic-electrical communication mode. The first underwater acoustic transmission rate corresponding to the data transmission communication task, the second underwater acoustic transmission rate corresponding to the control information communication task, the third underwater acoustic transmission rate corresponding to the status information communication task category, and the fourth underwater acoustic transmission rate corresponding to the fault alarm information communication task can be predetermined for the underwater acoustic-electrical communication mode.
[0096] On the basis of the above embodiment, the target communication rate information can be determined according to the task category information, the target communication mode and each preset mapping relationship in the communication task data. Furthermore, the target link communication rate can be updated according to the target communication rate information to determine the communication rate that the final communication node is about to adopt. In this embodiment, by mapping the hierarchical communication link rate with the classified communication task type, business-rate perception and matching are achieved, so that different communication rates are allocated to different businesses as much as possible under limited resources, and priority is given to ensuring the reliable transmission of important cross-domain communication services, such as high real-time or high reliability services, and adaptively switching the transmission rate, including increasing or decreasing the transmission rate.
[0097] S270. Adjust the transmission strategy of the communication node at the next moment based on the updated target communication decision information, so that the communication node performs the data transmission task based on the transmission strategy at the next moment, and takes the next moment as the current moment.
[0098] The technical solution of the embodiment of the present invention is to obtain the link communication feedback parameters corresponding to the communication node and the networking feedback parameters corresponding to the cross-domain communication network after the communication node completes the data transmission task based on the historical communication decision information at the historical moment, and then determine the target rate symmetry parameters based on the target link rate and historical transmission rate corresponding to each link associated with the communication node, and determine the communication information equity attributes based on the target load balancing degree, target transmission delay information, target packet loss rate and target rate symmetry parameters, and then, based on the communication information equity attributes, optimize the model parameters of the transmission strategy decision model corresponding to the previous moment to obtain the transmission strategy decision model corresponding to the current moment, and by continuously optimizing the transmission strategy decision model parameters, the generalization ability and adaptability of the model are improved, and the overall data transmission efficiency of the cross-domain communication network is further improved. In addition, before adjusting the transmission strategy of the communication node at the next moment based on the target communication decision information, the target communication rate information can also be determined based on the task category information in the communication task data and the preset mapping relationship between the task category and the rate, so as to update the target link communication rate based on the target communication rate information. By mapping the graded communication link rates with the classified communication task types, business-rate perception and matching are achieved, so that different communication rates can be differentiated and allocated to different businesses as much as possible under limited resources, and priority is given to ensuring the reliable transmission of important cross-domain communication businesses, such as high real-time or high reliability businesses, and the transmission rate is adaptively switched.
[0099] Example 3
[0100] Next, a specific example is used to illustrate the specific implementation process of the intelligent decision-making method applied to cross-domain communication networking. Figure 5 This is a schematic diagram of the architecture of the intelligent decision-making method applied to cross-domain communication networking. Figure 5 As shown, the intelligent decision-making method applied to cross-domain communication networking mainly involves a cross-domain communication environment, an intelligent control layer, and an intelligent decision-making layer.
[0101] Cross-domain communication network environment: This mainly includes cross-domain communication nodes, cross-domain communication links, and intelligent decision-making computing terminals. Cross-domain communication nodes include air, surface, and underwater communication nodes; cross-domain communication links include radio, underwater acoustic, and laser communication links; and intelligent decision-making computing terminals include central processing units (CPUs), graphics processing units (GPUs), and neural network processing units (NPUs).
[0102] Intelligent control layer: From bottom to top, it accesses and extracts cross-domain communication network data through the data interaction southbound interface, then pre-processes the data, and then inputs the data information into the intelligent decision model of the intelligent decision layer through the data interaction northbound interface; from top to bottom, it deploys the policy (i.e., target communication decision information) output by the intelligent decision model of the intelligent decision layer through the intelligent policy configuration module and applies it to the intelligent decision computing end in the cross-domain communication network environment.
[0103] Intelligent decision-making layer: The cross-domain communication networking intelligent decision-making layer is the core layer of the cross-domain communication networking intelligent decision-making system, mainly including: integrated resource management intelligent decision-making model, dynamic routing selection intelligent decision-making model, and adaptive rate switching intelligent decision-making model.
[0104] More specifically, the integrated resource management intelligent decision-making model: for different communication nodes in the air domain, surface domain, and underwater domain, a cross-domain communication network resource management access controller is constructed to monitor, obtain and analyze information such as resource status in real time. At the same time, the prediction algorithm based on supervised learning is improved, and the traffic conditions of cross-domain communication nodes, links, networks and tasks are intelligently predicted according to the actual needs of various communication platforms and tasks, etc., to optimize the integrated resource management performance, thereby improving the resource utilization and transmission efficiency of the cross-domain communication network.
[0105] The main functions of the integrated resource management intelligent decision-making model include:
[0106] Node and link status management: Node status primarily includes node type (air, surface, underwater), node function (transmit, receive, forward), node operating mode (transmit frequency, operating power), and node physical attributes (location information, longitude, latitude, altitude). Link status primarily includes information such as the link start node, link end node, link failure status, and link rate (accessibility and data transmission speed). Cross-domain communication network topology management: A cross-domain communication network system is a dynamic network that evolves over time, and its network topology also changes over time. To reflect the evolution of the cross-domain communication network topology over time, the time domain is divided into slices, and the dynamic topology is represented as a series of continuous static network topologies. For a short period of time, the network can be viewed as a static topology at that moment. Based on the cross-domain communication network topology model, cross-domain communication network topology management performs real-time topology perception and adjustment based on the dynamic changes in the topology across different time domain slices, thereby enabling detection and optimization of the cross-domain communication network topology. Node and task priority management: Since a large number of different communication nodes exist in a cross-domain communication network, and each communication node transmits different information, it is necessary to define the priority of communication nodes and communication tasks, and implement queue-based priority management for the priorities of different communication nodes and different communication tasks. Specifically, cross-domain communication node priority prioritizes communication transmission for important communication nodes based on their importance (e.g., backbone nodes are more important than edge nodes) when multiple nodes utilize the same communication link to perform reception and forwarding. Cross-domain communication task priority prioritizes communication transmission for important communication nodes by ensuring smooth communication of general services using a first-in-first-out order of the same priority level during the reception and forwarding process of a node. Queue priority management is performed based on the importance of cross-domain communication tasks (high real-time or high reliability tasks). For high-priority services, such as control instructions, an immediate queue-jumping strategy is implemented to ensure the reliable and efficient transmission of important cross-domain communication tasks. Quality of Service (QoS) management for communication and data transmission: QoS management for communication and data transmission focuses on service quality, namely the bandwidth occupied by end-to-end transmission of communication data, transmission delay, and packet loss rate. A dynamic detection and optimization mechanism for QoS service quality is established to detect the delay, bandwidth, and packet loss rate of cross-domain communication and data transmission, thereby achieving QoS management and improvement in terms of reducing communication transmission delay, ensuring communication bandwidth, and reducing data packet loss rate.
[0107] The main function of the dynamic routing selection intelligent decision model is: for each communication node in the cross-domain communication network, when the communication node performs the data transmission task, the communication task data corresponding to the data transmission task, the link status data of the cross-domain communication network at the current moment, and the status data of each communication node are input into the transmission strategy decision model corresponding to the current moment, and the target communication decision information of the communication node at the next moment is obtained, that is, the output node routing strategy information.
[0108] Adaptive Rate Switching Intelligent Decision-Making Model: This model determines target communication rates based on task category information in communication task data and the pre-defined mapping between task category and rate. This model maps hierarchical communication link rates to categorized communication service types, achieving service-rate awareness and matching. This model allocates differentiated communication rates to different services within limited resources, prioritizing the reliable transmission of critical cross-domain communication services, such as those requiring high real-time or high reliability, and adaptively switches transmission rates, including increasing or decreasing them.
[0109] During the inference phase of the cross-domain communication networking intelligent decision-making algorithm model, it can be deployed on CPUs, GPUs, or NPUs. Device deployment of the cross-domain communication networking intelligent decision-making algorithm model includes the following key steps: Step 1) Complete cross-domain communication networking intelligent decision-making algorithm model development: Complete the algorithm design for the cross-domain communication resource management intelligent decision-making model, the routing intelligent decision-making model, and the adaptive rate switching intelligent decision-making model, and complete the development of the cross-domain communication networking intelligent decision-making algorithm model. Step 2) Configure the artificial intelligence (AI) computing device development environment: Install and run the development environment based on the cross-domain communication networking intelligent decision-making algorithm model deployment requirements and the computing device requirements (primarily including the CPU, GPU, and NPU). Completely configure the dependency list and environment variables. Step 3) Migrate the cross-domain communication networking intelligent decision-making algorithm model: The cross-domain communication networking intelligent decision-making algorithm model is typically first developed on a CPU or GPU processor. When migrating the cross-domain communication networking intelligent decision-making algorithm model from a GPU or CPU to an NPU, operator development and adaptation are required for any unsupported AI model operators. Step 4) Environment Configuration and Cross-Domain Communication Networking Intelligent Decision-Making Model Training and Debugging: Configure environment variables and use a computer, industrial computer, server, or other device equipped with a CPU, GPU, or NPU processor to train and debug the cross-domain communication networking intelligent decision-making algorithm model. Step 5) Saving and Exporting the Cross-Domain Communication Networking Intelligent Decision-Making Algorithm Model: After training and debugging the cross-domain communication networking intelligent decision-making algorithm model, save and export the algorithm model as a model file suitable for computing processors such as CPUs, GPUs, or NPUs. Step 6) Inferencing the Cross-Domain Communication Networking Algorithm Model on an AI Computing Device: After training, debugging, and saving and exporting the cross-domain communication networking intelligent decision-making algorithm model, load and infer the cross-domain communication networking algorithm model on a computing processor such as a CPU, GPU, or NPU to complete the resource management, routing selection, and adaptive rate switching intelligent decision-making functions of the cross-domain communication networking intelligent decision-making algorithm.
[0110] Example 4
[0111] Figure 6 A structural diagram of an intelligent decision-making system for cross-domain communication networking provided in an embodiment of the present invention, wherein the cross-domain communication networking includes multiple communication nodes in the air domain, the surface domain, and the underwater domain, and the communication mode between the communication nodes is radio communication mode, laser communication mode, or underwater acoustic communication mode. The system includes: a target information determination module 310 and a target information adjustment module 320.
[0112] Among them, the target information determination module 310 is used to input the communication task data corresponding to the data transmission task, the link status data of the cross-domain communication network at the current moment, and the status data of each communication node into the transmission strategy decision model corresponding to the current moment for each communication node in the cross-domain communication network during the process of the communication node performing the data transmission task, so as to obtain the target communication decision information of the communication node at the next moment; wherein the target communication decision information includes: the target link, the target link communication mode and the target link communication rate, the transmission strategy decision model is determined after optimizing the transmission strategy decision model corresponding to the previous moment based on the communication information rights and interests attributes at the previous moment, and the communication information rights and interests attributes are determined by the link communication feedback parameters corresponding to the communication node and the networking feedback parameters corresponding to the cross-domain communication network after the communication node completes the data transmission task based on the historical communication decision information at the historical moment;
[0113] The target information adjustment module 320 is used to adjust the transmission strategy of the communication node at the next moment based on the target communication decision information, so that the communication node performs the data transmission task based on the transmission strategy at the next moment and takes the next moment as the current moment.
[0114] Based on the above system, the transmission strategy decision model optionally includes an action value mapping layer and an action decision layer, and a target information determination module, including:
[0115] A value parameter determination unit is configured to input the communication task data corresponding to the data transmission task, the status data of each link of the cross-domain communication network at the current moment, and the status data of each communication node into the action value mapping layer to obtain the value parameter corresponding to each preset execution action in the preset execution action set; wherein the preset execution action includes link information, the communication mode corresponding to the link, and the preset communication rate range corresponding to the communication mode;
[0116] The target value determination unit is used to input each value parameter into the action decision layer to obtain the target value parameter that meets the preset conditions;
[0117] The target link information determination unit is used to determine the target preset execution action corresponding to the target value parameter as the target link, target link communication mode and target link communication rate of the communication node at the next moment.
[0118] On the basis of the above system, optionally, the intelligent decision-making system applied to cross-domain communication networking further includes: an action set determination module;
[0119] The action set determination module is used to construct a preset execution action set based on at least one link, at least one communication mode and at least one preset communication rate range corresponding to each communication mode.
[0120] Based on the above system, optionally, the intelligent decision-making system applied to cross-domain communication networking further includes: a transmission strategy decision model determination module; the transmission strategy decision model determination module includes:
[0121] A feedback parameter acquisition unit is configured to acquire, after the communication node completes a data transmission task based on historical communication decision information at a historical moment, link communication feedback parameters corresponding to the communication node and networking feedback parameters corresponding to the cross-domain communication network; wherein the link communication feedback parameters include target transmission delay information, target packet loss rate, and target link rate corresponding to each link associated with the communication node; and the networking feedback parameters include target load balancing;
[0122] a rate symmetry determination unit, configured to determine a target rate symmetry parameter based on each target link rate;
[0123] A benefit attribute determination unit, configured to determine the benefit attribute of communication information based on a target load balancing degree, a target transmission delay information, a target packet loss rate, and a target rate symmetry parameter;
[0124] The decision model optimization unit is used to optimize the model parameters of the transmission strategy decision model corresponding to the previous moment based on the communication information rights and interests attributes to obtain the transmission strategy decision model corresponding to the current moment.
[0125] Based on the above system, optionally, a rate symmetry determination unit is specifically configured to determine a target rate symmetry parameter based on a ratio between target link rates.
[0126] Based on the above system, optionally, the equity attribute determination unit is specifically used to determine the first equity attribute based on the mapping relationship between the target load balancing degree and the first reward value; wherein the first reward value mapping relationship includes the mapping relationship between the load balancing degree and the first preset reward value; determine the second equity attribute based on the target transmission delay information and the second reward value mapping relationship; wherein the second reward value mapping relationship includes the mapping relationship between the transmission delay and the second preset reward value; determine the third equity attribute based on the target packet loss rate and the third reward value mapping relationship; wherein the third reward value mapping relationship includes the mapping relationship between the packet loss rate and the third preset reward value; determine the fourth equity attribute based on the target rate symmetry parameter and the fourth reward value mapping relationship; wherein the fourth reward value mapping relationship includes the mapping relationship between the rate symmetry parameter and the fourth preset reward value; determine the communication information equity attribute based on the first equity attribute, the second equity attribute, the third equity attribute and the fourth equity attribute.
[0127] Based on the above system, optionally, the communication task data includes task category information, and the task category information is a data transmission communication task, a control information communication task, a status information communication task category, or a fault alarm information communication task.
[0128] Based on the above system, optionally, the intelligent decision-making system applied to cross-domain communication networking further includes: a rate update module;
[0129] The rate update module is used to determine target communication rate information based on task category information in the communication task data and a preset mapping relationship between the task category and the rate, so as to update the target link communication rate based on the target communication rate information.
[0130] The technical solution provided by the embodiment of the present invention can dynamically adjust the link weight in real time according to the link receiving and sending information of different links in the cross-domain communication network in such a complex communication scenario of cross-domain communication networking, thereby determining the route corresponding to the current moment according to the adjusted link weight, and determining the route with the highest transmission efficiency, thereby improving the overall data transmission efficiency of the cross-domain communication network.
[0131] The intelligent decision-making system for cross-domain communication networking provided by the embodiment of the present invention can execute the intelligent decision-making method for cross-domain communication networking provided by any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the execution method.
[0132] It is worth noting that the various units and modules included in the above system are only divided according to functional logic, but are not limited to the above division, as long as the corresponding functions can be achieved; in addition, the specific names of the functional units are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of the embodiments of the present invention.
[0133] Example 5
[0134] Figure 7 The present invention provides a schematic structural diagram of an electronic device. Figure 7 A block diagram of an exemplary electronic device 40 suitable for implementing exemplary embodiments of the present invention is shown. Figure 7 The electronic device 40 shown is only an example and should not limit the functionality and scope of use of the embodiments of the present invention.
[0135] like Figure 7As shown, electronic device 40 is implemented as a general-purpose computing device. Components of electronic device 40 may include, but are not limited to, one or more processors or processing units 401, system memory 402, and a bus 403 connecting various system components (including system memory 402 and processing unit 401). Bus 403 represents one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, or a local bus between processors or processors using any of a variety of bus architectures. Examples include, but are not limited to, the Industry Standard Architecture (ISA) bus, the Micro Channel Architecture (MAC) bus, the Enhanced ISA bus, the Video Electronics Standards Association (VESA) local bus, and the Peripheral Component Interconnect (PCI) bus. Electronic device 40 typically includes a variety of computer system-readable media. These media can be any available media accessible by electronic device 40, including volatile and non-volatile media, removable and non-removable media.
[0136] System memory 402 may include computer system readable media in the form of volatile memory, such as random access memory (RAM) 404 and / or cache memory 405. Electronic device 40 may further include other removable / non-removable, volatile / non-volatile computer system storage media. By way of example only, storage system 406 may be used to read and write non-removable, non-volatile magnetic media ( Figure 7 Not shown, usually called a "hard drive"). Although Figure 7 Although not shown, a disk drive for reading and writing to a removable non-volatile disk (e.g., a "floppy disk"), as well as an optical disk drive for reading and writing to a removable non-volatile optical disk (e.g., a CD-ROM, DVD-ROM, or other optical media) can be provided. In these cases, each drive can be connected to bus 403 via one or more data media interfaces. Memory 402 may include at least one program product having a set (e.g., at least one) of program modules configured to perform the functions of various embodiments of the present invention.
[0137] A program / utility 408 having a set (at least one) of program modules 407 may be stored, for example, in memory 402. Such program modules 407 include, but are not limited to, an operating system, one or more application programs, other program modules, and program data, each of which, or some combination thereof, may include an implementation of a network environment. Program modules 407 generally implement the functions and / or methods of the embodiments described herein.
[0138] The electronic device 40 may also communicate with one or more external devices 409 (e.g., keyboard, pointing device, display 810, etc.), and may also communicate with one or more devices that enable a user to interact with the electronic device 40, and / or any device that enables the electronic device 40 to communicate with one or more other computing devices (e.g., network card, modem, etc.). Such communication may be performed through an input / output (I / O) interface 411. Furthermore, the electronic device 40 may also communicate with one or more networks (e.g., a local area network (LAN), a wide area network (WAN), and / or a public network, such as the Internet) through a network adapter 412. As shown, the network adapter 412 communicates with other modules of the electronic device 40 via the bus 403. It should be understood that although Figure 7 Although not shown, other hardware and / or software modules may be used in conjunction with the electronic device 40, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems. The processing unit 401 executes various functional applications and page processing by running programs stored in the system memory 402, such as implementing the intelligent decision-making method for cross-domain communication networking provided in an embodiment of the present invention.
Claims
1. An intelligent decision-making method applied to cross-domain communication networking, characterized in that: The cross-domain communication network includes multiple communication nodes in the air domain, surface domain, and underwater domain. The communication mode between the communication nodes is radio communication mode, laser communication mode, or underwater acoustic communication mode, including: For each communication node in the cross-domain communication network, in the process of the communication node performing a data transmission task, the communication task data corresponding to the data transmission task, the link status data of the cross-domain communication network at the current moment, and the status data of each communication node are input into the transmission strategy decision model corresponding to the current moment to obtain the target communication decision information of the communication node at the next moment; wherein, the target communication decision information includes: the target link, the target link communication mode and the target link communication rate, and the transmission strategy decision model is determined after optimizing the transmission strategy decision model corresponding to the previous moment based on the communication information rights and interests attributes of the previous moment, and the communication information rights and interests attributes are determined according to the link communication feedback parameters corresponding to the communication node and the networking feedback parameters corresponding to the cross-domain communication network after the communication node completes the data transmission task based on the historical communication decision information at the historical moment; adjusting the transmission strategy of the communication node at a next moment based on the target communication decision information, so that the communication node performs the data transmission task based on the transmission strategy at the next moment, and uses the next moment as the current moment; The transmission strategy decision model includes an action value mapping layer and an action decision layer. The communication task data corresponding to the data transmission task, the link status data of the cross-domain communication network at the current moment, and the status data of each communication node are input into the transmission strategy decision model corresponding to the current moment to obtain the target communication decision information of the communication node at the next moment, including: Constructing a preset execution action set based on at least one link, at least one communication mode, and at least one preset communication rate range corresponding to each of the communication modes; Input the communication task data corresponding to the data transmission task, the link status data of the cross-domain communication network at the current moment, and the status data of each communication node into the action value mapping layer to obtain the value parameter corresponding to each preset execution action in the preset execution action set; wherein the preset execution action includes link information, the communication mode corresponding to the link, and the preset communication rate range corresponding to the communication mode; Inputting each of the value parameters into the action decision layer to obtain a target value parameter that meets the preset conditions; The target preset execution action corresponding to the target value parameter is determined as the target link, target link communication mode and target link communication rate of the communication node at the next moment.
2. The method according to claim 1, characterized in that The transmission strategy decision model corresponding to the current moment is determined in the following manner: After the communication node completes the data transmission task based on the historical communication decision information at the historical moment, obtaining the link communication feedback parameters corresponding to the communication node and the networking feedback parameters corresponding to the cross-domain communication network; wherein the link communication feedback parameters include target transmission delay information, target packet loss rate, and target link rate corresponding to each link associated with the communication node, and the networking feedback parameters include target load balancing; Determining a target rate symmetry parameter based on each of the target link rates; Determining a communication information equity attribute based on the target load balancing degree, the target transmission delay information, the target packet loss rate, and the target rate symmetry parameter; Based on the communication information rights and interests attribute, the model parameters of the transmission strategy decision model corresponding to the previous moment are optimized to obtain the transmission strategy decision model corresponding to the current moment.
3. The method according to claim 2, characterized in that The determining a target rate symmetry parameter based on each of the target link rates includes: A target rate symmetry parameter is determined based on a ratio between the target link rates.
4. The method according to claim 2, characterized in that The determining of the communication information equity attribute based on the target load balancing degree, the target transmission delay information, the target packet loss rate, and the target rate symmetry parameter includes: Determining a first equity attribute based on the target load balancing degree and a first reward value mapping relationship; wherein the first reward value mapping relationship includes a mapping relationship between the load balancing degree and a first preset reward value; Determining a second benefit attribute based on the target transmission delay information and the second reward value mapping relationship; wherein the second reward value mapping relationship includes a mapping relationship between the transmission delay and the second preset reward value; Determining a third equity attribute based on the mapping relationship between the target packet loss rate and the third reward value; wherein the third reward value mapping relationship includes a mapping relationship between the packet loss rate and the third preset reward value; Determining a fourth equity attribute based on the target rate symmetry parameter and a fourth reward value mapping relationship; wherein the fourth reward value mapping relationship includes a mapping relationship between the rate symmetry parameter and a fourth preset reward value; Determine a communication information rights attribute based on the first rights attribute, the second rights attribute, the third rights attribute, and the fourth rights attribute.
5. The method according to claim 1, wherein The communication task data includes task category information, and the task category information is a data transmission communication task, a control information communication task, a status information communication task, or a fault alarm information communication task.
6. The method according to claim 5, characterized in that Before adjusting the transmission strategy of the communication node at the next moment based on the target communication decision information, the method further includes: Based on the task category information in the communication task data and a preset mapping relationship between the task category and the rate, target communication rate information is determined to update the target link communication rate based on the target communication rate information.
7. An intelligent decision-making system applied to cross-domain communication networking, characterized in that: The cross-domain communication network includes multiple communication nodes in the air domain, surface domain, and underwater domain. The communication mode between the communication nodes is radio communication mode, laser communication mode, or underwater acoustic communication mode, including: A target information determination module is used to input the communication task data corresponding to the data transmission task, the link status data of the cross-domain communication network at the current moment, and the status data of each communication node into the transmission strategy decision model corresponding to the current moment for each communication node in the cross-domain communication network during the process of the communication node performing the data transmission task, so as to obtain the target communication decision information of the communication node at the next moment; wherein the target communication decision information includes: the target link, the target link communication mode and the target link communication rate, the transmission strategy decision model is determined after optimizing the transmission strategy decision model corresponding to the previous moment based on the communication information rights and interests attributes of the previous moment, and the communication information rights and interests attributes are determined according to the link communication feedback parameters corresponding to the communication node and the networking feedback parameters corresponding to the cross-domain communication network after the communication node completes the data transmission task based on the historical communication decision information at the historical moment; a target information adjustment module, configured to adjust the transmission strategy of the communication node at a next moment based on the target communication decision information, so that the communication node performs the data transmission task based on the transmission strategy at the next moment, and uses the next moment as the current moment; The transmission strategy decision model includes an action value mapping layer and an action decision layer, and the target information determination module includes: an action set determination module, configured to construct a preset execution action set based on at least one link, at least one communication mode, and at least one preset communication rate range corresponding to each of the communication modes; a value parameter determination unit, configured to input the communication task data corresponding to the data transmission task, the link status data of the cross-domain communication network at the current moment, and the communication node status data into the action value mapping layer, and obtain the value parameter corresponding to each preset execution action in the preset execution action set; wherein the preset execution action includes link information, the communication mode corresponding to the link, and a preset communication rate range corresponding to the communication mode; A target value determination unit, configured to input each of the value parameters into the action decision layer to obtain a target value parameter that meets a preset condition; The target link information determination unit is used to determine the target preset execution action corresponding to the target value parameter as the target link, target link communication mode and target link communication rate of the communication node at the next moment.
8. An electronic device, characterized in that: The electronic device comprises: at least one processor; and a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program that can be executed by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the intelligent decision-making method applied to cross-domain communication networking according to any one of claims 1-6.