Data link establishment method, communication device, communication system and storage medium
By orchestrating the data processing role of data nodes and establishing data links in combination with resource status, the problem of mismatch between data production capacity and demand in the existing technology is solved, and a more reasonable and efficient data link establishment is achieved.
Patent Information
- Application Number
- PCT/CN2024/079136
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-08-11
- Filing Date
- 2024-02-28
- Publication Date
- 2025-02-20
AI Technical Summary
In the prior art, data producers and data consumers can only match and establish transmission links based on physical connection relationships, resulting in mismatch between data production capacity and data demands, making it difficult to reasonably establish data links.
Data links are established by determining the resource status of each data node in the network and orchestrating the data processing roles according to the resource status. This method combines the resource status and data processing role of the data node to optimize the establishment of data links to ensure that the data production capacity matches data requirements.
It realizes the establishment of a data link between data producers and data consumers whose data production capacity matches data needs, and improves the rationality and efficiency of the data link.
Smart Images

Figure CN2024079136_20022025_PF_FP_ABST
Abstract
Description
Data link establishment method, communication device, communication system and storage medium
[0001] This application claims priority to Chinese patent application No. 202311013682.5 filed on August 11, 2023, the entire contents of which are incorporated by reference into this application. Technical Field
[0002] The present disclosure relates to the field of communication technology, and in particular to a data link establishment method, a communication device, a communication system, and a storage medium. Background Art
[0003] In related technologies, it is necessary to match data consumers with data producers to produce the data required by the data consumers, and to establish a transmission link between the data consumers and the data producers to transmit the data produced by the data producers.
[0004] Summary of the Invention
[0005] On the one hand, a data link establishment method is provided, which includes: determining the resource status of each data node in the network; arranging the data processing role of each data node according to the resource status of each data node; and establishing a data link in the network according to the resource status of each data node and the data processing role of each data node.
[0006] On the other hand, another data link establishment method is provided, which includes: sending the resource status of the data nodes in the network nodes so that the data processing role of each data node is arranged according to the resource status of each data node in the network, and a data link in the network is established; data processing is performed according to the data processing role of each data node in the network and the data link in the network.
[0007] In yet another aspect, a data link establishment device is provided, comprising: a processing unit and a communication unit. The communication unit is configured to determine the resource status of each data node in a network; the processing unit is configured to schedule the data processing role of each data node based on the resource status of each data node. The processing unit is further configured to establish a data link in the network based on the resource status of each data node and the data processing role of each data node.
[0008] In yet another aspect, another data link establishment device is provided, comprising: a processing unit and a communication unit. The communication unit is configured to transmit resource status of data nodes in a network, so that data processing roles of the data nodes are arranged according to the resource status of the data nodes in the network and a data link in the network is established; and the processing unit is configured to perform data processing according to the data processing roles of the data nodes in the network and the data link in the network.
[0009] In another aspect, a data link establishment system is provided, comprising: a data link establishment device and multiple network nodes. The data link establishment device is configured to execute the data link establishment method described in the first aspect; and any of the multiple network nodes is configured to execute the data link establishment method described in the other aspect.
[0010] In another aspect, a communication device is provided, comprising: a memory and a processor. The memory is coupled to the processor; the memory is used to store a computer program; and the processor implements the data link establishment method described in any one of the above aspects when executing the computer program.
[0011] On the other hand, a computer-readable storage medium is provided, on which computer program instructions are stored. When the computer program instructions are executed by a processor, the data link establishment method described in any of the above aspects is implemented.
[0012] In yet another aspect, a computer program product is provided, comprising computer program instructions, which, when executed by a processor, implement the data link establishment method described in any one of the above aspects. BRIEF DESCRIPTION OF THE DRAWINGS
[0013] In order to more clearly illustrate the technical solutions in the present disclosure, the following briefly introduces the drawings required for use in some embodiments of the present disclosure. Obviously, the drawings described below are only drawings of some embodiments of the present disclosure. For ordinary technicians in this field, other drawings can also be obtained based on these drawings.
[0014] FIG1 is a schematic flow chart of a method for establishing a data link according to some embodiments of the present disclosure.
[0015] FIG2 is a system architecture diagram of a communication system according to some embodiments of the present disclosure.
[0016] FIG3A is a schematic structural diagram of a network node according to some embodiments of the present disclosure.
[0017] FIG3B is a system architecture diagram of another communication system according to some embodiments of the present disclosure.
[0018] FIG4 is a flowchart of another method for establishing a data link according to some embodiments of the present disclosure.
[0019] FIG5 is a flowchart of another method for establishing a data link according to some embodiments of the present disclosure.
[0020] FIG6 is a flowchart of another method for establishing a data link according to some embodiments of the present disclosure.
[0021] FIG7 is a flowchart of another method for establishing a data link according to some embodiments of the present disclosure.
[0022] FIG8 is a flowchart of another method for establishing a data link according to some embodiments of the present disclosure.
[0023] FIG9 is a flowchart of another method for establishing a data link according to some embodiments of the present disclosure.
[0024] FIG10 is a schematic structural diagram of a communication device according to some embodiments of the present disclosure.
[0025] FIG11 is a schematic structural diagram of another communication device according to some embodiments of the present disclosure.
[0026] FIG12 is a schematic diagram of the hardware structure of a communication device according to some embodiments of the present disclosure. DETAILED DESCRIPTION
[0027] In order to enable those skilled in the art to better understand the technical solutions of the embodiments of the present disclosure, the technical solutions of the present disclosure will be clearly and completely described below in conjunction with the drawings in the present disclosure. Obviously, the embodiments described are only part of the embodiments of the present disclosure, not all of the embodiments. Based on the embodiments of the present disclosure, all other embodiments obtained by ordinary technicians in this field without making creative efforts shall fall within the scope of protection of the present disclosure.
[0028] It should be noted that in this disclosure, words such as "exemplary" or "for example" are used to indicate examples, illustrations, or descriptions. Any embodiment or design described in this disclosure as "exemplary" or "for example" should not be construed as being preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "for example" is intended to present the relevant concepts in a concrete manner.
[0029] In the following, the terms "first," "second," etc. are used for descriptive purposes only and should not be understood to indicate or imply relative importance or implicitly specify the quantity of the technical features indicated. Therefore, a feature specified as "first," "second," etc. may explicitly or implicitly include one or more of the features.
[0030] In the description of this disclosure, unless otherwise specified, " / " means "or." For example, A / B can mean A or B. "And / or" in this document is simply a description of an association between related objects, indicating that three possible relationships exist. For example, "A and / or B" can mean: only A, only B, and A and B. Furthermore, "at least one" means one or more, and "a plurality" means two or more.
[0031] In wireless network architectures, including but not limited to fourth-generation mobile communication technology (4G) and fifth-generation mobile communication technology (5G) networks, data is transmitted between network nodes via fixed point-to-point transmission channels. Because the data production and data consumption functions of network nodes are generally fixed, the data production and data consumption functions of network nodes also have a fixed transmission relationship between them.
[0032] In related technologies, it is necessary to match data consumers with data producers to produce the data required by the data consumers, and to establish a transmission link between the data consumers and the data producers to transmit the data produced by the data producers.
[0033] Currently, data producers and consumers are bound to network nodes, and transmission links can only be established based on the physical connections between the nodes. However, the data production capacity of data producers in physically connected network nodes may not meet the data needs of data consumers. Therefore, how to properly establish data links in the network has become a pressing technical challenge.
[0034] In order to solve the technical problems existing in the above-mentioned related technologies, an embodiment of the present disclosure provides a data link establishment method. In this data link establishment method, the data processing role of each data node is arranged according to the resource status of each data node in the network, and then a data link is established according to the resource status and data processing role of the data node. In this way, when establishing a data link, the data link can be established in combination with the resource status and data processing role of the data node at the same time, so that a data link can be established between a data producer and a data consumer whose data production capacity matches the data demand, thereby increasing the rationality of the established data link.
[0035] Figure 1 shows a flow chart of a method for establishing a data link according to an embodiment of the present disclosure. As shown in Figure 1 , the method for establishing a data link provided by the embodiment of the present disclosure can be implemented, for example, through the following steps S101 to S103.
[0036] In S101, the data link establishing device determines the resource status of each data node in the network.
[0037] As an example, a data node may be a data producer or a data consumer in a network node. The resource status of each data node includes the resource status of each module in the network node.
[0038] In some embodiments, the data link establishment device obtains the resource status of the modules in each network node through the data plane proxy module in each network node in the network, and then determines the resource status of each data node in the network.
[0039] In S102 , the data link establishing device arranges the data processing role of each data node according to the resource status of each data node.
[0040] In some embodiments, data processing roles include data processing nodes and data requesting nodes. Accordingly, resource states include resource availability and resource demand. The data link establishment device schedules data nodes with a resource availability status as data processing nodes and schedules data nodes with a resource demand status as data requesting nodes.
[0041] It is understood that if a data node's resource status is in the resource-available state, it indicates that the data node's data production resources have not yet been fully occupied. In this case, the data link establishment device determines the data node as a data processing node, so that the data node can subsequently produce data based on its available data production resources. If a data node's resource status is in the resource-demand state, it indicates that the data node's data demand has not yet been met. In this case, the data link establishment device determines the data node as a data-demanding node, so that the data processing node can produce data for the data-demanding node based on its data demand.
[0042] In some embodiments, the data link establishing device determines that a data producer whose data production resources have not been fully occupied is a data processing node, and the data link establishing device determines that a data consumer whose data demand has not been met is a data demand node.
[0043] In S103, the data link establishing device establishes a data link in the network according to the resource status of each data node and the data processing role of each data node.
[0044] In some embodiments, a data link establishment device determines the resources required by a data-requiring node and then matches the data-requiring node with a data processing node that can meet its data requirements from among multiple data processing nodes. A data link is established between the data-requiring node and the data processing node that can meet its data requirements. The data link establishment device traverses the data-requiring nodes in the network until each data-requiring node is matched with a data processing node that meets its data requirements, and a data link is established.
[0045] In the disclosed embodiments, a data link establishment device arranges the data processing roles of each data node in the network based on the resource status of each data node, and then establishes a data link based on the resource status and data processing role of the data node. In this way, when establishing a data link, the data link establishment device can simultaneously combine the resource status and data processing role of the data node to establish the data link, thereby establishing a data link between a data producer and a data consumer whose data production capacity matches their data demand, thereby increasing the rationality of the established data link.
[0046] The data link establishment method provided by the embodiments of the present disclosure can be applied to the communication system shown in Figure 2, which is a system architecture diagram of a communication system according to an embodiment of the present disclosure. As shown in Figure 2, the communication system includes: a data link establishment device 201, a network node 202, and a network node 203. Each network node includes one or more data nodes.
[0047] It can be understood that the communication system of the embodiment of the present disclosure may include one or more network nodes, and FIG2 only takes two network nodes as an example for illustration.
[0048] The data link establishing device 201 is used to obtain the resource status of the data nodes in the network nodes in the network, and arrange the data processing roles of the data nodes according to the resource status of multiple data nodes in the network, and establish the data link in the network according to the data processing roles and resource status.
[0049] A network node is a network node that carries data nodes. A data node can be a data producer with data production capabilities, or a data consumer with data needs.
[0050] It is understandable that a network node may have both data consumers and data producers, or a network node may have only data consumers, or a network node 202 may have only data producers. This disclosure does not limit this.
[0051] In some embodiments, in addition to data nodes, network nodes may also deploy multiple data services. The data services in the network nodes include at least one of the following: data collection services, data storage services, data plane proxy services, data application programming interface (API) services, and data forwarding services.
[0052] Data services in network nodes can be implemented through corresponding unit modules. For example, the data collection service function is implemented by the data collection module, the data storage service function is implemented by the data storage module, the data plane proxy service function is implemented by the data plane proxy module, the data API interface service function is implemented by the data API interface module, and the data forwarding service function is implemented by the data forwarding module.
[0053] Figure 3A illustrates the structure of a network node 202 after deploying data services according to an embodiment of the present disclosure. As shown in Figure 3A , the modules within network node 202 used to implement data service functionality include a data acquisition module 2021, a data storage module 2022, a data plane proxy module 2023, a data API interface module 2024, and a data forwarding module 2025. Furthermore, the network node includes a data producer module 2026 for implementing data production capabilities for data producers, and a data consumer module 2027 for implementing data consumption capabilities for data consumers. In some embodiments, the network node also includes a data preprocessing module 2028 for preprocessing data.
[0054] In conjunction with Figure 3A , Figure 3B shows a system architecture diagram of a communication system after data services are deployed in network node 202. Data plane proxy module 2023 is configured to provide data plane proxy services. For example, data plane proxy module 2023 can obtain parameters for each module in network node 202 and report them to data link establishment device 201; obtain policies orchestrated by data link establishment device 201, adjust these policies into policies executable by each module in network node 202, and distribute them to each module in network node 202.
[0055] For example, the data plane proxy module 2023 is configured to obtain the resource status of data nodes in the network node 202 and report it to the data link establishment device 201. For example, the data plane proxy module 2023 obtains the data requirements of the data consumer module 2027 and the data processing capabilities of the data producer module 2026. The data plane proxy module 2023 is also configured to obtain the service capabilities of each data service module in the network node 202. For example, the data plane proxy module 2023 can obtain the data collection capabilities of the data collection module 2021, the data storage capabilities of the data storage module 2022, the API interface forwarding capabilities of the data API interface module 2024, and the data forwarding capabilities of the data forwarding module 2025. Furthermore, the data plane proxy module 2023 can also obtain identification information and transmission information for each network node 202. After obtaining this information from the network nodes, the data plane proxy module 2023 transmits this information to the data link establishment device 201.
[0056] It is understandable that when the parameters in the network node 202 are changed, the data plane proxy module 2023 may also obtain the changed parameters and re-report the changed parameters in the network node 202 to the data link establishing device 201 .
[0057] In addition, the data plane proxy module 2023 is also used to convert the data processing policy issued by the data link establishment device 201 into policies that can be executed by each data service module and distribute them to the corresponding data service module. For example, the data plane proxy module 2023 converts the data processing policy into a data collection policy, a data storage policy, a data API interface policy, a data forwarding policy, and a data extraction policy. The data plane proxy module 2023 distributes the data collection policy to the data collection module 2021, the data storage policy to the data storage module 2022, the data API interface policy to the data API interface module 2024, the data forwarding policy to the data forwarding module 2025, and the data extraction policy to the data consumer module 2027. The data collection module 2021 is used to collect data produced by data producers. For example, the data collection module 2021 reports its data collection capabilities for executing data collection tasks to the data plane proxy module 2023; for example, it reports the number of data types it can handle, the amount of data it can collect, or the speed at which it can collect data. After receiving the data collection strategy issued by the data plane agent module 2023, the data collection strategy is executed to collect data produced by the data producer.
[0058] In some embodiments, after receiving the data collection policy issued by the data plane proxy module 2023, the data collection module 2021 determines the data production task for the data producer based on the data collection policy and issues the data production task to the data producer. After the data producer completes the production task, the data collection module 2021 collects the required data from the data producer and forwards the collected data to the data storage module 2022.
[0059] Data storage module 2022 is used to store data received from data acquisition module 2021. For example, data storage module 2022 reports its data storage capacity to data plane proxy module 2023, such as its maximum storage capacity. After receiving the data storage policy issued by data plane proxy module 2023, data storage module 2022 executes the policy.
[0060] In some embodiments, the data storage policy is used to indicate the maximum amount of storage allocated by the data storage module 2022 to the corresponding network node 202. After receiving the data forwarded by the data acquisition module 2021, the network node 202 to which the data acquisition module belongs is determined, and then the maximum amount of storage allocated for the network node 202 is determined. If the sum of the current amount of data stored by the network node 202 and the amount of data to be stored this time is not greater than the maximum amount of storage allocated for the network node 202, the data forwarded by the data acquisition module 2021 is stored.
[0061] Data API interface module 2024 is responsible for forwarding data based on the data API interface. For example, data API interface module 2024 reports its own data API interface parameters to data plane proxy module 2023. After receiving the data API interface policy issued by data plane proxy module 2023, it provides the data consumer module 2027 with an API interface for extracting data based on the data API interface policy.
[0062] In some embodiments, when the data consumer module 2027 and the data API interface module 2024 are in the same network node 202, the data API interface module 2024 directly forwards data to the data consumer module 2027 according to the API interface indicated in the data API interface policy. When the data consumer module 2027 and the API interface module 2024 are not in the same network node 202, the data API interface module 2024 forwards data to the data forwarding module 2025 according to the API interface indicated in the data API interface policy, so that the data forwarding module 2025 forwards the data to the data consumer module 2027 according to the data forwarding policy.
[0063] Data forwarding module 2025 is configured to forward data based on a data link. For example, data forwarding module 2025 reports its data forwarding capabilities to data plane proxy module 2023. After receiving the data forwarding policy issued by data plane proxy module 2023, data forwarding is performed based on the data forwarding policy. After receiving data forwarded from data API interface module 2024, data forwarding module 2025 determines the identity of network node 202 to which data consumer module 2027 corresponding to the data belongs. Based on the identity of network node 202, data forwarding module 2025 determines the corresponding forwarding policy and sends the data to data consumer module 2027 in network node 202 according to the data link specified in the forwarding policy.
[0064] The data producer module 2026 is responsible for producing data for data consumers. For example, the data producer module 2026 reports its data production capabilities to the data plane proxy module 2023. After receiving a data production task from the data acquisition module, the data producer module 2026 produces data based on the task and sends the produced data to the data acquisition module 2021.
[0065] Data consumer module 2027 is a data consumer that consumes data. For example, data consumer module 2027 reports its own data needs to data plane proxy module 2023. After receiving the data extraction policy from the data plane proxy module, data consumer module 2027 determines the network node 202 from which to extract the required data based on the data extraction policy. If data consumer module 2027 needs to obtain the required data from the same network node 202, it sends a data extraction request to the data API interface module of that network node 202. The data extraction request includes parameters of the data to be extracted (e.g., data content and data rules). Data consumer module 2027 then obtains data forwarded by the data API interface based on the data extraction request. If data consumer module 2027 needs to obtain the required data from a different network node 202, it sends a data extraction request to the data API interface module of that different network node 202. Data consumer module 2027 then obtains the data forwarded by that different network node 202, sequentially through the data API interface module and the data forwarding module.
[0066] The system architecture diagram of the communication system provided by the embodiment of the present disclosure is described in detail above in conjunction with FIG. 2 , FIG. 3A and FIG. 3B .
[0067] In some embodiments, as shown in FIG4 in combination with FIG1 , the process of the data link establishing device in S101 determining the resource status of each data node in the network can be implemented, for example, through the following S401 and S402 .
[0068] In S401, the data link establishing apparatus determines the data services deployed in each network node.
[0069] The data service includes at least one of the following: data collection service, data storage service, data plane proxy service, data application programming interface API service, and data forwarding service.
[0070] In some embodiments, after a network node is connected to the network, each module in the network node reports its capabilities and requirements to the data plane proxy module in the network node. The data plane proxy module aggregates the capabilities and requirements of each module and sends the aggregated capabilities and requirements to the data link establishment device. The data link establishment device determines the data services deployed in the network node based on the capabilities and requirements of each module.
[0071] As an example, in Example 1, the network includes a data link establishment device and network node A. Network node A includes a data acquisition module, a data storage module, a data plane proxy module, a data API interface module, and a data forwarding module. Furthermore, network node A also includes a data producer module and a data consumer module.
[0072] After network node A is connected to the network, each module in the network node reports the capabilities and requirements of the corresponding module to the data plane proxy module in the network node.
[0073] The data consumer module in network node A reports to the data plane proxy module that the type of data it needs is (Data_A), and the amount of data required is: 2,000 data items per day. The data producer module in network node A reports to the data plane proxy module that the data types it can produce include: Data_A, Data_C, and the maximum data production capacity is 120 items / hour. The data acquisition module in network node A reports to the data plane proxy module its data acquisition capability of managing the acquisition tasks of two types of data at the same time. The data storage module in network node A reports to the data plane proxy module its data storage capability of storing up to 10,000 data items. In some embodiments, the data API interface module and the data forwarding module in network node A may also report their capabilities to the data plane proxy module.
[0074] The data plane proxy module in network node A sends data obtained from network node A to the data link establishment device. For example, the content sent by the data plane proxy module in network node A to the data link establishment device includes: data processing capability {the producible data types are Data_A and Data_C, the data models of Data_A and Data_C, the production specification is 120 items / hour, and the storage specification is 10,000 items}, data demand {Data_A data, 2,000 items per day}, and network node identifier {network node A, transmission address address_A}.
[0075] The data link establishing device determines the data service deployed in the network node according to the content reported by the data plane proxy module.
[0076] In S402, the data link establishing apparatus determines the resource status of each data node according to the corresponding relationship between each data node in each network node and the data service in each network node.
[0077] In some embodiments, the data node is a data producer or a data consumer in a network node. The resource status of the data node includes the resource status of the data node and the resource status of each data service in the network node to which the data node belongs.
[0078] For example, the data link establishment device determines the resource status of the data producer based on the data production capacity of the data producer and the service capacity of each data service in the network node to which the data producer belongs. The data link establishment device determines the resource status of the data consumer based on the data demand of the data consumer.
[0079] Combined with the above example 1, the data link establishment device determines the resource status of the data producer in network node A as follows: the data types that the data producer can produce include: Data_A, Data_C, and the maximum data production capacity is 120 items / hour; the data acquisition module simultaneously manages the acquisition tasks of two types of data; the data storage module reports to the data plane agent module that it can store up to 10,000 pieces of data.
[0080] The data link establishing device determines that the data consumer resource status in the network node A is: the required data type is (Data_A), and 2000 pieces of data are required every day.
[0081] In the disclosed embodiment, the data link establishment device can comprehensively consider the production capacity of data producers in the network nodes, the service capacity of each service node, and the data demand of the data demand node to determine the resource status of each data node.
[0082] After the data link establishing device arranges the data processing roles of the various data nodes, the data link establishing device may further match data demand nodes and data processing nodes that match the resource demand and available resource amounts.
[0083] As shown in Figure 4, the process of the data link establishment device matching data demand nodes and data processing nodes that match the resource demand and available resource amount can be achieved, for example, through the following S403: the data link establishment device establishes an association relationship between each data demand node and each data processing node based on the resource demand of each data demand node and the available resource amount of each data processing node.
[0084] The available resources of the associated data processing nodes are used to meet the resource requirements of the data demand nodes.
[0085] In conjunction with Example 1 above, after obtaining the content reported by the data plane proxy module of network node A, the data link establishment device determines that the data demand of the data consumer in network node A has not been met and that the data producer in network node A still has available data production capacity. The data link establishment device arranges the data consumer in network node A as a data demand node and the data producer in network node A as a data processing node.
[0086] The data link establishment device finds that the data production capacity of the data producer in network node A can meet the data needs of the data consumer in network node A, and that the data collection and data storage capabilities of network node A can also meet the data needs of the data consumer in network node A. The data link establishment device establishes an association between the data producer and the data consumer in network node A, so that the data producer in network node A produces the required data for the data consumer in network node A.
[0087] In the disclosed embodiment, the data link establishment device establishes an association between each data demand node and each data processing node, and the available resources of the associated data processing nodes are used to meet the resource requirements of the data demand nodes. Therefore, in the disclosed embodiment, data consumers can be matched with data producers that can meet their data needs, thereby ensuring that the data needs of all data consumers in the network are met, and thus making the data links established between data consumers and data producers more reasonable.
[0088] After the data link establishment device matches a data requesting node and a data processing node that match the resource requirements and available resources, the data link establishment device can send corresponding orchestration results to the data requesting node and the data processing node, respectively, so that the data requesting node and the data processing node perform data processing according to the orchestration results. As shown in FIG4 , this process can be implemented, for example, through the following steps S404 to S406.
[0089] In S404, the data link establishing device generates a first orchestration result corresponding to each data demand node and a second orchestration result corresponding to each data processing node according to the association relationship between each data demand node and each data processing node.
[0090] The first orchestration result is used to indicate the association relationship between the data demand node and the data processing node; the second orchestration result is used to indicate the data processing strategy of the data processing node for processing the data demand of the data demand node with the association relationship.
[0091] In combination with the above example 1, the first orchestration result generated by the data link establishment device for the data consumer in network node A is used to indicate that the data demand of the data consumer in network node A can be met, and the data consumer in network node A extracts the required amount of data Data_A from the data producer of network node A through the data API interface.
[0092] The second orchestration result generated by the data link establishment device for the data producer in network node A includes a data processing strategy for processing the data needs of the data consumer in network node A. For example, the data processing strategy includes: producing data Data_A at a rate of 100 pieces per hour, producing 2,400 pieces of data per day; storing 2,400 pieces of Data_A data per day; providing an interface service for extracting Data_A data; and no data forwarding strategy.
[0093] In S405 , the data link establishing apparatus sends the corresponding first orchestration result to each data demanding node, so that the data demanding node determines the corresponding data processing node according to the first orchestration result.
[0094] In S406, the data link establishing device sends the corresponding second orchestration result to each data processing node, so that the data processing node processes the data demand of the associated data demand node according to the data processing strategy in the second orchestration result.
[0095] In some embodiments, the data link establishing device stores the data processing capabilities of each data processing node and the data requirements of the data demanding node.
[0096] After the data link establishing device sends the first orchestration result to the data demanding node, it will mark that the data demand of the first data demanding node can be met.
[0097] After the data link establishment device sends the second orchestration result to the data processing node, it deducts the data processing capacity of the data processing node required for this orchestration process from its stored data processing capacity of the data processing node. This way, the next time data processing capacity is needed for other data-demanding nodes, the data link establishment device can directly allocate data based on the marked remaining data processing capacity.
[0098] In the embodiment of the present disclosure, the data link establishment device sends corresponding orchestration results to the data demand node and the data processing node respectively, so that the data processing node produces data according to the orchestration results and the data demand node obtains data according to the orchestration results, thereby meeting the data needs of the data demand node.
[0099] In some embodiments, after the data link establishing device establishes an association relationship between each data demand node and the corresponding data processing node, the data link establishing device establishes a data link between the data demand node and the data processing node with the association relationship, thereby completing the process of establishing a data link in the network.
[0100] In the embodiment of the present disclosure, the process of establishing a data link by the data link establishing device is different depending on whether the associated data demand node and the data processing node are in the same network node. The following will explain the different situations.
[0101] Case 1: The data demand node and the data processing node in the same network node are associated.
[0102] In case 1, the process of the data link establishing device establishing the data link between the data demand node and the data processing node can be implemented, for example, by the following S407: the data link establishing device establishes the data link according to the data API interface parameters in the same network node.
[0103] For example, if a data requesting node and a data processing node are associated within the same network node, the data requesting node can directly obtain the required data from the data processing node of the node. Different modules within the same node can directly transfer data through the data API interface within the node.
[0104] Therefore, in this scenario 1, the data link establishing device can directly establish the data link according to the data API interface parameters in the same network node. After that, the data demanding node directly extracts the required data through the data API interface in the same network node.
[0105] In conjunction with Example 1 above, the data link establishment device establishes a data link between the data producer and the data consumer in network node A based on the data API interface in network node A. Afterwards, the data consumer in network node A can directly extract the required data through the data API interface in the data link.
[0106] Case 2: The associated data demand node and data processing node are located in different network nodes.
[0107] In case 2, the process of the data link establishing device establishing a data link between the data demand node and the data processing node can be implemented, for example, through the following S408: the data link establishing device establishes a data link based on the data API interface parameters of the network node to which the data processing node belongs, and the transmission links between different network nodes.
[0108] For example, if a data requesting node and a data processing node are located in different network nodes, the data requesting node cannot directly obtain the required data from its own node, but must obtain the required data from a network node different from the network node to which the data processing node belongs. Because different network nodes are connected via transmission links, the data link establishing device must consider the transmission link between network nodes in addition to the data API interface in the network node when establishing the data link, so that the data generated by the data processing node can be forwarded to the data requesting node via the data API interface and the transmission link.
[0109] In the embodiment of the present disclosure, the data link establishment device uses different methods to establish data links between the data demand node and the data processing node in different situations, so that the data link establishment device can select an appropriate method to establish the data link according to different situations.
[0110] In an embodiment of the present disclosure, after the data link establishment device establishes a data link, if the resource status of the data node in the network changes, the data link establishment device can also rearrange the data processing roles and establish the data link according to the changed resource status, which is described in detail below.
[0111] 1 , as shown in FIG5 , when the resource status changes, the data link establishing device may rearrange the data processing roles and the process of establishing the data link according to the updated resource status, for example, by the following S501 and S502 .
[0112] In S501, the data link establishing device obtains the changed resource status.
[0113] The resource status change includes: the resource status of the data node changes; or a new data node is added to the network, and the new data node has a new resource status.
[0114] In some embodiments, when the resource status in the network changes, the data plane proxy module in the network node where the resource status has changed can obtain the changed resource status of the network node and send the changed resource status to the data link establishment device.
[0115] As an example 2, in combination with example 1, a network node B is newly added to the network of example 2. The network node B only includes a data consumer module and a data plane proxy module.
[0116] After network node B is connected to the network, the data consumer module of network node B reports its data requirements to the data plane proxy module of network node B. For example, the data consumer module of network node B reports to the data plane proxy module of network node B that the type of data it requires is (Data_C), and the quantity of data required is: 1000 data items per day.
[0117] There is no data producer module in network node B, and the data production content is empty.
[0118] The data plane proxy module in network node B sends the data obtained from network node B to the data link establishment device. For example, the content sent by the data plane proxy module in network node B to the data link establishment device includes: data processing capability {producible data types are empty, production specifications are empty, storage specifications are empty}, data requirements {Data_C data, 1000 items per day}, and network node identifier {network node B, transmission address address_B}.
[0119] The data link establishing device determines whether the resource status in the current network has changed according to the requirements of the data consumer module of the network node B.
[0120] In S502 , when the link in the current network does not meet the changed resource status, the data link establishing device rearranges the data processing role of each data node in the network and re-establishes the data link in the network.
[0121] The process of the data link establishment device re-arranging the data processing roles of each data node in the network and re-establishing the data link in the network can refer to the above S101 to S103, and the process of the data link establishment device arranging the data processing roles of each data node in the network and establishing the data link in the network in S401 to S408, which will not be repeated in this disclosure.
[0122] As an example, referring to Example 2 above, after network node B is added to the network, the data demand of the data consumer module in network node B has not yet been met, and no data link exists in the network for the data consumer in network node B. In this case, the data link establishment device re-arranges the data processing roles of the various data nodes in the network and re-establishes the data link in the network.
[0123] For example, the data link establishment device determines that while the data producer in network node A is producing data for the data consumer in network node A, its remaining available resources can also meet the resource needs of the data consumer in network node B. In other words, the production capacity of the data producer in network node A, the data collection capacity of the data collection module, and the storage capacity of the data storage module can further meet the resource needs of the data consumer in network node B while meeting the resource needs of the data consumer in network node A.
[0124] At this point, the data link establishment device determines to arrange the data consumer in network node B as a data demand node, maintains the data producer in network node A as a data processing node, and the data consumer in network node A as a data demand node. The data link establishment device additionally establishes a data link between the data consumer in network node B and the data producer in network node A.
[0125] In some embodiments, the data link establishment device will further establish an association relationship between the data consumer in network node B and the data producer in network node A, and generate a first orchestration result for the data consumer in network node B, and update the second orchestration result for the data producer in network node A based on the needs of the data consumer in network node A and the needs of the data consumer in network node B.
[0126] The first orchestration result of the data consumer in network node B is used to indicate that its data demand can be met. The data consumer in network node B extracts the required amount of data Data_C from the data producer in network node A through the data API interface and the transmission link between network node A and network node B.
[0127] The updated second orchestration result of the data producer in network node A includes the data processing policies of the data consumers in network node A and the data processing policies of the data consumers in network node B. For example, the data processing policies in the updated second orchestration result of the data producer in network node A are as follows: produce data Data_A at a rate of 100 items per hour, producing 2,400 items per day, and storing 2,400 items of Data_A data per day; produce data Data_C at a rate of 50 items per hour, producing 1,200 items per day; store 1,200 items of Data_C data per day; provide an interface service for extracting Data_A data, and provide an interface service for extracting Data_C data; and forward Data_C from network node A to network node B.
[0128] The data link establishing device sends the updated second orchestration result to the data producer in the network node A, and sends the first orchestration result of the data consumer in the network node B to the data consumer in the network node B.
[0129] It should be noted that Example 2 above illustrates only the case where a new network node is added, causing a change in the resource status of the network. In practice, changes to data node resources within a network node also occur. For example, the data requirements of a data consumer within network node A may change, or the capabilities of a data producer or data service within network node A may change. This process can be understood by referring to the case where a new network node causes a change in the resource status of the network, and this disclosure will not elaborate on this further.
[0130] In the embodiment of the present disclosure, when the resource status in the network changes, the data link establishment device can rearrange the data processing roles of the data nodes and re-establish the link according to the changed resource status, thereby improving the flexibility and timeliness of processing data needs.
[0131] The data link establishment method executed by the data link establishment device in the embodiment of the present disclosure is described above in detail.
[0132] In addition, the network node in the present disclosure may also execute a corresponding data link establishment method, so that the network node performs data processing according to the arrangement result of the data link establishment device and the established link.
[0133] As shown in FIG6 , the data link establishment method provided by the embodiment of the present disclosure further includes the following S601 and S602 .
[0134] In S601 , the network node sends the resource status of the data nodes in the network so that the data processing role of each data node is arranged according to the resource status of each data node in the network and a data link in the network is established.
[0135] The data plane proxy module in each network node in the network obtains the resource status of the data node in the network node and reports it to the data link establishment device. The implementation process can refer to the description of the data plane proxy module in the previous article and will not be repeated here.
[0136] In S602 , the network node performs data processing according to the data processing role of the data node and the data link in the network.
[0137] In the disclosed embodiment, the network node reports the resource status to the data link establishment device, and performs data processing according to the data processing role arranged by the data link establishment device and the data link in the established network, which can make the nodes in the network easier to manage uniformly.
[0138] 6 , as shown in FIG7 , before the above S601 , data services may be pre-deployed in the network node. The method of deploying data services in the network node may be implemented, for example, through the following S701 and S702 .
[0139] In S701 , a network node obtains a data service deployed in the network node.
[0140] Data services include at least one of the following: data collection services, data storage services, data plane proxy services, data application programming interface API services, and data forwarding services;
[0141] In S702, the network node determines the resource status of the data node according to the correspondence between the data service in the network node and the data node in the network node.
[0142] For understanding data services in the network and the relationship between the resource status of data nodes and data services, please refer to the description of the relevant content in the previous article and will not be repeated here.
[0143] In the embodiment of the present disclosure, the data processing role of the data node in the network node can be a data processing node or a data demand node. In the case of different data processing roles of the data node, the network node performs data processing in different ways, which is explained in different scenarios below.
[0144] Scenario 1: The data processing role of the data node in the network node is the data processing node.
[0145] In scenario 1, the data processing node needs to produce data based on the link established by the data link establishment device and the orchestration result sent.
[0146] 7 , as shown in FIG8 , the process of data processing by the network node in scenario 1 includes the following S801 to S803 , which will be described in detail below.
[0147] S801: A network node receives a second orchestration result.
[0148] For understanding of the second arrangement result, reference may be made to the description in S404 and S502 above, which will not be repeated here.
[0149] S802: The network node adjusts the data processing strategy to a strategy executable by the data capability corresponding to the data processing node based on the data plane proxy module.
[0150] S803: The network node processes the target data based on the executable policy.
[0151] Executable policies include: data collection policies executable by the data collection service and data storage policies executable by the data storage service. In this case, the network node calls the data collection service to execute the data collection policy to collect the target data produced by the data processing node; the network node calls the data storage service to execute the storage policy to store the collected target data.
[0152] In addition, when the data demand node and the data processing node are associated in the same network node, the executable strategies also include: the data API interface strategy executable by the data API service; at this time, the network node calls the data API service to execute the data API interface strategy to forward the target data through the target API interface, and the target API interface is the API interface in the same network node.
[0153] As an example, in a case where a data demand node and a data processing node are associated in the same network node, in combination with Example 1 and the above S404, the data plane proxy module in network node A adjusts the second orchestration result of the data producer in network node A recorded in S404 and adjusts it into a policy executable by each module in network node A.
[0154] Illustratively, the executable policy obtained after the data plane proxy module adjusts the second orchestration result is shown in Table 1 below.
[0155] Table 1
[0156] Furthermore, when the associated data demand node and data processing node are located in different network nodes, the policies executable by the data capability also include: a data API interface policy executable by the data API service, and a data forwarding policy executable by the data forwarding service. In this case, the network node invokes the data API service to execute the data API interface policy, and invokes the data forwarding service to execute the data forwarding policy, to forward the target data via the target API interface and target transmission path. The target API interface is the API interface in the network node to which the data processing node belongs, and the target transmission path is the transmission path between different network nodes.
[0157] As another example, when the associated data demand node and data processing node are located in different network nodes, in combination with Example 2 and S502 above, the data plane proxy module in network node A adjusts the updated second orchestration result of the data producer in network node A recorded in S502, and adjusts it into an updated executable policy for each module in network node A.
[0158] Exemplarily, the updated executable policy obtained after the data plane proxy module adjusts the updated second orchestration result is shown in Table 2 below.
[0159] Table 2
[0160] Scenario 2: The data processing role of the data node in the network node is the data demand node.
[0161] In scenario 2, the data demanding node needs to obtain the required data based on the link established by the data link establishing device and the orchestration result sent.
[0162] 7 , as shown in FIG9 , the process of data processing by the network node in scenario 2 includes the following S901 and S902 , which are described in detail below.
[0163] In S901 , a network node receives a first orchestration result.
[0164] For understanding of the first arrangement result, reference may be made to the description in S404 and S502 above, which will not be repeated here.
[0165] In S902 , the network node verifies, based on the first orchestration result, whether the received data is data sent by a data processing node having an associated relationship.
[0166] In some embodiments, the first orchestration result indicates the network node identifier of the data producer associated with the data consumer. After receiving the first orchestration result, the data consumer extracts the network node identifier from the first orchestration result and, based on the network node identifier, verifies whether the data originates from the network node associated with the data producer. If so, verification succeeds. If not, verification fails.
[0167] In some further embodiments, after receiving the first orchestration result, the network node adjusts the first orchestration result into a policy executable by the data consumer module through the data plane proxy module, and sends it to the data consumer, so that the data consumer verifies the data according to the executable policy.
[0168] As an example, in a case where a data demand node and a data processing node are associated in the same network node, in combination with Example 1 and the above S404, with respect to the first orchestration result of the data consumer in network node A recorded in S404, the data plane proxy module in network node A adjusts the first orchestration result and adjusts it into a policy executable by the data consumer module in network node A.
[0169] Exemplarily, the executable policy obtained after the data plane proxy module adjusts the orchestration result in the first orchestration result of the data consumer in the network node A is shown in Table 3 below.
[0170] Table 3
[0171] As another example, when the associated data demand node and data processing node are located in different network nodes, in combination with Example 2 and the above S502, the data plane proxy module in network node B adjusts the first orchestration result of the data consumer in network node B recorded in S502, and adjusts the first orchestration result of the data consumer in network node B into an executable policy of the data consumer module in network node B.
[0172] Exemplarily, the data plane proxy module adjusts the first orchestration result of the data consumer in the network node B to obtain an executable policy as shown in Table 4 below.
[0173] Table 4
[0174] The above respectively describes the process of data processing by network nodes in the scenarios where the data nodes are data processing nodes and the data nodes are data demand nodes.
[0175] In some embodiments, when the data link establishment device sends an orchestration policy to a network node, the orchestration policies of all data nodes in the network node can be uniformly sent to the network node, and the data plane proxy module in the network node can perform unified adjustments.
[0176] As an example, in the case where a data demand node and a data processing node are associated in the same network node, in combination with Example 1 and the above S404, the data plane proxy module in network node A adjusts the first orchestration result of the data consumer in network node A and the second orchestration result of the data producer in network node A recorded in S404, and adjusts them into policies executable by various modules in network node A.
[0177] Exemplarily, the executable policy obtained after the data plane proxy module adjusts the first orchestration result of the data consumer in network node A and the second orchestration result of the data producer in network node A is shown in Table 5 below.
[0178] Table 5
[0179] As another example, when the associated data demand node and data processing node are located in different network nodes, in combination with Example 2 and S502 above, the data plane proxy module in network node A adjusts the first orchestration result of the data consumer in network node A and the updated second orchestration result of the data producer in network node A recorded in S502 to a policy executable by each module in network node A.
[0180] Exemplarily, the executable policy obtained after the data plane proxy module adjusts the first orchestration result of the data consumer in network node A and the updated second orchestration result of the data producer in network node A is shown in Table 6 below.
[0181] Table 6
[0182] As another example, when the associated data demand node and data processing node are located in different network nodes, in combination with Example 2 and the above S502, the data plane proxy module in network node B adjusts the first orchestration result of the data consumer in network node B recorded in S502 and adjusts it into an executable policy of the data consumer module in network node B.
[0183] Exemplarily, the data plane proxy module adjusts the first orchestration result of the data consumer in the network node B to obtain an executable policy as shown in Table 7 below.
[0184] Table 7
[0185] Since the network node B does not have a data service module and a data producer, the data plane proxy module does not have a corresponding second orchestration result.
[0186] It can be understood that, in combination with Tables 1 to 7 above, after the data plane agent module adjusts the orchestration results into executable policies for each module, it sends the corresponding executable policies to each module respectively, so that each model executes its corresponding executable policy.
[0187] It is understandable that, in order to implement the above functions, the communication device includes hardware structures and / or software modules corresponding to the execution of each function. It should be readily apparent to those skilled in the art that, in conjunction with the algorithmic steps of the various examples described in the embodiments of the present disclosure, the present disclosure can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present disclosure.
[0188] The embodiments of the present disclosure can divide the functional modules of the communication device according to the above-mentioned method embodiments. For example, each functional module can be divided corresponding to each function, or two or more functions can be integrated into one functional module. The above-mentioned integrated modules can be implemented in the form of hardware or software. It should be noted that the division of modules in the embodiments of the present disclosure is schematic and is only a logical functional division. In actual implementation, there may be other division methods. The following is an example of dividing each functional module corresponding to each function.
[0189] FIG10 is a schematic diagram of the structure of a communication device according to an embodiment of the present disclosure, which can execute the data link establishment method performed by the data link establishment device provided in the above method embodiment. As shown in FIG10 , the communication device includes: a communication unit 1001 and a processing unit 1002.
[0190] The communication unit 1001 is configured to determine the resource status of each data node in the network.
[0191] The processing unit 1002 is configured to arrange the data processing role of each data node according to the resource status of each data node.
[0192] The processing unit 1002 is further configured to establish a data link in the network according to the resource status of each data node and the data processing role of each data node.
[0193] In some embodiments, the processing unit 1002 is further configured to, for example, determine data services deployed in each network node. Data services include at least one of the following: a data collection service, a data storage service, a data plane proxy service, a data application programming interface (API) service, and a data forwarding service. The resource status of each data node is determined based on the correspondence between each data node in each network node and the data service in each network node.
[0194] In some embodiments, data processing roles include data processing nodes and data requesting nodes; resource states include resource availability and resource requirement. Processing unit 1002 is further configured to, for example, schedule data nodes with a resource availability status as data processing nodes and schedule data nodes with a resource requirement status as data requesting nodes.
[0195] In some embodiments, the processing unit 1002 is configured to establish associations between each data demanding node and each data processing node based on the resource requirements of each data demanding node and the available resources of each data processing node. The available resources of the associated data processing nodes are used to satisfy the resource requirements of the data demanding nodes.
[0196] In some embodiments, the processing unit 1002 is used, for example, to: establish a data link based on the data API interface parameters in the same network node when the data demand node and the data processing node have an associated relationship in the same network node; and establish a data link based on the data API interface parameters of the network node to which the data processing node belongs and the transmission link between different network nodes when the associated data demand node and the data processing node are in different network nodes.
[0197] In some embodiments, the processing unit 1002 is further configured to: after establishing an association relationship between each data demand node and each data processing node, the data link establishment method further comprises: generating a first orchestration result corresponding to each data demand node and a second orchestration result corresponding to each data processing node based on the association relationship between each data demand node and each data processing node. The first orchestration result is used to indicate the association relationship between the data demand node and the data processing node; the second orchestration result is used to indicate the data processing strategy for the data processing node to process the data demand of the data demand node with the association relationship. The corresponding first orchestration result is sent to each data demand node so that the data demand node determines the corresponding data processing node based on the first orchestration result; and the corresponding second orchestration result is sent to each data processing node so that the data processing node processes the data demand of the data demand node with the association relationship based on the data processing strategy in the second orchestration result.
[0198] In some embodiments, processing unit 1002 is further configured to obtain a changed resource state. If a link in the current network does not satisfy the changed resource state, the processing unit 1002 re-arranges the data processing roles of each data node in the network and re-establishes data links in the network. A change in resource state includes: a change in the resource state of a data node; or a new data node is added to the network, resulting in a new resource state for the new data node.
[0199] FIG11 is a schematic diagram of the structure of another communication device according to an embodiment of the present disclosure, which can execute the data link establishment method performed by the network node provided in the above method embodiment. As shown in FIG11 , the communication device includes: a communication unit 1101 and a processing unit 1102.
[0200] The communication unit 1101 is configured to send the resource status of the data nodes in the network so as to arrange the data processing role of each data node according to the resource status of each data node in the network and establish a data link in the network.
[0201] The processing unit 1102 is configured to perform data processing according to the data processing role of each data node in the network and the data links in the network.
[0202] In some embodiments, communication unit 1101 is further configured to obtain data services deployed in the network node. Data services include at least one of the following: data collection services, data storage services, data plane proxy services, data application programming interface (API) services, and data forwarding services. Processing unit 1102 is further configured to determine the resource status of the data node based on the correspondence between the data services in the network node and the data nodes in the network node.
[0203] In some embodiments, communication unit 1101 is further configured to receive a second orchestration result from the data link establishment device. The second orchestration result is used to indicate a data processing strategy for the data processing node to process data requests from associated data requesting nodes. The available resources of the data processing node satisfy the resource requests of the associated data requesting nodes. Processing unit 1102 is further configured to, based on the data plane proxy module, adjust the data processing strategy to a strategy executable by the data capabilities of the data processing node; and process target data based on the executable strategy.
[0204] In some embodiments, executable policies include: data collection policies executable by a data collection service, and data storage policies executable by a data storage service. Processing unit 1102 is configured to, for example, invoke the data collection service to execute the data collection policy to collect target data generated by the data processing node; and invoke the data storage service to execute the storage policy to store the collected target data.
[0205] In some embodiments, when a data request node and a data processing node are associated in the same network node, the executable policy also includes a data API interface policy executable by the data API service. Processing unit 1102 is further configured to call the data API service to execute the data API interface policy to forward target data through a target API interface, where the target API interface is an API interface in the same network node.
[0206] In some embodiments, when the associated data demand node and data processing node are located in different network nodes, the policies executable by the data capability also include: a data API interface policy executable by the data API service, and a data forwarding policy executable by the data forwarding capability. Processing unit 1102 is further configured to: call the data API service to execute the data API interface policy, and call the data forwarding service to execute the data forwarding policy, so as to forward the target data through the target API interface and the target transmission path. The target API interface is the API interface in the network node to which the data processing node belongs, and the target transmission path is the transmission path between different network nodes.
[0207] In some embodiments, communication unit 1101 is further configured to receive a first orchestration result. The first orchestration result indicates an association between a data requesting node and a data processing node. The available resources of the associated data processing node satisfy the resource requirements of the data requesting node. Processing unit 1102 is further configured to verify, based on the first orchestration result, whether the received data is data sent by the associated data processing node.
[0208] In the case of implementing the functions of the above-mentioned integrated modules in hardware, the embodiments of the present disclosure provide another structure of the communication device involved in the above-mentioned embodiments. As shown in Figure 12, the communication device includes: a processor 1202 and a bus 1204. In some embodiments, the communication device may also include a memory 1201; in some embodiments, the communication device may also include a communication interface 1203.
[0209] Processor 1202 may implement or execute the various exemplary logic blocks, modules, and circuits described in conjunction with the embodiments of this disclosure. Processor 1202 may be a central processing unit, a general-purpose processor, a digital signal processor, an application-specific integrated circuit, a field-programmable gate array, or other programmable logic device, a transistor logic device, a hardware component, or any combination thereof, and may implement or execute the various exemplary logic blocks, modules, and circuits described in conjunction with the embodiments of this disclosure. Processor 1202 may also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, and the like.
[0210] The communication interface 1203 is used to connect to other devices via a communication network, such as Ethernet, wireless access network, or wireless local area network (WLAN).
[0211] The memory 1201 may be a read-only memory (ROM) or other type of static storage device that can store static information and instructions, a random access memory (RAM) or other type of dynamic storage device that can store information and instructions, or an electrically erasable programmable read-only memory (EEPROM), a disk storage medium or other magnetic storage device, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited thereto.
[0212] As an implementation, the memory 1201 may exist independently of the processor 1202. The memory 1201 may be connected to the processor 1202 via a bus 1204 and used to store instructions or program codes. When the processor 1202 calls and executes the instructions or program codes stored in the memory 1201, the data link establishment method provided in the embodiment of the present disclosure can be implemented.
[0213] In another implementation, the memory 1201 may also be integrated with the processor 1202 .
[0214] Bus 1204 can be an Extended Industry Standard Architecture (EISA) bus, etc. Bus 1204 can be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, FIG12 shows only one thick line, but this does not mean that there is only one bus or only one type of bus.
[0215] Some embodiments of the present disclosure provide a computer-readable storage medium (e.g., a non-transitory computer-readable storage medium), which stores computer program instructions. When the computer program instructions are executed on a computer, the computer executes the data link establishment method described in any of the above embodiments.
[0216] Exemplarily, the above-mentioned computer-readable storage media may include, but are not limited to: magnetic storage devices (e.g., hard disks, floppy disks, or magnetic tapes, etc.), optical disks (e.g., compact disks (CDs), digital versatile disks (DVDs), etc.), smart cards, and flash memory devices (e.g., erasable programmable read-only memories (EPROMs), cards, sticks, or key drives, etc.). The various computer-readable storage media described in the present disclosure may represent one or more devices and / or other machine-readable storage media for storing information. The term "machine-readable storage medium" may include, but is not limited to, wireless channels and various other media capable of storing, containing, and / or carrying instructions and / or data.
[0217] An embodiment of the present disclosure provides a computer program product comprising instructions. When the computer program product is run on a computer, the computer is enabled to execute the data link establishment method described in any one of the above embodiments.
[0218] In the disclosed embodiment, a data link establishment device arranges the data processing roles of each data node in the network based on the resource status of each data node, and then establishes a data link based on the resource status and data processing role of the data node. In this way, when establishing a data link, the data link establishment device can simultaneously establish the data link based on the resource status and data processing role of the data node, thereby establishing a data link between a data producer and a data consumer whose data production capacity and data demand match, thereby increasing the rationality of the established data link.
[0219] The above is only a specific embodiment of the present disclosure, but the scope of protection of the present disclosure is not limited thereto. Any changes or replacements within the technical scope disclosed in the present disclosure should be included in the scope of protection of the present disclosure. Therefore, the scope of protection of the present disclosure should be based on the scope of protection of the claims.
Claims
1. A data link establishment method, comprising: Determine the resource status of each data node in the network; Arrange the data processing role of each of the data nodes according to the resource status of each of the data nodes; A data link in the network is established according to the resource status of each of the data nodes and the data processing role of each of the data nodes.
2. The method according to claim 1, wherein: Determining the resource status of each data node in the network includes: Determine the data services deployed in each network node, wherein the data services include: data collection service, data storage service, data plane proxy service, data application programming interface API service, and data forwarding service; The resource status of each of the data nodes is determined according to the corresponding relationship between each of the data nodes in the network nodes and the data services in the network nodes.
3. The method according to claim 2, wherein: The data processing roles include: data processing nodes and data demand nodes; The resource status includes: resource availability status and resource demand status; Arranging the data processing roles of the data nodes according to the resource status of the data nodes includes: Arrange the data node whose resource status is the resource available status as the data processing node; The data node whose resource status is the resource demand status is arranged as the data demand node.
4. The method according to claim 3, wherein: After arranging the data processing roles of the data nodes according to the resource status of the data nodes, the method further includes: Establishing an association relationship between each of the data demand nodes and each of the data processing nodes according to the resource demand of each of the data demand nodes and the resource availability of each of the data processing nodes; The available resources of the data processing nodes having the association relationship are used to meet the resource requirements of the data demand nodes.
5. The method according to claim 4, wherein: The step of establishing a data link in the network according to the resource status of each of the data nodes and the data processing role of each of the data nodes includes: In the case where the data demand node and the data processing node have the association relationship in the same network node, establishing the data link according to the data API interface parameters in the same network node; or In the case where the data demand node and the data processing node having the association relationship are located in different network nodes, the data link is established according to the data API interface parameters of the network node to which the data processing node belongs and the transmission link between the different network nodes.
6. The method according to claim 5, wherein: After establishing the association relationship between each of the data demand nodes and each of the data processing nodes, the method further includes: According to the association relationship between each of the data demand nodes and each of the data processing nodes, a first orchestration result corresponding to each of the data demand nodes and a second orchestration result corresponding to each of the data processing nodes are generated; wherein the first orchestration result is used to indicate the association relationship between the data demand node and the data processing node; and the second orchestration result is used to indicate the data processing strategy of the data processing node for processing the data demand of the data demand node with the association relationship; Sending the corresponding first orchestration result to each of the data demand nodes, so that the data demand node determines the corresponding data processing node according to the first orchestration result; The corresponding second orchestration result is sent to each of the data processing nodes, so that the data processing node processes the data demand of the data demand node having an associated relationship according to the data processing strategy in the second orchestration result.
7. The method according to claim 1, wherein: When the resource state changes, the method further includes: Get the changed resource status; When the links in the current network do not satisfy the changed resource status, rearrange the data processing roles of the data nodes in the network and re-establish the data links in the network; The resource status change includes: the resource status of the data node changes; or a new data node is added to the network, and the new data node has a new resource status.
8. A data link establishment method, applied to a network node, comprising: Sending resource status of data nodes in the network nodes, so that data processing roles of each data node in the network are arranged according to the resource status of each data node in the network, and a data link in the network is established; Data processing is performed according to the data processing role of each of the data nodes in the network and the data links in the network.
9. The method according to claim 8, wherein: Before sending the resource status of the data node in the network node, the method further includes: Acquire data services deployed in the network node; wherein the data services include: data collection services, data storage services, data plane proxy services, data application programming interface API services, and data forwarding services; The resource status of the data node is determined according to the corresponding relationship between the data service in the network node and the data node in the network node.
10. The method according to claim 9, further comprising: receiving a second arrangement result; The second orchestration result is used to indicate a data processing strategy for a data processing node to process a data demand of a data demand node having an associated relationship with the data processing node; wherein the available amount of resources of the data processing node satisfies the resource demand of the data demand node having an associated relationship; Invoke the data plane proxy service to adjust the data processing strategy to a strategy executable by the data capability corresponding to the data processing node; Based on the executable policy, the target data is processed.
11. The method according to claim 10, wherein: The executable policies include: data collection policies executable by the data collection service, and data storage policies executable by the data storage service; The processing of the target data based on the executable policy includes: Calling the data collection service to execute the data collection strategy to collect the target data produced by the data processing node; The data storage service is called to execute the data storage strategy to store the collected target data.
12. The method according to claim 11, wherein: The executable strategy also includes: a data API interface strategy executable by the data API service, and the method also includes: The data API service is called to execute the data API interface policy to forward the target data through a target API interface, where the target API interface is an API interface in the same network node.
13. The method according to claim 11, wherein: The executable policies also include: a data API interface policy executable by the data API service, and a data forwarding policy executable by the data forwarding service; The method further comprises: The data API service is called to execute the data API interface strategy, and the data forwarding service is called to execute the data forwarding strategy, so as to forward the target data through the target API interface and the target transmission path, wherein the target API interface is the API interface in the network node to which the data processing node belongs, and the target transmission path is the transmission path between different network nodes.
14. The method according to claim 9, further comprising: receiving a first arrangement result; The first orchestration result is used to indicate an association relationship between a data demand node and a data processing node; wherein the available resources of the data processing node having the association relationship meet the resource demand of the data demand node; Based on the first orchestration result, it is verified whether the received data is data sent by the data processing node having the association relationship.
15. A communication system, wherein: include: A data link establishing device and a plurality of network nodes; The data link establishment device is used to execute the data link establishment method according to any one of claims 1-7; any network node among the multiple network nodes is used to execute the data link establishment method according to any one of claims 8-14.
16. A communication device, wherein: include: Memory and processor; The memory is coupled to the processor; The memory is used to store instructions executable by the processor; When the processor runs the instructions, the method for establishing a data link according to any one of claims 1 to 14 is performed.
17. A computer-readable storage medium, wherein: The computer-readable storage medium stores computer instructions, and when the computer instructions are executed on a computer, the computer is enabled to execute the data link establishment method according to any one of claims 1 to 14.
Citation Information
Patent Citations
Data-centered distributed real-time session management method
CN109151006A
Data transmission device and data transmission system
CN113079113A
Information processing method, device and system, electronic equipment and storage medium
CN114915629A
Multi-dimensional data processing method and system based on stream and batch integration
CN116383201A
System for allocating resources for use in data processing operations
US20190235921A1