Data flow circulation method and device, electronic equipment, storage medium and computer program product

Abstract

The application discloses a data flow circulation method and device, electronic equipment, storage medium and computer program product. The method comprises the following steps: a first network equipment generates a first strategy based on a first contract between a data demander and a data provider of a first data product; the first contract represents the use agreement between the data demander and the data provider for the first data product; the first strategy represents the data use strategy matched with the first contract; a first work order containing the first strategy is generated; the first work order is pushed to a first data access node and a second data access node; the first data access node represents the data access node of the data demander, the first work order is used for the data use of the data demander based on the first strategy, and the second data access node represents the data access node of the data provider, the first work order is used for the data delivery of the data provider based on the first strategy.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of big data, and particularly relates to a data flow method and device, electronic equipment, storage medium and computer program product. BACKGROUND

[0002] In related technologies, data flow is conducted between data providers and data demanders based on a point-to-point mode, and in the case where there are multiple data providers and multiple data demanders, the data flow efficiency is low. SUMMARY

[0003] To solve the problems in related technologies, the present application provides a data flow method and device, electronic equipment, storage medium and computer program product.

[0004] The technical scheme of the present application is implemented as follows:

[0005] The present application provides a data flow method applied to a first network device, and the method comprises the following steps:

[0006] generating a first strategy based on a first contract between a data demander and a data provider of a first data product; the first contract represents an agreement on use of the first data product between the data demander and the data provider; and the first strategy represents a data use strategy matched with the first contract;

[0007] generating a first work order containing the first strategy;

[0008] pushing the first work order to a first data access node and a second data access node; wherein

[0009] the first data access node represents a data access node of the data demander, and the first work order is used for the data demander to use data based on the first strategy; and the second data access node represents a data access node of the data provider, and the first work order is used for the data provider to deliver data based on the first strategy.

[0010] In the above scheme, the first work order comprises an identifier of the first data access node and an identifier of the second data access node; and before the first work order is pushed to the first data access node and the second data access node, the method further comprises the following steps:

[0011] determining a first address of the first data access node based on the identifier of the first data access node; and

[0012] determining a second address of the second data access node based on the identifier of the second data access node.

[0013] In the above scheme, the first data access node is registered to the first network device, and the second data access node is registered to the second network device; correspondingly, based on the identifier of the second data access node, the second address of the second data access node is determined, including:

[0014] Broadcast the first request and receive the first response from the second network device; and / or,

[0015] Send a first request to the setting server and receive a first response returned by the setting server; wherein,

[0016] The first request is used to query the address of the second data access node; the first request carries the identifier of the second data access node; the first response carries the second address, and the setting server stores the addresses of all data access nodes.

[0017] The method in the above scheme further includes:

[0018] Receive a second request sent by one or more data access nodes; wherein...

[0019] The second request is used to request the registration of the corresponding data access node in the first network device; the second request carries one or more of the following related information of the corresponding data access node:

[0020] The address of the data access node;

[0021] The identifiers of the data requester and / or data provider corresponding to the data access node;

[0022] Identifier of the data access node.

[0023] The method in the above scheme further includes:

[0024] Send the first message to the designated server; among which,

[0025] The first information includes one or more related information of the data access node registered in the first network device and the identifier of the first network device.

[0026] In the above scheme, the first data product is published to the first data platform by the data provider, and the first network device supports interfacing with multiple data platforms; the method further includes:

[0027] Receive the first contract sent by the first data platform.

[0028] The method in the above scheme further includes:

[0029] The system receives a third request sent by the second data access node; the third request is used to request the publication of data in the first network device; the data published to the first network device is used by the first data product to provide data services.

[0030] This application also provides a data circulation system, including: a first network device and multiple data access nodes; the multiple data access nodes include one or more first data access nodes and one or more second data access nodes;

[0031] The first network device is used to perform the steps of any of the above methods.

[0032] This application also provides a data circulation device applied to a first network device, comprising:

[0033] The first generation unit is used to generate a first strategy based on a first contract between the data demander and the data provider of the first data product; the first contract represents the usage agreement between the data demander and the data provider regarding the first data product; the first strategy represents a data usage strategy that matches the first contract.

[0034] The second generation unit is used to generate a first work order containing the first strategy;

[0035] The push unit is used to push the first work order to the first data access node and the second data access node; wherein,

[0036] The first data access node represents the data access node of the data requester, and the first work order is used by the data requester to use data based on the first strategy. The second data access node represents the data access node of the data provider, and the first work order is used by the data provider to deliver data based on the first strategy.

[0037] This application also provides an electronic device, including: a first processor and a first communication interface; wherein,

[0038] The first processor is configured to generate a first strategy based on a first contract between a data requester and a data provider for a first data product; the first contract represents an agreement between the data requester and the data provider regarding the use of the first data product; the first strategy represents a data usage strategy matching the first contract; and...

[0039] Generate a first work order that includes the first strategy;

[0040] The first communication interface is used to push the first work order to the first data access node and the second data access node; wherein,

[0041] The first data access node represents the data access node of the data requester, and the first work order is used by the data requester to use data based on the first strategy. The second data access node represents the data access node of the data provider, and the first work order is used by the data provider to deliver data based on the first strategy.

[0042] This application also provides an electronic device, including: a first processor and a first memory for storing a computer program capable of running on the processor.

[0043] Wherein, when the first processor is used to run the computer program, it executes the steps of any of the above methods.

[0044] This application also provides a storage medium storing a computer program thereon, which, when executed by a processor, implements the steps of any of the above methods.

[0045] This application also provides a computer program product, including a computer program that, when executed by a processor, implements the steps of any of the above methods.

[0046] In this embodiment, the first network device generates a first strategy based on a first contract between the data requester and the data provider of the first data product, then generates a first work order containing the first strategy, and pushes the first work order to the first data access node and the second data access node. The first contract represents the usage agreement of the first data product between the data requester and the data provider; the first strategy represents the data usage strategy matched with the first contract; the first data access node represents the data access node of the data requester; the first work order is used by the data requester to use data based on the first strategy; the second data access node represents the data access node of the data provider; and the first work order is used by the data provider to deliver data based on the first strategy. In this scheme, the first network device generates a work order containing a data usage strategy for data requesters and data providers with cooperative intentions, and pushes the work order to the data access nodes of the data requester and the data provider respectively, so that the data provider can deliver data and the data requester can use data. Compared with related technologies, data flow can be achieved without establishing a point-to-point communication leased line between the data requester and the data provider, thus improving data flow efficiency. Attached Figure Description

[0047] Figure 1 A schematic diagram illustrating the implementation process of a data flow method provided in an embodiment of this application;

[0048] Figure 2 A schematic diagram of the overall architecture of a data circulation system provided for an application embodiment of this application;

[0049] Figure 3 A schematic diagram of the deployment architecture of a data circulation system provided for an application embodiment of this application;

[0050] Figure 4 A schematic diagram of the interaction flow of a data circulation method provided for an application embodiment of this application;

[0051] Figure 5 A schematic diagram of the deployment architecture of a second data circulation system provided for an application embodiment of this application;

[0052] Figure 6 A schematic diagram of the interaction flow of the second data circulation method provided for the application embodiments of this application;

[0053] Figure 7 A schematic diagram of the interaction flow of the third data circulation method provided in the application embodiments of this application;

[0054] Figure 8 This is a schematic diagram of the structure of a data circulation device provided in an embodiment of this application;

[0055] Figure 9 This is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of this application. Detailed Implementation

[0056] In the era of big data, data is experiencing explosive growth, making it necessary to promote data sharing and openness through data circulation to contribute to the development of the digital economy and society. Among related technologies, a point-to-point model facilitates data circulation between data providers and data demanders. Specifically, a point-to-point communication line is established between data providers and demanders with mutual data cooperation intentions to synchronize data usage methods and deliver and use data based on these methods. However, when multiple data providers and demanders exist, a separate point-to-point communication line needs to be established between each pair of interested parties, resulting in low data circulation efficiency.

[0057] Based on this, in this embodiment, the first network device generates a first strategy based on the first contract between the data requester and the data provider of the first data product, then generates a first work order containing the first strategy, and pushes the first work order to the first data access node and the second data access node. The first contract represents the usage agreement of the first data product between the data requester and the data provider; the first strategy represents the data usage strategy matched with the first contract; the first data access node represents the data access node of the data requester; the first work order is used by the data requester to use data based on the first strategy; the second data access node represents the data access node of the data provider; and the first work order is used by the data provider to deliver data based on the first strategy. In the above scheme, the first network device generates a work order containing a data usage strategy for data requesters and data providers with cooperative intentions, and pushes the work order to the data access nodes of the data requester and the data provider respectively, so that the data provider can deliver data and the data requester can use data. Compared with related technologies, data flow can be achieved without establishing a point-to-point communication leased line between the data requester and the data provider, thus improving data flow efficiency.

[0058] To facilitate understanding, the main concepts involved in the embodiments of this application will be explained first:

[0059] Data products: Products that use data as the content of transactions. For example, data products may be training datasets or API call services.

[0060] Data platform: A platform for transactions between data demanders and data providers; it can also be described as a data trading platform or a data circulation application. Specifically, this platform is used by data providers to publish data products and by data demanders to purchase data products. For example, a data platform can be an existing online data exchange or similar platform in related technologies.

[0061] In practical applications, data providers integrate the data they can provide into data products and publish these products on a data platform. The published data products are then displayed on the platform's pages. Data requesters, based on their needs, select data products from the published offerings through the data platform and reach a mutually agreed-upon usage agreement with the data provider. The data products selected by the data requester are thus the data products traded between the data requester and the data provider.

[0062] It should be noted that in practical applications, the transaction behavior between data requesters and data providers on a data platform only indicates that the two parties have a transaction intention, and does not equate to the realization of data circulation. Data circulation between the two parties is only realized after the data provider completes data delivery based on a data contract and the data requester uses the data delivered by the data provider.

[0063] Data contract: This records the agreement between the data requester and the data provider regarding the use of the traded data product. For example, the usage agreement in a data contract might state that the annual maximum number of calls to query interface 1 provided by the data provider is 1 million. In practice, data contracts can be generated by the data platform.

[0064] This application provides a data flow method applied to a first network device.

[0065] In practical applications, the first network device represents the core entity used to realize data circulation in the embodiments of this application. The network domain to which the first network device belongs can be described as the data element core network, data element cloud, or data element circulation management layer, etc. Correspondingly, the first network device can also be described as a data element core network device, data element cloud device, or data element circulation management layer device, etc.

[0066] Data demanders and data providers can access the first network device through data access nodes.

[0067] After the data provider connects to the first network device through the data access node, the data provider can publish its available data to the first network device through the data access node. The data published to the first network device can then be used by the data provider to publish data products on the data platform, and subsequently, to provide data services through those products. The data provider can also deliver data through the data access node.

[0068] After the data requester connects to the first network device through the data access node, the data requester can use the data delivered by the data provider through the data access node.

[0069] In this embodiment of the application, the data access node includes:

[0070] The first data access node represents the data access node of the data demander.

[0071] The second data access node represents the data access node of the data provider.

[0072] In practical applications, data requesters access the first network device through the first data access node, while data providers access the first network device through the second data access node.

[0073] In practical applications, the first data access node and the second data access node can be registered to the same first network device or to different first network devices. Different first network devices can represent first network devices located in network domains in different regions.

[0074] In practical applications, data access nodes can have security verification functions to prevent attackers from accessing the first network device through the data access node. Therefore, data access nodes can also be described as trusted data access nodes.

[0075] Reference Figure 1 The data flow method provided in this application includes:

[0076] Step 101: Generate a first strategy based on the first contract between the data demander and the data provider of the first data product;

[0077] The first contract represents the agreement between the data demander and the data provider regarding the use of the first data product; the first strategy represents the data use strategy that matches the first contract.

[0078] Here, the first data product can be understood as the data product purchased by the data demander, and the first contract can be understood as the data contract between the data demander and the data provider regarding the first data product.

[0079] In practical applications, the first contract may include one or more of the following information: the identifiers of the data requester and / or the data provider, the identifiers of the first data access node and / or the second data access node, information representing the usage agreement between the data requester and the data provider regarding the first data product, and descriptive information corresponding to the first data product.

[0080] Here, the first strategy matches the first contract. In practical applications, the computer program can identify and execute the first strategy to ensure the implementation of the usage agreement corresponding to the first contract.

[0081] It should be noted that both the first contract and the first strategy can characterize the agreement between the data demander and the data provider regarding the use of the first data product. However, the first contract focuses on describing the agreement semantically, while the first strategy focuses on expressing the agreement strategically in the context of a computer program.

[0082] Step 102: Generate the first work order containing the first strategy.

[0083] The first work order is used by the data requester to use the data based on the first strategy, and the first work order is used by the data provider to deliver the data based on the first strategy.

[0084] Here, the first work order includes the first strategy. In practical applications, the first work order may also include one or more of the following information: the identifiers of the data requester and / or data provider, and the identifiers of the first data access node and / or the second data access node.

[0085] Step 103: Push the first work order to the first data access node and the second data access node.

[0086] In practical applications, data providers can deliver data through a second data access node. Specifically, after receiving a first work order pushed by the first network device, the second data access node connects to the data source configured by the data provider, reads the data that needs to be delivered to the data requester from the data source, and then provides the data to the data requester by providing data services. For example, the data service can be either the data provider actively sending data to the data requester, or it can be data returned based on the data requester's call to an interface provided by the data provider.

[0087] In practical applications, data requesters can use data through the first data access node. Specifically, after receiving the first work order pushed by the first network device, the first data access node can receive data provided by the data provider and execute the operations instructed by the data requester on the received data. It should be noted that data use here includes operations such as reading, modifying, and analyzing data. Receiving data is equivalent to reading the data; therefore, the data requester receiving data from the data provider through the first data access node can also be considered as the data requester using the data.

[0088] In practical applications, during the process of the second data access node providing data services, the first network device can perform policy monitoring based on the first policy in the first work order. This ensures that the second data access node provides data services to the data requester in accordance with the data usage agreement represented by the first policy, and also ensures that the first data access node uses the data delivered by the data provider in accordance with the first policy. The first data access node can also report its own usage information, such as the number of interface calls, during data usage to improve the accuracy of policy monitoring by the first network device.

[0089] For example, if the data product selected by the data requester is the query interface 1 call service, and the first contract between the data requester and the data provider represents the data usage agreement as follows: the annual call limit for query interface 1 is 1 million times, and the first network device generates a first work order based on this first contract and pushes the first work order to the first data access node and the second data access node, then the first data access node can call query interface 1 based on the first work order and report the number of calls to the first network device. The second data access node can, based on the first work order, instruct query interface 1 to respond to the data requester's call and return data to the data requester. The first network device can perform policy monitoring based on the first policy in the first work order. If the annual call volume of query interface 1 by the first data access node does not exceed 1 million times, the call to query interface 1 by the first data access node is allowed; if the annual call volume of query interface 1 by the first data access node exceeds 1 million times, the call to query interface 1 by the first data access node is prohibited. After receiving the data delivered by the second data access node, the first data access node can perform subsequent processing on the received data according to the instructions of the data requester. It can be seen that the first network device scheduled the data flow between the data provider and the data demander through the first work order.

[0090] In this embodiment, the first network device generates work orders containing data usage strategies for data requesters and data providers with cooperative intentions, and pushes these work orders to the data access nodes of the data requester and data provider respectively. This allows the data provider to deliver data and the data requester to use data. It is understood that by pushing these work orders, the first network device can push multiple different work orders to the corresponding data requester and data provider. That is, even when there are multiple data providers and multiple data requesters, it is not necessary to establish a point-to-point communication line between each pair of data providers and data requesters with cooperative intentions, and data flow between the supply and demand sides can still be coordinated. Therefore, the solution provided in this embodiment improves data flow efficiency compared to related technologies.

[0091] The following is a detailed explanation of how the first work order is pushed out.

[0092] In one embodiment, before pushing the first work order to the first data access node and the second data access node, the method further includes:

[0093] Based on the identifier of the first data access node, determine the first address of the first data access node; and,

[0094] The second address of the second data access node is determined based on its identifier.

[0095] The first work order includes: the identifier of the first data access node and the identifier of the second data access node.

[0096] In practical applications, the first network device can push a first work order to the first data access node based on a first address, and push a first work order to the second data access node based on a second address. Both the first and second addresses can be considered as the addresses of the data access nodes.

[0097] In practical applications, data access nodes can send their own relevant information to the first network device, including the data access node's address. Based on this,

[0098] In one embodiment, the method further includes:

[0099] Receive a second request sent by one or more data access nodes; wherein...

[0100] The second request is used to request the registration of the corresponding data access node in the first network device; the second request carries one or more of the following related information of the corresponding data access node:

[0101] The address of the data access node;

[0102] The identifiers of the data requester and / or data provider corresponding to the data access node;

[0103] Identifier of the data access node.

[0104] Here, one or more related information carried in the second request can be regarded as the registration information of the corresponding data access node. In practical applications, the address information in the registration information may include: the Internet Protocol (IP) address and port information of the data access node.

[0105] In practical applications, after obtaining the registration information carried in the second request, the first network device can store the registration information locally on the first network device, thereby completing the registration of the data access node with the first network device. After the data access node registers with the first network device, the data requester and / or data provider can access the first network device through the data access node.

[0106] In practical applications, when the first data access node and the second data access node are registered in the same first network device, the first network device can directly determine the address that matches the identifier of the first data access node as the first address and the address that matches the identifier of the second data access node as the second address based on the registration information stored locally.

[0107] When the first data access node and the second data access node are registered on different first network devices, the first network device needs to determine the address of the data access node in a different way than in the previous case. An example is provided below for illustration.

[0108] In one embodiment, a first data access node is registered to a first network device, and a second data access node is registered to a second network device; correspondingly, determining the second address of the second data access node based on its identifier includes:

[0109] Broadcast the first request and receive the first response from the second network device; and / or,

[0110] Send a first request to the configuration server and receive a first response from the configuration server; wherein,

[0111] The first request is used to query the address of the second data access node; the first request carries the identifier of the second data access node; the first response carries the second address, indicating that the server stores the addresses of all data access nodes.

[0112] In practical applications, the purchase behavior of data demanders triggers the generation of data contracts and subsequent data delivery. Therefore, the work order is usually pushed by the data access node of the data demander, that is, the first network device to which the first data access node is registered.

[0113] Here, the first data access node is registered with the first network device. Therefore, in practical applications, the first network device can determine the address that matches the identifier of the first data access node as the first address based on the registration information of the first data access node stored locally.

[0114] The second data access node is registered to the second network device. In practical applications, the second network device can be understood as any other first network device besides the first network device to which the first data access node is registered.

[0115] Here, the first network device can obtain the second address in the following two ways:

[0116] Method 1: The first network device broadcasts the first request and receives the first response from the second network device.

[0117] In practical applications, the first network device can broadcast the first request to all other first network devices besides itself. It is understood that the broadcast targets of the first network device include the second network device.

[0118] In practical applications, all broadcast devices can query the second address based on their locally stored registration information after receiving the first request. Since the second data access node is registered with the second network device, the second network device can, during the query process, determine the address matching the identifier of the second data access node as the second address based on its locally stored registration information, and then return a first response to the first network device to which the first data access node is registered. This first response carries the determined second address.

[0119] Method 2: The first network device sends a request to the configuration server and receives a first response from the configuration server. The configuration server stores the addresses of all data access nodes.

[0120] Here, all data access nodes can be all data access nodes that have been registered in all the first network devices.

[0121] In practical applications, the server can be set up together with a primary network device or deployed independently.

[0122] In one embodiment, the method further includes:

[0123] Send the first message to the designated server.

[0124] The first information includes one or more relevant information items of the data access node registered in the first network device and the identifier of the first network device.

[0125] Here, after receiving the registration information sent by the data access node, the first network device continues to report the registration information to the configuration server, thereby enabling the configuration server to store the relevant information of all data access nodes.

[0126] In practical applications, after receiving the first information, the server can store the first information locally on the server.

[0127] In this embodiment, the first network device determines the address of the data access node based on the identifier of the data access node, and then pushes the work order to the data access node based on the determined address, so that the data provider can deliver the data and the data demander can use the data. Compared with related technologies, in the case of multiple data providers and multiple data demanders, it is not necessary to establish a point-to-point communication line between each pair of data providers and data demanders with cooperative intentions, and it can also schedule the data flow between the supply and demand parties, thereby improving the data flow efficiency.

[0128] The method for obtaining the first contract will be explained below.

[0129] In practical applications, the first contract can be generated by the data platform and sent to the first network device by the data platform. Based on this,

[0130] In one embodiment, the data flow method provided in this application further includes:

[0131] Receive the first contract sent by the first data platform.

[0132] Here, the first data products are published by the data provider to the first data platform, and the first network equipment supports connection to multiple data platforms.

[0133] In practical applications, before publishing data products on a data platform, data providers can first connect the corresponding data to the platform. This allows them to manage the data and then publish it as a data product based on business needs. Therefore,

[0134] In one embodiment, the method further includes:

[0135] Receive the third request sent by the second data access node.

[0136] The third request is used to request the publication of data in the first network device; the data published to the first network device is used by the first data product to provide data services.

[0137] In practical applications, a third request for publishing data may carry one or more of the following related information: the identifier of the data provider, the identifier of the second data access node, metadata information, and metadata category. This one or more related information can also be described as data publishing information.

[0138] Metadata information refers to the descriptive information of the data. For example, metadata information may include: the table structure corresponding to the data, the amount of data, etc. Metadata category refers to the category to which the data belongs. For example, if the category is divided according to industry, the metadata category may be: power industry or transportation industry, etc.

[0139] In practical applications, the second data access node can connect to the data source configured by the data provider and read the data publication information of each data point from the data source. Then, the data provider can select the data to be published based on business needs. Subsequently, the second data access node, based on the data provider's selection, sends the data publication information of the data to be published in a third request to the first network device. It should be noted that the data publication information does not include the actual data to be delivered to the data requester; this actual data is only read when the second data access node performs data delivery.

[0140] After receiving a third request, the first network device can store the data publishing information carried in the third request locally, thereby enabling the data to be published in the first network device.

[0141] In practical applications, the first network device can connect the published data to all data platforms connected to the network. Specifically, this can involve synchronizing information carried in a third request to the connected data platforms. The data provider then manages this published data on the data platforms and subsequently releases data products based on business needs.

[0142] For example, if a data provider publishes data 1, data 2, and data 3 to a first network device, and the first network device is connected to data platform 1 and data platform 2, then the data provider can manage data 1, data 2, and data 3 on both data platform 1 and data platform 2. Management can be performed by viewing descriptive information, grouping, and other operations on the data. For instance, the data provider can view the descriptive information of these published data on data platform 1, merge data 1 and data 2 into the same category, and then publish the data of that category as a data product on data platform 1.

[0143] Understandably, different data platforms may employ different access standards. In related technologies, data flow based on a point-to-point model requires data access to each data platform that a data requester might access. This necessitates data providers adapting to each platform, a cumbersome process that reduces data flow efficiency. However, in this embodiment, the first network device supports interfacing with multiple data platforms. Data providers only need to publish their data to the first network device to connect to the data platforms, simplifying the operation and further improving data flow efficiency.

[0144] In one embodiment, the method further includes: generating a data catalog based on the published data, the data catalog representing a list of descriptions of the published data.

[0145] In practical applications, a data catalog can include one or more of the following information related to all published data: the data provider's identifier, the identifier of the second data access node, metadata information, and metadata categories. A data catalog can improve the efficiency of data providers in managing published data, thereby further enhancing data flow efficiency.

[0146] In one embodiment, the method further includes: generating a data product catalog based on published data products. The data product catalog represents a list of descriptions of the published data products.

[0147] In practical applications, a data product catalog can include one or more of the following information for all published data products: the data provider's identifier, the identifier of the second data access node, and product description information. A data product catalog can improve the efficiency of data providers in managing published data products and enhance the efficiency of data demanders in selecting data products, thereby further improving data circulation efficiency.

[0148] In practical applications, data product catalogs can also be generated by the data platform.

[0149] Based on the above method embodiments, this application also provides a data circulation system, including: a first network device and multiple data access nodes.

[0150] The plurality of data access nodes includes one or more first data access nodes and one or more second data access nodes. The first network device is used to execute the methods provided by one or more technical solutions in the above method embodiments.

[0151] In practical applications, this data circulation system can have multiple first network devices, and different first network devices can represent first network devices set up in network domains in different regions. The first data access node and the second data access node can be registered to the same first network device or to different first network devices.

[0152] In practical applications, this data circulation system may also include: computing network infrastructure, data sources, and one or more data platforms.

[0153] The computing network infrastructure provides network resources, computing power resources, and storage resources for data circulation. The data source is configured by the data provider to provide data, which can be multi-source and multi-dimensional; for example, the data source can be a database.

[0154] In this embodiment, the first network device in the data circulation system generates a work order containing a data usage strategy for data demanders and data providers with cooperative intentions, and pushes the work order to the data access nodes of the data demanders and data providers respectively, so that the data providers can deliver data and the data demanders can use data. Compared with related technologies, data circulation can be achieved without establishing a point-to-point communication leased line between the data demanders and data providers, thus improving the efficiency of data circulation.

[0155] The present application will be further described in detail below with reference to application examples.

[0156] This application provides a data circulation system through its application embodiments, referring to... Figure 2The data circulation system includes: computing network infrastructure, data sources, data access nodes, core network equipment for data elements, and data application layer.

[0157] The data element core network equipment is equivalent to the first network device in this embodiment. In practical applications, the data element core network equipment mainly includes: a data management module, a data service scheduling module, and a data service scheduling agent module. The data application layer includes multiple data circulation applications, which are equivalent to the data platform in this embodiment.

[0158] The data circulation system provided in this application embodiment can circulate data based on the following deployment architecture.

[0159] Architecture 1: Reference Figure 3 The data access nodes of the data demander and the data provider are registered on the same data element core network device. For ease of description, the data access node of the data demander will be referred to as the first data access node, and the data access node of the data provider will be referred to as the second data access node.

[0160] Reference Figure 4 The interaction process of data circulation in the data circulation system based on Architecture 1 mainly includes the following steps:

[0161] Step 1: Data access nodes register with the data element core network equipment.

[0162] Specifically, this step may involve the data access node sending a registration request to the data element core network device, the registration request carrying the registration information of the data access node requesting registration. Here, the registration request is equivalent to the second request in the embodiments of this application.

[0163] Step 2: The data service scheduling agent module saves the registration information of the data access nodes.

[0164] Step 3: The second data access node reads the data source information.

[0165] Here, the data source information is equivalent to the data publishing information in the embodiments of this application.

[0166] Step 4: The second data access node publishes data to the data element core network equipment.

[0167] Specifically, the second data access node can select the data to be published based on the data publication information read from the data source, and send the data publication information of the data to be published to the data element core network equipment.

[0168] Step 5: The data directory submodule in the data management module generates the data directory.

[0169] Specifically, the data catalog submodule can save the data publishing information sent by the second data access node locally and generate a data catalog based on the data publishing information.

[0170] Step 6: The data provider publishes the data product to data circulation applications.

[0171] Step 7: Data circulation applications generate a data product catalog based on the published data products.

[0172] Step 8: The data demander accesses the data circulation application, which generates a data contract based on the data products selected by the data demander.

[0173] Here, the data contract is equivalent to the first contract in the embodiments of this application.

[0174] Step 9: The data circulation application distributes the data contract to the data contract sub-module in the data management module.

[0175] Step 10: The data contract submodule saves the data contracts issued by the data circulation application, generates data usage strategies based on the data contracts, and then saves the data usage strategies in the data usage strategy submodule of the data management module.

[0176] Here, the data usage strategy is equivalent to the first strategy in the embodiments of this application.

[0177] Step 11: The data usage strategy submodule pushes the data usage strategy to the delivery scheduling submodule of the data service scheduling module.

[0178] Step 12: The delivery scheduling submodule generates a data delivery work order based on the data usage strategy.

[0179] Here, the data delivery work order is equivalent to the first work order in the embodiments of this application.

[0180] Step 13: The delivery scheduling submodule pushes the data delivery work order to the routing and addressing submodule in the data service scheduling agent module.

[0181] Step 14: The routing submodule performs routing based on the data delivery work order.

[0182] Specifically, the routing and addressing submodule can determine the address of the first data access node and the address of the second data access node based on the registration information stored locally by the data delivery work order and the data service scheduling agent module.

[0183] Step 15: The routing addressing submodule pushes data delivery work orders to the first data access node and the second data access node.

[0184] Step 16: Data delivery and data usage.

[0185] Specifically, this step may involve the service management module of the second data access node delivering data based on a data usage policy, and the service management module of the first data access node using the data delivered by the second data access node based on a data delivery policy.

[0186] Architecture 2: Reference Figure 5 The data access nodes of the data demander and the data access nodes of the data provider are registered on different data element core network devices. The primary data service scheduling agent is equivalent to the designated server in this embodiment.

[0187] For ease of description, the data access node of the data demander will be referred to as the first data access node, and the data access node of the data provider will be referred to as the second data access node. The data element core network equipment to which the first data access node is registered will be referred to as the data element core network equipment on the demand side, and the modules in the data element core network equipment on the demand side will be referred to as modules on the demand side. The data element core network equipment to which the second data access node is registered will be referred to as the data element core network equipment on the provider side, and the modules in the data element core network equipment on the provider side will be referred to as modules on the provider side.

[0188] Reference Figure 6 Without deploying a primary data service scheduling agent, the interaction process of the data circulation system based on Architecture 2 when conducting data circulation mainly includes the following steps:

[0189] Step 1: The data demander accesses the data circulation application, and the data circulation application generates a data contract based on the data products selected by the data demander.

[0190] Step 2: The data circulation application sends the first contract to the data contract submodule on the demand side.

[0191] Step 3: The data contract submodule on the demand side stores the data contracts issued by the data circulation application, generates data usage strategies based on the data contracts, and then stores the data usage strategies in the data usage strategy submodule of the data management module on the demand side.

[0192] Step 4: The data usage strategy submodule on the demand side pushes the data usage strategy to the delivery scheduling submodule of the data service scheduling module on the demand side.

[0193] Step 5: The delivery scheduling submodule on the demand side generates a data delivery work order based on the data usage strategy.

[0194] Step 6: The delivery scheduling submodule on the demand side pushes the data delivery work order to the routing and addressing submodule in the data service scheduling agent module on the demand side.

[0195] Step 7: The routing submodule on the demand side performs routing based on the data delivery work order.

[0196] Step 7 includes:

[0197] Step 7a: The routing and addressing submodule on the demand side broadcasts an address query request to all data element core network devices. Here, the address query request is equivalent to the first request in the embodiment of this application.

[0198] Step 7b: The routing submodule on the provider side returns the address of the second data access node to the routing submodule on the demand side.

[0199] In this way, the routing and addressing submodule on the demand side can determine the address of the second data access node.

[0200] In practical applications, the routing and addressing submodule on the demand side can also determine the address of the first data access node based on the registration information stored locally by the data service scheduling agent module on the demand side.

[0201] Step 8: The routing and addressing submodule on the demand side pushes the data delivery work order to the first data access node and the second data access node.

[0202] Step 9: Data delivery and data usage.

[0203] It should be noted that, in order to highlight the key steps of data circulation when the data circulation system performs data circulation based on architecture 2 without deploying a first-level data service scheduling agent, the above interaction process omits the steps related to data access nodes registering with data element core network equipment and data providers publishing data products. The omitted steps can be referred to steps 1 to 7 in the interaction process corresponding to architecture 1 above.

[0204] Reference Figure 7 With a primary data service scheduling agent already deployed, the interaction process of the data circulation system based on Architecture 2 when conducting data circulation mainly includes the following steps:

[0205] Step 1: Data access nodes register with the data element core network equipment.

[0206] Specifically, this step may involve the data access node sending a registration request to the data element core network device, the registration request carrying the registration information of the data access node requesting registration. Here, the registration request is equivalent to the second request in the embodiments of this application.

[0207] Step 2: The data service scheduling agent module of the data element core network equipment reports the registration information of the data access node to the first-level data service scheduling agent.

[0208] Step 3: The primary data service scheduling agent saves the registration information reported by the core network devices of data elements locally.

[0209] Step 4: The data contract submodule on the demand side stores the data contracts issued by the data circulation application, generates data usage strategies based on the data contracts, and then stores the data usage strategies in the data usage strategy submodule of the data management module on the demand side.

[0210] Step 5: The data usage strategy submodule on the demand side pushes the data usage strategy to the delivery scheduling submodule of the data service scheduling module on the demand side.

[0211] Step 6: The delivery scheduling submodule on the demand side generates a data delivery work order based on the data usage strategy.

[0212] Step 7: The delivery scheduling submodule on the demand side pushes the data delivery work order to the routing and addressing submodule in the data service scheduling agent module on the demand side.

[0213] Step 8: The routing submodule on the demand side performs routing based on the data delivery work order.

[0214] Step 8 includes:

[0215] Step 8a: The routing and addressing submodule on the demand side sends an address query request to the first-level data service scheduling agent. Here, the address query request is equivalent to the first request in the embodiment of this application.

[0216] Step 8b: The primary data service scheduling agent returns the address of the second data access node to the routing and addressing submodule on the demand side.

[0217] In this way, the routing and addressing submodule on the demand side can determine the address of the second data access node.

[0218] In practical applications, the routing and addressing submodule on the demand side can also determine the address of the first data access node based on the registration information stored locally by the data service scheduling agent module on the demand side.

[0219] Step 9: The routing and addressing submodule on the demand side pushes the data delivery work order to the first data access node and the second data access node.

[0220] Step 10: Data delivery and data usage.

[0221] It should be noted that, in order to highlight the key steps of the data circulation system based on architecture 2 when a first-level data service scheduling agent has been deployed, the steps related to the data provider publishing data products and the data demander selecting data products have been omitted in the above process. The omitted steps can be referred to steps 3 to 9 in the interaction process corresponding to architecture 1 above.

[0222] In the application embodiments of this application, the data element core network equipment in the data circulation system generates work orders containing data usage strategies for data demanders and data providers with cooperative intentions, and pushes the work orders to the data access nodes of the data demanders and data providers respectively, so that the data providers can deliver data and the data demanders can use data. Compared with related technologies, data circulation can be achieved without establishing a point-to-point communication leased line between the data demanders and data providers, thus improving the efficiency of data circulation.

[0223] Based on the embodiments described above, this application also provides a data circulation device applied to a first network device, referring to... Figure 8 The data circulation device includes:

[0224] First generation unit 81: used to generate a first strategy based on a first contract between a data demander and a data provider for a first data product; the first contract represents the agreement between the data demander and the data provider on the use of the first data product; the first strategy represents a data usage strategy that matches the first contract;

[0225] Second generation unit 82: used to generate a first work order containing the first strategy;

[0226] Push unit 83: used to push the first work order to the first data access node and the second data access node; wherein,

[0227] The first data access node represents the data access node of the data requester, and the first work order is used by the data requester to use data based on the first strategy. The second data access node represents the data access node of the data provider, and the first work order is used by the data provider to deliver data based on the first strategy.

[0228] In one embodiment, the first work order includes: the identifier of the first data access node and the identifier of the second data access node; before the push unit 83 pushes the first work order to the first data access node and the second data access node, the method further includes:

[0229] Based on the identifier of the first data access node, determine the first address of the first data access node; and,

[0230] Based on the identifier of the second data access node, the second address of the second data access node is determined.

[0231] In one embodiment, the first data access node is registered to the first network device, and the second data access node is registered to the second network device; correspondingly, the push unit 83 determines the second address of the second data access node based on the identifier of the second data access node, including:

[0232] Broadcast the first request and receive the first response from the second network device; and / or,

[0233] Send a first request to the setting server and receive a first response returned by the setting server; wherein,

[0234] The first request is used to query the address of the second data access node; the first request carries the identifier of the second data access node; the first response carries the second address, and the setting server stores the addresses of all data access nodes.

[0235] In one embodiment, the data circulation device further includes a receiving unit, the receiving unit being used for:

[0236] Receive a second request sent by one or more data access nodes; wherein...

[0237] The second request is used to request the registration of the corresponding data access node in the first network device; the second request carries one or more of the following related information of the corresponding data access node:

[0238] The address of the data access node;

[0239] The identifiers of the data requester and / or data provider corresponding to the data access node;

[0240] Identifier of the data access node.

[0241] In one embodiment, the data circulation device further includes a sending unit, the sending unit being used for:

[0242] Send the first message to the designated server; among which,

[0243] The first information includes one or more related information of the data access node registered in the first network device and the identifier of the first network device.

[0244] In one embodiment, the first data product is published to the first data platform by the data provider, the first network device supports interfacing with multiple data platforms, and the receiving unit is further configured to:

[0245] Receive the first contract sent by the first data platform.

[0246] In one embodiment, the receiving unit is further configured to:

[0247] The system receives a third request sent by the second data access node; the third request is used to request the publication of data in the first network device; the data published to the first network device is used by the first data product to provide data services.

[0248] In practical applications, the first generation unit 81, the second generation unit 82, the push unit 83, the receiving unit, and the sending unit can all be implemented by the processor in the data circulation device.

[0249] It should be noted that the data circulation device provided in the above embodiments is only illustrated by the division of the above program modules during data circulation. In actual applications, the above processing can be assigned to different program modules as needed, that is, the internal structure of the device can be divided into different program modules to complete all or part of the processing described above. In addition, the data circulation device and the data circulation method embodiments provided in the above embodiments belong to the same concept, and their specific implementation process can be found in the method embodiments, which will not be repeated here.

[0250] Based on the hardware implementation of the above program modules, and in order to implement the method of the embodiments of this application, this application also provides an electronic device, such as... Figure 9 As shown, the electronic device includes:

[0251] The first communication interface 1 is capable of exchanging information with other devices;

[0252] The first processor 2 is connected to the first communication interface 1 to enable information interaction with other devices. When running a computer program, it executes the methods provided by one or more technical solutions in the above embodiments. The computer program is stored in the first memory 3.

[0253] Specifically, the first processor 2 is used to generate a first strategy based on a first contract between the data demander and the data provider of the first data product; the first contract represents the usage agreement between the data demander and the data provider regarding the first data product; the first strategy represents a data usage strategy that matches the first contract.

[0254] Generate a first work order that includes the first strategy;

[0255] The first work order is pushed to the first data access node and the second data access node; wherein...

[0256] The first data access node represents the data access node of the data requester, and the first work order is used by the data requester to use data based on the first strategy. The second data access node represents the data access node of the data provider, and the first work order is used by the data provider to deliver data based on the first strategy.

[0257] In one embodiment, the first work order includes: the identifier of the first data access node and the identifier of the second data access node; before the first processor 2 pushes the first work order to the first data access node and the second data access node, the method further includes:

[0258] Based on the identifier of the first data access node, determine the first address of the first data access node; and,

[0259] Based on the identifier of the second data access node, the second address of the second data access node is determined.

[0260] In one embodiment, the first data access node is registered to the first network device, and the second data access node is registered to the second network device; correspondingly, the first processor 2 determines the second address of the second data access node based on the identifier of the second data access node, including:

[0261] Broadcast the first request and receive the first response from the second network device; and / or,

[0262] Send a first request to the setting server and receive a first response returned by the setting server; wherein,

[0263] The first request is used to query the address of the second data access node; the first request carries the identifier of the second data access node; the first response carries the second address, and the setting server stores the addresses of all data access nodes.

[0264] In one embodiment, the first communication interface 1 is used for:

[0265] Receive a second request sent by one or more data access nodes; wherein...

[0266] The second request is used to request the registration of the corresponding data access node in the first network device; the second request carries one or more of the following related information of the corresponding data access node:

[0267] The address of the data access node;

[0268] The identifiers of the data requester and / or data provider corresponding to the data access node;

[0269] Identifier of the data access node.

[0270] In one embodiment, the first communication interface 1 is further configured to:

[0271] Send the first message to the designated server; among which,

[0272] The first information includes one or more related information of the data access node registered in the first network device and the identifier of the first network device.

[0273] In one embodiment, the first data product is published to the first data platform by the data provider, the first network device supports interfacing with multiple data platforms, and the first communication interface 1 is further used for:

[0274] Receive the first contract sent by the first data platform.

[0275] In one embodiment, the first communication interface 1 is further configured to:

[0276] The system receives a third request sent by the second data access node; the third request is used to request the publication of data in the first network device; the data published to the first network device is used by the first data product to provide data services.

[0277] It should be noted that the specific processing procedure of the first communication interface 1 can be understood by referring to the above method.

[0278] Of course, in practical applications, the various components in an electronic device are coupled together through bus system 4. It can be understood that bus system 4 is used to achieve communication and connection between these components. In addition to the data bus, bus system 4 also includes a power bus, a control bus, and a status signal bus. However, for clarity, in... Figure 9 The general will label all buses as Bus System 4.

[0279] The first memory 3 in this embodiment is used to store various types of data to support operation in the electronic device. Examples of such data include any computer program used to operate on the electronic device.

[0280] The methods disclosed in the embodiments of this application can be applied to the first processor 2, or implemented by the first processor 2. The first processor 2 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by the integrated logic circuit of the hardware or by instructions in the form of software in the first processor 2. The first processor 2 may be a general-purpose processor, a DSP, or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The first processor 2 can implement or execute the methods, steps, and logic block diagrams disclosed in the embodiments of this application. The general-purpose processor may be a microprocessor or any conventional processor, etc. The steps of the methods disclosed in the embodiments of this application can be directly reflected as being executed by a hardware decoding processor, or being executed by a combination of hardware and software modules in the decoding processor. The software modules may be located in a storage medium, which is located in the first memory 3. The first processor 2 reads the information in the first memory 3 and completes the steps of the aforementioned method in combination with its hardware.

[0281] In an exemplary embodiment, the electronic device may be implemented by one or more ASICs, DSPs, PLDs, CPLDs, FPGAs, general-purpose processors, controllers, MCUs, microprocessors, or other electronic components to perform the aforementioned method.

[0282] It is understood that the first memory 3 in the embodiments of this application can be volatile memory or non-volatile memory, or both. The non-volatile memory can be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), ferromagnetic random access memory (FRAM), flash memory, magnetic surface memory, optical disc, or compact disc read-only memory (CD-ROM); the magnetic surface memory can be disk storage or magnetic tape storage. The volatile memory can be random access memory (RAM), which is used as an external cache. By way of example, but not limitation, many forms of RAM are available, such as Static Random Access Memory (SRAM), Synchronous Static Random Access Memory (SSRAM), Dynamic Random Access Memory (DRAM), Synchronous Dynamic Random Access Memory (SDRAM), Double Data Rate Synchronous Dynamic Random Access Memory (DDRSDRAM), Enhanced Synchronous Dynamic Random Access Memory (ESDRAM), SyncLink Dynamic Random Access Memory (SLDRAM), and Direct Rambus Random Access Memory (DRRAM).The memories described in the embodiments of this application are intended to include, but are not limited to, these and any other suitable types of memories.

[0283] In an exemplary embodiment, this application also provides a storage medium, namely a computer storage medium, specifically a computer-readable storage medium, such as an electronic device including a computer program. The computer program can be executed by a first processor 2 of the electronic device to complete the steps described in the aforementioned method. The computer-readable storage medium may be a memory such as FRAM, ROM, PROM, EPROM, EEPROM, Flash Memory, magnetic surface memory, optical disc, or CD-ROM.

[0284] In an exemplary embodiment, this application also provides a computer program product, including a computer program that can be executed by a first processor 2 of an electronic device to perform the steps described in any of the foregoing methods.

[0285] It should be noted that terms such as "first" and "second" are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence.

[0286] In this document, the term "and / or" is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent three cases: A alone, A and B simultaneously, and B alone. Additionally, the term "one or more" in this document refers to any combination of at least two of any one or more elements from a set of A, B, and C. For example, including at least one of A, B, and C can represent including any one or more elements selected from the set of A, B, and C.

[0287] Furthermore, the technical solutions described in the embodiments of this application can be combined arbitrarily without conflict.

[0288] The above description is merely a preferred embodiment of this application and is not intended to limit the scope of protection of this application.

Claims

1. A data circulation method, characterized in that, Applied to a first network device, the method includes: Receive the first contract sent by the first data platform; A first strategy is generated based on a first contract between the data demander and the data provider of the first data product; the first contract represents the agreement between the data demander and the data provider on the use of the first data product; the first strategy represents a data usage strategy that matches the first contract. A first work order containing the first policy is generated; the first policy is used by the first network device for policy monitoring. The first work order is pushed to the first data access node and the second data access node; wherein... The first data access node represents the data access node of the data requester, and the first work order is used by the data requester to use data based on the first strategy. The second data access node represents the data access node of the data provider, and the first work order is used by the data provider to deliver data based on the first strategy.

2. The method according to claim 1, characterized in that, The first work order includes: the identifier of the first data access node and the identifier of the second data access node; before pushing the first work order to the first data access node and the second data access node, the method further includes: Based on the identifier of the first data access node, determine the first address of the first data access node; and, Based on the identifier of the second data access node, the second address of the second data access node is determined.

3. The method according to claim 2, characterized in that, The first data access node is registered with the first network device, and the second data access node is registered with the second network device; correspondingly, based on the identifier of the second data access node, the second address of the second data access node is determined, including: Broadcast the first request and receive the first response from the second network device; and / or, Send a first request to the setting server and receive a first response returned by the setting server; wherein, The first request is used to query the address of the second data access node; the first request carries the identifier of the second data access node; the first response carries the second address, and the setting server stores the addresses of all data access nodes.

4. The method according to claim 1, characterized in that, The method further includes: Receive a second request sent by one or more data access nodes; wherein... The second request is used to request the registration of the corresponding data access node in the first network device; the second request carries one or more of the following related information of the corresponding data access node: The address of the data access node; The identifiers of the data requester and / or data provider corresponding to the data access node; Identifier of the data access node.

5. The method according to claim 4, characterized in that, The method further includes: Send the first message to the designated server; among which, The first information includes one or more related information of the data access node registered in the first network device and the identifier of the first network device.

6. The method according to claim 1, characterized in that, The first data product is published to the first data platform by the data provider, and the first network device supports interfacing with multiple data platforms.

7. The method according to claim 1, characterized in that, The method further includes: The system receives a third request sent by the second data access node; the third request is used to request the publication of data in the first network device; the data published to the first network device is used by the first data product to provide data services.

8. A data circulation system, characterized in that, include: A first network device and multiple data access nodes; the multiple data access nodes include one or more first data access nodes and one or more second data access nodes; The first network device is used to perform the steps of the method according to any one of claims 1 to 7.

9. A data circulation device, characterized in that, Applied to the first network device, including: The first generation unit is used to generate a first strategy based on a first contract between the data demander and the data provider of the first data product; the first contract represents the usage agreement between the data demander and the data provider regarding the first data product; the first strategy represents a data usage strategy that matches the first contract. The second generation unit is used to generate a first work order containing the first policy; the first policy is used by the first network device for policy monitoring. A receiving unit is used to receive the first contract sent by the first data platform; The push unit is used to push the first work order to the first data access node and the second data access node; wherein, The first data access node represents the data access node of the data requester, and the first work order is used by the data requester to use data based on the first strategy. The second data access node represents the data access node of the data provider, and the first work order is used by the data provider to deliver data based on the first strategy.

10. An electronic device, characterized in that, include: A first processor and a first communication interface; wherein... The first processor is configured to generate a first policy based on a first contract between a data demander and a data provider for a first data product; the first contract represents an agreement between the data demander and the data provider regarding the use of the first data product; the first policy represents a data usage policy matching the first contract; the first policy is used by the first network device for policy monitoring; and... Generate a first work order that includes the first strategy; The first communication interface is used to receive the first contract sent by the first data platform, and to push the first work order to the first data access node and the second data access node; wherein, The first data access node represents the data access node of the data requester, and the first work order is used by the data requester to use data based on the first strategy. The second data access node represents the data access node of the data provider, and the first work order is used by the data provider to deliver data based on the first strategy.

11. An electronic device, characterized in that, include: A first processor and a first memory for storing computer programs capable of running on the processor. Wherein, when the first processor is used to run the computer program, it performs the steps of the method according to any one of claims 1 to 7.

12. A storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 7.

13. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 7.

Images