Data circulation method and device, electronic equipment, storage medium and computer program product

Abstract

The invention discloses a data circulation method and device, electronic equipment, a storage medium and a computer program product, and the method comprises the steps that first network equipment generates a first strategy based on a first contract between a data demander and a data provider of a first data product; the first contract represents a use agreement on the first data product between the data demander and the data provider; the first strategy represents a data use strategy matched with the first contract; generating a first work order containing the first strategy; pushing the first work order to the first data access node and the second data access node; wherein the first data access node represents the data access node of the data demander, the first work order is used for the data demander to use data based on a first strategy, the second data access node represents the data access node of the data provider, and the first work order is used for the data provider to deliver data based on the first strategy.

Description

Technical Field

[0001] The present application relates to the field of big data technology, and in particular to a data circulation method, device, electronic device, storage medium and computer program product. Background Art

[0002] In the related art, data is circulated between data providers and data demanders based on a point-to-point model. When there are multiple data providers and multiple data demanders, the data circulation efficiency is low. Summary of the invention

[0003] To solve related technical problems, the embodiments of the present application provide a data circulation method, device, electronic device, storage medium and computer program product.

[0004] The technical solution of the embodiment of the present application is implemented as follows:

[0005] The present application embodiment provides a data circulation method, which is applied to a first network device, and the method includes:

[0006] generating a first policy based on a first contract between a data demander and a data provider of a first data product; the first contract represents a usage agreement between the data demander and the data provider for the first data product; and the first policy represents a data usage policy matching the first contract;

[0007] generating a first work order including the first strategy;

[0008] Pushing the first work order to the first data access node and the second data access node; wherein,

[0009] The first data access node represents the data access node of the data demander, the first work order is used by the data demander to use the data based on the first policy, and the second data access node represents the data access node of the data provider, and the first work order is used by the data provider to deliver data based on the first policy.

[0010] In the above solution, the first work order includes: an identifier of the first data access node and an identifier of the second data access node; before pushing the first work order to the first data access node and the second data access node, the method further includes:

[0011] determining a first address of the first data access node based on the identifier of the first data access node; and,

[0012] Based on the identifier of the second data access node, a second address of the second data access node is determined.

[0013] In the above solution, the first data access node is registered with the first network device, and the second data access node is registered with the second network device; correspondingly, based on the identifier of the second data access node, determining the second address of the second data access node includes:

[0014] broadcasting a first request, and receiving a first response returned by the second network device; and / or,

[0015] Sending a first request to a setting server and receiving a first response returned by the setting server; wherein,

[0016] The first request is used to request to query the address of the second data access node; the first request carries the identifier of the second data access node; the first response carries the second address, and the setting server stores the addresses of all data access nodes.

[0017] In the above scheme, the method further comprises:

[0018] receiving a second request sent by one or more data access nodes; wherein,

[0019] The second request is used to request registration of a corresponding data access node in the first network device; the second request carries one or more of the following relevant information of the corresponding data access node:

[0020] The address of the data access node;

[0021] The identifier of the data demander and / or data provider corresponding to the data access node;

[0022] The identifier of the data access node.

[0023] In the above scheme, the method further comprises:

[0024] Sending first information to a setting server; wherein,

[0025] The first information includes the one or more related information of the data access node registered in the first network device and an identifier of the first network device.

[0026] In the above solution, the first data product is published by the data provider to the first data platform, and the first network device supports docking with multiple data platforms; the method further includes:

[0027] Receive the first contract sent by the first data platform.

[0028] In the above scheme, the method further comprises:

[0029] Receive a third request sent by the second data access node; the third request is used to request to publish data in the first network device; the data published to the first network device is used for the first data product to provide data services.

[0030] The embodiment of the present application further provides a data circulation system, comprising: a first network device and a plurality of data access nodes; the plurality of data access nodes comprises one or more first data access nodes and one or more second data access nodes;

[0031] The first network device is used to execute the steps of any of the above methods.

[0032] The embodiment of the present application further provides a data circulation device, which is applied to a first network device, including:

[0033] A first generating unit, configured to generate a first policy based on a first contract between a data demander and a data provider of a first data product; the first contract represents a usage agreement between the data demander and the data provider for the first data product; the first policy represents a data usage policy matching the first contract;

[0034] A second generating unit, configured to generate a first work order including the first strategy;

[0035] A push unit is used to push the first work order to the first data access node and the second data access node; wherein,

[0036] The first data access node represents the data access node of the data demander, the first work order is used by the data demander to use the data based on the first policy, and the second data access node represents the data access node of the data provider, and the first work order is used by the data provider to deliver data based on the first policy.

[0037] The embodiment of the present application also provides an electronic device, comprising: a first processor and a first communication interface; wherein,

[0038] The first processor is used to generate a first policy based on a first contract between a data demander and a data provider of a first data product; the first contract represents a usage agreement between the data demander and the data provider for the first data product; the first policy represents a data usage policy matching the first contract; and

[0039] generating a first work order including the first strategy;

[0040] The first communication interface is used to push the first work order to the first data access node and the second data access node; wherein,

[0041] The first data access node represents the data access node of the data demander, the first work order is used by the data demander to use the data based on the first policy, and the second data access node represents the data access node of the data provider, and the first work order is used by the data provider to deliver data based on the first policy.

[0042] An embodiment of the present application further provides an electronic device, comprising: a first processor and a first memory for storing a computer program that can be run on the processor,

[0043] Wherein, the first processor is used to execute the steps of any of the above methods when running the computer program.

[0044] An embodiment of the present application further provides a storage medium on which a computer program is stored. When the computer program is executed by a processor, the steps of any of the above methods are implemented.

[0045] An embodiment of the present application also provides a computer program product, including a computer program, which implements the steps of any of the above methods when executed by a processor.

[0046] In an embodiment of the present application, the first network device generates a first strategy based on the first contract between the data demander and the data provider of the first data product, then generates a first work order containing the first strategy, and then pushes the first work order to the first data access node and the second data access node; wherein the first contract represents the use agreement between the data demander and the data provider for the first data product, the first strategy represents the data use strategy matching the first contract, the first data access node represents the data access node of the data demander, the first work order is used for the data demander to use the data based on the first strategy, the second data access node represents the data access node of the data provider, and the first work order is used for the data provider to deliver the data based on the first strategy. In the above scheme, the first network device generates a work order containing the data use strategy for the data demander and the data provider with cooperation intention, and pushes the work order to the data access nodes of the data demander and the data provider respectively, so that the data provider can deliver the data and the data demander can use the data. Compared with the related technology, data circulation can be realized without establishing a point-to-point communication line between the data demander and the data provider, which improves the efficiency of data circulation. BRIEF DESCRIPTION OF THE DRAWINGS

[0047] Figure 1 A schematic diagram of a data flow implementation method provided in an embodiment of the present application;

[0048] Figure 2 A schematic diagram of the overall architecture of a data circulation system provided for an application embodiment of the present application;

[0049] Figure 3 A schematic diagram of a deployment architecture of a data circulation system provided for an application embodiment of the present application;

[0050] Figure 4 A schematic diagram of an interactive process of a data circulation method provided in an application embodiment of the present application;

[0051] Figure 5 A schematic diagram of the deployment architecture of a second data circulation system provided in an application embodiment of the present application;

[0052] Figure 6 A schematic diagram of the interaction flow of the second data circulation method provided in the application embodiment of the present application;

[0053] Figure 7 A schematic diagram of the interaction flow of the third data circulation method provided in the application embodiment of the present application;

[0054] Figure 8 A schematic diagram of the structure of a data circulation device provided in an embodiment of the present application;

[0055] Fig. 9 A schematic diagram of the structure of the hardware composition of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0056] In the era of big data, data is showing an explosive growth trend. It is necessary to promote data sharing and openness through data circulation, so as to help the development of digital economy and society. In related technologies, data circulation is carried out between data providers and data demanders based on a point-to-point model. Specifically, a point-to-point communication line is established between data providers and data demanders who have data cooperation intentions, so that the data providers and data demanders can synchronize the data usage methods, and deliver and use data based on the data usage methods. However, in the case of multiple data providers and multiple data demanders, a point-to-point communication line needs to be established between each pair of data providers and data demanders who have cooperation intentions, resulting in low data circulation efficiency.

[0057] Based on this, in an embodiment of the present application, the first network device generates a first strategy based on the first contract between the data demander and the data provider of the first data product, and then generates a first work order containing the first strategy, and then pushes the first work order to the first data access node and the second data access node; wherein the first contract represents the use agreement between the data demander and the data provider for the first data product, the first strategy represents the data use strategy matching the first contract, the first data access node represents the data access node of the data demander, the first work order is used for the data demander to use the data based on the first strategy, the second data access node represents the data access node of the data provider, and the first work order is used for the data provider to deliver the data based on the first strategy. In the above scheme, the first network device generates a work order containing the data use strategy for the data demander and the data provider with cooperation intention, and pushes the work order to the data access nodes of the data demander and the data provider respectively, so that the data provider can deliver the data and the data demander can use the data. Compared with the related technology, data circulation can be realized without establishing a point-to-point communication line between the data demander and the data provider, which improves the efficiency of data circulation.

[0058] For ease of understanding, the main concepts involved in the embodiments of the present application are first explained:

[0059] Data product: a product with data as the transaction content. For example, a data product can be a training data set or an interface calling service.

[0060] Data platform: A platform for transactions between data demanders and data providers, which can also be described as a data trading platform or a data circulation application. Specifically, the platform is used for data providers to publish data products and for data demanders to purchase data products. For example, the data platform can be an online data exchange platform that already exists in the relevant technology.

[0061] In actual applications, data providers integrate the data they can provide into data products and publish them on the data platform. The published data products can be displayed on the data platform page. Then, data demanders purchase data products from the published data products through the data platform according to their own needs, and reach a consensus with the data providers on the use of the purchased data products. The data products purchased by the data demanders are also the data products traded between the data demanders and the data providers.

[0062] It should be noted that in actual applications, the transaction behavior between data demanders and data providers on the data platform can only represent the transaction intention between the supply and demand parties, and does not mean that data circulation has been achieved. The data circulation between the supply and demand parties is realized only after the data provider completes the data delivery based on the data contract and the data demander uses the data delivered by the data provider.

[0063] Data contract: records the information on the use agreement between the data demander and the data provider for the data product being traded. For example, the use agreement corresponding to the data contract may be: the annual call limit of the query interface 1 provided by the data provider is 1 million times. In actual applications, the data contract can be generated by the data platform.

[0064] An embodiment of the present application provides a data circulation method, which is applied to a first network device.

[0065] In actual applications, the first network device represents the core entity used to realize data circulation in the embodiment of the present application. The network domain to which the first network device belongs can be expressed as a data element core network, a data element cloud or a data element circulation management layer, etc. Correspondingly, the first network device can also be expressed as a data element core network device, a data element cloud device or a data element circulation management layer device, etc.

[0066] The data demander and the data provider can access the first network device through the data access node.

[0067] After the data provider accesses the first network device through the data access node, the data provider can publish the data that it can provide to the first network device through the data access node. The data published to the first network device can be used by the data provider to publish data products on the data platform, and then used for data products to provide data services. The data provider can also deliver data through the data access node.

[0068] After the data demander accesses the first network device through the data access node, the data demander can use the data delivered by the data provider through the data access node.

[0069] In the embodiment of the present application, the data access node includes:

[0070] The first data access node represents the data access node of the data demander.

[0071] The second data access node represents the data access node of the data provider.

[0072] In actual applications, a data demander accesses the first network device through a first data access node, and a data provider accesses the first network device through a second data access node.

[0073] In actual applications, the first data access node and the second data access node can be registered in the same first network device, or can be registered in different first network devices. Different first network devices can represent first network devices set up in network domains in different areas.

[0074] In practical applications, the data access node may have a security verification function to prevent attackers from accessing the first network device through the data access node. Therefore, the data access node may also be described as a trusted data access node.

[0075] Reference Figure 1 , the data circulation method provided in the embodiment of the present application includes:

[0076] Step 101: Generate a first strategy based on a first contract between a data demander and a data provider of a first data product;

[0077] The first contract represents the usage agreement between the data demander and the data provider on the first data product; the first policy represents the data usage policy matching the first contract.

[0078] Here, the first data product can be understood as a data product purchased by the data demander, and the first contract can be understood as a data contract between the data demander and the data provider for the first data product.

[0079] In actual applications, the first contract may include one or more of the following information: the identifier of the data demander and / or the data provider, the identifier of the first data access node and / or the second data access node, information characterizing the content of the usage agreement between the data demander and the data provider for the first data product, and descriptive information corresponding to the first data product.

[0080] Here, the first policy matches the first contract. In actual applications, the computer program can identify and execute the first policy to ensure the implementation of the usage agreement corresponding to the first contract.

[0081] It should be noted that both the first contract and the first policy can represent the usage agreement between the data demander and the data provider on the first data product, but the first contract focuses on describing the agreement semantically, while the first policy focuses on expressing the agreement strategically for computer programs.

[0082] Step 102: Generate a first work order including a first strategy.

[0083] Among them, the first work order is used by the data demander to use the data based on the first strategy, and the first work order is used by the data provider to deliver the data based on the first strategy.

[0084] Here, the first work order includes the first strategy. In practical applications, the first work order may also include one or more of the following information: an identifier of a data demander and / or a data provider, an identifier of a first data access node and / or a second data access node.

[0085] Step 103: Push the first work order to the first data access node and the second data access node.

[0086] In actual applications, the data provider can deliver data through the second data access node. Specifically, after receiving the first work order pushed by the first network device, the second data access node can connect to the data source configured by the data provider, and then read the data that needs to be delivered to the data demander in the data source, and then provide the data to the data demander for use by providing data services. Exemplarily, the data service can be the data provider actively sending data to the data demander, or it can be based on the data demander calling the interface provided by the data provider. Return data.

[0087] In actual applications, the data demander can use the data through the first data access node. Specifically, after receiving the first work order pushed by the first network device, the first data access node can receive the data provided by the data provider and perform the operation instructed by the data demander on the received data. It should be noted that, here, data use includes: reading, modifying, analyzing and other operations on data. The operation of receiving data is equivalent to reading the data. Therefore, the data demander receiving the data provided by the data provider through the first data access node can also be regarded as: the data demander uses the data.

[0088] In actual applications, during the process of the second data access node providing data services, the first network device can perform policy monitoring based on the first policy in the first work order, thereby ensuring that the second data access node provides data services to the data demander in accordance with the data usage agreement represented by the first policy, and ensuring that the first data access node uses the data delivered by the data provider in accordance with the first policy. The first data access node can also report its own usage information such as the number of interface calls during the use of data to improve the accuracy of the first network device's policy monitoring.

[0089] Exemplarily, if the data product purchased by the data demander is: the call service of query interface 1, the data use agreement represented by the first contract between the data demander and the data provider is: the annual call volume of query interface 1 is capped at 1 million times, the first network device generates a first work order based on the first contract, and has pushed the first work order to the first data access node and the second data access node. Then, the first data access node can call query interface 1 based on the first work order and report the number of calls to the first network device, and the second data access node can make query interface 1 respond to the call of the data demander and return data to the data demander based on the first work order. The first network device can perform policy monitoring based on the first policy in the first work order, and allow the first data access node to call query interface 1 if the annual call volume of query interface 1 by the first data access node does not exceed 1 million times, and prohibit the first data access node from calling query interface 1 if the annual call volume of query interface 1 by the first data access node exceeds 1 million times. After receiving the data delivered by the second data access node, the first data access node can perform subsequent processing on the received data according to the instructions of the data demander. It can be seen that the first network device schedules the data flow between the data provider and the data demander through the first work order.

[0090] In the embodiment of the present application, the first network device generates a work order containing a data usage policy for a data demander and a data provider with cooperation intention, and pushes the work order to the data access nodes of the data demander and the data provider, respectively, so that the data provider can deliver the data and the data demander can use the data. It can be understood that by pushing, the first network device can push multiple different work orders to the corresponding data demander and the corresponding data provider, that is, in the case of multiple data providers and multiple data demanders, there is no need to establish a point-to-point communication line between each pair of data providers and data demanders with cooperation intentions, and the data flow between the supply and demand parties can also be scheduled. Therefore, the solution provided in the embodiment of the present application improves the efficiency of data flow compared to the related art.

[0091] The method for pushing the first work order is described in detail below.

[0092] In one embodiment, before pushing the first work order to the first data access node and the second data access node, the method further includes:

[0093] Based on the identifier of the first data access node, determining a first address of the first data access node; and,

[0094] Based on the identifier of the second data access node, a second address of the second data access node is determined.

[0095] The first work order includes: an identifier of the first data access node and an identifier of the second data access node.

[0096] In practical applications, the first network device can push the first work order to the first data access node according to the first address, and push the first work order to the second data access node according to the second address. The first address and the second address can both be regarded as addresses of data access nodes.

[0097] In actual applications, the data access node can send its own relevant information to the first network device, and the relevant information includes the address of the data access node.

[0098] In one embodiment, the method further comprises:

[0099] receiving a second request sent by one or more data access nodes; wherein,

[0100] The second request is used to request to register the corresponding data access node in the first network device; the second request carries one or more of the following relevant information of the corresponding data access node:

[0101] The address of the data access node;

[0102] The identifier of the data demander and / or data provider corresponding to the data access node;

[0103] The identifier of the data access node.

[0104] Here, the one or more related information carried in the second request can be regarded as the registration information of the corresponding data access node. In practical applications, the address information in the registration information can include: the Internet Protocol (IP) address and port of the data access node.

[0105] In actual applications, after obtaining the registration information carried in the second request, the first network device can store the registration information locally in the first network device, thereby completing the registration of the data access node to the first network device. After the data access node is registered with the first network device, the data demander and / or data provider can access the first network device through the data access node.

[0106] In actual applications, when the first data access node and the second data access node are registered on the same first network device, the first network device can directly determine the address that matches the identifier of the first data access node as the first address based on the locally stored registration information, and determine the address that matches the identifier of the second data access node as the second address.

[0107] When the first data access node and the second data access node are registered in different first network devices, the first network device needs to determine the address of the data access node in a different manner from the previous case. An embodiment is provided below for illustration.

[0108] In one embodiment, the first data access node is registered with the first network device, and the second data access node is registered with the second network device; correspondingly, based on the identifier of the second data access node, determining the second address of the second data access node includes:

[0109] broadcasting a first request, and receiving a first response returned by the second network device; and / or,

[0110] Sending a first request to a setting server and receiving a first response returned by the setting server; wherein,

[0111] The first request is used to request to query the address of the second data access node; the first request carries the identifier of the second data access node; the first response carries the second address, and the server is set to store the addresses of all data access nodes.

[0112] In actual applications, the data demander's purchase of data products triggers the generation of a data contract and subsequent data delivery. Therefore, the work order is generally pushed by the data demander's data access node, that is, the first network device where the first data access node is registered.

[0113] Here, the first data access node is registered with the first network device. Therefore, in actual applications, the first network device can determine the address matching the identifier of the first data access node as the first address based on the registration information of the first data access node stored locally.

[0114] The second data access node is registered with the second network device. In practical applications, the second network device can be understood as other first network devices except the first network device with which the first data access node is registered.

[0115] Here, the first network device can obtain the second address in the following two ways:

[0116] Mode 1: The first network device broadcasts a first request, and receives a first response returned by the second network device.

[0117] In actual applications, the first network device may broadcast the first request to all other first network devices except the first network device itself. It can be understood that the broadcast object of the first network device includes the second network device.

[0118] In actual applications, all broadcasted devices can query the second address based on the locally stored registration information after receiving the first request. The second data access node is registered with the second network device. Therefore, the second network device can determine the address matching the identifier of the second data access node as the second address during the query process based on the locally stored registration information, and then return a first response to the first network device where the first data access node is registered, wherein the first response carries the determined second address.

[0119] Mode 2: The first network device sends a request to the setting server and receives a first response returned by the setting server, wherein the setting server stores the addresses of all data access nodes.

[0120] Here, all the data access nodes may be all the data access nodes registered in all the first network devices.

[0121] In actual applications, the setting server can be co-installed with a first network device or deployed independently.

[0122] In one embodiment, the method further comprises:

[0123] The first information is sent to the setting server.

[0124] The first information includes one or more relevant information of the data access node registered in the first network device and an identifier of the first network device.

[0125] Here, after receiving the registration information sent by the data access node, the first network device continues to report the registration information to the setting server, so that the setting server can store the relevant information of all data access nodes.

[0126] In actual applications, after receiving the first information, the setting server may store the first information locally on the setting server.

[0127] In an embodiment of the present application, the first network device determines the address of the data access node based on the identifier of the data access node, and then pushes the work order to the data access node based on the determined address, so that the data provider can deliver the data and the data demander can use the data. Compared with the related art, when there are multiple data providers and multiple data demanders, there is no need to establish a point-to-point communication line between each pair of data providers and data demanders with cooperation intentions, and the data flow between the supply and demand parties can be scheduled, thereby improving the data flow efficiency.

[0128] The following describes how to obtain the first contract.

[0129] In actual applications, the first contract can be generated by the data platform and sent by the data platform to the first network device.

[0130] In one embodiment, the data circulation method provided by the present application further includes:

[0131] Receive a first contract sent by a first data platform.

[0132] Here, the first data product is published by the data provider to the first data platform, and the first network device supports docking with multiple data platforms.

[0133] In actual applications, before releasing data products on the data platform, data providers can first connect the data corresponding to the data products to the data platform, so that the data providers can manage the data on the data platform and then release the data as data products based on business needs.

[0134] In one embodiment, the method further comprises:

[0135] A third request sent by the second data access node is received.

[0136] The third request is used to request the release of data in the first network device; the data released to the first network device is used for the first data product to provide data services.

[0137] In practical applications, the third request for publishing data may carry one or more of the following related information of the data requested for publishing: the identifier of the data provider, the identifier of the second data access node, metadata information, and metadata category. The one or more related information may also be expressed as data publishing information.

[0138] Among them, metadata information is the description information of the data. For example, the metadata information may include: the table structure corresponding to the data, the data volume and other information; the metadata category is the category to which the data belongs. For example, if the categories are divided according to industry, the metadata category may be: power industry or transportation industry, etc.

[0139] In actual applications, the second data access node can connect to the data source configured by the data provider, and read the data publishing information of each data in the data source from the data source. Then, the data provider can select the data to be published according to business needs. After that, the second data access node carries the data publishing information of the data to be published in the third request and sends it to the first network device based on the selection of the data provider. It should be noted that the data publishing information does not include the real data for delivery to the data demander. These real data will only be read when the second data access node delivers the data.

[0140] After receiving the third request, the first network device may store the data publishing information carried in the third request locally, thereby implementing the publishing of data in the first network device.

[0141] In actual applications, the first network device can access the published data to all data platforms connected to the network. Specifically, it can synchronize the information carried in the third request to the connected data platform. Then, the data provider manages the published data on the data platform and publishes data products based on business needs.

[0142] For example, if the data provider publishes data 1, data 2, and data 3 to the first network device, and the first network device has been connected to data platform 1 and data platform 2, then the data provider can manage data 1, data 2, and data 3 on both data platform 1 and data platform 2, and the management method can be to view the description information of the data, group the data, etc. For example, the data provider can view the description information of the published data on data platform 1, merge data 1 and data 2 into the same category, and then publish the data of this category as a data product on data platform 1.

[0143] It is understandable that different data platforms may adopt different access standards. In the related art, data circulation is based on a point-to-point model, which requires data access to each data platform that each data demander may access. Then, the data provider needs to adapt to each data platform, which is cumbersome and reduces the efficiency of data circulation. In the embodiment of the present application, the first network device supports docking with multiple data platforms. The data provider only needs to publish the data to the first network device to achieve the docking of the data with the data platform, which simplifies the operation method and further improves the efficiency of data circulation.

[0144] In one embodiment, the method further includes: generating a data catalog based on the published data, wherein the data catalog represents a description list of the published data.

[0145] In practical applications, the data directory may include one or more of the following related information of all published data: the identifier of the data provider, the identifier of the second data access node, metadata information, and metadata category. The data directory can improve the efficiency of the data provider in managing the published data, thereby further improving the efficiency of data circulation.

[0146] In one embodiment, the method further includes: generating a data product catalog based on the published data products. The data product catalog represents a description list of the published data products.

[0147] In practical applications, the data product catalog may include one or more of the following relevant information of all published data products: the identifier of the data provider, the identifier of the second data access node, and product description information. The data product catalog can improve the efficiency of data providers in managing published data products and the efficiency of data demanders in purchasing data products, thereby further improving the efficiency of data circulation.

[0148] In actual applications, data product catalogs can also be generated by the data platform.

[0149] Based on the above method embodiment, the embodiment of the present application also provides a data circulation system, including: a first network device and multiple data access nodes.

[0150] The multiple data access nodes include one or more first data access nodes and one or more second data access nodes. The first network device is used to execute the method provided by one or more technical solutions in the above method embodiment.

[0151] In actual applications, the data circulation system may have multiple first network devices, and different first network devices may represent first network devices in network domains in different regions. The first data access node and the second data access node may be registered in the same first network device or in different first network devices.

[0152] In actual applications, the data circulation system may also include: computing network infrastructure, data sources and one or more data platforms.

[0153] The computing network infrastructure is used to provide network resources, computing resources, storage resources, etc. for data circulation. The data source is configured by the data provider to provide data, which can be multi-source and multi-dimensional data. For example, the data source can be a database.

[0154] In the embodiment of the present application, the first network device in the data circulation system generates a work order containing a data usage policy for a data demander and a data provider with cooperation intentions, and pushes the work order to the data access nodes of the data demander and the data provider respectively, so that the data provider can deliver the data and the data demander can use the data. Compared with the related technology, data circulation can be achieved without establishing a point-to-point communication line between the data demander and the data provider, thereby improving the efficiency of data circulation.

[0155] The present application is further described in detail below in conjunction with application examples.

[0156] The present application embodiment provides a data circulation system, referring to Figure 2The data circulation system includes: computing network infrastructure, data source, data access node, data element core network equipment and data application layer.

[0157] Among them, the data element core network device is equivalent to the first network device in the embodiment of the present application. In actual applications, the data element core network device mainly includes: a data management module, a data service scheduling module, and a data service scheduling agent module. The data application layer includes multiple data circulation applications, and the data circulation application is equivalent to the data platform in the embodiment of the present application.

[0158] The data circulation system provided by the application embodiment of the present application can perform data circulation based on the following deployment architecture.

[0159] Architecture 1: Reference Figure 3 , the data access node of the data demander and the data access node of the data provider are registered in the same data element core network device. For the convenience of description, the data access node of the data demander is referred to as the first data access node, and the data access node of the data provider is referred to as the second data access node.

[0160] Reference Figure 4 The interactive process of the data circulation system for data circulation based on architecture 1 mainly includes the following steps:

[0161] Step 1: The data access node registers with the data element core network device.

[0162] Specifically, this step may be that the data access node sends a registration request to the data element core network device, and the registration request carries the registration information of the data access node requesting registration. Here, the registration request is equivalent to the second request in the embodiment of the present application.

[0163] Step 2: The data service scheduling agent module saves the registration information of the data access node.

[0164] Step 3: The second data access node reads the data source information.

[0165] Here, the data source information is equivalent to the data publishing information in the embodiment of the present application.

[0166] Step 4: The second data access node publishes data to the data element core network device.

[0167] Specifically, the second data access node can select the data to be published based on the data publishing information read from the data source, and send the data publishing information of the data to be published to the data element core network device.

[0168] Step 5: The data directory submodule in the data management module generates a data directory.

[0169] Specifically, the data directory submodule may store the data publishing information sent by the second data access node locally, and generate a data directory based on the data publishing information.

[0170] Step 6: The data provider publishes the data product to the data circulation application.

[0171] Step 7: The data circulation application generates a data product catalog based on the published data products.

[0172] Step 8: The data demander accesses the data circulation application, and the data circulation application generates a data contract based on the data product purchased by the data demander.

[0173] Here, the data contract is equivalent to the first contract in the embodiment of the present application.

[0174] Step 9: The data circulation application sends the data contract to the data contract submodule in the data management module.

[0175] Step 10: The data contract submodule saves the data contract issued by the data circulation application, generates a data usage policy based on the data contract, and then saves the data usage policy in the data usage policy submodule in the data management module.

[0176] Here, the data usage strategy is equivalent to the first strategy in the embodiment of the present application.

[0177] Step 11: The data usage policy submodule pushes the data usage policy to the delivery scheduling submodule of the data service scheduling module.

[0178] Step 12: The delivery scheduling submodule generates a data delivery work order based on the data usage policy.

[0179] Here, the data delivery work order is equivalent to the first work order in the embodiment of the present application.

[0180] Step 13: The delivery scheduling submodule pushes the data delivery work order to the routing addressing submodule in the data service scheduling agent module.

[0181] Step 14: The routing addressing submodule performs routing addressing according to the data delivery work order.

[0182] Specifically, the routing addressing submodule may determine the address of the first data access node and the address of the second data access node based on the data delivery work order and the registration information locally stored by the data service scheduling agent module.

[0183] Step 15: The routing addressing submodule pushes the data delivery work order to the first data access node and the second data access node.

[0184] Step 16: Data delivery and data usage.

[0185] Specifically, this step may be that the service management module of the second data access node delivers data based on the data usage policy, and the service management module of the first data access node uses the data delivered by the second data access node based on the data delivery policy.

[0186] Architecture 2: Reference Figure 5 , the data access node of the data demander and the data access node of the data provider are registered in different data element core network devices. Among them, the first-level data service scheduling agent is equivalent to the setting server in the embodiment of the present application.

[0187] For ease of description, the data access node of the data demander is referred to as the first data access node, and the data access node of the data provider is referred to as the second data access node. The data element core network device on which the first data access node is registered is referred to as the data element core network device on the demander side, and the module in the data element core network device on the demander side is referred to as the module on the demander side. The data element core network device on which the second data access node is registered is referred to as the data element core network device on the provider side, and the module in the data element core network device on the provider side is referred to as the module on the provider side.

[0188] Reference Figure 6 , when the first-level data service dispatch agent is not deployed, the interactive process of the data circulation system for data circulation based on architecture 2 mainly includes the following steps:

[0189] Step 1: The data demander accesses the data circulation application, and the data circulation application generates a data contract based on the data product purchased by the data demander.

[0190] Step 2: The data circulation application sends the first contract to the data contract submodule on the demand side.

[0191] Step 3: The data contract submodule on the demand side saves the data contract issued by the data circulation application, generates a data usage policy based on the data contract, and then saves the data usage policy in the data usage policy submodule in the data management module on the demand side.

[0192] Step 4: The data usage policy submodule on the demand side pushes the data usage policy to the delivery scheduling submodule of the data service scheduling module on the demand side.

[0193] Step 5: The delivery scheduling submodule on the demand side generates a data delivery work order based on the data usage policy.

[0194] Step 6: The delivery scheduling submodule on the demand side pushes the data delivery work order to the routing addressing submodule in the data service scheduling proxy module on the demand side.

[0195] Step 7: The routing addressing submodule on the demand side performs routing addressing based on the data delivery work order.

[0196] Wherein, step 7 further comprises:

[0197] Step 7a: The routing addressing submodule on the demand side broadcasts an address query request to all data element core network devices. Here, the address query request is equivalent to the first request in the embodiment of the present application.

[0198] Step 7b: The routing addressing submodule on the provider side returns the address of the second data access node to the routing addressing submodule on the demander side.

[0199] In this way, the routing addressing submodule on the demand side can determine the address of the second data access node.

[0200] In actual applications, the routing addressing submodule on the demand side may also determine the address of the first data access node based on the registration information locally stored by the data service scheduling proxy module on the demand side.

[0201] Step 8: The routing addressing submodule on the demand side pushes the data delivery work order to the first data access node and the second data access node.

[0202] Step 9: Data delivery and data usage.

[0203] It should be noted that in order to highlight the key steps of the data circulation system based on architecture 2 for data circulation when a first-level data service scheduling agent is not deployed, the above interaction process omits the relevant steps of data access nodes registering with data element core network equipment and data providers publishing data products. The omitted steps can refer to steps 1 to 7 in the interaction process corresponding to the above architecture 1.

[0204] Reference Figure 7 , when the first-level data service dispatch agent has been deployed, the interactive process of the data circulation system for data circulation based on architecture 2 mainly includes the following steps:

[0205] Step 1: The data access node registers with the data element core network device.

[0206] Specifically, this step may be that the data access node sends a registration request to the data element core network device, and the registration request carries the registration information of the data access node requesting registration. Here, the registration request is equivalent to the second request in the embodiment of the present application.

[0207] Step 2: The data service scheduling agent module of the data element core network device reports the registration information of the data access node to the first-level data service scheduling agent.

[0208] Step 3: The first-level data service scheduling agent saves the registration information reported by the data element core network device locally.

[0209] Step 4: The data contract submodule on the demand side saves the data contract issued by the data circulation application, generates a data usage policy based on the data contract, and then saves the data usage policy in the data usage policy submodule in the data management module on the demand side.

[0210] Step 5: The data usage policy submodule on the demand side pushes the data usage policy to the delivery scheduling submodule of the data service scheduling module on the demand side.

[0211] Step 6: The delivery scheduling submodule on the demand side generates a data delivery work order based on the data usage policy.

[0212] Step 7: The delivery scheduling submodule on the demand side pushes the data delivery work order to the routing addressing submodule in the data service scheduling proxy module on the demand side.

[0213] Step 8: The routing addressing submodule on the demand side performs routing addressing based on the data delivery work order.

[0214] Among them, step 8 also includes:

[0215] Step 8a: The routing addressing submodule on the demand side sends an address query request to the first-level data service scheduling agent. Here, the address query request is equivalent to the first request in the embodiment of the present application.

[0216] Step 8b: The primary data service scheduling agent returns the address of the second data access node to the routing addressing submodule on the demand side.

[0217] In this way, the routing addressing submodule on the demand side can determine the address of the second data access node.

[0218] In actual applications, the routing addressing submodule on the demand side may also determine the address of the first data access node based on the registration information locally stored by the data service scheduling proxy module on the demand side.

[0219] Step 9: The routing addressing submodule on the demand side pushes the data delivery work order to the first data access node and the second data access node.

[0220] Step 10: Data delivery and data usage.

[0221] It should be noted that in order to highlight the key steps of the data circulation system in data circulation based on architecture 2 when a first-level data service scheduling agent has been deployed, the above process omits the relevant steps of data providers publishing data products and data demanders purchasing data products. The omitted steps can refer to steps 3 to 9 in the interaction process corresponding to the above architecture 1.

[0222] In the application embodiment of the present application, the data element core network equipment in the data circulation system generates a work order containing a data usage policy for data demanders and data providers with cooperation intentions, and pushes the work order to the data access nodes of the data demanders and data providers respectively, so that the data providers can deliver the data and the data demanders can use the data. Compared with the related technology, data circulation can be achieved without establishing a point-to-point communication line between the data demanders and the data providers, thereby improving the efficiency of data circulation.

[0223] Based on the above embodiments, the present application also provides a data circulation device, which is applied to a first network device, referring to Figure 8 , the data circulation device comprises:

[0224] A first generating unit 81 is used to generate a first policy based on a first contract between a data demander and a data provider of a first data product; the first contract represents a usage agreement between the data demander and the data provider for the first data product; the first policy represents a data usage policy matching the first contract;

[0225] A second generating unit 82 is configured to generate a first work order including the first strategy;

[0226] The push unit 83 is used to push the first work order to the first data access node and the second data access node; wherein,

[0227] The first data access node represents the data access node of the data demander, the first work order is used by the data demander to use the data based on the first policy, and the second data access node represents the data access node of the data provider, and the first work order is used by the data provider to deliver data based on the first policy.

[0228] In one embodiment, the first work order includes: an identifier of the first data access node and an identifier of the second data access node; before the pushing unit 83 pushes the first work order to the first data access node and the second data access node, the method further includes:

[0229] determining a first address of the first data access node based on the identifier of the first data access node; and,

[0230] Based on the identifier of the second data access node, a second address of the second data access node is determined.

[0231] In one embodiment, the first data access node is registered with the first network device, and the second data access node is registered with the second network device; correspondingly, the pushing unit 83 determines the second address of the second data access node based on the identifier of the second data access node, including:

[0232] broadcasting a first request, and receiving a first response returned by the second network device; and / or,

[0233] Sending a first request to a setting server and receiving a first response returned by the setting server; wherein,

[0234] The first request is used to request to query the address of the second data access node; the first request carries the identifier of the second data access node; the first response carries the second address, and the setting server stores the addresses of all data access nodes.

[0235] In one embodiment, the data flow device further includes a receiving unit, and the receiving unit is used to:

[0236] receiving a second request sent by one or more data access nodes; wherein,

[0237] The second request is used to request registration of a corresponding data access node in the first network device; the second request carries one or more of the following relevant information of the corresponding data access node:

[0238] The address of the data access node;

[0239] The identifier of the data demander and / or data provider corresponding to the data access node;

[0240] The identifier of the data access node.

[0241] In one embodiment, the data circulation device further includes a sending unit, and the sending unit is used to:

[0242] Sending first information to a setting server; wherein,

[0243] The first information includes the one or more related information of the data access node registered in the first network device and an identifier of the first network device.

[0244] In one embodiment, the first data product is published by the data provider to a first data platform, the first network device supports docking with multiple data platforms, and the receiving unit is further configured to:

[0245] Receive the first contract sent by the first data platform.

[0246] In one embodiment, the receiving unit is further configured to:

[0247] Receive a third request sent by the second data access node; the third request is used to request to publish data in the first network device; the data published to the first network device is used for the first data product to provide data services.

[0248] In actual application, the first generating unit 81, the second generating unit 82, the pushing unit 83, the receiving unit and the sending unit can all be implemented by a processor in the data circulation device.

[0249] It should be noted that: the data circulation device provided in the above embodiment only uses the division of the above program modules as an example to illustrate when performing data circulation. In actual applications, the above processing can be assigned to different program modules as needed, that is, the internal structure of the device is divided into different program modules to complete all or part of the above-described processing. In addition, the data circulation device provided in the above embodiment and the data circulation method embodiment belong to the same concept, and the specific implementation process is detailed in the method embodiment, which will not be repeated here.

[0250] Based on the hardware implementation of the above program modules, and in order to implement the method of the embodiment of the present application, the present application also provides an electronic device, such as Fig. 9 As shown, the electronic device includes:

[0251] The first communication interface 1 is capable of exchanging information with other devices;

[0252] The first processor 2 is connected to the first communication interface 1 to implement information exchange with other devices, and is used to execute the method provided by one or more technical solutions in the above embodiments when running a computer program. The computer program is stored in the first memory 3.

[0253] Specifically, the first processor 2 is used to generate a first policy based on a first contract between a data demander and a data provider of a first data product; the first contract represents a usage agreement between the data demander and the data provider for the first data product; the first policy represents a data usage policy matching the first contract;

[0254] generating a first work order including the first strategy;

[0255] Pushing the first work order to the first data access node and the second data access node; wherein,

[0256] The first data access node represents the data access node of the data demander, the first work order is used by the data demander to use the data based on the first policy, and the second data access node represents the data access node of the data provider, and the first work order is used by the data provider to deliver data based on the first policy.

[0257] In one embodiment, the first work order includes: an identifier of the first data access node and an identifier of the second data access node; before the first processor 2 pushes the first work order to the first data access node and the second data access node, the method further includes:

[0258] determining a first address of the first data access node based on the identifier of the first data access node; and,

[0259] Based on the identifier of the second data access node, a second address of the second data access node is determined.

[0260] In one embodiment, the first data access node is registered with the first network device, and the second data access node is registered with the second network device; correspondingly, the first processor 2 determines the second address of the second data access node based on the identifier of the second data access node, including:

[0261] broadcasting a first request, and receiving a first response returned by the second network device; and / or,

[0262] Sending a first request to a setting server and receiving a first response returned by the setting server; wherein,

[0263] The first request is used to request to query the address of the second data access node; the first request carries the identifier of the second data access node; the first response carries the second address, and the setting server stores the addresses of all data access nodes.

[0264] In one embodiment, the first communication interface 1 is used for:

[0265] receiving a second request sent by one or more data access nodes; wherein,

[0266] The second request is used to request registration of a corresponding data access node in the first network device; the second request carries one or more of the following relevant information of the corresponding data access node:

[0267] The address of the data access node;

[0268] The identifier of the data demander and / or data provider corresponding to the data access node;

[0269] The identifier of the data access node.

[0270] In one embodiment, the first communication interface 1 is further used for:

[0271] Sending first information to a setting server; wherein,

[0272] The first information includes the one or more related information of the data access node registered in the first network device and an identifier of the first network device.

[0273] In one embodiment, the first data product is published by the data provider to the first data platform, the first network device supports docking with multiple data platforms, and the first communication interface 1 is further used for:

[0274] Receive the first contract sent by the first data platform.

[0275] In one embodiment, the first communication interface 1 is further used for:

[0276] Receive a third request sent by the second data access node; the third request is used to request to publish data in the first network device; the data published to the first network device is used for the first data product to provide data services.

[0277] It should be noted that the specific processing process of the first communication interface 1 can be understood by referring to the above method.

[0278] Of course, in actual application, the various components in the electronic device are coupled together through the bus system 4. It can be understood that the bus system 4 is used to realize the connection and communication between these components. In addition to the data bus, the bus system 4 also includes a power bus, a control bus and a status signal bus. However, for the sake of clarity, Fig. 9 Various buses are labeled as bus system 4 .

[0279] The first memory 3 in the embodiment of the present application is used to store various types of data to support operations in the electronic device. Examples of such data include: any computer program used to operate on the electronic device.

[0280] The method disclosed in the above embodiment of the present application can be applied to the first processor 2, or implemented by the first processor 2. The first processor 2 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by the hardware integrated logic circuit or software instructions in the first processor 2. The above-mentioned first processor 2 may be a general-purpose processor, DSP, or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc. The first processor 2 can implement or execute the various methods, steps and logic block diagrams disclosed in the embodiments of the present application. A general-purpose processor may be a microprocessor or any conventional processor, etc. In combination with the steps of the method disclosed in the embodiment of the present application, it can be directly embodied as a hardware decoding processor to execute, or it can be executed by a combination of hardware and software modules in the decoding processor. The software module can be located in a storage medium, which is located in the first memory 3. The first processor 2 reads the information in the first memory 3 and completes the steps of the above method in combination with its hardware.

[0281] In an exemplary embodiment, the electronic device may be implemented by one or more ASICs, DSPs, PLDs, CPLDs, FPGAs, general purpose processors, controllers, MCUs, Microprocessors, or other electronic components to perform the aforementioned methods.

[0282] It can be understood that the first memory 3 of the embodiment of the present application can be a volatile memory or a non-volatile memory, and can also include both volatile and non-volatile memories. Among them, the non-volatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), a magnetic random access memory (FRAM), a flash memory, a magnetic surface memory, an optical disc, or a compact disc read-only memory (CD-ROM); the magnetic surface memory can be a disk memory or a tape memory. The volatile memory can be a random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static random access memory (SRAM), synchronous static random access memory (SSRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM, SyncLink Dynamic Random Access Memory), and direct RAMbus random access memory (DRRAM, Direct Rambus Random Access Memory).The memories described in the embodiments of the present application are intended to include, but are not limited to, these and any other suitable types of memories.

[0283] In an exemplary embodiment, the present application also provides a storage medium, namely a computer storage medium, specifically a computer-readable storage medium, for example, an electronic device storing a computer program, and the computer program can be executed by the first processor 2 of the electronic device to complete the steps of the aforementioned method. The computer-readable storage medium can be a memory such as FRAM, ROM, PROM, EPROM, EEPROM, Flash Memory, magnetic surface storage, optical disk, or CD-ROM.

[0284] In an exemplary embodiment, the embodiment of the present application further provides a computer program product, including a computer program, and the computer program can be executed by the first processor 2 of the electronic device to complete the steps of any of the aforementioned methods.

[0285] It should be noted that: "first", "second", etc. are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence.

[0286] The term "and / or" herein is only a description of the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent the three situations that A exists alone, A and B exist at the same time, and B exists alone. In addition, the term "one or more" herein represents any combination of at least two of any one or more of a plurality. For example, including at least one of A, B, and C can represent including any one or more elements selected from the set consisting of A, B, and C.

[0287] In addition, the technical solutions described in the embodiments of the present application can be combined arbitrarily without conflict.

[0288] The above description is only a preferred embodiment of the present application and is not intended to limit the protection scope of the present application.

Claims

1. A data circulation method, characterized in that: Applied to a first network device, the method comprises: generating a first policy based on a first contract between a data demander and a data provider of a first data product; the first contract represents a usage agreement between the data demander and the data provider for the first data product; and the first policy represents a data usage policy matching the first contract; generating a first work order including the first strategy; Pushing the first work order to the first data access node and the second data access node; wherein, The first data access node represents the data access node of the data demander, the first work order is used by the data demander to use the data based on the first policy, and the second data access node represents the data access node of the data provider, and the first work order is used by the data provider to deliver data based on the first policy.

2. The method according to claim 1, characterized in that The first work order includes: an identifier of the first data access node and an identifier of the second data access node; before pushing the first work order to the first data access node and the second data access node, the method further includes: determining a first address of the first data access node based on the identifier of the first data access node; and, Based on the identifier of the second data access node, a second address of the second data access node is determined.

3. The method according to claim 2, characterized in that The first data access node is registered with the first network device, and the second data access node is registered with the second network device; correspondingly, based on the identifier of the second data access node, determining the second address of the second data access node includes: broadcasting a first request, and receiving a first response returned by the second network device; and / or, Sending a first request to a setting server and receiving a first response returned by the setting server; wherein, The first request is used to request to query the address of the second data access node; the first request carries the identifier of the second data access node; the first response carries the second address, and the setting server stores the addresses of all data access nodes.

4. The method according to claim 1, characterized in that: The method further comprises: receiving a second request sent by one or more data access nodes; wherein, The second request is used to request registration of a corresponding data access node in the first network device; the second request carries one or more of the following relevant information of the corresponding data access node: The address of the data access node; The identifier of the data demander and / or data provider corresponding to the data access node; The identifier of the data access node.

5. The method according to claim 4, characterized in that The method further comprises: Sending first information to a setting server; wherein, The first information includes the one or more related information of the data access node registered in the first network device and an identifier of the first network device.

6. The method according to claim 1, characterized in that The first data product is published by the data provider to the first data platform, and the first network device supports docking with multiple data platforms; the method further includes: Receive the first contract sent by the first data platform.

7. The method according to claim 1, characterized in that The method further comprises: Receive a third request sent by the second data access node; the third request is used to request to publish data in the first network device; the data published to the first network device is used for the first data product to provide data services.

8. A data circulation system, characterized in that: include: A first network device and a plurality of data access nodes; the plurality of data access nodes include one or more first data access nodes and one or more second data access nodes; The first network device is used to execute the steps of the method according to any one of claims 1 to 7.

9. A data circulation device, characterized in that: Applied to a first network device, comprising: A first generating unit, configured to generate a first policy based on a first contract between a data demander and a data provider of a first data product; the first contract represents a usage agreement between the data demander and the data provider for the first data product; the first policy represents a data usage policy matching the first contract; A second generating unit, configured to generate a first work order including the first strategy; A push unit is used to push the first work order to the first data access node and the second data access node; wherein, The first data access node represents the data access node of the data demander, the first work order is used by the data demander to use the data based on the first policy, and the second data access node represents the data access node of the data provider, and the first work order is used by the data provider to deliver data based on the first policy.

10. An electronic device, characterized in that: include: A first processor and a first communication interface; wherein, The first processor is used to generate a first policy based on a first contract between a data demander and a data provider of a first data product; the first contract represents a usage agreement between the data demander and the data provider for the first data product; the first policy represents a data usage policy matching the first contract; and generating a first work order including the first strategy; The first communication interface is used to push the first work order to the first data access node and the second data access node; wherein, The first data access node represents the data access node of the data demander, the first work order is used by the data demander to use the data based on the first policy, and the second data access node represents the data access node of the data provider, and the first work order is used by the data provider to deliver data based on the first policy.

11. An electronic device, characterized in that: include: a first processor and a first memory for storing a computer program executable on the processor, Wherein, when the first processor is used to run the computer program, the steps of the method described in any one of claims 1 to 7 are executed.

12. A storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.

13. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.

Images