A Method for Implementing a Data Market Based on a Data Grid

Abstract

The present invention discloses a method for implementing a data market based on a data grid, which comprises the following steps: Step 1: Construct a distributed data grid architecture; Step 2: The self-service platform provides basic service interfaces; Step 3: The seller constructs and publishes data products; Step 4: The buyer searches for relevant data products and places orders; Step 5: Upgrade to a service-distributed data market. On the basis of considering the necessary function of the data market, which is to provide a platform for data trading, and in order to achieve distributed management of data and ensure data privacy and security, the present invention combines the traditional centralized data market model with the data market model based on blockchain technology, improving the efficiency of data management and ensuring data privacy, security and credibility. Starting from the functions of the data market and the essence of the implementation technology, a method for constructing a distributed data market is developed, while maximizing data privacy, data security and transaction fairness.

Description

Technical Field

[0001] The present invention relates to the technical field of big data, and in particular to a method for implementing a data market based on a data grid. Background Art

[0002] Since the rise of the Internet era to date, especially with the continuous iteration of emerging and cutting-edge data storage and analysis technologies represented by big data and artificial intelligence, data has become one of the core barriers in all walks of life. Massive business systems produce incalculable amounts of various structured and unstructured data every day. Collecting data for continuous in-depth analysis plays an important role in providing personalized services, optimizing company decisions, and predicting future trends, etc., and thus leads to technological innovation and economic growth.

[0003] Thereby, a service platform centered around data - the data market - has emerged. The necessary roles in the data market are data buyers and data sellers. Data sellers provide various data products in the data market. Data buyers need to purchase data products and combine them with their own data for in - depth insights into business systems. The data market, as a service platform, provides a complete path for the transaction process between the two parties and relevant privacy protection, etc.

[0004] Currently, the more representative and mature data market model is the centralized data market, that is, the data market is a centralized data platform, and both parties' data need to flow into the data market, such as centralized data storage and download. With the upgrading of requirements in aspects such as data privacy, security, and data circulation efficiency, the data market model based on blockchain is also constantly developing. And the data market model based on blockchain has two different development directions around whether the data is uploaded to the chain. The data - on - chain model mainly adds data to the nodes of the blockchain network through distributed data storage; the data - off - chain model mainly involves notaries participating in the verification of data transactions, and the storage and transmission of data occur off - chain.

[0005] Currently, both of the two mainstream data market models have obvious defects: (1) The centralized data market model requires the seller to upload data to the centralized data storage of the platform, which not only causes secondary storage of data, but also causes an obvious data swamp dilemma in the long - term maintenance of massive data; (2) The data storage based on blockchain does not provide an effective solution for the storage and transfer of massive data. The distributed file data storage based on blockchain cannot ensure the data is always reachable, and it depends on the simultaneous online of multiple nodes; (3) The system transfer power of the data market based on blockchain is insufficient. Although it can protect users' privacy and data security to a great extent, the motivation for user nodes to maintain the system operation is not clear, which is more likely to lead to system crashes. And its technical privacy implementation does not fit well with the positioning of the data market. For example, how to resist and supervise if a user sells illegal data, etc.

[0006] Therefore, it is necessary to provide an implementation method for a data market based on a data grid to address the deficiencies of the above problems. Starting from the functions of the data market and the essence of the implementation technology, this method constructs a distributed data market method while maximizing data privacy, data security, and transaction fairness. Summary of the Invention

[0007] The purpose of this section is to outline some aspects of the embodiments of the present invention and briefly introduce some preferred embodiments. Simplifications or omissions may be made in this section, the abstract of the specification, and the title of the invention to avoid obscuring the purpose of this section, the abstract of the specification, and the title of the invention, but such simplifications or omissions shall not be used to limit the scope of the present invention.

[0008] Therefore, the technical problem to be solved by the present invention is how to further optimize the performance and functions of the data grid relying on big data, construct a distributed data market method, improve data consistency, security, and access efficiency, and solve the problems of data privacy, data security, and transaction fairness.

[0009] To solve the above technical problems, the present invention provides the following technical solution: An implementation method for a data market based on a data grid, characterized by comprising the following steps:

[0010] Step 1: Construct a distributed data grid architecture management system, including a self-service platform module and a distributed network composed of several nodes. Each node registers and maintains its own data to form a data product and is connected to the data grid through the distributed network;

[0011] Step 2: The self-service platform sets the public implementation of the basic service interface as an embodiment of the smart contract, including access for user node registration, information verification of the data products submitted by users, calculation of data rankings in the data market, and display and search of data information, etc.;

[0012] Step 3: The seller constructs a data product and publishes it to the data market, including encryption settings of the data product and writing and publishing of metadata information;

[0013] Step 4: The buyer searches for relevant data products and subscribes, including viewing information of the seller's data products and data subscription;

[0014] Step 5: Upgrade the distributed data market platform for services.

[0015] As a preferred solution for the implementation method of the data market based on the data grid of the present invention, step 1 further includes: the data seller and the data buyer are registered in the data grid as a single domain or a data product; the data of the data seller is organized and managed by itself, realizing the distributed storage of data, and the data market itself does not bear the responsibility of storing massive data and disaster recovery backup; the data seller encapsulates the data and the corresponding metadata, code, and infrastructure into a data product and directly publishes it in the data market; the self-service platform of the data market publicly defines the basic principles and infrastructure interfaces for data transactions in the market, the public interfaces for data registration, the basic process interfaces for data transactions, and the underlying implementation interfaces for data security; the data transaction process is compatible with blockchain technology for multi-party proof.

[0016] As a preferred solution for the implementation method of the data market based on the data grid of the present invention, step 2 further includes that the self-service data platform has a built-in function for user registration and login, enabling the data seller and the data buyer to log in to the distributed data market as a domain node; the data products constructed by the seller will be displayed according to the ranking based on the user's search keywords, and the ranking system is the open information of the self-service data platform.

[0017] As a preferred solution for the implementation method of the data market based on the data grid of the present invention, step 3 further includes a data product component, and the data product component includes: (1) data and metadata, (2) code, (3) infrastructure; the data is the data prepared for sale by the seller through operations such as collection, cleaning, or annotation, and the metadata is a detailed description of the data asset; the code is the functional interface code encapsulated by the data product inheriting the self-service data platform.

[0018] As a preferred solution for the implementation method of the data market based on the data grid of the present invention, the data subscription in step 4 includes: (1) direct subscription; (2) the buyer publishes data requirements and broadcasts them in the data market; (3) the seller prepares the data product and notifies the buyer, and the buyer subscribes after multi-party evaluation; (4) the buyer determines the seller's data product that meets the requirements and selects to subscribe, including interacting with the self-service platform to obtain a subscription voucher; (5) the subscribed data is transmitted, the transaction is completed and evaluated, including interacting with the self-service platform to obtain a transaction ticket voucher.

[0019] As a preferred solution for the implementation method of the data market based on the data grid of the present invention, step 5 further includes (1) the nodes starting the service will obtain commissions through the transactions of other data sellers and buyers; (2) the self-service data platform provides a public verification model for the preset data types, and the model used is publicly available on the platform to ensure that the original data will not be modified or recorded; (3) when the preset filtering model detects illegal data, it will be broadcast across the network, the reputation of this ID will be downgraded, and the operations of this ID will be restricted.

[0020] Advantages of the present invention: The present invention proposes a method for implementing a data market based on a data grid, starting from the essential existence of the data market, and constructing a complete runtime solution for data storage, data privacy, data security, and efficient data circulation.

[0021] (1) The present invention uses a data grid as the underlying implementation of the data market, and clearly defines the functions of the platform and each node based on the domain ownership principle and the self-service data platform principle of the data grid.

[0022] (2) Decentralized, with data self-managed by each domain node, achieving true distributed data storage and eliminating the disadvantages of centralized data storage.

[0023] (3) Define and explain the necessary functions of the self-service data platform, making the overall operation of the data market convenient, efficient, and secure.

[0024] (4) Add data encryption and signature during the transaction process to ensure data privacy, security, and trust to the greatest extent.

[0025] (5) Define and open up the ranking mechanism for data products for optimization to achieve market fairness.

[0026] (6) The proposed data market can be extended to a service-distributed data market through blockchain technology. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the following will briefly introduce the drawings required for the description of the embodiments. Obviously, the following drawings are only some embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0028] Among them:

[0029] Figure 1 is a flowchart of a method for implementing a data market based on a data grid according to an embodiment provided by the present invention;

[0030] Figure 2 is a schematic diagram of a centralized data market architecture of a method for implementing a data market based on a data grid according to an embodiment provided by the present invention;

[0031] Figure 3 is a schematic diagram of Data Market Mode 1 based on blockchain of a method for implementing a data market based on a data grid according to an embodiment provided by the present invention;

[0032] Figure 4Schematic diagram of data market mode 2 based on blockchain for the implementation method of data market based on data grid provided by the present invention;

[0033] Figure 5 Component architecture diagram of data market based on data grid for the implementation method of data market based on data grid provided by the present invention;

[0034] Figure 6 Schematic diagram of self-service platform components for the implementation method of data market based on data grid provided by the present invention;

[0035] Figure 7 Schematic diagram of data trading process in the data market for the implementation method of data market based on data grid provided by the present invention. Detailed implementation manners

[0036] To make the above objects, features, and advantages of the present invention more obvious and understandable, the following detailed description of the specific implementation manners of the present invention will be made in conjunction with the accompanying drawings of the specification.

[0037] In the following description, many specific details are set forth to fully understand the present invention. However, the present invention can also be implemented in other ways different from those described herein. Those skilled in the art can make similar extensions without departing from the connotation of the present invention. Therefore, the present invention is not limited by the specific embodiments disclosed below.

[0038] Secondly, the present invention will be described in detail with reference to the schematic diagrams. When detailing the embodiments of the present invention, for the sake of convenience of description, the cross-sectional views showing the device structures will be enlarged locally not in accordance with the general scale, and the schematic diagrams are only examples and should not limit the scope of protection of the present invention herein.

[0039] Embodiment 1

[0040] Refer to Figure 1-7 , the first embodiment of the present invention. This embodiment provides a method for implementing a data market based on a data grid, which is characterized by including the following steps:

[0041] Step 1: Construct a distributed data grid architecture management system, including a self-service platform module and a distributed network composed of several nodes. Each node registers and maintains its own data to form data products, and is connected to the data grid through the distributed network.

[0042] Currently, data market models mainly include two categories:

[0043] (1) One category is the centralized data market model, such as Figure 2In a centralized data market architecture, data sellers need to upload data to a central service provider for verification and centralized storage, and data buyers download data through the central service provider. Although data security is somewhat guaranteed, data privacy is damaged, and centralized data storage will bring about the quagmire disaster of continuous maintenance.

[0044] (2) Another type is the data market model based on blockchain technology, which includes two directions. One direction (such as Figure 3 ) is shown in the blockchain-based data market model 1, that is, complete blockchain technologyization. Data is distributedly stored and transmitted peer-to-peer by network nodes, and transactions are completed by smart contracts. Its obvious disadvantage is that blockchain technology has great difficulty in storing massive data, and requires multi-point backup. Each distributed node needs to be online to access, and there are loopholes in the supervision of illegal data, which is not suitable for the actual scenario of the data market; the other direction (such as Figure 4 ) is the blockchain-based data market model 2, which divides data market transactions into two parts: on-chain and off-chain. On-chain is responsible for transactions, and off-chain is responsible for data transmission. At the same time, a notary role is added to supervise data and transactions. This method can ensure the immutability of data and the integrity of transactions, but the invasive operation actually collides with the design concept of blockchain.

[0045] Data grid is a decentralized data architecture. The core purpose is to organize and manage data according to domains and form data products, and the domain has ownership of the data. The design principles of the data grid include domain-oriented data ownership, data as a product, self-service platform, and joint computing governance. In the data grid architecture, blockchain technology is a technical means to achieve distributed or federated governance, rather than the main architecture.

[0046] Data product is the architectural quantum in the data grid, constructed by the domain. Each data product, as the smallest component that can run independently, should include three structural components: code, data and metadata, and infrastructure.

[0047] (Such as Figure 5 ) The data market component diagram of the present invention based on the data grid. The data grid architecture has natural advantages as the basic architecture of the data market:

[0048] (1) Data sellers and data buyers can register in the data grid as a single domain or data product;

[0049] (2) The data of data sellers is organized and managed by themselves (including data disaster recovery), realizing the distributed storage of data. The data market itself does not bear the responsibility of storing massive data and disaster recovery backup;

[0050] (3) The data seller encapsulates the data, corresponding metadata, code, etc. into a data product and directly publishes it in the data market to achieve discoverability, searchability, and subscribability.

[0051] (4) The self-service platform of the data market publicly defines the basic principles and infrastructure interfaces for data transactions in the market, such as the public interface for data registration, the basic process interface for data transactions, and the underlying implementation interface for data security. The data market can be regarded as the role of a smart contract in the blockchain, ensuring the Turing completeness of the data market.

[0052] (5) The data transaction process can be compatible with blockchain technology for multi-party proof.

[0053] Step 2: The self-service platform sets up the public implementation of the basic service interface as an embodiment of the smart contract, including the access for user node registration, the information verification of the data products submitted by users, the calculation of the data ranking in the data market, and the display and search of data information.

[0054] (As Figure 6 ) As shown in the self-service data (service) platform of the data market of the present invention, the self-service data platform is not only the basic implementation at the functional interface level and the guarantee of the Turing complete system of the data transaction flow chart, but also an entrance with interface function implementation.

[0055] The self-service data platform has built-in functions for user registration and login, enabling data sellers and data buyers to log in as a domain node to the distributed data market.

[0056] The data mart component is the core component of the data market, realizing complete transactions such as the release, query, and subscription of data products. Seller users can publish data here, and buyer users can publish and subscribe to demands here.

[0057] The data products constructed by the seller will be displayed according to the ranking based on the user's search keywords. The ranking system is the open information of the self-service data platform. The most basic ranking strategy recommended in the present invention is based on the subscription times, price, and margin of the data product. The scheme is as follows:

[0058] Ranking = Comprehensive coefficient 1 × Number of subscribers × (Price / Margin) + Comprehensive coefficient 2 × Domain score

[0059] Wherein:

[0060] (1) The number of subscribers is an important measurement indicator, which can reflect the popularity and trustworthiness of the data provider. More subscribers usually mean higher demand and a wider user base. Therefore, the number of subscribers is a key factor in the ranking.

[0061] (2) Divide the price by the margin ratio as the second indicator to more accurately reflect the reasonableness of the price. For data providers with a relatively high price compared to a low margin, the score for this item in the ranking will decrease to prevent unfair ranking results caused by excessively high prices;

[0062] (3) The domain score is the comprehensive score of the organization where the data product is located. For example, a certain seller organization can release multiple data products. When a new data product is released, the ranking score of this data product is 0. At this time, the domain score is required as a reference. The domain score is mainly calculated from the historical data product score and the margin score;

[0063] (4) The comprehensive coefficient is a continuously adjusted coefficient. Initially, it can be calculated by normalizing the parameters of the industry to which the data label belongs. The purpose is to maximize the normalization of the data ranking within the range where the keyword is located when the user searches for data. The data prices in different fields, with different contents, and different quantities will all have large fluctuations, so normalization is required. This coefficient can be adjusted by dynamic voting of market users.

[0064] Information such as data details in the data mart component is encapsulated by the data seller itself when reconstructing the data product, and the self-service data platform is responsible for direct display.

[0065] The personal center records all the data products published or purchased by the user as well as the transaction voucher records. The user can regularly back up and download the proof information for subsequent data security credentials.

[0066] The interface description part is the index entry of all the underlying service interfaces that ensure the closed-loop transaction of the data market in the self-service data platform. The self-service platform itself acts as a role of a smart contract and has Turing completeness, such as the built-in implementation of basic functions such as user registration, data publishing, data querying, and data subscribing. It also includes infrastructure interfaces involved in data product encapsulation. For example, when constructing a data product, it is necessary to construct data publishing APIs and data subscription APIs according to the interface description. These APIs inherit the base classes provided by the self-service data platform, enabling the data product to operate in a closed loop in a distributed data grid.

[0067] Step 3: The seller constructs a data product and publishes it to the data market, including encryption settings of the data product and writing and publishing of metadata information, etc.

[0068] In the present invention, the data product is the basic unit of transaction. The data product itself encapsulates the data constructed by the data seller, and at the same time, it is necessary to construct a publishing API according to the interface of the self-service data platform so that it can operate in a distributed grid. The construction of the data product needs to involve three components: code, data and metadata, and infrastructure.

[0069] (1) Data and Metadata

[0070] The data is the data to be sold formed by the seller through a series of business operations such as collection, cleaning, and annotation, including all data assets such as statistical information, images, audio, etc.

[0071] Metadata is a detailed description of data assets. The metadata fields required by the data market in the present invention include:

[0072] {

[0073] Description: Explanation of the basic information of the data

[0074] Type: Text, image, audio, video, table, etc.

[0075] Data volume: Total number of data entries, duration, and other type-related measurement information

[0076] Data size: Physical storage space on the disk, shape of a single entry, etc.

[0077] Selling price: Includes the complete selling price of the data and the compensation price for data that does not meet the warranty statement conditions

[0078] Label: Labels based on the industry or data attributes

[0079] Warranty statement: Additional warranty attributes of the data, such as ensuring complete data fields, time limits, etc.

[0080] Others: Other information that can be supplemented

[0081] }

[0082] (2) Code

[0083] The code is the functional interface code encapsulation inherited by the data product from the self-service data platform, mainly including the following points:

[0084] Data publishing interface code: Used to connect the prepared data to the data market and provide other nodes with the ability to discover the data product and address it;

[0085] Data subscription interface code: Used to encapsulate the data transmission implementation after the buyer subscribes to the data, that is, extract data from its own data storage and transmit the data to the subscriber according to the subscription mode.

[0086] Data update interface code: Used to encapsulate the data update strategy, and can dynamically update the provided data according to the specific contract for subscription;

[0087] Transaction interface code: An interface used to specify relevant information such as the wallet for the transaction, the signature subject, etc.;

[0088] The above are relatively important interfaces, which are options that must be configured during the construction of data products. The purpose is to ensure the complete circulation of data products in the data market. In fact, through user login to the self-service platform, the information required for some interfaces has been bound, so they can be directly configured. However, the specific implementation of the transmission of seller data from its own data storage to subscribers needs to be updated by the seller itself.

[0089] (3) Infrastructure

[0090] Infrastructure is a necessary dependency for the operation of data products. One part is the operation interfaces provided by the self-service data platform, and the other part is the functional infrastructure of domain users themselves, such as source data storage facilities, etc.

[0091] Step 4: The buyer searches for relevant data products and subscribes, including viewing the information of the seller's data products and data subscription.

[0092] (As Figure 7 ) As shown in the data subscription transaction process of the present invention, data subscription specifically includes the following basic processes:

[0093] Step 4-1: Direct subscription

[0094] When the seller prepares the data products for sale, these data products can be discovered, queried, and subscribed in the data market. The data buyer conducts keyword queries on the self-service data platform according to its own needs, views the available data products based on the ranking, and at this time, the metadata information of the data products is viewed. When the buyer is satisfied with a certain data product, it can subscribe to the data product.

[0095] Step 4-2: The buyer publishes data requirements and broadcasts them in the data market;

[0096] Where there is a demand, there is a response. As a market, it is reasonable for the data market to achieve a balance of bilateral demands. When the data buyer cannot find a satisfactory data product in the data market, it can broadcast information in the data market by publishing demands. The requirements for the broadcast field information are as follows:

[0097] {

[0098] Description: Requirement description

[0099] Expected price:

[0100] Expected quantity:

[0101] Other data requirements: Such as the length and shape of entries, etc.

[0102] Deadline: The deadline for this requirement

[0103] }

[0104] After the requirements are published through the self-service data platform, they will be broadcast in the distributed grid, and all nodes can receive the requirements. Relevant data sellers can prepare data fields according to the requirement descriptions before the deadline.

[0105] Step 4-3: The seller prepares the data product and notifies the buyer, and the buyer conducts a multi-party evaluation and then subscribes.

[0106] The data seller prepares the data product required by the requester according to the specifications of the data mart, and actively notifies the requester after the data is prepared.

[0107] Before the deadline, the data requester evaluates the comprehensive data information received from the delivered seller and subscribes to the satisfactory data product.

[0108] Step 4-4: The buyer determines the seller's data product that meets the requirements and selects a subscription, including interacting with the self-service platform to obtain a subscription voucher.

[0109] The buyer decides to subscribe to the data product and can receive the data through the subscription interface provided by the seller's data product. To ensure data privacy, that is, the data is not damaged during the transmission process, the transmission is verified by combining encryption and signature.

[0110] (1) The buyer generates an encryption key pair (such as RSA), calls the subscription interface, and passes in the buyer's public key

[0111] (2) The seller receives the buyer's public key and encrypts the provided data

[0112] (3) The seller generates an encryption key pair, uses the private key to digitally sign the provided data, specifically including generating a digest of the provided data using a hash function (such as sha256), and encrypting the generated digest as the digital signature

[0113] (4) The seller transmits the encrypted data, digital signature, hash function name, and the seller's public key to the buyer through the subscription interface

[0114] (5) After receiving the data, the buyer decrypts the data and the digital signature, and uses the hash function on the decrypted data to obtain a digest to check if it has been tampered with

[0115] Data protection during the transmission process is completed through the above methods, so that the data will not be leaked or tampered with.

[0116] The subscription operation is accompanied by the self-service data platform's recording of the status of both parties, including the buyer's declaration of subscribing to a certain data product of the seller and the price that needs to be supported, the metadata information of the seller's corresponding data product and supplementary guarantee responsibilities. Both parties confirm the receipt of the recorded information and sign the confirmation. The data self-service platform, the seller, and the buyer jointly hold the same signed transaction contract.

[0117] Step 4-5: Transmit the subscribed data, complete the current transaction and conduct an evaluation, including interacting with the self-service platform to obtain the transaction receipt voucher.

[0118] After the seller transmits the data, the self-service data platform records the seller's operations, and the seller receives the transaction voucher provided by the self-service data platform. After the buyer receives the data, the buyer completes the verification, pays the corresponding price, and also receives the transaction voucher from the self-service data platform. At this point, a complete transaction is completed, and the complete transaction link is coordinated and transferred by the self-service data platform, and the transaction information is jointly confirmed by the three parties.

[0119] Step 5: Upgrade the service distributed data market platform

[0120] The above completes a complete method for building a data market based on a data grid from construction to data transaction transfer, in which the storage, organization, and management of data are truly distributed. The self-service data platform plays the role of a smart contract, determining the effective and secure transaction link between the data seller and the data buyer. The information of both parties is invisible to each other, ensuring data privacy. Even the information of the buyer and the seller can be invisible to the self-service data platform, which is technically fully achievable. However, based on the principle of promoting the development of an effective, legal, and orderly market, this invention does not recommend loosening supervision. Therefore, the baseline of this invention is that the data self-service platform still needs to assume part of the responsibility for centralized monitoring. In addition, the blockchain technology can still be used to record the transaction process blocks, and the self-service platform provides commissions to ensure the normal transfer of the blocks.

[0121] The service provider of the data market is an organization with certain qualifications, which is responsible for the multi-point operation of the service. To maximize the guarantee of the legal and orderly development of the market, the user's identity information can be completely anonymous to the platform, and registration can be done through the unique ID of the blockchain wallet. However, the premise for the data transaction between the two parties is to mortgage a certain amount of margin as compensation for the liability of both parties' default behaviors. Because the service provider of the data market has certain qualifications, the provider extracts a certain commission in the transaction between the two parties and compensates for the liability of the system default. As mentioned above, any transaction ultimately has the signatures of the three parties. Therefore, once a problem occurs in the data transaction, the service provider will act as the main responsible person to complete the compensation work.

[0122] The fully autonomous network based on blockchain can not only make transaction information public, but also greatly enhance user privacy and data security. However, its ability to supervise illegal information is weak. As a transaction product on the chain, according to the essence of blockchain technology, its transactions are legal and should be protected and private. However, for the real market and legal supervision, this is illegal, so conflicts are increased. Currently, there are similar technologies to make up for this gap, such as identity verification and trust mechanisms, content review and censorship mechanisms, permission control and legal supervision, etc. But these undoubtedly weaken the essential attributes of blockchain through direct or indirect intervention. Therefore, the direct or interventionist application of blockchain in the data market itself is controversial. Technology serves the market, but it should not be the case that technology is imposed on the market just for the sake of using the technology.

[0123] Based on this, the present invention also provides an idea and solution for the fully distributed data market based on data grid (increasing service distribution), that is, the storage and transaction of data products have been realized in a distributed manner, and the service providers in the data market have also been realized in a distributed manner, namely the complete blockchain mode:

[0124] (1) The nodes starting the service will obtain commissions through the transactions of other data sellers and buyers;

[0125] (2) The self-service data platform provides a public verification model for the preset data types. For example, data of image type needs to be confirmed by passing the review of the self-service data platform before transmission. The model adopted is public on the platform to ensure that the original data will not be modified or recorded;

[0126] (3) When the preset filtering model detects illegal data, it will broadcast it across the network, degrade the reputation of this ID, and restrict the operations of this ID;

[0127] The principle of minimum intervention is used to ensure the orderly development of the market and at the same time intervene in users who provide malicious and illegal data. It should be noted that if higher-level legal sanctions are required, more intervention is needed.

[0128] In summary, on the basis of considering the necessary function of the data market, which is to provide a platform for data buying and selling, in order to achieve the distributed management of data and ensure the privacy, security and trust of data, the traditional centralized data market model is combined with the data market model based on blockchain technology, which improves the efficiency of data management and ensures the privacy, security and credibility of data.

[0129] It should be understood that, in the development of any actual implementation, such as in any engineering or design project, a large number of specific implementation decisions can be made. Such development efforts may be complex and time-consuming, but for those of ordinary skill in the art who benefit from this disclosure, without undue experimentation, such development efforts will be routine work of design, fabrication, and production.

[0130] It should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention and not to limit them. Although the present invention has been described in detail with reference to the preferred embodiments, those of ordinary skill in the art should understand that the technical solutions of the present invention can be modified or equivalently replaced without departing from the spirit and scope of the technical solutions of the present invention, and they should all be covered within the scope of the claims of the present invention.

Claims

1. A method for implementing a data market based on a data grid, characterized in that Including the following steps: Step 1: Construct a distributed data grid architecture management system, including a self-service platform module and a distributed network composed of several nodes. Each node registers and maintains its own data to form a data product, and is connected to the data grid through the distributed network; Step 2: The self-service platform sets the public implementation of the basic service interface as an embodiment of the smart contract, including the access of user node registration, the information verification of the data products submitted by users, the calculation of the data ranking in the data market, and the display and search of data information; Step 3: The seller constructs a data product and publishes it to the data market, including the encryption setting of the data product and the writing and publishing of metadata information; Step 4: The buyer searches for relevant data products and subscribes, including the information viewing and data subscription of the seller's data products; Step 5: Upgrade the distributed data market platform; The said Step 1 further includes: The data seller and the data buyer register in the data grid as a single domain or data product; The data of the data seller is organized and managed by itself, realizing the distributed storage of data, and the data market itself does not bear the responsibility of massive data storage and disaster recovery backup; The data seller encapsulates the data and the corresponding metadata, code, and infrastructure into a data product and directly publishes it in the data market; The self-service platform of the data market publicly defines the basic principles and infrastructure interfaces of data transactions in the market, the public interfaces for data registration, the basic process interfaces for data transactions, and the underlying implementation interfaces for data security; The data transaction process is compatible with blockchain technology for multi-party proof; The said Step 3 further includes a data product component, and the data product component includes: (1) data and metadata, (2) code, (3) infrastructure; The data is the data prepared for sale by the seller through operations such as collection, cleaning, or annotation, and the metadata is a detailed description of the data asset; The code is the functional interface code encapsulated by the data product inheriting the self-service data platform.

2. The implementation method of the data market based on the data grid according to claim 1, characterized in that: The said Step 2 further includes the functions of user registration and login built in the self-service data platform, enabling the data seller and the data buyer to log in to the distributed data market as a domain node; The data products constructed by the seller will be displayed according to the ranking based on the user's search keywords, and the ranking system is the open information of the self-service data platform.

3. The implementation method of the data market based on the data grid according to claim 1, characterized in that: The data subscription in the said Step 4 includes: (1) direct subscription; (2) The buyer publishes data requirements and broadcasts them in the data market; (3) The seller prepares the data product and notifies the buyer, and the buyer subscribes after multi-party evaluation; (4) The buyer determines the seller's data product that meets the requirements and selects to subscribe, including interacting with the self-service platform to obtain a subscription voucher; (5) Transmit the subscribed data, complete this transaction and conduct an evaluation, including interacting with the self-service platform to obtain a transaction ticket voucher.

4. The implementation method of the data market based on the data grid according to claim 1, wherein: Step 5 further includes: (1) The node that starts the service obtains commissions through the transactions of other data sellers and buyers; (2) The self-service data platform provides an open verification model for the preset data types, and the model adopted is publicly available on the platform to ensure that the original data will not be modified or recorded; (3) When the preset filtering model detects illegal data, it broadcasts it across the network, downgrades the reputation of this ID, and restricts the operations of this ID.

Images