Data management method and related equipment

By using blockchain networks on multi-cloud platforms for data segmentation and decentralization, and generating backup identifiers, the single point of bottleneck problem is solved, and the security and management efficiency of multi-cloud backup data are improved.

CN118939472APending Publication Date: 2024-11-12HUAWEI CLOUD COMPUTING TECHNOLOGIES CO LTD +1
View PDF 0 Cites 7 Cited by

Patent Information

Application Number
CN202310889759.9
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2023-05-10
Filing Date
2023-07-19
Publication Date
2024-11-12

AI Technical Summary

Technical Problem

In the prior art, data backup relying on a single cloud platform has a single point of bottleneck, which has threatened data security and storage reliability. Data management of multi-cloud platforms is difficult and there is a lack of effective unified management solutions.

Method used

Adopt the decentralized, secure and trustworthy characteristics of the blockchain network, and realize the multi-cloud backup data by dividing the data into multiple blocks and scattering it on a multi-cloud platform, and using the blockchain network to generate a globally unique backup identifier to achieve multi-cloud backup data. Unified management and addressing to eliminate single-point security bottlenecks.

Benefits of technology

It improves the security and reliability of multi-cloud backup data, reduces user operation complexity, improves data query efficiency and accuracy, and realizes efficient management and recovery of distributed multi-cloud backup data.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118939472A_ABST
    Figure CN118939472A_ABST
Patent Text Reader

Abstract

The invention provides a data management method. The method comprises the steps that a client receives a backup plan which is configured by a user and aims at data to be backed up; the client side divides data to be backed up into c data blocks according to the number of cloud nodes used for backup and the number of backup copies, the c data blocks are stored in n cloud nodes in the multi-cloud platform in a scattered mode, and for at least one data block in the c data blocks, the multi-cloud platform stores b backup copies of the at least one data block; and the client provides metadata of the data stored by the multi-cloud platform for the block chain network, so that the block chain network encodes the metadata into a backup identifier and stores the backup identifier, and the backup identifier is used for addressing the data stored by the multi-cloud platform. According to the method, cloud chain fusion is carried out in combination with the characteristics of decentralization, security and credibility of a block chain network, the security of multi-cloud backup data is improved, and the single-point security bottleneck existing in a traditional method is eliminated.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office of China on May 10, 2023, with application number 202310524887.3 and invention name “A data management method and related equipment”, the entire contents of which are incorporated by reference in this application. Technical Field

[0002] The present application relates to the field of cloud computing technology, and in particular to a data management method, a data management system, a computing device cluster, a computer-readable storage medium, and a computer program product. Background Art

[0003] With the in-depth application and development of cloud computing in all walks of life, more and more individual users, enterprises and organizations use data disaster recovery solutions based on cloud storage, which effectively reduces the difficulty and cost of building and maintaining data disaster recovery systems. Compared with traditional backup and recovery technologies, cloud disaster recovery does not require the deployment of a large amount of infrastructure, supports on-demand subscription, elastic expansion, and is compatible with the backup of databases, files, virtualization platforms, operating systems and physical environments. It has the advantages of low investment cost, high scalability and strong compatibility.

[0004] Considering that relying on a single cloud platform will result in a single point of bottleneck, once the cloud platform fails or completely collapses, a large amount of data will be lost, threatening data security and storage reliability. More and more users choose to back up data on multiple cloud platforms (also referred to as multi-cloud platforms) to reduce the risk of failure of a single cloud platform.

[0005] How to uniformly manage data on multi-cloud platforms has become a key concern in the industry. Summary of the invention

[0006] The present application provides a data management method, which realizes cloud-chain integration and improves the security of multi-cloud backup data by combining the decentralized, secure and reliable characteristics of blockchain networks. The present application also provides a data management system, a computing device cluster, a computer-readable storage medium and a computer program product corresponding to the method.

[0007] In a first aspect, the present application provides a data management method, which can be executed by a data management system. The data management system includes a client, a multi-cloud platform, and a blockchain network, and the data management system is used to manage data on the multi-cloud platform.

[0008] Specifically, the client receives a backup plan configured by the user for the data to be backed up, the backup plan including the number n of cloud nodes used for backup in the multi-cloud platform and the number b of backup copies. Then, the client divides the data to be backed up into c data blocks according to the number n of cloud nodes used for backup and the number b of backup copies, and stores the c data blocks in n cloud nodes in the multi-cloud platform in a dispersed manner. For at least one of the c data blocks, the multi-cloud platform stores b backup copies of at least one data block. The client provides the blockchain network with metadata (also referred to as backup metadata) of the data stored on the multi-cloud platform, so that the blockchain network encodes the metadata into a backup identifier and stores the backup identifier. The backup identifier is used to address the data stored on the multi-cloud platform.

[0009] This method divides the data to be backed up into blocks and stores them in a distributed manner on the multi-cloud platform, and provides its metadata to the blockchain network for unified encoding to obtain a globally unique backup identifier. The backup identifier on the chain records and manages the data backed up in the multi-cloud platform, and uniformly locates and addresses the data backed up in the multi-cloud platform to achieve distributed multi-cloud backup data management. This method combines the decentralized, secure and reliable characteristics of the blockchain network to integrate the cloud and chain, improve the security of multi-cloud backup data, and eliminate the single-point security bottleneck of traditional methods.

[0010] In some possible implementations, the backup identifier may include a short identifier and a long identifier, wherein the short identifier may include a data identifier, and the long identifier may include a storage address of the data on the multi-cloud platform. The blockchain network may receive the short identifier provided by the user, search for the long identifier corresponding to the short identifier based on the short identifier, parse the long identifier to obtain the storage address of the data on the multi-cloud platform, and return the storage address of the data on the multi-cloud platform.

[0011] In this method, the backup identifier is determined by combining the short identifier and the long identifier. In this way, users can use the short identifier to query data, reducing the complexity of user operations. The blockchain network determines the storage address of the data through the long identifier corresponding to the short identifier, thereby improving data query efficiency and accuracy.

[0012] In some possible implementations, the backup identifier includes a first short identifier, a first long identifier, and a second short identifier and a second long identifier, the first short identifier includes a data identifier, the first long identifier includes a version set, the second short identifier includes the data identifier and a target version in the version set, and the second long identifier includes the storage address of the target version data on the multi-cloud platform.

[0013] This method takes into account that the data backed up by the multi-cloud platform can have multiple versions. The version of the data is added to the backup identifier, so that the data of multiple time versions can be recorded and managed through the backup identifier on the chain, thereby supporting the unified positioning and addressing of the data backed up by the multi-cloud platform, so as to realize the management of distributed multi-cloud backup data.

[0014] In some possible implementations, the blockchain network can obtain the state parameters of the cloud nodes in the multi-cloud platform, obtain the weights of the cloud nodes in the multi-cloud platform based on the state parameters, and return the node identifiers of n cloud nodes whose weights meet the requirements to the client.

[0015] This method obtains the weight of the cloud node through the state parameters of the cloud node, thereby determining the n cloud nodes used for distributed storage of data, thereby realizing the scheduling of the multi-cloud platform and further realizing the efficient management of the multi-cloud platform data.

[0016] In some possible implementations, the state parameters may include one or more of node bandwidth, node cost, node remaining storage capacity, and node reputation information. In this method, the state parameters may include static parameters (node ​​bandwidth and node cost) that are basically fixed after subscribing to the cloud service and dynamic parameters (node ​​remaining storage capacity and node reputation information) whose values ​​can be dynamically adjusted. In this way, as the data is backed up on the multi-cloud platform, the smart contract is updated.

[0017] In some possible implementations, the node reputation information may include a node reputation value, which may be dynamically adjusted as the backup operation triggers a multi-cloud state parameter update contract. For example, the node reputation value may be dynamically adjusted based on the audit results. The more successful audits there are, the higher the node reputation value (credibility) of the cloud node; the more failed audits there are, the lower the node reputation value (credibility) of the cloud node.

[0018] In some possible implementations, the blockchain network can normalize the state parameters of the cloud nodes before calculating the weights of the cloud nodes in the multi-cloud platform. By selecting a suitable normalization function to process the parameter vector, the comparability between different parameters can be enhanced. Then, the influence coefficient of each parameter can be determined by a suitable method (such as the entropy weight method). The influence of each parameter on the weight is processed according to the degree of difference of each parameter, which can improve the credibility of the multi-cloud scheduling calculation and the flexibility of the scheduling strategy.

[0019] In some possible implementations, the blockchain network can check the consistency between the actual storage address of the data in the multi-cloud platform and the storage address recorded in the backup identifier stored in the blockchain network. If there is inconsistency, the blockchain network can restore the data on the multi-cloud platform according to the storage address recorded in the backup identifier.

[0020] This method takes into account the inconsistency caused by accidental deletion of files or directories by the operation and maintenance personnel of the cloud service provider after the data is backed up. By setting up a consistency verification mechanism, the inconsistency caused by the accidental deletion operation can be discovered in time and restored in time.

[0021] In some possible implementations, the client may create a backup storage transaction and execute the backup storage transaction to perform a transaction operation of dispersing and storing c data blocks on n cloud nodes in the multi-cloud platform and a transaction operation of providing metadata of the data stored on the multi-cloud platform to the blockchain network.

[0022] This method introduces the concept of transaction, which can be defined as backing up data in the data management system. By executing backup storage transactions, backup data storage is realized, thereby ensuring the consistency of the cloud chain before and after backup data storage and improving the security of multi-cloud backup data.

[0023] In some possible implementations, the client may obtain incremental data, create a backup update transaction, and execute the backup update transaction to perform a transaction operation of storing incremental data in the multi-cloud platform and a transaction operation of updating a backup identifier.

[0024] This method introduces the concept of transaction, which can be defined as an incremental update of data in the data management system. By executing backup update transactions, incremental backup updates can be achieved, thereby ensuring the consistency of the cloud chain before and after the incremental update and improving the security of multi-cloud backup data.

[0025] In some possible implementations, the client may create a backup deletion transaction in response to a deletion operation, and execute the backup deletion transaction to perform a transaction operation of deleting data corresponding to a specified data identifier and a transaction operation of deleting a backup identifier corresponding to the specified data identifier.

[0026] This method introduces the concept of transaction, which can be defined as the deletion of data in the data management system. By executing backup deletion transactions, backup data deletion is achieved, thereby ensuring the consistency of the cloud chain before and after backup data deletion and improving the security of multi-cloud backup data.

[0027] In some possible implementations, the client can achieve consistency and atomicity of backup, update, and deletion transactions through retry and rollback mechanisms. For example, in the process of storing the data to be backed up in the multi-cloud platform, if there is a network anomaly on the cloud platform that causes the transaction to fail, the client can retry and rollback. For another example, in the process of storing incremental data in the multi-cloud platform, if there is a network anomaly on the cloud platform that causes the transaction to fail, the client can roll back and retry. For another example, in the process of deleting the data corresponding to the specified data identifier from the multi-cloud platform, if there is a network anomaly on the cloud platform that causes the transaction to fail, the deletion failure position can be returned and the backup identifier in the blockchain network can be updated.

[0028] In some possible implementations, the number of data blocks to be cut into pieces for data to be backed up is equal to C(n,n-q+1). The client can generate a scheduling allocation table based on the number of data blocks to be cut into pieces for data to be backed up. The scheduling allocation table records the data blocks to be stored in n cloud nodes, and then stores the c data blocks in the n cloud nodes in the multi-cloud platform in a distributed manner according to the scheduling allocation table.

[0029] This method uses the idea of ​​secret partitioning (also called threshold secret partitioning) to implement the scheduling of backup resources. When any backup data block within the corresponding range fails, the data can still be fully restored, which improves the robustness of data backup. In addition, the cloud nodes participating in the backup have exactly the same importance. The impact of multiple node crashes is related to the number of crashed nodes. There are no special or unusually important nodes, which realizes a truly decentralized scheduling strategy.

[0030] In a second aspect, the present application provides a data management system, the system comprising a client, a multi-cloud platform, and a blockchain network, the system being used to manage data on the multi-cloud platform;

[0031] The client is used to receive a backup plan configured by a user for the data to be backed up, wherein the backup plan includes the number n of cloud nodes used for backup in the multi-cloud platform and the number b of backup copies;

[0032] The client is further configured to divide the data to be backed up into c data blocks according to the number of cloud nodes for backup and the number of backup copies, and store the c data blocks in n cloud nodes in the multi-cloud platform in a dispersed manner; for at least one data block among the c data blocks, the multi-cloud platform stores b backup copies of the at least one data block;

[0033] The client is also used to provide the blockchain network with metadata of the data stored on the multi-cloud platform, so that the blockchain network encodes the metadata into a backup identifier and stores the backup identifier, and the backup identifier is used to address the data stored on the multi-cloud platform.

[0034] In some possible implementations, the backup identifier includes a short identifier and a long identifier, the short identifier includes a data identifier, the long identifier includes a storage address of the data on the multi-cloud platform, and the blockchain network is used to:

[0035] Receiving the short identifier provided by the user;

[0036] The long identifier corresponding to the short identifier is searched according to the short identifier, the long identifier is parsed to obtain the storage address of the data on the multi-cloud platform, and the storage address of the data on the multi-cloud platform is returned.

[0037] In some possible implementations, the backup identifier includes a first short identifier, a first long identifier, and a second short identifier and a second long identifier, the first short identifier includes a data identifier, the first long identifier includes a version set, the second short identifier includes a data identifier and a target version in the version set, and the second long identifier includes a storage address of the data of the target version on the multi-cloud platform.

[0038] In some possible implementations, the blockchain network is also used to:

[0039] Obtaining status parameters of cloud nodes in the multi-cloud platform;

[0040] Obtaining weights of cloud nodes in the multi-cloud platform according to the state parameters;

[0041] The node identifiers of the n cloud nodes whose weights meet the requirements are returned to the client.

[0042] In some possible implementations, the state parameters include one or more of node bandwidth, node cost, node remaining storage capacity, and node reputation information.

[0043] In some possible implementations, the blockchain network is also used to:

[0044] Checking the consistency between the actual storage address of the data in the multi-cloud platform and the storage address recorded in the backup identifier stored in the blockchain network;

[0045] If they are inconsistent, the data is restored on the multi-cloud platform according to the storage address recorded in the backup identifier.

[0046] In some possible implementations, the client is further configured to:

[0047] Create a backup storage transaction;

[0048] The backup storage transaction is executed to perform the transaction operation of dispersively storing the c data blocks in the n cloud nodes in the multi-cloud platform and the transaction operation of providing the blockchain network with metadata of the data stored in the multi-cloud platform.

[0049] In some possible implementations, the client is further configured to:

[0050] Get incremental data;

[0051] A backup update transaction is created, and the backup update transaction is executed to perform a transaction operation of storing the incremental data in the multi-cloud platform and a transaction operation of updating the backup identifier.

[0052] In some possible implementations, the client is further configured to:

[0053] In response to the delete operation, creating a backup delete transaction;

[0054] The backup deletion transaction is executed to perform a transaction operation of deleting the data corresponding to the specified data identifier and a transaction operation of deleting the backup identifier corresponding to the specified data identifier.

[0055] In some possible implementations, the number of data blocks of the data to be backed up is equal to C(n,n-q+1), and the client is specifically used to:

[0056] Generate a scheduling allocation table according to the number of data blocks to be backed up, wherein the scheduling allocation table records the data blocks to be stored by the n cloud nodes;

[0057] According to the scheduling allocation table, the c data blocks are dispersedly stored in the n cloud nodes in the multi-cloud platform.

[0058] In a third aspect, the present application provides a computing device cluster. The computing device cluster includes at least one computing device, and the at least one computing device includes at least one processor and at least one memory. The at least one processor and the at least one memory communicate with each other. The at least one processor is used to execute instructions stored in the at least one memory, so that the computing device or the computing device cluster executes the data management method as described in the first aspect or any implementation of the first aspect.

[0059] In a fourth aspect, the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores instructions, wherein the instructions instruct a computing device or a computing device cluster to execute the data management method described in the first aspect or any one of the implementations of the first aspect.

[0060] In a fifth aspect, the present application provides a computer program product comprising instructions, which, when executed on a computing device or a computing device cluster, enables the computing device or the computing device cluster to execute the data management method described in the first aspect or any one of the implementations of the first aspect.

[0061] Based on the implementations provided in the above aspects, this application can also be further combined to provide more implementations. BRIEF DESCRIPTION OF THE DRAWINGS

[0062] In order to more clearly illustrate the technical method of the embodiments of the present application, the drawings required for use in the embodiments are briefly introduced below.

[0063] Figure 1 A schematic diagram of the architecture of a data management system provided in an embodiment of the present application;

[0064] Figure 2 A flowchart of a data management method provided in an embodiment of the present application;

[0065] Figure 3 A schematic diagram of a backup configuration interface provided in an embodiment of the present application;

[0066] Figure 4 A schematic diagram of a backup identifier provided in an embodiment of the present application;

[0067] Figure 5 An operation flow chart of a backup storage transaction, a backup update transaction, and a backup deletion transaction provided in an embodiment of the present application;

[0068] Figure 6 A flowchart of a data management method provided in an embodiment of the present application;

[0069] Figure 7 A flowchart of a data management method provided in an embodiment of the present application;

[0070] Figure 8 A flowchart of a data management method provided in an embodiment of the present application;

[0071] Fig. 9 A schematic diagram of the structure of a computing device provided in an embodiment of the present application;

[0072] Fig.10 A schematic diagram of the structure of a computing device cluster provided in an embodiment of the present application;

[0073] Fig.11 A schematic diagram of the structure of another computing device cluster provided in an embodiment of the present application;

[0074] Fig.12 A schematic diagram of the structure of another computer cluster provided in an embodiment of the present application. DETAILED DESCRIPTION

[0075] The terms "first" and "second" in the embodiments of the present application are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features.

[0076] First, some technical terms involved in the embodiments of the present application are introduced.

[0077] Multi-cloud backup refers to backing up data using a multi-cloud platform (multiple cloud platforms, such as cloud platforms built by different cloud service providers), where data is stored in multiple backup copies on the multi-cloud platform. Furthermore, when data is lost in the backup copy of a certain cloud platform, such as being deleted or tampered with, the backup copy can be obtained from other cloud platforms in the multi-cloud platform for recovery. This process is also called multi-cloud recovery. This can solve the problem of single-point bottlenecks in data backup on a single cloud platform. Once a cloud platform fails or completely collapses, a large amount of data will be lost, threatening data security and storage reliability.

[0078] Considering the difficulty of multi-cloud backup and recovery management, the industry provides a multi-cloud unified management platform to achieve multi-cloud backup management, disaster recovery and automatic verification. Specifically, the multi-cloud unified management platform is a fault-tolerant parallel application scheduling architecture that monitors, coordinates and manages the resources of cloud service providers through a third-party resource negotiation layer. This method relies on a trusted third-party platform (i.e., the multi-cloud unified management platform) to manage resources between users and cloud service providers. Due to the high concentration of information resources, the third-party platform faces multi-dimensional network attacks, especially administrators and third-party platforms have extremely high access rights to data and resources and can modify and delete data.

[0079] In view of this, the present application provides a distributed data management method based on blockchain technology. The method can be applied to a data management system. The data management system includes a client, a multi-cloud platform, and a blockchain network. The data management system is used to manage the data of the multi-cloud platform. For example, the data management system can back up the data on the multi-cloud platform.

[0080] Specifically, the client receives a backup plan configured by the user for the data to be backed up, the backup plan including the number n of cloud nodes used for backup in the multi-cloud platform and the number b of backup copies. Then, the client divides the data to be backed up into c data blocks according to the number n of cloud nodes used for backup and the number b of backup copies, and stores the c data blocks in n cloud nodes in the multi-cloud platform in a dispersed manner. For at least one of the c data blocks, the multi-cloud platform stores b backup copies of at least one data block. The client provides the blockchain network with metadata (also referred to as backup metadata) of the data stored on the multi-cloud platform, so that the blockchain network encodes the metadata into a backup identifier and stores the backup identifier. The backup identifier is used to address the data stored on the multi-cloud platform.

[0081] This method divides the data to be backed up into blocks and stores them in a distributed manner on the multi-cloud platform, and provides its metadata to the blockchain network for unified encoding to obtain a globally unique backup identifier. The backup identifier on the chain records and manages the data backed up in the multi-cloud platform, and uniformly locates and addresses the data backed up in the multi-cloud platform to achieve distributed multi-cloud backup data management. This method combines the decentralized, secure and reliable characteristics of the blockchain network to integrate the cloud and chain, improve the security of multi-cloud backup data, and eliminate the single-point security bottleneck of traditional methods.

[0082] In order to make the technical solution of the present application clearer and easier to understand, the system architecture of the present application is introduced below with reference to the accompanying drawings.

[0083] See also Figure 1 A schematic diagram of the architecture of a data management system is shown in FIG. Figure 1 As shown, the data management system 10 includes a client 100, a multi-cloud platform 200 and a blockchain network 300. The client 100 establishes communication connections with the multi-cloud platform 200 and the blockchain network 300 respectively. The connection method can be wired communication, or wireless communication methods such as cellular networks and WiFi.

[0084] The client 100 can be a program that provides local services to users, or a terminal that deploys the above program, including but not limited to desktops, laptops, smart phones, and smart wearable devices. Users can use the client (or terminal) to execute the consistency maintenance protocol to manage data and metadata on the multi-cloud platform 200 and the blockchain network 300, including but not limited to storage, recovery, incremental updates, and deletions. When the user wants to back up data, the data is uploaded and stored to the remote multi-cloud platform 200 through the client 100. When the locally stored data is damaged and the data needs to be restored from the multi-cloud platform 200, the user can obtain a backup identifier from the blockchain network 300 through the client 100, and obtain a copy of the data stored on the multi-cloud platform 200 based on the backup identifier.

[0085] The multi-cloud platform 200 includes cloud platforms built by various types of cloud service providers, providing various types of computing and storage resources, such as cloud computing and storage, edge computing and storage, etc. Figure 1 Taking the multi-cloud platform 200 as an example, the multi-cloud platform includes multiple cloud platforms that provide cloud storage resources. A user can pre-subscribe to cloud services from multiple cloud service providers so as to combine different resources to form a multi-cloud platform with complementary advantages.

[0086] The blockchain network 300 includes multiple blockchain nodes, and multiple blockchain nodes collaboratively store, manage and maintain backup data. In some possible implementations, the client 100 and the multi-cloud platform 200 (for example, the cloud node in the multi-cloud platform 200) can also be used as different types of blockchain nodes to jointly build the blockchain network 300. Among them, the client 100 can be a lightweight node (or light node), and the cloud node in the multi-cloud platform 200 can be a full node (or full node). Among them, the full node can initiate transactions, receive transactions, and participate in consensus. The light node can be connected to the full node and accessed through the full node. The blockchain network 300 of the present application supports different underlying blockchain infrastructures, has high flexibility, and can plug and unplug different consensus mechanisms according to application requirements. Smart contracts are an important part of the blockchain network. The system first deploys a backup identification registration contract and a backup metadata management contract on the blockchain network to realize the storage and update of metadata in the blockchain network. Multi-cloud state parameter management contracts (such as multi-cloud state parameter initialization contracts and multi-cloud state parameter update contracts) can also be deployed on the blockchain network to realize the scheduling of cloud nodes in the multi-cloud platform 200.

[0087] In a specific implementation, the client 100 is used to receive a backup plan configured by the user for the data to be backed up, the backup plan including the number n of cloud nodes used for backup and the number b of backup copies in the multi-cloud platform 200, and then divide the data to be backed up into c data blocks according to the number of cloud nodes used for backup and the number of backup copies, and store the c data blocks in n cloud nodes in the multi-cloud platform in a dispersed manner. For at least one of the c data blocks, the multi-cloud platform 200 stores b backup copies of at least one data block. The client 100 is also used to provide the blockchain network 300 with metadata of the data stored by the multi-cloud platform 200, so that the blockchain network 300 encodes the metadata into a backup identifier and stores the backup identifier.

[0088] Among them, the backup identifier is used to address the data stored in the multi-cloud platform 200. In some examples, the backup identifier includes a short identifier and a long identifier. The short identifier includes a data identifier (DataID), and the long identifier includes the storage address of the data in the multi-cloud platform 200. In this way, when the user provides a short identifier through the client 100, the blockchain network 300 can search for the long identifier corresponding to the short identifier according to the short identifier, parse the long identifier to obtain the storage address of the data in the multi-cloud platform 200, and return the storage address of the data in the multi-cloud platform 200.

[0089] The client 100 is described below from the perspective of functional modularization.

[0090] The client 100 may include a backup storage module 102. The backup storage module 102 is used to undertake the storage task of the data to be backed up, store the data to be backed up in the multi-cloud platform 200 according to the multi-cloud scheduling strategy, and store the metadata in the blockchain network 300. Specifically, the backup storage module 102 can divide the data to be backed up into c data blocks according to the number n of cloud nodes for backup and the number b of backup copies configured by the user, and disperse the c data blocks in n cloud nodes in the multi-cloud platform 200, and provide the blockchain network 300 with metadata (also called backup metadata) of the data stored in the multi-cloud platform 200, so that the blockchain network 300 encodes the metadata into a backup identifier and stores the backup identifier, which is used to address the data stored in the multi-cloud platform 200.

[0091] In some possible implementations, the client 100 may further include a multi-cloud state parameter upload module 104. The multi-cloud state parameter upload module 104 is used to upload the state parameters of the cloud nodes in the multi-cloud platform 200 to the blockchain network 300, so that the blockchain network 300 obtains the weights of the cloud nodes in the multi-cloud platform 200 according to the state parameters, and returns the identities of the n cloud nodes whose weights meet the requirements to the client 100. For example, the multi-cloud state parameter upload module 104 can upload the initialization state parameters of multiple cloud nodes to the blockchain network 300, which are recorded in the blockchain account book by the blockchain network 300 for the formulation of the multi-cloud backup scheduling strategy. Further, after the backup is completed, the global multi-cloud state parameters (for example, the state of the cloud nodes used for backup) will usually change, and the changed multi-cloud state parameters can be submitted to the blockchain network 300, and the blockchain network 300 can record the changed multi-cloud state parameters in the blockchain account book.

[0092] The client 100 also supports incremental update, deletion, and recovery of data. The following is an example of functional modules that implement corresponding functions, such as the backup addition and deletion module 106 and the backup recovery module 108.

[0093] The backup addition and deletion module 106 is used to perform incremental updates or deletions of data. The backup addition and deletion module 106 performing incremental updates of data may include the following steps: storing the incremental data in the multi-cloud platform 200, and updating the metadata in the backup identifier. For example, when a user needs to incrementally update data, he can enter a short identifier and incremental data, and the backup addition and deletion module 106 can store the incremental data in the multi-cloud platform 200 and update the corresponding fields in the long identifier. The backup addition and deletion module 106 performing deletion of data may include the following steps: deleting the data copy corresponding to the backup identifier from the multi-cloud platform 200, and deleting the backup identifier from the blockchain network 300. For example, when a user needs to delete data, he can enter a short identifier, and the backup addition and deletion module 106 can query the corresponding long identifier according to the end identifier, delete the data from the multi-cloud platform 200 according to the storage address of the data in the long identifier, and delete the short identifier and the long identifier from the blockchain network 300.

[0094] The backup recovery module 108 is used to restore data based on the backup identifier in the blockchain network 300 and the backup copy stored in the multi-cloud platform 200. Specifically, the backup recovery module 108 first queries the storage address (storage location) of the backup copy of the data on the multi-cloud platform 200 from the blockchain network 300, and then downloads the backup copy from the corresponding location of the multi-cloud platform 200 to restore the data. The application of the cloud chain fusion solution of the present application can avoid the single point bottleneck problem of the traditional method, realize the distributed multi-cloud backup management and recovery of the cloud chain collaboration, and ensure the security and availability of the backup data.

[0095] In addition, the client 100 may also include a cloud chain consistency collaboration module 109. The cloud chain consistency collaboration module 109 is used to define backup storage transactions, backup update transactions (such as backup incremental update transactions) or backup deletion transactions, and ensure the consistency of backup storage, backup update, and backup deletion through the transaction consistency protocol.

[0096] based on Figure 1 The data management system 10 shown in the figure, the present application also provides a data management method. The data management method of the present application is introduced below in conjunction with an embodiment.

[0097] See also Figure 2 A flow chart of a data management method is shown, the method is applied to a data management system 10, the data management system 10 includes a client 100, a multi-cloud platform 200 and a blockchain network 300, the data management system 10 is used to manage the data of the multi-cloud platform 200, the method includes:

[0098] S202: The client 100 receives a backup plan configured by the user for the data to be backed up.

[0099] The backup plan includes the number n of cloud nodes used for backup in the multi-cloud platform and the number b of backup copies. The cloud nodes used can come from different cloud platforms. For example, the n cloud nodes used can come from n cloud platforms, where n is a positive integer. The number b of backup copies can be a positive integer. Considering the storage reliability, the number b of backup copies can be greater than 1. Usually, three-copy storage can be used, based on which the number b of backup copies can be 3.

[0100] Specifically, when the user triggers a backup operation, for example, the user triggers a backup operation for the selected data to be backed up through a shortcut key, a voice command, or a menu control, the client 100 may present a backup configuration interface to the user. The backup configuration interface may be a graphical user interface (GUI) or a command user interface (CUI). The following description takes the backup configuration interface as an example of a GUI. Figure 3 A schematic diagram of a backup configuration interface is shown, wherein the backup configuration interface 30 includes a node usage quantity configuration control 32 and a backup copy quantity configuration control 34. The user can configure the number n of cloud nodes used for backup in the multi-cloud platform through the node usage quantity configuration control 32, and configure the number b of backup copies through the backup copy quantity configuration control 34. The backup configuration interface 30 also carries a submit control 36 and a cancel control 38. When the user triggers the submit control 36, the above configuration information can be submitted for subsequent processes. When the user triggers the cancel control 38, the configuration of the backup plan can be canceled.

[0101] S204. The client 100 divides the data to be backed up into c data blocks according to the number n of cloud nodes used for backup and the number b of backup copies.

[0102] S206 , the client 100 stores the c data blocks in a dispersed manner on n cloud nodes in the multi-cloud platform.

[0103] The client 100 (for example, the backup storage module of the client 100) can execute the multi-cloud backup scheduling strategy and the identification encoding and registration method, store multiple backup copies of the data to the multi-cloud platform 200 (for example, n cloud nodes of the multi-cloud platform 200), and encode the metadata of the data into a globally unique backup identifier and register it in the blockchain account book, so as to realize the addressing, positioning and unified management of the dispersedly stored data.

[0104] Among them, the multi-cloud backup scheduling strategy may include the scheduling of backup resources (data) and the scheduling of the multi-cloud platform 200.

[0105] The scheduling of backup resources (e.g., resources such as data to be backed up) can be that the client 100 determines the number of data blocks to be cut from the data to be backed up according to the backup plan configured by the user, such as the number n of cloud nodes used for backup and the number b of backup copies, and then generates a scheduling allocation table (also called a data block allocation table) according to the number of data blocks to be cut from the data to be backed up. The scheduling allocation table records the data blocks to be stored by the n cloud nodes. Accordingly, the client 100 can cut (split) the data into data blocks according to the number, and the cut data blocks can be divided into multiple groups according to the scheduling allocation table to wait for upload. Among them, when grouping the data blocks according to the scheduling allocation table, the data blocks can be grouped according to the storage location (e.g., the cloud node storing the data blocks).

[0106] The scheduling of the multi-cloud platform 200 can be that the blockchain network 300 (for example, the blockchain smart contract deployed in the blockchain node of the blockchain network 300) determines the weight of the cloud node in the multi-cloud platform 200 according to the state parameters of the cloud node, selects n cloud nodes whose weights meet the requirements (for example, the largest weight or the weight greater than the preset value) after sorting, and returns the node identifier of the cloud node whose weight meets the requirements.

[0107] The following is an illustrative description of the scheduling of backup resources and the scheduling of the multi-cloud platform 200.

[0108] The scheduling of backup resources is implemented by borrowing the idea of ​​secret splitting. Secret splitting, also known as threshold secret splitting, is a robust key management scheme in cryptographic systems that can operate safely and reliably even if some fragments are damaged. Specifically, a secret s (or key) is divided into n parts, each part is called a subkey, and each part is held by a participant, so that:

[0109] (1) The subkeys held by q or more participants can reconstruct s;

[0110] (2) Subkeys held by fewer than q participants cannot reconstruct s.

[0111] The scheme is called a (q, n) threshold secret partitioning scheme, and q is called the threshold value.

[0112] In this example, it is assumed that n clouds S for backup have been determined. 1 ,…S n , split the data file O into x data blocks P 1 ,P 2 ,…,P x Parallel storage, any cloud node cannot have complete data, which can be expressed as At least q clouds can restore the original data file, so the constraints of the threshold secret splitting scheme can be abstracted as:

[0113] Condition 1: The union S of the data block sets S backed up by any k cloud nodes m ∪S m+1 ∪…∪S m+k-1 =O

[0114] Condition 2: The union of the data block sets S backed up by any k cloud nodes

[0115] Where q is the threshold value. It can be considered that when k = q-1 When k = q

[0116] S m ∪S m+1 ∪…∪S m+k-1 =O.

[0117] Then for any data block P i , there exists a union S of q-1 sets S m+1 ∪S m+2 ∪…∪S m+q-1 Does not contain P i , the union S of any q sets S m ∪S m+1 ∪S m+2 ∪…∪S m+q-1 Contains P i , which means that the data block P i is divided into a specific n-q+1 set C. i From the arbitrariness of , we know that each data block should have n-q+1 backups, that is, b=n-q+1. Considering that when k=q-1 There must be a data block P j It is not included in the union of any q-1 sets, which means that the number of data blocks of the data segment to be backed up is c=C(n,n-q+1).

[0118] Through the above deduction, we can conclude that: if there are n backupable clouds (or n cloud nodes), any q clouds (or q cloud nodes) can restore the original data, and each data block has b backups, then the original data can be divided into C (n, n-q + 1) blocks.

[0119] Each data block can be allocated to n-q+1 cloud nodes and the cloud nodes allocated to each data block are not exactly the same. In some embodiments, the client 100 can allocate according to all situations of C(n,n-q+1) combinations to obtain a scheduling allocation table. For example, for the scenario where n=5 and b=3, a possible allocation method is shown in the following table:

[0120] Table 1 Scheduling allocation table

[0121] <![CDATA[P 1 ]]> <![CDATA[P 2 ]]> <![CDATA[P 3 ]]> <![CDATA[P 4 ]]> <![CDATA[P 5 ]]> <![CDATA[P 6 ]]> <![CDATA[P 7 ]]> <![CDATA[P 8 ]]> <![CDATA[P 9 ]]> <![CDATA[P 10 ]]> Cloud Node 1 1 1 1 1 1 1 0 0 0 0 Cloud Node 2 1 1 1 0 0 0 1 1 1 0 Cloud Node 3 1 0 0 1 1 0 1 1 0 1 Cloud Node 4 0 1 0 1 0 1 1 0 1 1 Cloud Node 5 0 0 1 0 1 1 0 1 0 1

[0122] Compared to the simple method of backing up data blocks as separate files, the above allocation strategy can reduce the number of backup requests to blockchain nodes, alleviate the pressure on computing resources in the blockchain network 300, and increase bandwidth utilization by uploading data blocks in parallel.

[0123] In the above method, the client 100 automatically calculates the number of data blocks for data segmentation, and uploads different data blocks to different cloud platforms (such as cloud nodes in different cloud platforms) for storage. A single cloud platform cannot recover secret information (such as complete data), and when any backup data block within the corresponding range has a problem, the data can still be completely restored, thereby improving the robustness of data backup. Specifically, the crash of any q cloud nodes is within the tolerance range and does not affect the recoverability of the original data. Under this strategy, the cloud nodes participating in the backup have exactly the same importance, and the impact of the crash of multiple nodes is related to the number of crashed nodes. There are no special or unusually important nodes, thus realizing a truly decentralized scheduling strategy.

[0124] The scheduling of the multi-cloud platform 200 can be implemented by calculating the weights of the cloud nodes in the multi-cloud platform 200. Furthermore, parameter normalization can be performed before calculating the weights of the cloud nodes. The specific implementation of the scheduling of the multi-cloud platform 200 is described in detail below.

[0125] A multi-cloud global parameter update smart contract is deployed in the blockchain node, and the state parameters of the cloud node can be uploaded to the blockchain account book for storage and calculation. Among them, the state parameters can be stored in the form of key-value pairs (key value, KV). In some examples, the global unique identifier of the cloud node (for example, the node ID) is used as the key, and the state parameters of the cloud node are used as the value. The state parameters of the cloud node may include static parameters or dynamic parameters. Among them, the static parameters include at least one of the node bandwidth and the node cost (also known as the node price and the cloud storage price). The static parameters are basically fixed after subscribing to the cloud service, and can be written to the blockchain account book through the multi-cloud state parameter initialization contract. The dynamic parameters include at least one of the remaining storage capacity of the node and the node reputation information (such as the node reputation value). In the initialization stage, the above dynamic parameters can be written to the blockchain account book through the multi-cloud state parameter initialization contract. As the data is backed up on the multi-cloud platform 200, the values ​​of the dynamic parameters can be dynamically adjusted as the backup operation triggers the multi-cloud state parameter update contract. Specifically, the adjustment process of dynamic parameters is defined in the multi-cloud state parameter update contract. For example, the node reputation value can be dynamically adjusted according to the audit results. The more successful audits, the higher the node reputation value (credibility) of the cloud node; the more failed audits, the lower the node reputation value (credibility) of the cloud node.

[0126] In this example, cloud node S i The state parameters are Then the state parameters of all m cloud nodes are recorded as:

[0127]

[0128] in, Represents a parameter vector formed by the state parameters of multiple cloud nodes.

[0129] By parameter vector Standardization is performed, such as ZScore standardization, to adjust the state parameters to a standard normal distribution mode, so that the state parameters can reasonably maintain the original size relationship, can be processed normally through the nonlinear region of the sigmoid function, and then normalized with the sigmoid function.

[0130] For benefit parameters (the larger the value, the better, such as node bandwidth), the normalization method is:

[0131]

[0132] For cost parameters (the smaller the value, the better, such as node cost), the normalization method is:

[0133]

[0134] Among them, mean represents the mean and std represents the standard deviation.

[0135] After normalization, the influence coefficients of various parameters on weights can be determined. In specific implementation, the entropy weight method can be used to adaptively adjust parameter weights, so that parameters with large differences in value distribution are given larger influence coefficients without manually specifying the priorities of various parameters. The calculation process is as follows:

[0136] For the normalized parameter vector Calculate the normalized parameter vector The "entropy" value of each element of is obtained to obtain the entropy vector.

[0137] Among them, the "entropy" value of an element can be determined by the following formula:

[0138]

[0139] in, represents the normalized parameter vector The jth value of represents the weight of the jth value in the parameter vector, Represents the "entropy" value of the j-th value of the normalized parameter vector.

[0140] Next, we can synthesize the difference between the "entropy" value of the cloud node's parameter vector (usually a column vector) and the maximum value 1. Assuming that there are r types of cloud node state parameters, calculate the jth value of the cloud node's parameter vector The influence coefficient One way is: Cloud Node S j The normalization parameter y Sj,1 ,…,y Sj,r and influence coefficient Weighted summation to calculate the weight of the cloud node: The blockchain network 300 sorts the cloud nodes by weight, selects n cloud nodes whose weights meet the conditions (for example, the highest weight or the weight is greater than a preset value), and returns the node IDs of the n cloud nodes whose weights meet the conditions to the client 100.

[0141] In this way, the client 100 can upload the data block to the cloud node corresponding to the node ID for backup storage according to the scheduling allocation table. 1 To P 6 Upload to the cloud node corresponding to one of the N node IDs returned by the blockchain network 300 for backup storage, and store the data block P 1 To P 3 and P 7 To P 9The backup storage is performed in the cloud node corresponding to another node ID among the N node IDs returned by the blockchain network 300, and the backup storage of other cloud nodes is deduced in the same way, which will not be described in detail here.

[0142] S208. The client 100 provides the blockchain network 300 with metadata of the data stored by the multi-cloud platform 200, so that the blockchain network 300 encodes the metadata into a backup identifier and stores the backup identifier.

[0143] The metadata of the data stored in the multi-cloud platform 200 includes a data identifier (DataID) and a storage address. The storage address may include a Uniform Resource Locator (URL). Since the data is divided into multiple data blocks and stored in different cloud platforms, the storage address may include a URL list formed by multiple URLs. Furthermore, the metadata may also include a user identifier, a backup time, a number of backup copies, and an available cloud list. The available cloud list may include a list of cloud platforms subscribed by the user.

[0144] In specific implementation, the client 100 can send a coding registration request to the blockchain network 300, which carries the metadata (also called backup metadata) of the data stored in the multi-cloud platform 200. Accordingly, the blockchain network 300 can extract the backup metadata, generate a backup identifier according to the identifier encoding rule, and store the backup identifier in the blockchain account book.

[0145] The backup identifier may include a short identifier and a long identifier. Among them, the short identifier includes the data identifier, and the long identifier includes the storage address of the data on the multi-cloud platform. The blockchain network 300 can return the short identifier to the user. In this way, in the subsequent data query process, the blockchain network 300 can receive the short identifier provided by the user, search for the long identifier corresponding to the short identifier according to the short identifier, parse the long identifier to obtain the storage address of the data on the multi-cloud platform 200, and return the storage address of the data on the multi-cloud platform. The client 100 can download data from the multi-cloud platform according to the storage address.

[0146] Considering that the data backed up by the multi-cloud platform 200 may have multiple versions, the backup identifier may be divided into multiple levels, such as two levels (also referred to as two levels), thereby implementing version management of the backup data. For ease of description, the following is an example in which the backup identifier includes a two-level identifier.

[0147] See also Figure 4A schematic diagram of a two-level identification is shown, in which the first-level identification is used to query and record the time version of the backup data, and the first-level identification includes a short identification (also called the first short identification) and a long identification (also called the first long identification). Among them, the short identification in the first-level identification includes the data identification DataID. Further, considering security, the short identification in the first-level identification can also include a user identification, such as the public key DataOwnerPk of the data owner. The format of the short identification in the first-level identification can be: DataOwnerPk|DataID. The long identification in the first-level identification includes a version set (the versions in the version set can be represented by time). The second-level identification is used to query and manage the backup metadata of the specified version. Similarly, the second-level identification includes a short identification (the second short identification) and a long identification (the second long identification). The short identification in the second-level identification includes the data identification DataID and the target version in the version set. Further, the short identification in the second-level identification can also include a user identification. The short identifier format in the secondary identifier can be: DataOwnerPk|DataID|Version, where DataOwnerPk represents the user ID of the "user registration domain", DataID represents the data identifier of the "user data domain", and Version represents the version of the backed up data (for example, the time version). The short identifier is globally unique. The long identifier in the secondary identifier includes the storage address of the target version of the data on the multi-cloud platform. Figure 2 As shown, the long identifier in the secondary identifier is a set of backup metadata describing the data, and the long identifier in the secondary identifier includes: basic data attribute domain, backup policy domain, data addressing information domain, data verification information domain and extensible domain. Among them, the basic data attribute domain describes the basic information such as the size and type of the backup data, the backup policy domain describes the policy information such as the storage period and number of backup copies of the backup data, the data addressing information domain describes the storage address of the backup data in the multi-cloud platform 200, and the data verification information domain describes the hash value of the backup data and the stored version, and the extensible domain is other backup information that the user needs to add, which can be empty.

[0148] When the user has a query demand or data recovery demand, a query request can be initiated to the blockchain network 300 with the data identifier DataID and version Version as parameters. Specifically, the client 100 receives the data identifier DataID and version Version input by the user, and initiates a query request to the blockchain network, which carries the data identifier DataID and version Version. The blockchain network 300 automatically forms a short identifier based on the parameters carried in the query request, such as the data identifier DataID and version Version, and then the blockchain network 300 obtains the long identifier corresponding to the short identifier from the blockchain account book according to the short identifier, parses the long identifier, and obtains the storage address of each data block (for example, a URL list). It should be noted that the blockchain network 300 can also parse the long identifier to obtain a hash value. When the hash value calculated by the data block is consistent with the hash value returned by the blockchain network 300, data download can be executed. Further, the client can return the query result or data recovery result to the user.

[0149] Based on the above description, the data management method provided in the embodiment of the present application designs a cloud-chain fusion mechanism (cloud-chain coordination mechanism) that encodes the metadata of the data backed up by the multi-cloud platform as a backup identifier, and stores the backup identifier in the blockchain network. The backup identifier on the chain records and manages multiple time versions of data, thereby supporting unified positioning and addressing of the data backed up by the multi-cloud platform 200, so as to realize the management of distributed multi-cloud backup data. This method uses the secure and reliable characteristics of the cloud-chain fusion mechanism to improve the security of multi-cloud backup data and eliminate the single-point security bottleneck existing in traditional methods.

[0150] Moreover, the method designs an adaptive multi-cloud scheduling strategy based on smart contracts. According to the backup plan set by the user, the state parameters of all available cloud nodes are extracted to calculate the weights, and the corresponding number of cloud nodes whose weights meet the requirements are selected after sorting. Among them, by selecting a suitable normalization function to process the parameter vector before calculating the weight, the comparability between different parameters can be enhanced, and then the influence coefficient of each parameter is determined by a suitable method (such as the entropy weight method), and the influence of each parameter on the weight is processed according to the degree of difference, which can improve the credibility of multi-cloud scheduling calculation and the flexibility of scheduling strategy.

[0151] Due to the risk of data consistency being destroyed due to network failures or accidental deletion of data by operation and maintenance personnel, in order to ensure that data can be successfully restored when a disaster occurs, an automatic data consistency maintenance and verification mechanism can also be established to ensure the consistency of the backed-up data. To this end, the present application can also introduce the concept of transactions, defining transactions as a series of operations performed on data in the data management system, including backup, deletion, and incremental updates. Transactions have consistency and atomicity. Consistency means that the data management system must ensure that the execution of transactions allows the cloud chain backup to be transferred from one consistent state to another. Atomicity means that the cloud chain operations in the transaction are either all executed or not executed. The present application can achieve consistency and atomicity of backup, update, and deletion transactions through a retry and rollback mechanism.

[0152] Since transaction execution involves three parties including the client 100, the multi-cloud platform 200 and the blockchain network 300, before submitting the transaction, it is possible to first check whether there are any anomalies in the client 100, the multi-cloud platform 200 and the blockchain network 300 before performing the operation task. Since it is usually assumed that the cloud platform is semi-trusted, that is, once a data operation instruction is received, it will be executed correctly, the inconsistency in this application mainly includes the failure of transaction execution due to an anomaly in a cloud platform network during the operation of the multi-cloud platform 200.

[0153] The following describes the operation procedures of the backup storage transaction, backup update transaction, and backup deletion transaction provided by the present application in conjunction with the embodiments.

[0154] See also Figure 5 An operational flow chart of a backup storage transaction, a backup update transaction, and a backup deletion transaction is shown, and the backup storage transaction includes the following transaction operations: (a) storing the data to be backed up in the multi-cloud platform 200 according to the multi-cloud backup scheduling strategy, (b) encoding the metadata of the data backed up by the multi-cloud platform 200 as a backup identifier and storing it in the blockchain ledger (also known as metadata on-chain). The client 100 can create a backup storage transaction, and then execute the backup storage transaction, thereby executing the transaction operation corresponding to the backup storage transaction. It should be noted that the transaction execution involves multiple participants. When the client executes the backup storage transaction, it executes the transaction operation of dispersing and storing c data blocks in n cloud nodes in the multi-cloud platform 200, and provides the blockchain network 300 with the metadata of the data stored in the multi-cloud platform 200, so that the blockchain network 300 executes the transaction operation of encoding the metadata as a backup identifier and storing the backup identifier.

[0155] In the process of storing the data to be backed up in the multi-cloud platform 200, if there is a network anomaly of the cloud platform that causes the transaction execution to fail, rollback and retry can be performed. For example, the client 100 can delete the backed-up data in the cloud platform with the network anomaly, and reselect a cloud platform from the multi-cloud platform 200 for retry. For another example, the client 100 can also delete all the backed-up data in the n cloud platforms (or n cloud nodes) participating in the backup, and reselect n cloud platforms (or n cloud nodes) from the multi-cloud platform 200 for retry.

[0156] Similarly, a backup update transaction (e.g., a backup incremental update transaction) includes the following transaction operations: (a) storing incremental data in the multi-cloud platform 200 (b) updating the backup identifier in the blockchain ledger. Specifically, the client 100 can obtain incremental data, such as receiving incremental data input by the user, creating a backup update transaction, and then executing the backup update transaction to perform the transaction operation of storing incremental data in the multi-cloud platform and the transaction operation of updating the backup identifier. Among them, the operation of updating the backup identifier can be that the client 100 provides metadata of the incremental data so that the blockchain network 300 can perform the transaction operation of updating the backup identifier. Similar to the backup storage transaction, when there is a network anomaly of the cloud platform during the process of storing incremental data in the multi-cloud platform 200, the transaction execution fails, and a rollback and retry can be performed. For example, the client 100 can delete the incremental data that has been backed up in the cloud platform with network anomaly, and reselect the cloud platform from the multi-cloud platform 200 for retry. For another example, the client 100 can also delete all the backed up data in the cloud platform participating in the incremental update, and reselect the cloud platform participating in the incremental update from the multi-cloud platform 200 for retry.

[0157] The backup deletion transaction includes the following transaction operations: (a) deleting the data corresponding to the specified data identifier from the multi-cloud platform 200 (b) deleting the backup identifier corresponding to the specified data identifier from the blockchain network (e.g., a blockchain account book). Specifically, the client 100 can create a backup deletion transaction in response to the deletion operation (manually triggered or automatically triggered), and then execute the backup deletion transaction to execute the transaction operation of deleting the data corresponding to the specified data identifier and the transaction operation of deleting the backup identifier corresponding to the specified data identifier. Among them, the operation of deleting the data corresponding to the specified data identifier can be that the client 100 provides a data identifier (or a short identifier) ​​so that the multi-cloud platform 200 can delete the corresponding data, and the operation of deleting the backup identifier corresponding to the specified data identifier can be that the client 100 provides a data identifier (or a short identifier) ​​so that the blockchain network 300 can delete the corresponding backup identifier. Similar to the backup storage transaction and the backup update transaction, in the process of deleting the data corresponding to the specified data identifier from the multi-cloud platform 200, if there is a network anomaly of the cloud platform that causes the transaction execution to fail, it can return to the deletion failure position and update the backup identifier in the blockchain network 300. The user can manually check the network status of the cloud platform and try again. It should be noted that once the backup deletion transaction is committed, the deleted data cannot usually be restored.

[0158] Taking into account the inconsistency caused by the accidental deletion of files or directories by the operation and maintenance personnel of the cloud service provider after the data is backed up, the present application also designs a consistency verification mechanism, which uses the metadata in the blockchain network to verify the consistency state of the backed-up data. Among them, the consistency verification mechanism includes verifying the consistency of the storage address of the data in the multi-cloud platform 200 and the storage address declared by the blockchain network 300. Among them, the storage address declared by the blockchain network 300 can be the storage address recorded in the backup identifier stored in the blockchain network 300 (for example, the blockchain account book maintained by the blockchain network 300).

[0159] In specific implementation, the blockchain network 300 can check the consistency between the actual storage address of the data in the multi-cloud platform 200 and the storage address recorded in the backup identifier stored in the blockchain network 300. If inconsistent, the blockchain network 300 restores the data on the multi-cloud platform according to the storage address recorded in the backup identifier. Among them, the blockchain network 300 can periodically check the consistency between the actual storage address of the data in the multi-cloud platform 200 and the storage address recorded in the backup identifier stored in the blockchain network 300, so as to promptly discover the inconsistency caused by the accidental deletion operation and restore it in time. When verifying the consistency of the storage address, the blockchain network 300 can obtain the hash value of the storage address of the data in the multi-cloud platform (for example, the hash value of the file directory), call the consistency verification contract, and compare the hash value with the hash value in the backup identifier stored in the blockchain network 300, thereby verifying the consistency of the storage address.

[0160] In some possible implementations, the client 100 may also submit a consistency verification request. For example, the client 100 submits a consistency verification request in response to a consistency verification operation triggered by a user, and the blockchain network 300 responds to the consistency verification request, obtains the hash value of the storage address of the data uploaded by the multi-cloud platform 200 (for example, the hash value of the file directory), calls the consistency verification contract, compares the hash value uploaded by the multi-cloud platform 200 and the hash value stored by the blockchain network 300, and returns the verification transaction ID and the verification result. When the verification result is inconsistent, the client can also send a backup recovery request to restore data from other cloud platforms.

[0161] Next, the management of incremental update, deletion, and restoration of data after backup is completed is described in detail in conjunction with the embodiments.

[0162] After the data backup is completed, the user can submit an incremental update request through the client 100. The incremental update request is used to incrementally update the data corresponding to the specified data identifier. The data management system 10 performs incremental updates of cloud data and blockchain-side backup identifier updates based on the backup update transaction. After the update is completed, the blockchain network 300 can also return a transaction ID. The following is an explanation with reference to the accompanying drawings.

[0163] See also Figure 6 A flow chart of a data management method is shown, the method comprising the following steps:

[0164] ① Client 100 submits an incremental update request.

[0165] The incremental update request is used to incrementally update data. Specifically, the incremental update request carries incremental data (denoted as IncreData) and a specified data identifier (DataID). When the data corresponding to the specified data identifier includes multiple versions, the incremental update request can also carry a version (Version). Among them, the specified data identifier and version can be carried by a short identifier. Based on this, the incremental update request can carry incremental data (IncreData) and a short identifier (DataID|Version).

[0166] ② The client 100 executes the incremental update transaction according to the incremental update request.

[0167] First, the client 100 can upload the incremental data for updating to the multi-cloud platform 200 for incremental updating, and record the storage address of the incremental data (for example, a URL list). Furthermore, the client 100 can also record the hash value of the incremental data. Then, the client 100 sends the transaction parameters, such as a short identifier and metadata of the incremental data, to the blockchain network 300.

[0168] ③ The blockchain network 300 performs identity resolution, obtains the long identity through short identity query, and updates the addressing information field in the long identity.

[0169] Specifically, the blockchain network 300 can call the backup metadata management contract, query the corresponding long identifier according to the short identifier composed of DataOwnerPk|DataID|Version, parse the long identifier to obtain the addressing information domain, and update the relevant fields in the addressing information domain, for example, according to the metadata of the incremental data, construct the attribute fields of the incremental data, including but not limited to the storage address of the incremental data. In some possible implementations, the blockchain network 300 can also parse the long identifier to obtain the data verification information domain, and update the relevant fields of the data verification information domain, for example, according to the metadata of the incremental data, construct the attribute fields of the incremental data, including but not limited to the hash value of the incremental data.

[0170] ④ The blockchain network 300 returns the transaction ID and update success flag to the client 100.

[0171] The update success flag is used to indicate that the incremental update is completed.

[0172] After the data backup is completed, if the user has a deletion requirement, the user can also submit a backup deletion request through the client 100 and provide a short identifier of the data to be deleted. The data management system 10 deletes the backup copy stored in the multi-cloud platform 200 and the backup identifier stored in the blockchain network 300 based on the backup deletion transaction.

[0173] See also Figure 7 A flow chart of a data management method is shown, the method comprising the following steps:

[0174] ① Client 100 submits a backup deletion request.

[0175] The backup deletion request is used to delete the backed-up data. Specifically, the backup deletion request carries a data identifier (DataID). When the data corresponding to the data identifier includes multiple versions, the backup deletion request can also carry a version (Version), thereby requesting to delete the data of a specified version.

[0176] The data identifier or version can be carried by a short identifier, based on which the backup deletion request can carry a short identifier (DataID|Version). The backup deletion request carries the short identifier in the first-level identifier, such as the first short identifier DataOwnerPk|DataID, which indicates a request to delete all versions of the data and the corresponding backup identifier. The backup deletion request carries the short identifier in the second-level identifier, such as the second short identifier DataOwnerPk|DataID|Version, which indicates a request to delete the specified version of the data and the corresponding backup identifier.

[0177] ② The client 100 executes the backup deletion transaction.

[0178] Specifically, the client 100 uses the short identifier in the backup identifier to obtain the long identifier corresponding to the short identifier, and queries the storage address of the backed-up data from the long identifier, for example, obtaining the storage address from the addressing information field of the long identifier, and the multi-cloud platform 200 deletes the corresponding data according to the storage address in the addressing information field until the corresponding data is completely deleted. Correspondingly, the blockchain network 300 can delete the backup identifier corresponding to the data. If there is a deletion failure, the client 100 can also record the deletion failure position, and the blockchain network can update the long identifier in the backup identifier according to the deletion failure position.

[0179] In some possible implementations, the backup metadata deletion rule is defined in the backup metadata management contract. The backup metadata deletion rule may be: if the deletion failure record is empty, the backup identifier is directly deleted. Furthermore, the backup metadata deletion rule may also include: if the deletion failure record is not empty, the long identifier corresponding to the short identifier is updated according to the deletion failure position. The blockchain network 300 may call the backup metadata management contract to delete or update the backup identifier.

[0180] ③ When the deletion is successful, the blockchain network 300 returns the transaction ID and the deletion success mark. When the deletion fails, the blockchain network 300 returns the transaction ID and the deletion failure record.

[0181] The deletion success flag is used to indicate that the deletion is complete.

[0182] Considering the possibility that the operation and maintenance personnel of the cloud service provider may delete data by mistake, they can also apply to restore the data. When the user submits a data recovery request and provides the user identifier (such as the user identity identifier DataOwnerPk), the data identifier of the data to be restored, and the expected recovery time point, the blockchain network 300 can construct a short identifier based on the data identifier of the data to be restored and the expected recovery time point, perform hierarchical analysis based on the short identifier to obtain the storage address of the backup copy of the data to be restored, and download the backup copy based on the storage address to restore the data. Furthermore, the method also supports data verification based on the hash value, and returns the data recovery result to the user after the verification is passed.

[0183] See also Figure 8 A flow chart of a data management method is shown, the method comprising the following steps:

[0184] ① Client 100 submits a data recovery request.

[0185] The data recovery request carries the data identifier of the data to be recovered. When the data to be recovered includes multiple versions (time versions), the data recovery request may also carry the expected recovery time point (time version). Considering data security, the data recovery request may also carry the user identifier to facilitate user identity verification.

[0186] In specific implementation, the user can submit a data recovery request through the data recovery interface, and the request parameters include: user identity, data identifier of the data to be recovered, and expected recovery time point.

[0187] ② The blockchain network 300 queries the backup identifier based on the data identifier to obtain the storage address and hash value of the data.

[0188] Specifically, the blockchain network 300 can construct a short identifier (also referred to as a first-level short identifier, a first short identifier) ​​in the first-level identifier based on the data identifier, query the corresponding first-level long identifier based on the first-level short identifier, and obtain the version closest to the expected recovery time point. According to the data identifier and version, a short identifier (also referred to as a second-level short identifier, a second short identifier) ​​in the second-level identifier can be constructed. The blockchain network 300 can query the corresponding second-level long identifier based on the second-level short identifier. The blockchain network 300 parses the second-level long identifier to obtain the storage address (referred to as DataURLs) and hash value (referred to as DataHashs) of the data backed up by the multi-cloud platform 200. Furthermore, when the version closest to the expected recovery time point is the incrementally updated version, the blockchain network 300 parses the second-level long identifier and can also obtain the storage location and hash value of the incremental data.

[0189] ③ The client 100 downloads data from the multi-cloud platform 200 according to the storage address obtained through the analysis, and verifies the hash value of the data.

[0190] Specifically, the data is stored in the multi-cloud platform 200 in the form of multiple data blocks. i When the data block P is deleted by mistake, the client 100 can obtain the storage address from the storage address where the data block P is stored according to the storage address obtained by parsing the blockchain network 300. i The second cloud platform downloads the data block P i , and then upload the data block P i To the First Cloud Platform.

[0191] Furthermore, considering the situation that the data block is tampered with or the transmission fails, the client 100 may also determine the downloaded data block P i The hash value is compared with the hash value obtained by parsing the blockchain network 300 to perform consistency verification. When the consistency verification passes, the data block P is uploaded. i To the First Cloud Platform.

[0192] Based on the data management method of the above embodiment, the present application embodiment further provides a data management system 10 as described above. The data management system 10 is introduced below with reference to the accompanying drawings.

[0193] See also Figure 1 The structural diagram of the data management system 10 shown, the data management system 10 includes a client 100, a multi-cloud platform 200 and a blockchain network 300, and the data management system 10 manages the data of the multi-cloud platform 200;

[0194] The client 100 is used to receive a backup plan configured by a user for data to be backed up, where the backup plan includes the number n of cloud nodes used for backup in the multi-cloud platform 200 and the number b of backup copies;

[0195] The client 100 is further configured to divide the data to be backed up into c data blocks according to the number of cloud nodes for backup and the number of backup copies, and disperse the c data blocks to store them in n cloud nodes in the multi-cloud platform 200, and for at least one data block among the c data blocks, the multi-cloud platform 200 stores b backup copies of at least one data block;

[0196] The client 100 is also used to provide the blockchain network 300 with metadata of the data stored in the multi-cloud platform 200, so that the blockchain network 300 encodes the metadata into a backup identifier and stores the backup identifier, which is used to address the data stored in the multi-cloud platform 200.

[0197] In some possible implementations, the backup identifier includes a short identifier and a long identifier, the short identifier includes a data identifier, and the long identifier includes a storage address of the data in the multi-cloud platform 200, and the blockchain network 300 is used to:

[0198] Receive a short identifier provided by the user;

[0199] The long identifier corresponding to the short identifier is searched according to the short identifier, the long identifier is parsed to obtain the storage address of the data on the multi-cloud platform 200, and the storage address of the data on the multi-cloud platform 200 is returned.

[0200] In some possible implementations, the backup identifier includes a first short identifier, a first long identifier, and a second short identifier and a second long identifier, the first short identifier includes a data identifier, the first long identifier includes a version set, the second short identifier includes the data identifier and a target version in the version set, and the second long identifier includes the storage address of the target version data on the multi-cloud platform 200.

[0201] In some possible implementations, the blockchain network 300 is also used to:

[0202] Obtaining status parameters of cloud nodes in the multi-cloud platform 200;

[0203] Obtaining weights of cloud nodes in the multi-cloud platform 200 according to the state parameters;

[0204] The node identifiers of n cloud nodes whose weights meet the requirements are returned to the client 100 .

[0205] In some possible implementations, the state parameters include one or more of node bandwidth, node cost, node remaining storage capacity, and node reputation information.

[0206] In some possible implementations, the blockchain network 300 is also used to:

[0207] Check the consistency between the actual storage address of the data in the multi-cloud platform 200 and the storage address recorded in the backup identifier stored in the blockchain network 300;

[0208] If there is inconsistency, the data is restored on the multi-cloud platform 200 according to the storage address recorded in the backup identifier.

[0209] In some possible implementations, the client 100 is further configured to:

[0210] Create a backup storage transaction;

[0211] A backup storage transaction is executed to perform a transaction operation of distributing and storing c data blocks in n cloud nodes in the multi-cloud platform 200 and a transaction operation of providing metadata of the data stored in the multi-cloud platform 200 to the blockchain network 300.

[0212] In some possible implementations, the client 100 is further configured to:

[0213] Get incremental data;

[0214] A backup update transaction is created and executed to perform a transaction operation of storing incremental data in the multi-cloud platform 200 and a transaction operation of updating a backup identifier.

[0215] In some possible implementations, the client 100 is further configured to:

[0216] In response to the delete operation, creating a backup delete transaction;

[0217] A backup deletion transaction is executed to execute a transaction operation of deleting data corresponding to the specified data identifier and a transaction operation of deleting a backup identifier corresponding to the specified data identifier.

[0218] In some possible implementations, the number of data blocks of the data to be backed up is equal to C(n,n-q+1), and the client 100 is specifically used to:

[0219] Generate a scheduling allocation table according to the number of data blocks to be backed up, and the scheduling allocation table records the data blocks to be stored in n cloud nodes;

[0220] According to the scheduling allocation table, the c data blocks are dispersedly stored in the n cloud nodes in the multi-cloud platform 200 .

[0221] The above content describes the data management system 10 provided in the embodiment of the present application from the perspective of hardware. The following describes the data management system 10 from the perspective of functional modularization. The data management system 10 includes:

[0222] The backup storage module 102 is used to divide the data to be backed up into c data blocks according to the number n of cloud nodes for backup and the number b of backup copies configured by the user, and to disperse and store the c data blocks in n cloud nodes in the multi-cloud platform 200, and to provide the blockchain network 300 with metadata of the data stored in the multi-cloud platform 200, so that the blockchain network 300 encodes the metadata into a backup identifier and stores the backup identifier, which is used to address the data stored in the multi-cloud platform 200.

[0223] The multi-cloud state parameter uploading module 104 is used to upload the state parameters of the cloud nodes in the multi-cloud platform 200 to the blockchain network 300, so that the blockchain network 300 obtains the weights of the cloud nodes in the multi-cloud platform 200 according to the state parameters, and returns the identifiers of n cloud nodes whose weights meet the requirements to the client 100.

[0224] The backup addition and deletion module 106 is used to obtain incremental data, create a backup update transaction, and execute the backup update transaction to perform a transaction operation of storing the incremental data in the multi-cloud platform 200 and a transaction operation of updating the backup identifier.

[0225] The backup add / delete module 106 is further configured to create a backup delete transaction in response to a delete operation, and execute the backup delete transaction to execute a transaction operation of deleting data corresponding to the specified data identifier and a transaction operation of deleting a backup identifier corresponding to the specified data identifier.

[0226] The backup and recovery module 108 is used to query the storage address of the data on the multi-cloud platform 200 from the blockchain network 300, so as to download the backup copy from the corresponding location of the multi-cloud platform 200 to restore the data.

[0227] The backup storage module 102, the multi-cloud state parameter upload module 104, the backup addition and deletion module 106, and the backup recovery module 108 can be implemented by a hardware module or by a software module. Among them, the backup storage module 102, the multi-cloud state parameter upload module 104, the backup addition and deletion module 106, and the backup recovery module 108 can be implemented by a computing device or a computing engine on a computing device. Below, the backup storage module 102 is taken as an example for description.

[0228] When implemented by software, the backup storage module 102 may be an application or application module running on a computing device or a computing device cluster, such as a computing engine. The application may be provided to users in the form of a virtualized service. Virtualization services may include virtual machine (VM) services, bare metal server (BMS) services, and container services. Among them, the VM service may be a service that uses virtualization technology to virtualize a virtual machine (VM) resource pool on multiple physical hosts (such as computing devices) to provide users with VMs on demand for use. The BMS service is a service that virtualizes a BMS resource pool on multiple physical hosts to provide users with BMS on demand for use. The container service is a service that virtualizes a container resource pool on multiple physical hosts to provide users with containers on demand for use. VM is a simulated virtual computer, that is, a logical computer. BMS is a high-performance computing service that can be elastically scalable, and its computing performance is no different from that of a traditional physical machine, and it has the characteristics of secure physical isolation. Containers are a kernel virtualization technology that can provide lightweight virtualization to achieve the purpose of isolating user space, processes, and resources. It should be understood that the VM service, BMS service and container service in the above-mentioned virtualization services are merely specific examples. In actual applications, the virtualization service may also be other lightweight or heavyweight virtualization services, which are not specifically limited here.

[0229] When implemented by hardware, the backup storage module 102 may include at least one computing device, such as a server, etc. Alternatively, the backup storage module 102 may also be a device implemented by an application-specific integrated circuit (ASIC) or a programmable logic device (PLD), etc. The PLD may be a complex programmable logical device (CPLD), a field-programmable gate array (FPGA), a generic array logic (GAL), or any combination thereof.

[0230] The present application also provides a computing device 900. Fig. 9 As shown, the computing device 900 includes: a bus 902, a processor 904, a memory 906, and a communication interface 908. The processor 904, the memory 906, and the communication interface 908 communicate through the bus 902. The computing device 900 can be a server or a terminal device. It should be understood that the present application does not limit the number of processors and memories in the computing device 900.

[0231] The bus 902 may be a peripheral component interconnect (PCI) bus or an extended industry standard architecture (EISA) bus. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Fig. 9 The bus 902 may include a path for transmitting information between various components of the computing device 900 (eg, the memory 906, the processor 904, and the communication interface 908).

[0232] The processor 904 may include any one or more of a central processing unit (CPU), a graphics processing unit (GPU), a microprocessor (MP), or a digital signal processor (DSP).

[0233] The memory 906 may include a volatile memory, such as a random access memory (RAM). The memory 906 may also include a non-volatile memory, such as a read-only memory (ROM), a flash memory, a hard disk drive (HDD) or a solid state drive (SSD). The memory 906 stores executable program code, and the processor 904 executes the executable program code to implement the aforementioned data management method. Specifically, the memory 906 stores instructions for the data management system 10 to execute the data management method.

[0234] The communication interface 908 uses a transceiver module such as, but not limited to, a network interface card or a transceiver to implement communication between the computing device 900 and other devices or communication networks.

[0235] The embodiment of the present application also provides a computing device cluster. The computing device cluster includes at least one computing device. The computing device can be a server, such as a central server, an edge server, or a local server in a local data center. In some embodiments, the computing device can also be a terminal device such as a desktop computer, a laptop computer, or a smart phone.

[0236] like Fig.10 As shown, the computing device cluster includes at least one computing device 900. The memory 906 in one or more computing devices 900 in the computing device cluster may store the same data management system 10 for executing instructions of the data management method.

[0237] In some possible implementations, one or more computing devices 900 in the computing device cluster may also be used to execute some instructions of the data management system 10 for executing the data management method. In other words, a combination of one or more computing devices 900 may jointly execute instructions of the data management system 10 for executing the data management method.

[0238] It should be noted that the memory 906 in different computing devices 900 in the computing device cluster may store different instructions for executing partial functions of the data management system 10 .

[0239] Fig.11 A possible implementation is shown. Fig.11As shown, two computing devices 900A and 900B are connected via a communication interface 908. The memory in the computing device 900A stores instructions for executing the functions of the backup storage module 102 and the multi-cloud state parameter upload module 104. The memory in the computing device 900B stores instructions for executing the functions of the backup addition and deletion module 106 and the backup recovery module 108. In other words, the memories 906 of the computing devices 900A and 900B jointly store instructions for the data management system 10 to execute the data management method.

[0240] Fig.11 The connection mode between the computing device clusters shown can be considered that the data management method provided by the present application needs to perform data storage and data addition, deletion, and recovery. Therefore, it is considered that the functions implemented by the backup storage module 102 and the multi-cloud state parameter upload module 104 are performed by the computing device 900A, and the functions implemented by the backup addition and deletion module 106 and the backup recovery module 108 are performed by the computing device 900B.

[0241] It should be understood that Fig.11 The functions of the computing device 900A shown in FIG. 9A may also be completed by multiple computing devices 900. Similarly, the functions of the computing device 900B may also be completed by multiple computing devices 900.

[0242] In some possible implementations, one or more computing devices in the computing device cluster may be connected via a network, which may be a wide area network or a local area network. Fig.12 A possible implementation is shown. Fig.12 As shown, two computing devices 900C and 900D are connected via a network. Specifically, the network is connected via a communication interface in each computing device. In this type of possible implementation, the memory 906 in the computing device 900C stores instructions for executing the functions of the backup storage module 102 and the multi-cloud state parameter upload module 104. At the same time, the memory 906 in the computing device 900D stores instructions for executing the functions of the backup addition and deletion module 106 and the backup recovery module 108.

[0243] Fig.12 The connection mode between the computing device clusters shown can be considered that the data management method provided by this application needs to perform data storage and data addition, deletion, and recovery. Therefore, it is considered that the functions implemented by the backup storage module 102 and the multi-cloud state parameter upload module 104 are performed by the computing device 900C, and the functions implemented by the backup addition and deletion module 106 and the backup recovery module 108 are performed by the computing device 900D. It should be understood that Fig.12 The functions of the computing device 900C shown in FIG. 900A may also be completed by multiple computing devices 900. Similarly, the functions of the computing device 900D may also be completed by multiple computing devices 900.

[0244] The embodiment of the present application also provides a computer-readable storage medium. The computer-readable storage medium can be any available medium that can be stored by the computing device or a data storage device such as a data center containing one or more available media. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state hard disk). The computer-readable storage medium includes instructions that instruct the computing device to execute the above-mentioned application to the data management system for executing the data management method.

[0245] The embodiment of the present application also provides a computer program product including instructions. The computer program product may be software or a program product including instructions that can be run on a computing device or stored in any available medium. When the computer program product is run on at least one computing device, the at least one computing device executes the above data management method.

[0246] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the protection scope of the technical solutions of the embodiments of the present invention.

Claims

1. A data management method, characterized in that: Applied to a data management system, the system includes a client, a multi-cloud platform and a blockchain network, the system is used to manage data on the multi-cloud platform, and the method includes: The client receives a backup plan configured by a user for data to be backed up, wherein the backup plan includes the number n of cloud nodes used for backup in the multi-cloud platform and the number b of backup copies; The client divides the data to be backed up into c data blocks according to the number of cloud nodes for backup and the number of backup copies, and stores the c data blocks in n cloud nodes in the multi-cloud platform in a dispersed manner; for at least one data block among the c data blocks, the multi-cloud platform stores b backup copies of the at least one data block; The client provides metadata of the data stored by the multi-cloud platform to the blockchain network, so that the blockchain network encodes the metadata into a backup identifier and stores the backup identifier, where the backup identifier is used to address the data stored by the multi-cloud platform.

2. The method according to claim 1, characterized in that The backup identifier includes a short identifier and a long identifier, the short identifier includes a data identifier, and the long identifier includes a storage address of the data on the multi-cloud platform. The method further includes: The blockchain network receives the short identifier provided by the user; The blockchain network searches for the long identifier corresponding to the short identifier according to the short identifier, parses the long identifier to obtain the storage address of the data on the multi-cloud platform, and returns the storage address of the data on the multi-cloud platform.

3. The method according to claim 2, characterized in that The backup identifier includes a first short identifier, a first long identifier, a second short identifier, and a second long identifier, the first short identifier includes a data identifier, the first long identifier includes a version set, the second short identifier includes a data identifier and a target version in the version set, and the second long identifier includes a storage address of the data of the target version on the multi-cloud platform.

4. The method according to any one of claims 1 to 3, characterized in that: The method further comprises: The blockchain network obtains status parameters of cloud nodes in the multi-cloud platform; The blockchain network obtains the weight of the cloud node in the multi-cloud platform according to the state parameter; The blockchain network returns the node identifiers of the n cloud nodes whose weights meet the requirements to the client.

5. The method according to claim 4, characterized in that The state parameters include one or more of node bandwidth, node cost, node remaining storage capacity, and node reputation information.

6. The method according to any one of claims 1 to 5, characterized in that: The method further comprises: The blockchain network checks the consistency between the actual storage address of the data in the multi-cloud platform and the storage address recorded in the backup identifier stored in the blockchain network; If there is inconsistency, the blockchain network restores the data on the multi-cloud platform according to the storage address recorded in the backup identifier.

7. The method according to any one of claims 1 to 6, characterized in that: The method further comprises: The client creates a backup storage transaction; The client executes the backup storage transaction to perform the transaction operation of dispersing and storing the c data blocks in n cloud nodes in the multi-cloud platform and the transaction operation of providing metadata of the data stored in the multi-cloud platform to the blockchain network.

8. The method according to any one of claims 1 to 7, characterized in that: The method further comprises: The client obtains incremental data; The client creates a backup update transaction and executes the backup update transaction to perform a transaction operation of storing the incremental data in the multi-cloud platform and a transaction operation of updating the backup identifier.

9. The method according to any one of claims 1 to 8, characterized in that: The method further comprises: The client creates a backup deletion transaction in response to the deletion operation; The client executes the backup deletion transaction to perform a transaction operation of deleting the data corresponding to the specified data identifier and a transaction operation of deleting the backup identifier corresponding to the specified data identifier.

10. The method according to any one of claims 1 to 9, characterized in that: The number of data blocks of the data to be backed up is equal to C(n,n-q+1), and the client stores the c data blocks in n cloud nodes in the multi-cloud platform in a dispersed manner, including: The client generates a scheduling allocation table according to the number of data blocks cut from the data to be backed up, and the scheduling allocation table records the data blocks to be stored by the n cloud nodes; The client stores the c data blocks in a dispersed manner on n cloud nodes in the multi-cloud platform according to the scheduling allocation table.

11. A data management system, characterized in that: The system includes a client, a multi-cloud platform, and a blockchain network, and the system is used to manage data on the multi-cloud platform; The client is used to receive a backup plan configured by a user for the data to be backed up, wherein the backup plan includes the number n of cloud nodes used for backup in the multi-cloud platform and the number b of backup copies; The client is further configured to divide the data to be backed up into c data blocks according to the number of cloud nodes for backup and the number of backup copies, and store the c data blocks in n cloud nodes in the multi-cloud platform in a dispersed manner; for at least one data block among the c data blocks, the multi-cloud platform stores b backup copies of the at least one data block; The client is also used to provide the blockchain network with metadata of the data stored on the multi-cloud platform, so that the blockchain network encodes the metadata into a backup identifier and stores the backup identifier, and the backup identifier is used to address the data stored on the multi-cloud platform.

12. The system according to claim 11, characterized in that The backup identifier includes a short identifier and a long identifier, the short identifier includes a data identifier, the long identifier includes a storage address of the data on the multi-cloud platform, and the blockchain network is used to: Receiving the short identifier provided by the user; The long identifier corresponding to the short identifier is searched according to the short identifier, the long identifier is parsed to obtain the storage address of the data on the multi-cloud platform, and the storage address of the data on the multi-cloud platform is returned.

13. The system according to claim 12, characterized in that The backup identifier includes a first short identifier, a first long identifier, a second short identifier, and a second long identifier, the first short identifier includes a data identifier, the first long identifier includes a version set, the second short identifier includes a data identifier and a target version in the version set, and the second long identifier includes a storage address of the data of the target version on the multi-cloud platform.

14. The system according to any one of claims 11 to 13, characterized in that: The blockchain network is also used to: Obtaining status parameters of cloud nodes in the multi-cloud platform; Obtaining weights of cloud nodes in the multi-cloud platform according to the state parameters; The node identifiers of the n cloud nodes whose weights meet the requirements are returned to the client.

15. The system according to claim 14, characterized in that The state parameters include one or more of node bandwidth, node cost, node remaining storage capacity, and node reputation information.

16. The system according to any one of claims 11 to 15, characterized in that The blockchain network is also used to: Checking the consistency between the actual storage address of the data in the multi-cloud platform and the storage address recorded in the backup identifier stored in the blockchain network; If they are inconsistent, the data is restored on the multi-cloud platform according to the storage address recorded in the backup identifier.

17. The system according to any one of claims 11 to 16, characterized in that: The client is also used to: Create a backup storage transaction; The backup storage transaction is executed to perform the transaction operation of dispersively storing the c data blocks in the n cloud nodes in the multi-cloud platform and the transaction operation of providing the blockchain network with metadata of the data stored in the multi-cloud platform.

18. The system according to any one of claims 11 to 17, characterized in that The client is also used to: Get incremental data; A backup update transaction is created, and the backup update transaction is executed to perform a transaction operation of storing the incremental data in the multi-cloud platform and a transaction operation of updating the backup identifier.

19. The system according to any one of claims 11 to 18, characterized in that The client is also used to: In response to the delete operation, creating a backup delete transaction; The backup deletion transaction is executed to perform a transaction operation of deleting the data corresponding to the specified data identifier and a transaction operation of deleting the backup identifier corresponding to the specified data identifier.

20. The system according to any one of claims 11 to 19, characterized in that The number of data blocks of the data to be backed up is equal to C(n,n-q+1), and the client is specifically used for: Generate a scheduling allocation table according to the number of data blocks to be backed up, wherein the scheduling allocation table records the data blocks to be stored by the n cloud nodes; According to the scheduling allocation table, the c data blocks are dispersedly stored in the n cloud nodes in the multi-cloud platform.

21. A computing device cluster, characterized in that: The computing device cluster includes at least one computing device, and the at least one computing device includes at least one processor and at least one memory, wherein the at least one memory stores computer-readable instructions; the at least one processor executes the computer-readable instructions so that the computing device cluster executes the method as described in any one of claims 1 to 10.

22. A computer-readable storage medium, characterized in that: The method comprises computer-readable instructions; the computer-readable instructions are used to implement the method according to any one of claims 1 to 10.

23. A computer program product, characterized in that The method comprises computer-readable instructions; the computer-readable instructions are used to implement the method according to any one of claims 1 to 10.

Citation Information

Cited By

  • Multi-cloud storage processing method and device, equipment and storage medium

    CN119788691A

  • A multi-cloud storage processing method, device, equipment and storage medium

    CN119788691B

  • Custom voice broadcasting method, device and equipment for payment loudspeaker box and storage medium

    CN121281489A

  • Multi-dimensional dynamic evaluation method and system for block chain transaction scheduling algorithm

    CN121458434A

  • A multi-dimensional dynamic evaluation method and system for a blockchain transaction scheduling algorithm

    CN121458434B