Block chain-based trusted file distributed storage management system

Through blockchain technology and smart contracts, the resource allocation optimization and data security improvement of distributed storage systems are achieved, the problem of insufficient motivation for storage nodes to participate is solved, and the efficiency and stability of the system are ensured.

CN119030687APending Publication Date: 2024-11-26UNIV OF ELECTRONICS SCI & TECH OF CHINA
View PDF 0 Cites 1 Cited by

Patent Information

Application Number
CN202411127124.6
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-16
Publication Date
2024-11-26

AI Technical Summary

Technical Problem

Existing distributed storage systems face unbalanced resource allocation, data security challenges and insufficient motivation to participate in storage nodes, making it difficult to achieve efficient data storage and long-term system stability.

Method used

Adopting a trusted file distributed storage management system based on blockchain, by introducing trusted adaptive file allocation algorithms and smart contract technology, the file allocation strategy is dynamically adjusted, the efficiency and security of data storage are improved, and the incentive and punishment mechanisms are used. Maintain the participation motivation of storage nodes.

Benefits of technology

It effectively solves the problems of unbalanced resource allocation, data security and insufficient motivation to participate in storage nodes, improves the efficiency and security of data storage, and ensures the long-term high availability and data privacy of the system.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119030687A_ABST
    Figure CN119030687A_ABST
Patent Text Reader

Abstract

The invention provides a trusted file distributed storage management system based on a block chain. By introducing the trusted adaptive file allocation algorithm, the method can dynamically adjust the file allocation strategy according to the real-time state of the storage node, thereby effectively improving the efficiency and security of data storage. According to the invention, a node excitation and maintenance mechanism is implemented by adopting an intelligent contract technology, and long-term high availability and data privacy of the system are maintained by automatically monitoring node behaviors and executing rewards or punishment. According to the method, the key problems of unbalanced resource configuration, data security challenge, insufficient participation power of the storage nodes and the like of the existing distributed storage system can be effectively solved, and a new solution is provided for the field of distributed file storage.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention belongs to the technical field of blockchain, and in particular relates to a trusted file distributed storage management system based on blockchain. Background Art

[0002] In this rapidly developing information age, the importance of distributed file storage systems has become increasingly prominent. They not only support large-scale cloud computing services, but are also the cornerstone of big data processing and storage. However, distributed file storage systems face the following technical challenges:

[0003] First of all, the current distributed storage system faces the situation of unbalanced resource allocation and security challenges. The distributed file storage system urgently needs to implement policy adjustments based on different scenarios to ensure the efficiency of the storage process and the security of the data.

[0004] Secondly, faced with the dual challenges of storing large amounts of data and reducing resource consumption, existing distributed storage systems lack a reliable and efficient data allocation algorithm that can enhance the system's disaster recovery capabilities.

[0005] Furthermore, in the face of storage nodes’ long-term lack of storage motivation and low data availability, it is necessary to develop a solution that combines incentives and punishment mechanisms to promote continuous storage node participation and ensure the long-term effectiveness of the system.

[0006] Therefore, the present invention proposes a trusted file distributed storage management system based on blockchain. By introducing a trusted adaptive file allocation algorithm, the present invention can dynamically adjust the file allocation strategy according to the real-time status of the storage node, effectively improving the efficiency and security of data storage. The adaptive algorithm is divided into two modes: decentralized and centralized, which are respectively adapted to scenarios with abundant storage node resources and tight resources, and increase file security by improving the decentralization of files. In addition, the present invention adopts smart contract technology to implement a node incentive and maintenance mechanism, and maintains the long-term high availability and data privacy of the system by automatically monitoring node behavior and executing rewards or penalties. Therefore, the invention can effectively solve the key problems of existing distributed storage systems in terms of unbalanced resource allocation, data security challenges, and insufficient motivation for storage node participation, and provides a new solution for the field of distributed file storage. Summary of the invention

[0007] In order to solve the key problems of existing distributed storage systems such as unbalanced resource allocation, data security challenges, and insufficient motivation for storage node participation, the present invention provides a trusted file distributed storage management system based on blockchain, including the following modules:

[0008] F1. Interactive interface module: It is a module that integrates file collection and data exchange. It plays the role of a communication channel between customers and the system, connecting the algorithm module, data storage node and blockchain network;

[0009] F2, Algorithm module: It is a core module used to process files, formulate file allocation plans, and perform file access verification. It improves the security of data storage by adaptively adjusting the storage node selection plan;

[0010] F3, Smart Contract Module: It is a technical module that includes three parts: customer-oriented, data storage node-oriented and system-oriented. It is responsible for processing and recording various types of information during the entire file access process to maintain the security and stability of the system;

[0011] F4. Blockchain network module: It is a module that serves as the core data layer of the system. It not only stores the uploaded data of the smart contract module, but is also responsible for implementing data access control, ensuring the integrity and security of information, and enhancing the authenticity and traceability of records on the chain, thereby providing guarantee for the long-term stable operation of the system.

[0012] The F1 module contains two functional units:

[0013] F11, File Collection Unit: The window for customers to store and retrieve files, and the main channel for customers to communicate with the system;

[0014] F12, Data exchange unit: responsible for the data exchange between the algorithm module, data storage node and the blockchain network, and realizing the data flow between system modules.

[0015] The F2 module contains two functional units:

[0016] F21, file processing algorithm unit: mainly responsible for file segmentation, encryption and verification;

[0017] F22, Trusted Adaptive File Allocation Algorithm Unit: Mainly responsible for formulating and adaptively adjusting file allocation plans.

[0018] The F3 module contains three functional units:

[0019] F31, infofetch smart contract unit: responsible for processing customers' file storage and retrieval requests, ensuring the safe upload and effective retrieval of files;

[0020] F32, nodeManager smart contract unit: responsible for managing the registration of data storage nodes, authority allocation, and qualification review for participating in storage activities, ensuring the healthy operation of the storage network;

[0021] F33, meritDeductionAlorithm algorithm unit: By evaluating the performance and behavior of the nodes, dynamically adjust the reputation of the nodes to promote the combination of fairness and incentives.

[0022] The F33 unit contains two subunits, namely:

[0023] F331, blockchain data processing unit: a functional unit responsible for reading node reputation information and screening low-reputation nodes.

[0024] F332, meritDeduction smart contract unit: a functional unit responsible for rewarding and punishing nodes, and uploading node reward and punishment information to the blockchain.

[0025] The F4 module contains two functional units:

[0026] F41. Blockchain network unit: A distributed network consisting of multiple nodes used to transmit blockchain data.

[0027] F42. Blockchain node: A computer node participating in a blockchain network, used to store and manage blockchain data.

[0028] Among them, the infofetch contract unit described in F31 includes the following functions:

[0029] F311, function handleFile() used by the client to upload file information and pay storage points;

[0030] F312, function getFile() used by clients to extract files;

[0031] F313. Function submitHash() is used by the client to submit a file hash value to verify the integrity and correctness of the file.

[0032] Among them, the nodeManager contract unit described in F32 includes the following functional functions:

[0033] F321, function getEntryFee() used by nodes to pay membership points;

[0034] F322, function enroll() used for nodes to register to participate in storage activities;

[0035] F323, the function nodeReceipt() used by the data storage node to upload the file hash value to complete the receipt verification during the file extraction phase.

[0036] Among them, the blockchain data processing unit described in F33 includes the following functional functions:

[0037] F3311. Manage node reputation and filter nodes based on their reputation using the filterAndDelistNodes() function.

[0038] Among them, the meritDeduction smart contract unit described in F33 includes the following functions:

[0039] F3321, function distributeFunds() that equally distributes the stored points as incentives;

[0040] F3322, function updateDetail() used to submit information and complete system maintenance.

[0041] The specific steps of a blockchain-based trusted file distributed storage management method proposed by the present invention are as follows:

[0042] S1. The customer initiates a file storage request and uploads the file;

[0043] S2, the uploaded files are processed and allocated for storage by the algorithm module;

[0044] S3, the client initiates a file read request to extract the file;

[0045] S4. After receiving the file read request, the algorithm module recovers and verifies the file;

[0046] S5. The verified secure and trusted file is delivered to the client through the interactive interface;

[0047] S6. After the user receives and acknowledges the receipt, the system maintains stability.

[0048] Furthermore, step S1 includes the following sub-steps:

[0049] S11, the client initiates a file storage request through the interactive interface;

[0050] S12. The client calls the handleFile() function in the infofetch contract unit to upload file information and pay storage points.

[0051] Furthermore, step S2 includes the following sub-steps:

[0052] S21. The node pays the membership points through the getEntryFee() function in the nodeManager contract unit and becomes a data custodian node;

[0053] Among them, the data storage node is a node that is qualified to participate in file storage activities.

[0054] S22. The data custodian node registers to participate in the storage activity through the enroll() function in the nodeManager contract unit;

[0055] S23, the algorithm module reads the file information through the interactive interface, splits the file into multiple sub-file blocks using a segmentation method based on a fixed number of copies, and uploads the hash values ​​of the sub-file blocks to the blockchain;

[0056] S24, the algorithm module adopts a hybrid encryption method to encrypt the split sub-file blocks to form encrypted file blocks.

[0057] Among them, the hybrid encryption method means that the PBKDF2 algorithm is first used to generate a symmetric encryption key pair. Then, based on the customer's public key, the RSA algorithm is used to asymmetrically encrypt the symmetric encryption key.

[0058] Among them, the PBKDF2 algorithm is an encryption algorithm that derives the key through a pseudo-random function. The RSA algorithm is an asymmetric encryption algorithm that provides a secure and reliable encryption method;

[0059] S25. The algorithm module reads the registration information and selects safe and reliable data storage nodes.

[0060] The registration information includes the ID of each registered data storage node and three indicators to determine the trustworthiness of the data storage node: reputation, load and credit points.

[0061] Among them, reputation is an indicator to measure the long-term trustworthiness of data storage nodes. Load is an indicator to measure the ability of data storage nodes to store file information completely, and it is also an important indicator to promote the balanced distribution of system file information. Credit points are an indicator to measure the short-term trustworthiness of data storage nodes;

[0062] S26, the algorithm module transmits the encrypted file block to the selected secure and reliable data storage node for storage and generates file distribution information, which records the node location of each file block distribution;

[0063] S27. File distribution information is uploaded to the blockchain network.

[0064] Furthermore, step S3 includes the following sub-steps:

[0065] S31. The client initiates a file reading request using the interactive interface module.

[0066] S32. The smart contract receives the request and calls the infofetch contract unit to start the file extraction process.

[0067] Furthermore, step S4 includes the following sub-steps:

[0068] S41. The data storage node holding the corresponding file submits the file to the system through the data exchange unit and uploads the sub-file block hash value through the nodeReceipt() function.

[0069] S42, the algorithm module compares the hash value uploaded by the data storage node with the hash value of the sub-file block on the blockchain network, selects the correct file block and merges the files in order.

[0070] S43. If the hash value of the sub-file block uploaded by the data custodian node does not match the hash value on the blockchain, the algorithm module will record the node with the inconsistent hash value into the malicious node form, and the node that correctly submitted the file block in the storage activity will be recorded in the reward node form.

[0071] The malicious node table records all the data custodian nodes that submitted sub-file blocks incorrectly during this storage activity. The reward node table records all the data custodian nodes that submitted sub-file blocks correctly during this storage activity.

[0072] S44. The algorithm module compares the recorded information on the blockchain with the information of the merged complete file to complete the verification.

[0073] Furthermore, step S5 includes the following sub-steps:

[0074] S51. The system sends the complete trusted file and the asymmetrically encrypted key to the customer.

[0075] S52. The client calls the getFile() function in the infofetch contract unit to extract the verified secure and trusted file.

[0076] S53. After completing the file extraction, the client needs to submit the file hash value through the submitHash() function in the infofetch contract unit to verify the integrity and correctness of the file.

[0077] Furthermore, step S6 includes the following sub-steps:

[0078] S61. The system calls the distributeFunds() function in the meritDeduction unit to read the malicious node form and the reward node form, and divides the storage points equally as incentives, while increasing the credibility of the nodes in the reward node form and reducing the credibility of the nodes in the malicious node form.

[0079] S62. The function filterAndDelistNodes() in the blockchain data processing unit reads the reputation of all nodes after the update, and filters out the nodes below the reputation threshold to generate a low-reputation node list. The data custodian nodes that participated in this storage activity outside the low-reputation node list are recorded in the final node list.

[0080] The low-reputation node list is responsible for recording the data storage nodes whose reputation is adjusted below the reputation threshold during this storage activity. The final node list is responsible for recording the data storage nodes other than the low-reputation node list during this storage activity.

[0081] S63, the meritDeductionAlgorithm unit counts the membership points of the nodes in the low-credibility node list to obtain the membership points of the low-credibility nodes.

[0082] S64. The meritDeduction unit calls the function updateDetail() to submit information, divides the membership points of low-credibility nodes equally among the nodes in the final node list as incentives, and revokes the file storage activity participation qualifications of the nodes in the low-credibility node list, completing system maintenance.

[0083] Technical effects and advantages of the present invention:

[0084] The blockchain-based trusted file distributed storage management system proposed in the present invention can effectively solve the key problems of existing distributed storage systems such as unbalanced resource allocation, data security challenges, and insufficient motivation for storage node participation. By introducing a trusted adaptive file allocation algorithm, the present invention can dynamically adjust the file allocation strategy according to the real-time status of the storage node, effectively improving the efficiency and security of data storage. In addition, the present invention adopts smart contract technology to implement the node incentive and maintenance mechanism, and maintains the long-term high availability and data privacy of the system by automatically monitoring node behavior and executing rewards or penalties. Therefore, the present invention can effectively solve the key problems of existing distributed storage systems such as unbalanced resource allocation, data security challenges, and insufficient motivation for storage node participation, and provides a new solution for the field of distributed file storage. BRIEF DESCRIPTION OF THE DRAWINGS

[0085] Figure 1 The present invention is a flow chart of the method.

[0086] Figure 2 UML diagram for smart contract

[0087] Figure 3 Shows N E >N R With N E ≤NR In the two cases, facing different proportions of malicious nodes, the system proposed in the present invention and other four distributed file storage solutions: HDFS, CRUSH, DHT, and CH are able to successfully recover files.

[0088] Figure 4 Gas graph

[0089] Figure 5 , 6 7. Smart contract processing time chart DETAILED DESCRIPTION

[0090] In the implementation example of the present invention, the blockchain-based trusted file distributed storage management system proposed by the present invention is verified. By simulating the system, the ability of the system proposed by the present invention to resist malicious node attacks and successfully recover files is measured to verify the feasibility of the system and method proposed by the present invention.

[0091] In an embodiment of the present invention, a hardhat tool is used to generate a virtual node for model testing, and a smart contract is compiled using the Solidity language, with version number 0.8.19. Interactive verification is performed in Sepolia, a blockchain test chain built on Ethereum, and the consensus mechanism is POS.

[0092] Among them, Hardhat is a development environment for compiling, deploying, testing and debugging Ethereum applications. It can help developers manage and automate repetitive tasks inherent in building smart contracts, and easily introduce more features around this workflow. Solidity is a contract-oriented, high-level programming language created to implement smart contracts. The consensus mechanism refers to the verification and confirmation of transactions in a very short time through the voting of special nodes. POS is a consensus mechanism.

[0093] The system prototype was implemented and verified on a desktop computer equipped with a 12th generation Intel Core i5 series processor with a base clock frequency of 2.50GHz and an NVIDIA GeForce RTX 3060 27.9gb graphics card.

[0094] The embodiment of the present invention includes four modules: an interactive interface module, an algorithm module, a smart contract module, and a blockchain network module. The interactive interface module is a module that integrates file collection and data exchange, and plays the role of a communication channel between the client and the system, connecting the algorithm module, the data storage node, and the blockchain network. The algorithm module is a core module for processing files, formulating file allocation plans, and performing file access verification. It improves the security of data storage by adaptively adjusting the storage node selection plan; the smart contract module is a technical module that includes three parts: customer-oriented, data storage node-oriented, and system-oriented. It is responsible for processing and recording various types of information during the entire file access process, and is used to maintain the security and stability of the system; it is a module that serves as the core data layer of the system, which not only stores the uploaded data of the smart contract module, but is also responsible for implementing data access control, ensuring the integrity and security of the information, and enhancing the authenticity and traceability of the records on the chain, thereby providing a guarantee for the long-term stable operation of the system.

[0095] In order to more clearly illustrate the system workflow in a specific implementation case, the specific implementation steps are first explained, and then the various modules used in the implementation plan are described in detail.

[0096] like Figure 1 As shown, the present invention proposes a trusted file distributed storage management system based on blockchain, and the specific steps of the trusted file distributed storage management method based on blockchain are as follows:

[0097] S1. The customer initiates a file storage request and uploads the file;

[0098] S2, the uploaded files are processed and allocated for storage by the algorithm module;

[0099] S3, the client initiates a file read request to extract the file;

[0100] S4. After receiving the file read request, the algorithm module recovers and verifies the file;

[0101] S5. The verified secure and trusted file is delivered to the client through the interactive interface;

[0102] S6. After the user receives and acknowledges the receipt, the system maintains stability.

[0103] Furthermore, step S1 includes the following sub-steps:

[0104] S11, the client initiates a file storage request through the interactive interface;

[0105] S12. The client calls the handleFile() function in the infofetch contract unit to upload file information and pay storage points.

[0106] Furthermore, step S2 includes the following sub-steps:

[0107] S21. The node pays the membership points through the getEntryFee() function in the nodeManager contract unit and becomes a data custodian node;

[0108] Among them, data custody nodes are nodes that are qualified to participate in file storage activities. Ordinary nodes pay membership points exceeding the set threshold value to become data custody nodes.

[0109] S22. The data custodian node registers to participate in the storage activity through the enroll() function in the nodeManager contract unit;

[0110] S23, the algorithm module reads the file information through the interactive interface, splits the file into multiple sub-file blocks using a segmentation method based on a fixed number of copies, and uploads the hash values ​​of the sub-file blocks to the blockchain;

[0111] S24, the algorithm module adopts a hybrid encryption method to encrypt the split sub-file blocks to form encrypted file blocks.

[0112] Among them, the hybrid encryption method means that the PBKDF2 algorithm is first used to generate a symmetric encryption key pair. Then, based on the customer's public key, the RSA algorithm is used to asymmetrically encrypt the symmetric encryption key.

[0113] Among them, the PBKDF2 algorithm is an encryption algorithm that derives the key through a pseudo-random function. The RSA algorithm is an asymmetric encryption algorithm that provides a secure and reliable encryption method;

[0114] S25. The algorithm module reads the registration information and selects safe and reliable data storage nodes.

[0115] The registration information includes the ID of each registered data storage node and three indicators to determine the trustworthiness of the data storage node: reputation, load and credit points.

[0116] Among them, reputation is an indicator to measure the long-term trustworthiness of data storage nodes. Load is an indicator to measure the ability of data storage nodes to store file information completely, and it is also an important indicator to promote the balanced distribution of system file information. Credit points are an indicator to measure the short-term trustworthiness of data storage nodes;

[0117] S26, the algorithm module transmits the encrypted file block to the selected secure and reliable data storage node for storage and generates file distribution information, which records the node location of each file block distribution;

[0118] S27. File distribution information is uploaded to the blockchain network.

[0119] Furthermore, step S3 includes the following sub-steps:

[0120] S31. The client initiates a file reading request using the interactive interface module.

[0121] S32. The smart contract receives the request and calls the infofetch contract unit to start the file extraction process.

[0122] Furthermore, step S4 includes the following sub-steps:

[0123] S41. The data storage node holding the corresponding file submits the file to the system through the data exchange unit and uploads the sub-file block hash value through the nodeReceipt() function.

[0124] S42, the algorithm module compares the hash value uploaded by the data storage node with the hash value of the sub-file block on the blockchain network, selects the correct file block and merges the files in order.

[0125] S43. If the hash value of the sub-file block uploaded by the data custodian node does not match the hash value on the blockchain, the algorithm module will record the node with the inconsistent hash value into the malicious node form, and the node that correctly submitted the file block in the storage activity will be recorded in the reward node form.

[0126] The malicious node table records all the data custodian nodes that submitted sub-file blocks incorrectly during this storage activity. The reward node table records all the data custodian nodes that submitted sub-file blocks correctly during this storage activity.

[0127] S44. The algorithm module compares the recorded information on the blockchain with the information of the merged complete file to complete the verification.

[0128] Furthermore, step S5 includes the following sub-steps:

[0129] S51. The system sends the complete trusted file and the asymmetrically encrypted key to the customer.

[0130] S52. The client calls the getFile() function in the infofetch contract unit to extract the verified secure and trusted file.

[0131] S53. After completing the file extraction, the client needs to submit the file hash value through the submitHash() function in the infofetch contract unit to verify the integrity and correctness of the file.

[0132] Furthermore, step S6 includes the following sub-steps:

[0133] S61. The system calls the distributeFunds() function in the meritDeduction unit to read the malicious node form and the reward node form, and divides the storage points equally as incentives, while increasing the credibility of the nodes in the reward node form and reducing the credibility of the nodes in the malicious node form.

[0134] S62. The function filterAndDelistNodes() in the blockchain data processing unit reads the reputation of all nodes after the update, and filters out the nodes below the reputation threshold to generate a low-reputation node list. The data custodian nodes that participated in this storage activity outside the low-reputation node list are recorded in the final node list.

[0135] The low-reputation node list is responsible for recording the data storage nodes whose reputation is adjusted below the reputation threshold during this storage activity. The final node list is responsible for recording the data storage nodes other than the low-reputation node list during this storage activity.

[0136] S63, the meritDeductionAlgorithm unit counts the membership points of the nodes in the low-credibility node list to obtain the membership points of the low-credibility nodes.

[0137] S64. The meritDeduction unit calls the function updateDetail() to submit information, divides the membership points of low-credibility nodes equally among the nodes in the final node list as incentives, and revokes the file storage activity participation qualifications of the nodes in the low-credibility node list, completing system maintenance.

[0138] The present invention proposes a blockchain-based trusted file distributed storage management system. The specific branch functions of each module in the blockchain-based trusted file distributed storage management system are as follows:

[0139] F1. Interactive interface module: It is a module that integrates file collection and data exchange. It plays the role of a communication channel between customers and the system, connecting the algorithm module, data storage node and blockchain network;

[0140] F2, Algorithm module: It is a core module used to process files, formulate file allocation plans, and perform file access verification. It improves the security of data storage by adaptively adjusting the storage node selection plan;

[0141] F3, Smart Contract Module: It is a technical module that includes three parts: customer-oriented, data storage node-oriented and system-oriented. It is responsible for processing and recording various types of information during the entire file access process to maintain the security and stability of the system;

[0142] F4. Blockchain network module: It is a module that serves as the core data layer of the system. It not only stores the uploaded data of the smart contract module, but is also responsible for implementing data access control, ensuring the integrity and security of information, and enhancing the authenticity and traceability of records on the chain, thereby providing guarantee for the long-term stable operation of the system.

[0143] The F1 module contains two functional units:

[0144] F11, File Collection Unit: The window for customers to store and retrieve files, and the main channel for customers to communicate with the system;

[0145] F12, Data exchange unit: responsible for the data exchange between the algorithm module, data storage node and the blockchain network, and realizing the data flow between system modules.

[0146] The F2 module contains two functional units:

[0147] F21, file processing algorithm unit: mainly responsible for file segmentation, encryption and verification;

[0148] F22, Trusted Adaptive File Allocation Algorithm Unit: Mainly responsible for formulating and adaptively adjusting file allocation plans.

[0149] The F3 module contains three functional units:

[0150] F31, infofetch smart contract unit: responsible for processing customers' file storage and retrieval requests, ensuring the safe upload and effective retrieval of files;

[0151] F32, nodeManager smart contract unit: responsible for managing the registration of data storage nodes, authority allocation, and qualification review for participating in storage activities, ensuring the healthy operation of the storage network;

[0152] F33, meritDeductionAlorithm algorithm unit: By evaluating the performance and behavior of the nodes, dynamically adjust the reputation of the nodes to promote the combination of fairness and incentives.

[0153] The F33 unit contains two subunits, namely:

[0154] F331, blockchain data processing unit: a functional unit responsible for reading node reputation information and screening low-reputation nodes.

[0155] F332, meritDeduction smart contract unit: a functional unit responsible for rewarding and punishing nodes, and uploading node reward and punishment information to the blockchain.

[0156] The F4 module contains two functional units:

[0157] F41. Blockchain network unit: A distributed network consisting of multiple nodes used to transmit blockchain data.

[0158] F42. Blockchain node: A computer node participating in a blockchain network, used to store and manage blockchain data.

[0159] Among them, the infofetch contract unit described in F31 includes the following functions:

[0160] F311, function handleFile() used by the client to upload file information and pay storage points;

[0161] F312, function getFile() used by clients to extract files;

[0162] F313. Function submitHash() is used by the client to submit a file hash value to verify the integrity and correctness of the file.

[0163] Among them, the nodeManager contract unit described in F32 includes the following functional functions:

[0164] F321, function getEntryFee() used by nodes to pay membership points;

[0165] F322, function enroll() used for nodes to register to participate in storage activities;

[0166] F323, the function nodeReceipt() used by the data storage node to upload the file hash value to complete the receipt verification during the file extraction phase.

[0167] Among them, the blockchain data processing unit described in F33 includes the following functional functions:

[0168] F3311. Manage node reputation and filter nodes based on their reputation using the filterAndDelistNodes() function.

[0169] Among them, the meritDeduction smart contract unit described in F33 includes the following functions:

[0170] F3321, function distributeFunds() that equally distributes the stored points as incentives;

[0171] F3322, function updateDetail() used to submit information and complete system maintenance.

[0172] Through the system and method proposed in the present invention, users can store and read files through an interactive interface, and the stored files can be allocated according to the real-time status of the storage node by the algorithm, effectively improving the efficiency and security of data storage.

[0173] Figure 2 The UML diagrams of three smart contracts in the embodiment of the present invention are shown, the embodiment of the present invention is visually modeled, and the connection between classes in the embodiment of the present invention is shown.

[0174] Figure 3 Shows N E >N R With N E ≤N R In the two cases, facing different proportions of malicious nodes, the system proposed in the present invention and the four distributed file storage solutions HDFS, CRUSH, DHT, and CH are able to successfully recover files.

[0175] Among them, HDFS is a distributed file system that is specifically designed to handle the storage and management of large data sets. CRUSH is a data placement algorithm for distributed storage systems that determines the storage location of data blocks by calculation rather than table lookup, thereby improving the scalability and performance of the storage system. DHT is a decentralized distributed storage structure used to distribute and find data in a peer-to-peer network. CH, or consistent hashing, is a distributed storage hashing algorithm used to solve the distribution and load balancing problems of data between nodes. A malicious node refers to a node in a distributed system that sends inconsistent information to each node in order to obstruct the transmission of real information and the achievement of effective consensus. Malicious nodes can control the computing node device itself, as well as the communication between the node and the server.

[0176] The results show that the embodiment of the present invention performs best in resisting malicious nodes. Even under extreme conditions where the proportion of malicious nodes is as high as 90%, when the number of applicants is greater than the required number of people, the number of files successfully recovered by the system is 30% of the total number of files, which is about three times that of other solutions; at the same time, when the number of applicants is less than the required number of people, the embodiment of the present invention effectively resists the attack of malicious nodes by dynamically adjusting the number of redundancies and reusing high-quality nodes. The number of files successfully recovered by the system is 57% of the total number of files, which is about 5.7 times that of other solutions. This is because compared with other solutions, the solution proposed in the present invention takes into account the reliability of storage nodes, effectively screens trusted nodes to store files through intelligent file allocation strategies, and improves file security. At the same time, the solution proposed in the present invention uses a set of effective incentive mechanisms and system maintenance mechanisms to punish malicious nodes in a timely manner, incentivize excellent nodes, and eliminate nodes with too low credibility. Through this dynamic incentive and maintenance mechanism, the system effectively improves its ability to resist malicious nodes and ensures long-term system availability and data reliability. Moreover, as the proportion of malicious nodes increases, the file recovery rate of the solution proposed in the present invention decreases more slowly than other solutions, showing stronger robustness and resilience. From Figure 3 It can be seen that the system and method proposed in the present invention are practical and feasible.

[0177] Figure 4 The GAS consumption of 3 smart contracts is shown.

[0178] Among them, Gas is the name of the execution points that the transaction initiator needs to pay for each operation on the Ethereum blockchain. It can be seen from the figure that the gas value consumption of the deploy operation in the three smart contracts is the highest among all functions. This is because the deploy action of the smart contract is a one-time overhead action, and the process of uploading the contract bytecode to the Ethereum blockchain involves a large number of data writing operations. Due to the immutability of blockchain data, these bytecodes are permanently stored on the blockchain once uploaded. Therefore, the cost of deploy is much higher than that of contract functions that only modify status or perform calculations. The getEntryFee function in the nodeManager smart contract unit only involves the simple operations of the DC node submitting membership points and checking membership points, so the GAS consumption is the least among the functions. From Figure 4 It can be seen from the above that the system and method proposed in the present invention are practical and feasible.

[0179] Figure 5 , 67 is the execution time change of the main functions of the three smart contracts, infofetch smart contract unit, nodeManager smart contract unit, and meritDeduction smart contract unit, as the number of calls increases. The experimental results not only cover the execution time of the smart contract function on the blockchain, but also include the time for data processing in the background of the system. The execution time of the contract function includes blockchain-specific operations such as state reading and writing, network verification, Gas calculation, and transaction confirmation. The background data processing time involves data processing analysis and other non-chain resource usage processed internally by the server. In the experiment, it was observed that as the number of contract function calls increased, the function execution time of all contracts showed an upward trend. Figure 5 The execution time of the two functions of registration and file receipt submission in the nodeManager smart contract unit changes with the increase of calling here. Since the getEntryFee() function of the nodeManager smart contract unit is only executed once when entering the system, the two functions of enroll() and nodeReceipt() have a greater impact on the system execution speed. From the experimental results, it can be seen that the enroll() function takes longer to execute than the nodeReceipt() function, because the enroll function has more information to submit. The nodeManager smart contract unit has the shortest function execution time among the three contracts, which is also because the function submits less information and does not involve a large number of background data processing operations. In contrast, the meritDeduction smart contract unit has the longest execution time because it submits a lot of node forms and other information, and involves more background data processing operations. Figure 7 It can be seen that the distributeFunds() function has the longest execution time, because the distributeFunds() function is used to issue incentives to nodes, which involves changes in node reputation and account points, as well as background node statistics calculations. In contrast, the updateDetail() function is only used to update node status, and the background calculation amount is less, so the execution time is shorter. Figure 5 , 6 ,7 It can be seen that the system proposed in the present invention is feasible.

[0180] The present invention is described by some embodiments, and it is known to those skilled in the art that various changes or equivalent substitutions may be made to these features and embodiments without departing from the spirit and scope of the present invention. In addition, under the teachings of the present invention, these features and embodiments may be modified to adapt to specific circumstances and materials without departing from the spirit and scope of the present invention. Therefore, the present invention is not limited to the specific embodiments disclosed herein, and all embodiments falling within the scope of the claims of this application are within the scope of protection of the present invention.

Claims

1. A trusted file distributed storage management system based on blockchain, characterized in that: Includes the following modules: F1. Interactive interface module: It is a module that integrates file collection and data exchange. It plays the role of a communication channel between customers and the system, connecting the algorithm module, data storage node and blockchain network; The F1 module contains two functional units: F11, File Collection Unit: The window for customers to store and retrieve files, and the main channel for customers to communicate with the system; F12, Data exchange unit: responsible for the data exchange between the algorithm module, data storage node and the blockchain network, and realizing the data flow between system modules. F2, Algorithm module: It is a core module used to process files, formulate file allocation plans, and perform file access verification. It improves the security of data storage by adaptively adjusting the storage node selection plan; The F2 module contains two functional units: F21, file processing algorithm unit: mainly responsible for file segmentation, encryption and verification; F22, Trusted Adaptive File Allocation Algorithm Unit: Mainly responsible for formulating and adaptively adjusting file allocation plans. F3, Smart Contract Module: It is a technical module that includes three parts: customer-oriented, data storage node-oriented and system-oriented. It is responsible for processing and recording various types of information during the entire file access process to maintain the security and stability of the system; The F3 module contains three functional units: F31, infofetch smart contract unit: responsible for processing customers' file storage and retrieval requests, ensuring the safe upload and effective retrieval of files; F32, nodeManager smart contract unit: responsible for managing the registration of data storage nodes, authority allocation, and qualification review for participating in storage activities, ensuring the healthy operation of the storage network; F33, meritDeductionAlorithm algorithm unit: By evaluating the performance and behavior of the nodes, dynamically adjust the reputation of the nodes to promote the combination of fairness and incentives. The F33 unit contains two subunits, namely: F331, blockchain data processing unit: a functional unit responsible for reading node reputation information and screening low-reputation nodes. F332, meritDeduction smart contract unit: a functional unit responsible for rewarding and punishing nodes, and uploading node reward and punishment information to the blockchain. F4. Blockchain network module: It is a module that serves as the core data layer of the system. It not only stores the uploaded data of the smart contract module, but is also responsible for implementing data access control, ensuring the integrity and security of information, and enhancing the authenticity and traceability of records on the chain, thereby providing guarantee for the long-term stable operation of the system. The F4 module contains two functional units: F41. Blockchain network unit: A distributed network consisting of multiple nodes used to transmit blockchain data. F42. Blockchain node: A computer node participating in a blockchain network, used to store and manage blockchain data. Furthermore, the F31 unit in the module F3 includes the following functions: F311, function handleFile() used by the client to upload file information and submit storage points; F312, function getFile() used by clients to extract files; F313. Function submitHash() is used by the client to submit a file hash value to verify the integrity and correctness of the file. Furthermore, the F32 unit in the module F3 includes the following functions: F321, function getEntryFee() used by nodes to submit membership points; F322, function enroll() used for nodes to register to participate in storage activities; F323, the function nodeReceipt() used by the data storage node to upload the file hash value to complete the receipt verification during the file extraction phase. Furthermore, the unit F331 in the unit F33 includes the following functions: F3311. Manage node reputation and filter nodes based on their reputation using the filterAndDelistNodes() function. Furthermore, the unit F332 in the unit F33 includes the following functions: F3321, function distributeFunds() that equally distributes the membership points as incentives; F3322, function updateDetail() used to submit information and complete system maintenance.

2. A trusted file distributed storage management method based on blockchain, characterized in that: The following steps are involved: S1. The customer initiates a file storage request and uploads the file; S2, the uploaded files are processed and allocated for storage by the algorithm module; S3, the client initiates a file read request to extract the file; S4. After receiving the file read request, the algorithm module recovers and verifies the file; S5. The verified secure and trusted file is delivered to the client through the interactive interface; S6. After the user receives and acknowledges the receipt, the system maintains stability. Furthermore, the step S1 comprises the following sub-steps: S11, the client initiates a file storage request through the interactive interface; S12. The client calls the handleFile() function in the infofetch contract unit to upload file information and submit storage points. Furthermore, step S2 comprises the following sub-steps: S21. The node submits the membership points through the getEntryFee() function in the nodeManager contract unit and becomes a data custodian node; Among them, the data storage node is a node that is qualified to participate in file storage activities. S22. The data custodian node registers to participate in the storage activity through the enroll() function in the nodeManager contract unit; S23, the algorithm module reads the file information through the interactive interface, splits the file into multiple sub-file blocks using a segmentation method based on a fixed number of copies, and uploads the hash values ​​of the sub-file blocks to the blockchain; S24, the algorithm module adopts a hybrid encryption method to encrypt the split sub-file blocks to form encrypted file blocks. Among them, the hybrid encryption method means that the PBKDF2 algorithm is first used to generate a symmetric encryption key pair. Then, based on the customer's public key, the RSA algorithm is used to asymmetrically encrypt the symmetric encryption key. Among them, the PBKDF2 algorithm is an encryption algorithm that derives the key through a pseudo-random function. The RSA algorithm is an asymmetric encryption algorithm that provides a secure and reliable encryption method; S25. The algorithm module reads the registration information and selects safe and reliable data storage nodes. The registration information includes the ID of each registered data storage node and three indicators to determine the trustworthiness of the data storage node: reputation, load and credit points. Among them, reputation is an indicator to measure the long-term trustworthiness of data storage nodes. Load is an indicator to measure the ability of data storage nodes to store file information completely, and it is also an important indicator to promote the balanced distribution of system file information. Credit points are an indicator to measure the short-term trustworthiness of data storage nodes; S26, the algorithm module transmits the encrypted file block to the selected secure and reliable data storage node for storage and generates file distribution information, which records the node location of each file block distribution; S27. File distribution information is uploaded to the blockchain network. Furthermore, step S3 includes the following sub-steps: S31. The client initiates a file reading request using the interactive interface module. S32. The smart contract receives the request and calls the infofetch contract unit to start the file extraction process. Furthermore, step S4 comprises the following sub-steps: S41. The data storage node holding the corresponding file submits the file to the system through the data exchange unit and uploads the sub-file block hash value through the nodeReceipt() function. S42, the algorithm module compares the hash value uploaded by the data storage node with the hash value of the sub-file block on the blockchain network, selects the correct file block and merges the files in order. S43. If the hash value of the sub-file block uploaded by the data custodian node does not match the hash value on the blockchain, the algorithm module will record the node with the inconsistent hash value into the malicious node form, and the node that correctly submitted the file block in the storage activity will be recorded in the reward node form. The malicious node table records all the data custodian nodes that submitted sub-file blocks incorrectly during this storage activity. The reward node table records all the data custodian nodes that submitted sub-file blocks correctly during this storage activity. S44. The algorithm module compares the recorded information on the blockchain with the information of the merged complete file to complete the verification. Furthermore, the step S5 comprises the following sub-steps: S51. The system sends the complete trusted file and the asymmetrically encrypted key to the customer. S52. The client calls the getFile() function in the infofetch contract unit to extract the verified secure and trusted file. S53. After completing the file extraction, the client needs to submit the file hash value through the submitHash() function in the infofetch contract unit to verify the integrity and correctness of the file. Furthermore, step S6 includes the following sub-steps: S61. The system reads the malicious node form and the reward node form by calling the distributeFunds() function in the meritDeduction unit, and equally stores the membership points as incentives, while increasing the credibility of the nodes in the reward node form and decreasing the credibility of the nodes in the malicious node form. S62. The function filterAndDelistNodes() in the blockchain data processing unit reads the reputation of all nodes after the update, and filters out the nodes below the reputation threshold to generate a low-reputation node list. The data custodian nodes that participated in this storage activity outside the low-reputation node list are recorded in the final node list. The low-reputation node list is responsible for recording the data storage nodes whose reputation is adjusted below the reputation threshold during this storage activity. The final node list is responsible for recording the data storage nodes other than the low-reputation node list during this storage activity. S63, the meritDeductionAlgorithm unit counts the membership points of the nodes in the low-credibility node list to obtain the membership points of the low-credibility nodes. S64. The meritDeduction unit calls the function updateDetail() to submit information, divides the membership points of low-credibility nodes equally among the nodes in the final node list as incentives, and revokes the file storage activity participation qualifications of the nodes in the low-credibility node list to complete system maintenance.

Citation Information

Cited By

  • Distributed intelligent computing resource scheduling optimization method and system

    CN120469817A