Data processing method and device based on distributed storage, equipment and medium

Abstract

The invention provides a data processing method and device based on distributed storage, equipment and a medium, and the method comprises the steps: carrying out the space detection of a first block processing space of a storage buffer pool when first block data is written into a local cache and a local storage, and obtaining a first space detection result; if the first space detection result indicates that the number of the to-be-stored blocks does not reach the buffer block processing threshold, writing the first block data into the storage buffer pool based on the N pieces of to-be-stored block data; performing space detection on a second block processing space of a storage processing pool to obtain a second space detection result; and if the second space detection result indicates thatthe number of the to-be-fed back blocks does not reach the feedback block processing threshold, based on the number of the to-be-fed back blocks and the feedback block processing threshold, determining to carry out overlapping detection with the M to-be-fed back block data and the to-be-merged block data from the storage buffer pool, and writing the data after overlapping detection into a distributed database. By adopting the method and the device, the data storage efficiency can be improved.

Description

technical field [0001] The present application relates to the technical field of blockchain, and in particular to a data processing method, device, device and medium based on distributed storage. Background technique [0002] At present, in the blockchain system, some consensus nodes participating in the consensus (for example, consensus node A) often use local storage as the data storage medium when storing data. For example, when the consensus node A passes the consensus layer In the process of block consensus on a block (for example, block N), the execution layer can be further called to execute each transaction in the block N, and then the transaction execution results of each transaction can be executed when the block consensus is reached Send it to the storage layer so that the storage layer can write the block information (for example, block header, transaction list, transaction execution result, etc.) of the block N into local storage. It should be noted that the lo...

AI Technical Summary

Problems solved by technology

It should be noted that the local storage and storage layer in the consensus node A are two independent hard disk spaces, so that when using the local storage in the consensus node A for data storage, it will be limited by the entire hard disk space , resulting in a limited amount of storage for local storage

[0003] In addition, in other blockchain systems, some consensus nodes can also be allowed to use independent databases for data storage. However, for these blockchain systems, when using independent databases for data storage, they are often affected. It is limited to the block chain structure of the blockchain maintained by these blockchain systems. For example, when the storage layer successfully stores a certain block in the corresponding database, it can continue to notify the consensus layer to execute the next block, which means In the whole process of data storage, it is often necessary to store data serially according to the block generation time stamp of each block, which will inevitably reduce the storage efficiency of data in these blockchain systems

Images