Blockchain Asynchronous Bookkeeping for I/O Delay Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The existing method of serially writing block information into disk or distributed storage in blockchain networks results in significant delays due to heavy reliance on I/O resources, affecting the performance of the blockchain network.
Innovation Solution
Implementing asynchronous accounting by writing block information into message queues and caches after verification, allowing parallel processing and reducing the need to wait for data persistence before starting the next round of consensus, thereby improving throughput.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If block information is written serially into disk or distributed storage, then data persistence is ensured, but accounting delay increases and processing performance decreases
Solution Approach 1:
The patent segments the block information into multiple components (block header, transaction list, execution result, write set) and writes them to different locations (message queue and disk) independently. This allows the consensus process to continue without waiting for all data to be written to disk, thus reducing accounting delay while maintaining data persistence through the message queue mechanism.
Solution Approach 2:
The patent implements preliminary action by writing block information to the message queue before completing the serial write process to disk. The message queue acts as a buffer that accepts data in advance, allowing the consensus round to proceed while background processes complete the disk writing operation. This decouples the consensus timing from the I/O completion timing.
2Reliability
If serial writing of block information is used, then data integrity is maintained, but I/O resource dependency increases causing delays
Solution Approach 1:
The message queue serves as an intermediary between the consensus process and the disk I/O operation. It receives block information from the consensus mechanism and buffers it, allowing the consensus to proceed without direct dependency on I/O completion speed. The disk writing process can then execute in parallel without blocking the consensus round, reducing accounting delay while maintaining data integrity through the queue's buffering mechanism.
Solution Approach 2:
The patent introduces dynamic data handling where block information is written to the message queue asynchronously rather than synchronously. The writing process can dynamically adjust its pace independent of the consensus timing, using background threads or processes to complete I/O operations without affecting the main consensus flow. This dynamic approach decouples data integrity assurance from processing speed.
Data Source
Figure 1~2
Figure 3~4
Figure 5~6
AI summary
Provided in the embodiments of the present disclosure are a data synchronization method and system based on a blockchain, an electronic device and a computer-readable medium. The blockchain comprises a hierarchical structure formed by a consensus node, a first service node and a second service node, the consensus node being a root node in the hierarchical structure, and the first service node and the second service node being descendant nodes of the consensus node. Said method comprises: a first service node receiving block header data issued by a consensus node according to a hierarchical structure; the first service node downloading transaction hash data according to the block header data; the first service node receiving a buffer mapping table of a second service node; and the first service node receiving, according to the buffer mapping table of the second service node, transaction content data corresponding to a storage index and sent by the second service node. The technical solution provided in the embodiments of the present disclosure can implement a blockchain system with an isolation requirement and a data synchronization scheme with high efficiency and security in the system.