Transaction Deduplication Filter Expansion Across Blockchain Nodes
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The accuracy of deduplication filtering in blockchain systems deteriorates as the number of transactions increases, leading to high misjudgment rates in filters like Bloom filters, rendering them ineffective.
Innovation Solution
A method to obtain a capacity-expanded filter from other nodes in the blockchain network when a capacity expansion condition is met, using nodes with better performance to generate a larger filter without occupying resources of the execution node, thereby improving deduplication accuracy.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If a Bloom filter is used for transaction deduplication, then the filtering operation can be performed, but the misjudgment rate becomes very high when the quantity of transactions reaches a scale
Solution Approach 1:
The filter capacity expansion is segmented into different levels: first in-process filter for normal operation, and first capacity-expanded filter for high-volume scenarios. The system segments the filtering responsibility between execution nodes (which use the first in-process filter) and selected first nodes (which generate the capacity-expanded filter), allowing the system to maintain accuracy even when transaction quantity increases significantly.
Solution Approach 2:
The patent introduces a new dimension of filter capacity by creating a capacity-expanded filter with greater filtering capability than the standard in-process filter. This dimensional expansion allows the system to handle large-scale transaction quantities without sacrificing deduplication accuracy, effectively solving the contradiction between transaction volume and filter reliability.
2Reliability
If filter capacity is expanded to maintain accuracy with large transaction volumes, then deduplication accuracy improves, but resource consumption increases
Solution Approach 1:
The patent merges the filter generation function with the filtering function by having first nodes (which may be execution nodes) generate capacity-expanded filters and then distribute them to execution nodes. This combination allows resource-intensive filter generation to be performed once, while multiple execution nodes benefit from the expanded filter capacity, reducing overall resource consumption across the network while maintaining high deduplication accuracy.
Solution Approach 2:
Execution nodes can obtain the first capacity-expanded filter from first nodes within the same blockchain network, eliminating the need for external filter generation services. The network serves itself by having participating nodes generate and share expanded filters, reducing the resource burden on any single node while maintaining system-wide accuracy.
Data Source
AI summary
The present disclosure relates to a transaction processing method and apparatus. The transaction processing method includes: obtaining a first block to be uploaded; when it is determined that the first block meets a first capacity expansion condition, determining, from nodes of the blockchain and based on the first capacity expansion condition, a first node for performing filter expansion; obtaining a first capacity-expanded filter from the first node, a capacity of the first capacity-expanded filter being greater than a capacity of a first in-process filter in the execution node, and the first capacity-expanded filter being generated by the first node based on transactions having been uploaded to the blockchain; and loading a transaction in the first block to the first capacity-expanded filter, and using the first capacity-expanded filter as a second in-process filter, to perform, through the capacity-expanded second in-process filter, deduplication filtering on transactions to be uploaded to the blockchain.