Blockchain Storage Hot-Cold Data Segmentation for Overhead Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current blockchain storage systems are inefficient in managing large-size unstructured data, leading to excessive storage overhead due to a lack of consideration for storage requirements and incompatibility with distributed storage environments, as seen in Bitcoin and Ethereum nodes where data size continuously increases.
Innovation Solution
The method involves dividing blockchain data into hot and cold data, where hot data is stored in each node and cold data is distributed across multiple nodes, with multiple copies for disaster recovery, reducing storage capacity and enhancing data integrity and reliability.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If all blockchain data is stored in each node locally, then data accessibility and reliability are improved, but storage overhead increases significantly
Solution Approach 1:
The patent segments blockchain data into hot data and cold data based on access frequency. Hot data (frequently accessed) is stored in each node's local storage, while cold data (infrequently accessed) is stored in distributed storage. This segmentation resolves the contradiction by ensuring frequently needed data remains accessible while reducing redundant storage of less frequently accessed data across all nodes.
Solution Approach 2:
The patent applies local quality by storing different types of data in different locations with different storage characteristics. Hot data is kept in local node storage for fast access, while cold data is moved to distributed storage systems. This allows each storage location to have optimized properties for its specific data type, resolving the contradiction between accessibility and storage overhead.
2Ease of manufacture
If traditional blockchain storage design is used, then implementation simplicity is improved, but compatibility with distributed storage and data discrimination capability deteriorate
Solution Approach 1:
The patent introduces dynamic data classification and migration mechanisms that automatically move data between hot and cold storage based on access patterns. This dynamic approach maintains simplicity of implementation while achieving adaptability to distributed storage environments, as the system automatically adjusts without requiring complex manual configuration or redesign of the entire storage architecture.
Solution Approach 2:
The patent creates a universal storage architecture that can work with both traditional local storage and modern distributed storage systems. The hot-cold data separation framework provides a layer of abstraction that enables compatibility with various underlying storage implementations, making the system versatile across different distributed storage platforms while maintaining implementation simplicity through standardized interfaces.
Data Source
AI summary
The method includes: performing blockchain storage area allocation for transaction broadcast data; establishing a peer-to-peer transmission mechanism and a trust mechanism between nodes by the blockchain; acquiring network transaction broadcast data that needs to be subjected to blockchain storage; and recording, storing and managing the network transaction broadcast data; where the network transaction broadcast data is managed by dividing blockchain data into hot data and cold data; the hot data is stored in each of the blockchain nodes; and the cold data is divided into N parts to be correspondingly stored in N nodes of the blockchain nodes; and the hot data is data that needs to be frequently accessed by computing nodes, and the cold data is data that is infrequently accessed.