Blockchain Metadata Compression Using On-Chain Dictionary Blocks
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current blockchain systems face high storage and computational costs due to the need to store extensive metadata, which increases CPU cycles, storage, and network bandwidth, limiting the amount of information that can be stored beyond basic transaction details like buyer and seller aliases.
Innovation Solution
Implementing a dictionary-style compression method that stores metadata in a compressed format directly on the blockchain, using substitution coders and dictionary blocks, allowing for efficient storage and decompression of arbitrary tuples, while maintaining persistence and immutability, without requiring a separate online data store.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If metadata is stored in uncompressed format on the blockchain, then data retrieval is straightforward, but storage requirements and computational costs increase significantly
Solution Approach 1:
The patent applies preliminary action by pre-computing compression dictionaries and storing them on the blockchain before actual metadata compression. The system performs compression analysis and dictionary generation in advance, allowing subsequent metadata to be compressed using these pre-established dictionaries, thereby reducing storage requirements without adding complex real-time compression logic to each transaction.
Solution Approach 2:
The patent introduces compression dictionaries as an intermediary layer between the raw metadata and the blockchain storage. These dictionaries act as mediators that map frequent metadata patterns to compact representations, enabling efficient compression while maintaining the ability to retrieve original data through the intermediary dictionary layer.
2Loss of information
If more metadata is stored on the blockchain, then data availability improves, but CPU cycles and network bandwidth consumption increase
Solution Approach 1:
The patent applies parameter changes by transforming metadata from its original format into a compressed representation using substitution codes from dictionaries. This parameter transformation changes the size and structure of stored data, allowing more information to be stored with reduced CPU cycles and network bandwidth requirements for processing and transmission.
Solution Approach 2:
The patent uses copying by creating compressed copies of metadata that reference original data patterns through dictionary codes. Instead of storing redundant full metadata, the system stores compact copies that can be efficiently decompressed using the dictionary, reducing storage and transmission overhead while maintaining data availability.
3Productivity
If dictionary blocks are added to the blockchain, then compression efficiency improves, but the initial storage overhead increases
Solution Approach 1:
The patent applies preliminary action by pre-computing and storing compression dictionaries on the blockchain before actual metadata compression. The system performs compression analysis and dictionary generation in advance, allowing subsequent metadata to be compressed using these pre-established dictionaries, thereby reducing storage requirements without adding complex real-time compression logic to each transaction.
Data Source
AI summary
A method of reducing the storage requirements of blockchain metadata via dictionary-style compression includes receiving a request to add a transaction block to a blockchain. The method further includes determining an identifier (ID) of a dictionary block most recently stored on the blockchain. The method further includes compressing, by a processing device, one or more transactions of the transaction block based on the dictionary block to generate a compressed transaction block. The method further includes adding the ID of the dictionary block to the compressed transaction block. The method further includes providing the compressed transaction block, including the ID of the dictionary block, for storage on the blockchain.