Blockchain Index Database for Efficient Transaction Retrieval
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing blockchain systems face inefficiencies in data retrieval, particularly in supporting Value-based queries and fast retrieval of transactions related to specific business applications, due to limitations in storage architecture and query methods, leading to high redundant storage overhead and impact on system throughput.
Innovation Solution
A blockchain data index method that generates a blockchain transaction with additional note and index fields, constructs a key transaction information list, and stores it in an index database, allowing for efficient querying based on various conditions, including multi-condition AND/OR queries and precise/index matching queries, without re-traversing blockchain blocks.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If a relational database is deployed outside the chain to synchronize blockchain data in real time, then data retrieval efficiency is improved, but data reliability deteriorates and additional redundant storage overhead increases
Solution Approach 1:
The patent introduces an index database as an intermediary layer between the blockchain and query interfaces. This index database stores structured indexes of blockchain data (transactions, blocks, accounts) enabling efficient queries without requiring real-time synchronization with external relational databases, thus maintaining data reliability while improving retrieval efficiency
Solution Approach 2:
The patent segments blockchain data into different storage layers: raw blockchain data (blocks and transactions) stored in the ledger, and structured index data stored in the index database. This segmentation allows the index database to provide fast query capabilities while the blockchain ledger maintains the source of truth, resolving the contradiction between retrieval efficiency and data reliability
2Productivity
If the relational database is used as the storage architecture of the underlying blockchain system, then data retrieval efficiency is improved, but transformation cost increases and performance compared to NoSQL deteriorates
Solution Approach 1:
The patent changes the data structure parameters by introducing standardized index fields (transaction fields, block fields, account fields) with specific data types and structures. This allows the index database to store blockchain data in an optimized format that enables efficient queries without requiring complex transformation logic, reducing transformation cost while maintaining retrieval efficiency
3Device complexity
If only coarse-grained query based on Key value is performed, then storage architecture simplicity is maintained, but retrieval efficiency deteriorates and system throughput is impacted
Solution Approach 1:
The patent adds another dimension to the storage architecture by introducing an index database layer that works alongside the existing Key-Value database and file storage. This index layer provides structured query capabilities (supporting queries by transaction hash, account address, block number, etc.) without replacing the existing simple storage architecture, thus maintaining simplicity while dramatically improving retrieval efficiency and system throughput
4Reliability
If the entire blockchain is traversed to query transactions under an account, then data completeness is ensured, but query time increases significantly
Solution Approach 1:
The patent applies preliminary action by pre-processing blockchain data during block synchronization and creating structured indexes in advance. The index database pre-organizes transaction data by various fields (account addresses, transaction hashes, block numbers) so that when queries are executed, the system can directly retrieve relevant data without traversing the entire blockchain, ensuring data completeness while reducing query time from O(n) to O(1) or O(log n)
Data Source
AI summary
A blockchain data index method, a blockchain data storage method and a device are provided. This method first persists a block into a block file, persists an index data layer into an index database, then obtains a matching transaction location according to a query condition, and finally obtains a complete transaction from the block file. In the present application, through expanding the process of the blockchain data storage processing, the blockchain index data is stored in an independent index database and transaction atomicity of multi-database is guaranteed, and a data index mechanism, in which business information is customized in a transaction note field, and then a transaction is associated with the business information through the customized transaction note index field and finally the complete transaction is acquired based on key transaction information, is established.