Database Shadow Table for Blockchain Consensus Integration
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current systems that integrate data processing, storage, and querying into blockchain consensus systems face limitations such as low throughput for public blockchains, which can compromise trust and efficiency when applied to traditional database systems.
Innovation Solution
A method is proposed to enhance traditional database systems by creating a shadow table, serializing data, generating verification fingerprints, and providing them to a consensus system, allowing for improved trustworthiness and data integrity through blockchain-based consensus without inheriting the throughput limitations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If data processing and storage are integrated into blockchain consensus system, then data trustworthiness and integrity are improved, but system throughput decreases to about 10 transactions per second
Solution Approach 1:
The system separates data storage functions from consensus verification functions. Traditional database systems handle high-volume data storage and processing, while blockchain consensus systems only verify cryptographic fingerprints of data batches. This segmentation allows each system to operate at its optimal throughput while maintaining data integrity through periodic consensus verification.
Solution Approach 2:
Cryptographic fingerprints (hashes) serve as intermediaries between the database system and consensus system. Instead of submitting actual data to the blockchain, the system generates compact cryptographic representations that verify data integrity without requiring the blockchain to store or process the full data sets, thus maintaining high throughput while ensuring trustworthiness.
2Reliability
If more nodes participate in consensus, then data trustworthiness is improved, but system throughput decreases due to increased consensus overhead
Solution Approach 1:
The system applies partial verification by checking cryptographic fingerprints of data batches rather than verifying every individual transaction. This allows the consensus system to validate data integrity with reduced overhead, enabling more nodes to participate in consensus without proportionally reducing system throughput.
3Reliability
If blockchain stores all transaction data, then data integrity is improved, but storage costs and system complexity increase
Solution Approach 1:
The invention extracts only the essential verification element (cryptographic fingerprint) from the complete transaction data and submits it to the blockchain. The full data remains stored in the traditional database system, reducing blockchain storage requirements and system complexity while maintaining data integrity through fingerprint verification.
Data Source
AI summary
A method and a system for interfacing a database system with a consensus system are provided. The method comprises at least the steps of creating a shadow table of a table of the database system; and for each row of the shadow table: serialization of data, stored in a current row of the shadow table; generating a data item verification fingerprint of the data; and providing the data item verification fingerprint to the consensus system.