Rowblock Versioning for Conflict-Aware Distributed Storage
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Distributed database systems face challenges in managing uneven workloads and transaction conflicts due to the lack of record-level processing and efficient data management, leading to increased computational burden and reduced performance.
Innovation Solution
Implementing a record-aware distributed storage system that uses rowblocks for data storage, enabling version management, transaction conflict detection, and multiversion concurrency control, thereby offloading data management responsibilities from database access applications.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If distributed database systems use traditional storage methods without record-level processing, then device complexity is reduced, but productivity decreases due to increased computational burden and uneven workloads
Solution Approach 1:
The patent segments data storage into rowblocks (groups of records) that can be independently managed, versioned, and distributed. This segmentation enables record-level processing while maintaining manageable complexity through standardized rowblock units that can be handled uniformly by the storage system.
Solution Approach 2:
The patent introduces rowblocks as an intermediary layer between the database application and the underlying storage system. This intermediary enables record-level operations without requiring the storage system to understand individual record structures, thus improving productivity while controlling complexity through abstraction.
2Productivity
If distributed database systems implement comprehensive data management features, then productivity improves through better data control, but device complexity increases due to additional management responsibilities
Solution Approach 1:
The patent extracts data management responsibilities (versioning, conflict detection, concurrency control) from the database application and implements them natively in the distributed storage system. This extraction improves query processing efficiency by enabling storage-system-optimized operations while reducing the complexity burden on application-layer systems.
Solution Approach 2:
The patent enables the distributed storage system to self-manage data through automated version control, conflict detection, and concurrency control mechanisms. This self-service capability improves productivity by eliminating the need for external application-layer management while containing complexity within the storage system's standardized rowblock operations.
3Reliability
If distributed database systems lack version management and conflict detection, then device complexity is lower, but reliability decreases due to transaction conflicts and inconsistent data access
Solution Approach 1:
The patent implements version management and conflict detection mechanisms that operate in advance of data access operations. By pre-establishing version control at the rowblock level and detecting potential conflicts before they affect data consistency, the system achieves high reliability while containing complexity through proactive rather than reactive management.
Data Source
AI summary
Rowblock modifications may be performed at record-aware distributed storage systems. Record-aware distributed storage systems may implement a storage service engine that can evaluate access requests to a table and make rowblock modification determinations based on the evaluation. The storage service engine can instruct storage nodes of the record-aware distributed storage system to perform the rowblock modifications.