Distributed Storage Transactions Using Lock Tokens Instead of Global Locks
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing solid-state drives are designed to conform to hard disk drive standards, making it difficult to leverage the unique characteristics of flash memory and other solid-state storage for enhanced features, and global locks limit system bandwidth and throughput during transactions.
Innovation Solution
A storage cluster architecture that distributes user data across storage nodes using erasure coding and redundant metadata, employing authorities with tokens to manage transactions without a global lock, enabling distributed transaction processing and proactive data rebuilds.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If a global lock mechanism is applied during transactions to maintain system consistency, then system state consistency is improved, but system bandwidth and throughput deteriorate
Solution Approach 1:
The patent segments the centralized lock mechanism into distributed lock tokens that are allocated to individual authorities. Each authority receives a token that enables it to perform transactions without acquiring a global lock. This segmentation allows parallel transaction processing across multiple authorities while maintaining consistency through token validation, thereby resolving the contradiction between system consistency and throughput.
Solution Approach 2:
The patent introduces lock tokens as intermediary objects that mediate between the need for consistent state management and the requirement for high throughput. Instead of directly implementing a global lock that blocks all transactions, the system uses tokens as intermediaries that carry authorization information, allowing transactions to proceed in parallel while still enforcing consistency constraints through token-based validation.
2Ease of operation
If solid-state drives conform to hard disk drive standards for compatibility, then ease of operation is improved, but adaptability to leverage unique flash memory characteristics deteriorates
Solution Approach 1:
The patent implements a universal authority model where authorities can handle multiple types of storage devices (HDD, SSD, flash memory) through a common interface. The distributed authority architecture provides a universal framework that maintains compatibility with traditional storage operations while simultaneously enabling specialized optimizations for different storage media types, allowing the system to serve multiple functions without sacrificing adaptability.
Solution Approach 2:
The patent applies local quality by allowing different storage nodes and authorities to have specialized configurations optimized for their specific storage media while maintaining a uniform global interface. Each authority can be tuned to leverage the unique characteristics of its local storage (e.g., flash memory endurance, SSD caching patterns) while the overall system presents a consistent compatibility layer to clients.
Data Source
AI summary
A method of processing transactions associated with a command in a storage system is provided. The method includes receiving, at a first authority of the storage system, a command relating to user data. The method includes sending a transaction of the command, from the first authority to a second authority of the storage system, wherein a token accompanies the transaction and writing data in accordance with the transaction as permitted by the token into a partition that is allocated to the second authority in a storage device of the storage system.


