Distributed Storage Quota Enforcement via Local Caching
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Enforcing storage quotas in distributed data storage networks is challenging due to distributed, parallel consumption of data across multiple volume members, leading to negative performance impacts on file operations and increased communication overhead.
Innovation Solution
Implementing a method that uses node computing devices with quota management and tally management modules to efficiently manage storage quotas through ticket generation numbers, reducing resource utilization and communication overhead by coordinating quota enforcement across the network.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Volume of stationary object
If distributed, parallel consumption of data across multiple volume members is implemented to handle enterprise data storage requirements, then storage capacity and scalability are improved, but performance impact on file operations increases and communication overhead increases
Solution Approach 1:
The patent segments the distributed storage system into multiple volume members, each with its own local quota cache, allowing independent local quota checks without requiring coordination across all nodes for every file operation. This segmentation enables parallel data consumption across volumes while maintaining quota enforcement locally, thus preserving file operation performance while achieving distributed storage capacity.
Solution Approach 2:
The patent implements preliminary action by pre-caching quota information locally at each storage node before it is needed for quota enforcement. By maintaining local copies of quota data and validation results, the system avoids real-time communication overhead during file operations, thus improving performance while supporting distributed storage across multiple nodes.
2Measurement precision
If precise quota enforcement with communication overhead between storage nodes is implemented when quota usage is approaching a limit, then quota enforcement accuracy is improved, but file operation performance decreases
Solution Approach 1:
The patent applies partial action by implementing selective communication between storage nodes only when necessary - specifically when quota usage approaches predefined thresholds. Normal file operations proceed with local quota cache validation without inter-node communication, while precise enforcement with communication is triggered only when needed, thus maintaining both accuracy and performance.
Solution Approach 2:
The patent implements feedback mechanisms where storage nodes monitor quota usage and trigger communication with other nodes only when usage approaches predetermined thresholds. This feedback-driven approach ensures precise quota enforcement when necessary while avoiding unnecessary communication overhead during normal operations, thus maintaining file operation performance.
Data Source
AI summary
Methods, non-transitory machine readable media, and computing devices that more efficiently and effectively manage storage quota enforcement are disclosed. With this technology, a quota ticket comprising a tally generation number (TGN) and a local allowed usage amount (AUA) are obtained. The local AUA comprises a portion of a global AUA associated with a quota rule. The local AUA is increased following receipt of another portion of the global AUA in a response from a cluster peer, when another TGN in the response matches the TGN and the local AUA is insufficient to execute a received storage operation associated with the quota rule. The local AUA is decreased by an amount corresponding to, and following execution of, the storage operation, when the increased local AUA is sufficient to execute the storage operation.