Distributed Storage Quota Management via Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional disk file systems and network file systems face challenges in efficiently managing storage quotas across multiple storage servers in a distributed file system, leading to administrative overhead and spurious error messages due to uneven usage patterns.
Innovation Solution
A multi-tenant distributed file system that dynamically manages local storage quotas by dividing global storage quotas among multiple storage servers, allowing for real-time adjustments based on usage patterns, and reallocating storage resources to prevent quota exceedance without altering the global quota assigned to tenants.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If traditional disk file systems are used in a distributed environment, then storage management is simple on a single server, but administrative overhead increases and quota management becomes complex across multiple servers
Solution Approach 1:
The patent divides the global storage quota into multiple local storage quotas, one for each storage server. This segmentation allows the centralized quota management system to distribute quota enforcement across multiple servers, reducing the administrative overhead on any single server while maintaining centralized control. Each storage server manages its own local quota independently, eliminating the need for complex inter-server coordination.
2Adaptability or versatility
If static storage quotas are assigned to storage servers, then quota allocation is simple, but the system cannot adapt to changing usage patterns and generates spurious error messages
Solution Approach 1:
The patent implements dynamic storage quotas that can be automatically adjusted based on actual usage patterns. The system continuously monitors storage consumption by tenants across multiple servers and dynamically reallocates local quotas to match actual demand. This dynamic adjustment eliminates spurious error messages by preventing quota exceedance before it occurs, while the system remains relatively simple as it operates autonomously without manual intervention.
3Reliability
If global storage quotas are strictly enforced across all storage servers, then tenant storage limits are maintained, but local storage servers cannot optimize their individual resource allocation
Solution Approach 1:
The patent segments the global quota into independent local quotas for each storage server. This segmentation allows each storage server to optimize its local resource allocation based on actual tenant usage patterns while collectively adhering to the global quota through the sum of local quotas. The independence of local quotas enables flexible local optimization without compromising global enforcement.
Solution Approach 2:
The system implements feedback mechanisms where storage servers report their actual usage to the centralized quota management system. Based on this feedback, the system dynamically adjusts local quotas to better match actual consumption patterns. This feedback loop ensures that local optimization does not violate global quotas, as the system continuously monitors and adjusts allocations in real-time.
Data Source
AI summary
A processing device causes a plurality of storage servers to create tenant identifiers for a tenant of a multi-tenant distributed file system that is distributed over the plurality of storage servers, the plurality of storage servers having underlying local file systems that interface with the multi-tenant distributed file system. The processing device maps the tenant to the tenant identifiers. The processing device assigns a global storage quota to the tenant. The processing device divides the global storage quota into a plurality of local storage quotas and assigns a local storage quota of the plurality of local storage quotas to each storage server of the plurality of storage servers.