Storage Allocation Policy Enforcement via Tiered Counters
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current data storage systems face challenges in enforcing capacity restrictions across multiple storage tiers, leading to potential violations and inefficient resource allocation, as they lack effective mechanisms to monitor and manage storage allocations dynamically.
Innovation Solution
A method is introduced that involves receiving information on storage groups with thin devices, maintaining counters for storage allocation across tiers, identifying threshold violations, and processing capacity violation queues to determine data movement candidates, thereby ensuring compliance with allocation policies and optimizing resource utilization.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If storage allocation is dynamically managed across multiple tiers, then resource utilization is optimized, but capacity restriction enforcement becomes complex
Solution Approach 1:
The storage system is segmented into multiple storage tiers (e.g., flash memory tier, disk tier) with distinct capacity characteristics. Each tier is independently managed with separate counters tracking allocation status, enabling granular control while simplifying overall enforcement complexity through hierarchical organization.
Solution Approach 2:
The system implements continuous feedback mechanisms by monitoring counter values that track storage allocation across tiers. When allocation thresholds are approached or violated, the system generates feedback signals that trigger automated data movement operations, dynamically adjusting allocations to maintain policy compliance without manual intervention.
2Measurement precision
If counters are maintained for each storage group and thin device, then allocation monitoring precision is improved, but system complexity increases
Solution Approach 1:
The monitoring system is segmented into hierarchical levels: storage group-level counters providing aggregate allocation views, and thin device-level counters providing granular allocation details. This segmentation enables precise monitoring at appropriate levels without requiring all counters to operate simultaneously at maximum granularity, reducing overall system complexity.
Solution Approach 2:
The counter mechanism is designed as a universal multi-functional component that serves multiple purposes: tracking current allocation status, detecting threshold violations, and providing input for data movement decisions. This multi-functionality reduces the need for separate specialized components, simplifying the system despite the precision requirements.
3Reliability
If data movement is performed to alleviate threshold violations, then allocation policy compliance is improved, but processing time increases
Solution Approach 1:
The system performs preliminary actions by proactively moving data before threshold violations occur, based on predictive analysis of allocation trends. By anticipating future violation scenarios and pre-positioning data in optimal tiers, the system maintains policy compliance without requiring reactive emergency data movements that would consume excessive processing time.
Solution Approach 2:
When threshold violations are detected, the system prioritizes and rushes through the essential data movement operations needed to restore compliance, skipping non-critical processing steps. This selective acceleration ensures policy compliance is restored quickly while minimizing overall processing time impact on other system functions.
Data Source
AI summary
Described are techniques for enforcing an allocation policy. Information is received that describes one or more storage groups. Each of the storage groups includes one or more thin devices. Each of the thin devices includes a plurality of chunks of storage allocated on one or more of a plurality of storage tiers. For each of the one or more storage groups, a plurality of counters is determined indicating amounts of storage currently allocated from the plurality of storage tiers for use by the storage group. Using the plurality of counters, it is determined whether each of the one or more storage groups violates thresholds included in an allocation policy associated with each storage group. Each of the thresholds specifies a maximum amount of storage of one of the plurality of storage tiers that can be used by each storage group.