Data Storage Tiering Controller for Flash Write Life
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current data storage tiering systems move frequently accessed data to higher, more expensive tiers, whereas valuable data intended to remain longer should be stored on cheaper, less durable Flash storage devices to minimize costs and maximize capacity, while existing systems do not efficiently utilize less expensive Flash storage due to its lower write durability.
Innovation Solution
Implement a data storage system with a tiering controller that determines subsets of data in a more durable tier for migration to a less durable tier, leveraging deduplicated and compressed data storage arrays like EMC XtremIO, using hash mappings to manage data distribution across storage devices, prioritizing reads over writes, and retiering data based on deduplication ratios and fragmentation to minimize write operations on less durable Flash storage.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If data is stored on cheaper, less durable Flash storage devices to reduce costs and maximize capacity, then storage cost and capacity are improved, but write durability and reliability deteriorate
Solution Approach 1:
The storage system is segmented into multiple tiers with different durability characteristics. The method divides data into different categories based on durability requirements and places them in appropriate tiers - highly durable storage for critical data and less durable cheaper storage for non-critical data, thereby resolving the contradiction between capacity and reliability
Solution Approach 2:
Different portions of the storage system are assigned different quality characteristics. The invention applies local quality by making certain storage tiers more durable than others based on the specific needs of the data being stored, rather than uniform durability across all storage
2Speed
If frequently accessed data is moved to higher, more expensive tiers to improve performance, then access speed is improved, but storage cost increases
Solution Approach 1:
The storage tiering system is dynamic rather than static. The method continuously monitors data access patterns and automatically moves data between tiers based on current performance requirements, allowing the system to adapt to changing access patterns and optimize the balance between speed and cost
Solution Approach 2:
The invention changes the parameter of storage location based on data access characteristics. By dynamically adjusting which tier data resides in based on access frequency and performance requirements, the system optimizes the trade-off between access speed and storage cost
3Quantity of substance
If data is tiered from more durable tier to less durable tier to reduce costs, then storage cost is reduced, but data loss risk increases
Solution Approach 1:
The system performs preliminary assessment of data characteristics and durability requirements before tiering decisions are made. By evaluating data importance, access patterns, and durability needs in advance, the invention prevents inappropriate placement of critical data in less durable tiers, thereby reducing data loss risk while still achieving cost savings
Solution Approach 2:
The tiering system incorporates feedback mechanisms that monitor data performance, access patterns, and storage conditions. This feedback allows the system to detect potential issues and adjust tiering decisions to prevent data loss, maintaining an appropriate balance between cost reduction and risk mitigation
Data Source
AI summary
Example embodiments of the present invention relate to a method, a system, and a computer program product for data storage tiering. The method includes maintaining data in a data storage system having a plurality of tiers, determining a subset of the data stored in a first, more-durable tier should be stored in a second, less-durable tier, and tiering the subset of the data from the first, more-durable tier to the second, less-durable tier.