Content Addressable Storage Tiering via Primary Secondary Replication
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Content addressable storage systems face high costs for storing large amounts of data, and existing solutions do not efficiently manage storage between expensive and less expensive storage devices, leading to inefficient use of resources.
Innovation Solution
Implementing a system with a primary storage system using more expensive devices and a secondary storage system using less expensive devices, where content is replicated from the primary to the secondary system based on user-defined policies, allowing for deletion from the primary system to free up space and maintain access through the secondary system.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If data is stored on expensive high-performance storage devices, then access speed and reliability are improved, but storage cost increases
Solution Approach 1:
The storage system is segmented into two distinct storage systems: a first storage system using expensive high-performance devices for frequently accessed data, and a second storage system using less expensive devices for archived data. This segmentation allows the system to optimize for both speed and cost by placing different types of data on appropriate storage media.
Solution Approach 2:
Different storage locations are assigned different qualities based on data access patterns. The first storage system provides high-speed access for active data, while the second storage system provides cost-effective storage for archived data. This local quality differentiation ensures that expensive storage resources are only used where high performance is actually needed.
2Quantity of substance
If data is moved to less expensive storage, then storage cost is reduced, but access time increases
Solution Approach 1:
The system performs preliminary actions by archiving data to the second storage system in advance, with the understanding that this data will be accessed later. The archiving process is triggered by data age and access patterns, preparing the storage infrastructure before actual access occurs, thus balancing cost savings with acceptable access times.
Solution Approach 2:
The content addressable storage system acts as an intermediary layer between the two storage systems. It manages data placement, tracks data locations, and handles retrieval operations, abstracting the complexity of dual-storage management from users while optimizing the balance between cost and access time.
3Quantity of substance
If data is archived to secondary storage, then primary storage space is freed, but system complexity increases
Solution Approach 1:
The system implements self-service archiving where data is automatically moved to the second storage system based on predefined criteria such as data age and access frequency. This automated self-service mechanism reduces the need for manual intervention and simplifies operations despite the underlying system complexity.
Solution Approach 2:
The system uses parameter changes in data characteristics (such as age, access frequency, and size) to trigger archiving decisions. When data parameters meet certain thresholds, it is automatically archived to the second storage system, providing a simple rule-based approach to managing complex multi-storage environments.
4Speed
If frequent data access is enabled on primary storage, then access speed is maintained, but storage capacity is consumed
Solution Approach 1:
The system dynamically manages data placement between the two storage systems based on changing access patterns and data characteristics. Data that was previously frequently accessed may be archived when it becomes less active, while recently created or frequently accessed data remains on the first storage system. This dynamic adjustment optimizes both storage capacity utilization and access performance.
Data Source
AI summary
One embodiment is directed to a computer system that includes primary and secondary storage systems. When a request to store a content unit is received, it may be determined whether to store the content unit on the primary storage system or the secondary storage system. In another embodiment, a computer may store information relating to an action to be performed in one of the directories of a file system that corresponds to a period of time. When the period of time to which the directory corresponds arrives, the action may be performed. In another embodiment, a content unit stored on a primary storage system may be copied to a secondary storage system in a computer system. After the content unit has been copied, the secondary storage system may send a delete request to the primary storage system to delete the content unit from the primary storage system.