Storage Data Access Characterization for Failover Alignment
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In data replication systems, discrepancies in data storage management between primary and secondary storage devices can lead to inefficiencies, as data managed on the secondary device may not match the performance requirements of the primary device, especially during failover scenarios, due to differences in access patterns and storage configurations.
Innovation Solution
A method is implemented to collect and characterize raw data access information from the primary storage device, generating summarized data access information that is transmitted to the secondary device, allowing independent management to match performance requirements, including access rates, frequency, and last use statistics, enabling efficient data tiering and workload handling.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If data is replicated from primary to secondary storage device, then data redundancy and disaster recovery capability are improved, but data storage management efficiency deteriorates due to configuration discrepancies and performance requirement mismatches
Solution Approach 1:
The system implements feedback by having the secondary storage device send performance information to the primary storage device, which then sends data access information back to the secondary device. This closed-loop feedback mechanism enables the secondary device to adjust its data storage management based on actual performance requirements, resolving the contradiction between maintaining reliability through replication and improving productivity through efficient management.
Solution Approach 2:
The secondary storage device autonomously manages its own data storage by receiving data access information and independently determining data placement strategies. This self-service approach eliminates the need for manual configuration synchronization while ensuring performance requirements are met, thereby improving management efficiency without compromising the reliability provided by data replication.
2Adaptability or versatility
If data access information is synchronized from primary to secondary storage device, then performance requirement matching is improved, but system complexity and data transfer overhead increase
Solution Approach 1:
The system changes parameters by transforming detailed data access information into summarized performance requirements that the secondary storage device can process. Instead of synchronizing complete raw data access logs, the system extracts and transmits only the essential performance parameters (such as data access frequency, read/write ratios, and response time requirements), thereby achieving performance requirement matching while minimizing system complexity and data transfer overhead.
3Ease of operation
If secondary storage device manages data independently, then management flexibility and autonomy are improved, but data consistency with primary device performance requirements may deteriorate
Solution Approach 1:
The system applies preliminary action by having the primary storage device prepare and send data access information to the secondary device before the secondary device needs to make management decisions. This advance provision of performance requirement information enables the secondary device to independently manage data while pre-configured knowledge ensures consistency with primary device performance requirements, resolving the contradiction between management autonomy and data consistency.
Data Source
AI summary
Synchronization of data layouts and resource utilizations at one or more remote replica sites with the workload and data tiering decisions being made at the primary site allows for an efficient and effective workload support transfer in the event of site failover from a primary site to a remote site. Relevant data access information about workload being supported at the primary site is collected and from that raw information, characterized data access information is generated that condenses the raw data access information or otherwise provides relevant encapsulated information about the raw data access information. The characterized data access information is transmitted to the one or more remote sites allowing each remote site to make its own independent decisions on how best to utilize its available resources to match the performance requirements currently being supported by the primary site.