Consistent Hashing for Multi-Site Data Replication
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional data storage networks face challenges in efficiently storing and maintaining data availability across multiple sites, often sacrificing storage space or security due to inefficient data replication and access control.
Innovation Solution
Implementing a computer-implemented method that uses a modified consistency hashing algorithm and a namespace with a common cell for management data and separate cells for object data, allowing for efficient storage and access while maintaining data integrity and security across multiple sites.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If traditional data replication methods are used across multiple sites, then data availability is improved, but storage space efficiency deteriorates due to redundant copies
Solution Approach 1:
The namespace is divided into multiple cells, with management data segregated into a common cell and object data distributed across separate cells. This segmentation allows efficient routing of replication traffic and reduces redundant data transmission across the network, improving storage space efficiency while maintaining data availability.
Solution Approach 2:
A modified consistency hashing algorithm acts as an intermediary mechanism that intelligently routes management data to the common cell and object data to respective cells. This intermediary routing system optimizes data placement and replication paths, reducing unnecessary storage redundancy while ensuring data can be retrieved from any site.
2Reliability
If data is replicated across multiple geographic locations, then access control and security are improved, but data consistency deteriorates due to synchronization delays
Solution Approach 1:
The modified consistency hashing algorithm provides feedback mechanisms that track data placement and replication status across cells. This feedback enables the system to detect and resolve consistency issues, ensuring that data remains synchronized across multiple geographic locations while maintaining secure access control.
Solution Approach 2:
The system performs preliminary routing decisions using the consistency hashing algorithm before data replication occurs. By pre-determining the correct cell destinations for management and object data, the system prevents consistency errors from occurring in the first place, rather than attempting to correct them after synchronization delays occur.
3Device complexity
If management data and object data are stored together, then system complexity is reduced, but access efficiency deteriorates due to mixed data routing
Solution Approach 1:
The namespace is segmented into a common cell for management data and separate cells for object data. This segmentation enables specialized handling and optimized access paths for each data type, improving access efficiency despite the increased structural organization required.
Solution Approach 2:
Different cells are assigned different qualities and purposes: the common cell handles management data with specific access patterns, while object cells handle data objects with different access requirements. This local quality differentiation optimizes access efficiency for each data type while maintaining overall system manageability.
Data Source
AI summary
A computer-implemented method, according to one embodiment, includes: sending management data to a designated common cell in a namespace of a central storage location from one or more remote storage locations. The management data corresponds to object data stored at the one or more remote storage locations. the object data stored at each of the one or more remote storage locations is further transferred to a respective cell in the namespace of the central storage location. Moreover, a modified consistency hashing algorithm configuration is implemented. The modified consistency hashing algorithm configuration routes updates of existing object data in the one or more remote storage locations to the respective cells in the central storage location. Other systems, methods, and computer program products are described in additional embodiments.