Metadata-Driven Data Replication for Storage Systems
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current data replication solutions require manual creation of copies, which is impractical for large environments involving Exabytes of storage space, especially in managing access and replication across different locations.
Innovation Solution
A method that examines metadata to determine whether to replicate data to another storage system, automatically replicating data based on permissions and access controls, allowing for granular control over which data is replicated to specific sites, including clouds or internal storage.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If manual creation of data copies is used, then data replication can be controlled, but it becomes impractical for large environments involving Exabytes of storage space
Solution Approach 1:
The system automatically examines metadata and performs replication decisions without human intervention. The storage system itself evaluates data characteristics and autonomously determines replication actions, eliminating the need for manual copy creation while maintaining controlled replication based on data attributes.
Solution Approach 2:
The system changes the approach from manual to automated operation by introducing metadata examination as a new parameter. Replication decisions are based on data characteristics stored in metadata, transforming the replication process from labor-intensive to automated and scalable.
2Productivity
If automated replication is implemented, then replication efficiency improves, but control over which data is replicated becomes more complex
Solution Approach 1:
Metadata serves as an intermediary that simplifies the replication control mechanism. Instead of complex automated decision-making, the system uses metadata attributes as a straightforward criterion for replication, making the control mechanism both automated and manageable.
3Reliability
If all data is replicated to ensure protection, then data protection is improved, but storage costs and management overhead increase
Solution Approach 1:
Different data receives different replication treatment based on its metadata characteristics. Instead of uniform replication of all data, the system applies replication selectively to specific data subsets that meet certain criteria, optimizing both protection and resource utilization.
Solution Approach 2:
The system performs partial replication rather than complete replication of all data. By examining metadata and selecting only certain data for replication, the system achieves adequate protection without the excessive storage overhead of replicating everything.
Data Source
AI summary
A method, a computer program product, and a system for replicating different projections of data, comprising: examining metadata associated with data on a storage system to determine whether to replicate the data to at least one other storage system; and based on a positive determination, replicating the data to the at least one other storage system.