Selective Replication for Hierarchical Data Structures
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Hierarchical storage systems face increased complexity and operational costs due to the need for multiple versions or replicas to ensure data availability, leading to reduced system responsiveness as a single component becomes overburdened with synchronization protocols.
Innovation Solution
Implementing a selective replication method for hierarchical data structures across distributed data stores, allowing different replication settings and permissions for individual objects to manage visibility and data sharing across geographic regions, thereby reducing the burden on individual storage hosts and enhancing system responsiveness.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If multiple versions or replicas of data are stored on multiple storage hosts to ensure data availability, then data availability is improved, but system complexity and operational costs increase
Solution Approach 1:
The patent segments the hierarchical data structure into multiple levels (e.g., root directory, subdirectories, files) and applies selective replication at different levels. Not all data is replicated uniformly, but only specific portions that require availability across multiple storage hosts, thereby reducing overall system complexity while maintaining data availability where needed.
Solution Approach 2:
Different replication strategies are applied to different parts of the hierarchical data structure based on their specific requirements. Critical data may be replicated across multiple hosts while less critical data remains localized, allowing the system to optimize between availability and complexity on a per-data-type basis.
2Reliability
If multiple versions or replicas of data are stored on multiple storage hosts to ensure data availability, then data availability is improved, but operational costs increase
Solution Approach 1:
Instead of replicating all data uniformly across all storage hosts (excessive action), the patent implements partial replication where only necessary data is copied to specific hosts. This selective approach reduces the total number of replication operations and storage resources consumed, thereby lowering operational costs while still ensuring data availability for critical operations.
3Stability of the object's composition
If a single component handles synchronization operations to maintain data consistency, then data consistency is improved, but system responsiveness decreases as the component becomes overburdened
Solution Approach 1:
The synchronization protocol is segmented into multiple independent components or processes that can handle different aspects of consistency maintenance simultaneously. This distribution of synchronization tasks across multiple components prevents any single component from becoming a bottleneck, thereby maintaining data consistency while improving system responsiveness.
Solution Approach 2:
The patent introduces intermediary components or message queues that mediate between data modification operations and consistency propagation. These intermediaries buffer and coordinate synchronization operations, allowing the system to maintain data consistency without overloading individual components, thus preserving system responsiveness.
Data Source
AI summary
Updates to a hierarchical data structure may be selectively replicated to other replicas of the hierarchical data structure. An update for a hierarchical data structure may be received and committed to the hierarchical data structure. A determination as to whether any other replicas of the hierarchical data structure have permission to receive the update may be made. For those replicas of the hierarchical data structure with permission to receive the update, the update may be provided to the replicas and committed to the replicas. Different types of replication techniques may be implemented, such as pull-based replication techniques or push-based replication techniques. Replication permissions for objects of the hierarchical data structure may be individually defined, in some embodiments.