Hierarchical Data Service Multi-Cloud State Propagation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Managing complex resource clusters across multiple clouds is challenging due to increased complexity and the need for efficient data propagation and high availability in hierarchical data service systems.
Innovation Solution
A hierarchical data service (HDS) with a multi-cloud data service (MCDS) architecture that manages resource clusters across multiple clouds using a tree structure or directed acyclic graph (DAG) for both resource clusters and cluster managers, implementing novel processes for data propagation and high availability to ensure scalability and reliability.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If a hierarchical data service manages resource clusters across multiple clouds with detailed state propagation, then system visibility and control are improved, but data propagation complexity and system overhead increase
Solution Approach 1:
The patent segments the hierarchical data service into multiple levels (e.g., global, regional, zone levels) with each level managing specific subsets of resource clusters. This segmentation reduces the complexity at any single level while maintaining overall system visibility through the hierarchical structure. Each level propagates state to its children, creating an organized flow of information that prevents overwhelming complexity.
Solution Approach 2:
The patent implements a nested hierarchical structure where lower-level cluster managers are contained within higher-level hierarchies. Each cluster manager level is nested within its parent level, creating a compact organization where detailed state information flows from leaves to root. This nesting allows detailed state propagation at lower levels while abstracting complexity at higher levels, resolving the contradiction between visibility and complexity.
2Loss of information
If the management hierarchy sends detailed state information from all progeny clusters to ancestor clusters, then complete system state is maintained, but the amount of data sent upstream increases significantly
Solution Approach 1:
The patent applies partial action by having cluster managers propagate state information selectively based on their position in the hierarchy and the specific requirements of ancestor clusters. Not all detailed state information from every progeny cluster needs to be sent to all ancestor clusters. The system propagates sufficient state information to maintain necessary visibility and control while avoiding excessive data transmission through intelligent selective propagation at each level.
3Adaptability or versatility
If the system allows flexible addition of resource clusters and cluster managers, then scalability is improved, but system complexity increases
Solution Approach 1:
The patent segments the system into independent, interchangeable cluster manager units that can be added at any level of the hierarchy. Each cluster manager operates as an independent module with standardized interfaces, allowing flexible addition without increasing overall system complexity. The hierarchical structure provides standardized patterns for integration that simplify scalability.
Solution Approach 2:
The patent implements universal cluster manager components that can function at multiple levels of the hierarchy and manage different types of resource clusters across various clouds. This universality allows the same basic components to be reused and scaled, improving adaptability while maintaining manageable complexity through standardization.
4Reliability
If the management hierarchy implements comprehensive high availability mechanisms, then system reliability is improved, but the complexity of failure handling increases
Solution Approach 1:
The patent implements beforehand cushioning by pre-configuring backup cluster managers and redundant communication paths at each hierarchical level. When a failure occurs, the system has pre-established mechanisms to redirect state propagation through alternative paths, cushioning against the impact of failures without requiring complex real-time failure analysis or reconstruction.
Data Source
AI summary
Some embodiments provide a hierarchical data service (HDS) that manages many resource clusters that are in a resource cluster hierarchy. In some embodiments, each resource cluster has its own cluster manager, and the cluster managers are in a cluster manager hierarchy that mimics the hierarchy of the resource clusters. In some embodiments, both the resource cluster hierarchy and the cluster manager hierarchy are tree structures, e.g., a directed acyclic graph (DAG) structure that has one root node with multiple other nodes in a hierarchy, with each other node having only one parent node and one or more possible child nodes.


