Federated Cloud Job Deployment with Regional Raft Groups
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing cloud computing tools lack the capability to coordinate deployments of a single job across multiple regions, leading to burdensome manual efforts for operators, especially in multi-cloud deployments.
Innovation Solution
A system and method for multi-region deployment of jobs in a federated cloud infrastructure, which includes receiving a job for execution in multiple regions, generating a copy of the job for each region, deploying the job according to a deployment plan, and managing staged rollouts and rollbacks on failure within the federated cloud infrastructure.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If each cluster has its own independent state store, then isolated failure domains and performance are improved, but deployment coordination across multiple regions deteriorates
Solution Approach 1:
The system segments the deployment process into region-independent job specification and region-specific deployment execution. Each region maintains its own independent state store and raft group, isolating failure domains while allowing coordinated deployment through the shared job specification that contains multi-region deployment plans.
2Ease of operation
If manual automation is implemented for each multi-region job, then deployment control is improved, but operational burden and complexity increase
Solution Approach 1:
The system enables self-service automation where the workload orchestrator automatically executes multi-region deployments based on the job specification. The system handles deployment planning, state tracking, and coordination across regions without requiring manual intervention, reducing operational burden while maintaining control.
3Loss of information
If job version index is incremented for each deployment, then version tracking is improved, but state synchronization across clusters deteriorates
Solution Approach 1:
The system introduces a shared job specification as an intermediary that contains the authoritative job version index. This intermediary is replicated across all regions, allowing version tracking information to be consistently shared without requiring direct state synchronization between independent cluster state stores.
Data Source
AI summary
A system and method for multi-region deployment of application jobs in a federated cloud computing infrastructure. A job is received for execution in two or more regions of the federated cloud computing infrastructure, each of the two or more regions comprising a collection of servers joined in a raft group for separate, regional execution of the job generating a copy of the job for each of the two or more regions. The job is then deployed to the two or more regions, the workload orchestrator deploying the job according to a deployment plan. A state indication is received from each of the two or more regions, the state indication representing a state of completion of the job by each respective region of the multi-cloud computing infrastructure.