Orchestration Service for Dynamic Cloud Resource Allocation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Business customers face challenges in managing and scaling computing resources dynamically to meet fluctuating demands, as existing solutions require significant configuration and management efforts, leading to inefficiencies and increased costs.
Innovation Solution
A system that utilizes a control plane computer system to dynamically allocate and manage a cluster of virtual computing resources, including master and slave nodes, with separate network namespaces for control plane and data plane operations, allowing for on-demand resource allocation and de-allocation based on job requirements, thereby eliminating the need for customers to configure and manage dedicated resources.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If customers acquire computing resources from Web-based service providers, then customers do not need to acquire, maintain, and upgrade physical hardware, but customers face challenges in managing and scaling computing resources dynamically to meet fluctuating demands
Solution Approach 1:
The patent implements dynamic resource allocation through an orchestration service that automatically provisions, configures, and manages computing resources based on real-time job requirements. The system dynamically scales resources by creating or destroying computing instances as needed, allowing customers to easily adapt to fluctuating demands without manual intervention.
Solution Approach 2:
The orchestration service provides self-service capabilities by automatically managing the entire resource lifecycle including provisioning, configuration, deployment, and termination of computing resources. This eliminates the need for customers to manually acquire, maintain, and upgrade physical hardware while simultaneously enabling dynamic scaling through automated resource management.
2Reliability
If dedicated computing resources are allocated to customers, then customers have guaranteed performance, but resource utilization is inefficient and costs increase
Solution Approach 1:
The patent implements a shared resource pool where computing resources serve multiple customers and multiple jobs simultaneously. The orchestration service dynamically allocates resources from this shared pool based on real-time demands, ensuring that resources are utilized efficiently across multiple users while maintaining guaranteed performance through resource reservations and quality of service mechanisms.
Solution Approach 2:
The system dynamically adjusts resource allocation parameters based on job requirements and demand patterns. The orchestration service modifies resource provisioning parameters in real-time, scaling resources up or down to match actual utilization needs while maintaining performance guarantees through parameter-based resource management and automated adjustment of allocation policies.
3Productivity
If computing resources are allocated on-demand, then resource utilization is optimized and costs are reduced, but system complexity increases
Solution Approach 1:
The patent introduces an orchestration service as an intermediary layer between customers and the underlying computing infrastructure. This intermediary automatically handles the complexity of on-demand resource allocation, provisioning, and management, presenting a simplified interface to customers while managing the complex coordination of resources, configurations, and deployments in the background.
Solution Approach 2:
The orchestration service implements self-service automation that handles complex resource management tasks without requiring customer intervention. The system automatically provisions, configures, deploys, and terminates computing resources based on job requirements, eliminating the need for customers to understand or manage system complexity while optimizing resource utilization through automated decision-making.
4Adaptability or versatility
If customers configure and manage dedicated resources, then customers have full control over their environment, but configuration and management efforts increase significantly
Solution Approach 1:
The orchestration service provides self-service automation that maintains customer control over their computing environment while eliminating manual configuration and management efforts. The system automatically provisions, configures, and manages resources according to customer specifications and job requirements, allowing customers to define their environmental needs without having to manually configure or manage the underlying infrastructure.
Solution Approach 2:
The orchestration service acts as an intermediary that translates customer requirements into automated resource management actions. It maintains customer control by implementing their specified configurations and policies while automating the complex tasks of resource provisioning, deployment, and management, thereby preserving adaptability while reducing operational effort.
Data Source
AI summary
A system operated by a computing resource service provider maintains a pool of computing resources for use in processing job requests submitted by customers. The system allocates computing resources to the pool in anticipation of future resource needs. In various embodiments, future resource needs can be estimated based on scheduled jobs, or historical job information. In an embodiment, the computing resources are virtual computer systems which may be arranged in a cluster. In response to receiving a parallel processing job from a customer, the system reserves computing resources from the pool for performing the job. In an embodiment, the reserved resources are configured with a network namespace that is able to access to a customer's resources.