Cloud Runtime Service Fabric for SLO-Aware Multi-Cloud Scaling
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Cloud infrastructure providers face challenges in ensuring reliability and adhering to service level objectives (SLOs) due to lack of intelligent infrastructure systems that can automate performance management and respond to issues in a prescribed manner.
Innovation Solution
A cloud-distributed application runtime that tracks end-to-end transactions, provides intelligent resiliency, and automates remediation actions to ensure adherence to SLOs by monitoring and optimizing application performance across multiple clouds.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If cloud infrastructure providers use traditional infrastructure systems, then device complexity is reduced, but reliability and adherence to service level objectives deteriorate due to lack of intelligent automation
Solution Approach 1:
The patent introduces an intermediary layer (service mesh/runtime) that sits between the cloud infrastructure and applications. This intermediary handles complexity management, observability, and automation of SLO adherence, allowing traditional infrastructure to maintain simplicity while achieving enhanced reliability through the intermediary's intelligent capabilities.
Solution Approach 2:
The infrastructure system implements self-service capabilities through automated observability and remediation mechanisms. The runtime automatically monitors application performance, detects SLO violations, and triggers remediation actions without human intervention, enabling the system to self-manage reliability while reducing operational complexity.
2Productivity
If manual processes are used for performance management, then device complexity is reduced, but productivity deteriorates due to lack of automation
Solution Approach 1:
The patent implements continuous feedback loops where the runtime monitors application performance metrics, compares them against SLOs, and automatically triggers remediation actions. This closed-loop feedback system automates performance management, significantly improving productivity while the modular architecture manages the associated complexity.
Solution Approach 2:
The patent replaces manual mechanical processes with automated electronic/software-based systems. The runtime uses automated observability tools, machine learning models, and orchestration mechanisms to substitute human-performed performance management tasks, dramatically improving efficiency while managing complexity through automation frameworks.
3Reliability
If over-provisioning is used to ensure reliability, then reliability is improved, but loss of energy and resource usage deteriorate
Solution Approach 1:
The patent implements dynamic resource provisioning where the runtime continuously monitors application performance and SLO adherence, automatically scaling resources up or down based on actual needs. This dynamic approach ensures reliability by provisioning resources only when necessary, eliminating the waste associated with static over-provisioning while maintaining SLO compliance.
Data Source
AI summary
A cloud distributed application runtime is deployed to execute a cloud infrastructure. During deployment of an application service by the cloud infrastructure, each action implemented in the cloud infrastructure is traced, from an initiation of the application service to a termination of the application service. Level objectives associated with the cloud infrastructure and associated with the application service deployed by the cloud infrastructure are tracked. In response to tracing an action implemented in the cloud infrastructure and in response to tracking the level objectives, a scaling decision associated with the application service is determined. The scaling decision incudes either an upscaling or a downscaling. In response to determining the scaling decision, the scaling decision is implemented to match the level objectives associated with the cloud infrastructure and associated with the application service.