Service-Level Feedback Power Management Framework

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional power management strategies in cloud systems rely primarily on processor-level performance metrics, failing to adaptively assign appropriate resources to handle varying user requests, leading to potential SLA violations and inefficient resource utilization.

Innovation Solution

A power management system that employs a reinforcement learning algorithm using direct and indirect service-level feedbacks to guide power management decisions, considering operating system, logical processor, and service-level metrics, and providing a fast decision override mechanism for platform events, to dynamically adjust processor states based on real-time service demands.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Use of energy by moving object

If processor-level performance metrics are used for power management decisions, then power consumption can be reduced through state changes, but the system fails to reflect actual service-level needs and request types, leading to SLA violations

Engineering Contradiction:
Improvepower consumptionVSAvoidSLA compliance
Core Design Contradiction:
Use of energy by moving objectVSReliability

Solution Approach 1:

The patent implements a feedback mechanism that collects service-level metrics (request types, service priorities, workload characteristics) and feeds them into the power management decision-making process. This multi-level feedback loop ensures that processor state changes are made with knowledge of actual service requirements, preventing SLA violations while still achieving power savings through informed decisions about when to transition between performance states.

Inventive Principle:
Principle #23Feedback

2Reliability

If the cloud system operates at maximum capacity, then incoming requests can be handled without delays, but resources become idle during low-demand periods, leading to inefficient resource utilization

Engineering Contradiction:
Improverequest handling capabilityVSAvoidresource utilization efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent employs dynamic power management that continuously adapts processor operating states based on real-time workload analysis. Instead of static maximum capacity operation, the system dynamically transitions between performance states (P-states) and power states (C-states) according to actual service-level demands, ensuring high request handling capability during peaks while achieving energy efficiency during low-utilization periods.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes operational parameters (processor frequency, voltage, and power states) based on analyzed service-level metrics. By monitoring request characteristics, service priorities, and workload patterns, the system adjusts processor parameters to match actual demand, preventing both over-provisioning and under-provisioning of computational resources.

Inventive Principle:
Principle #35Parameter changes

3Productivity

If processor state changes are made frequently to adapt to workload variations, then resource efficiency improves, but the complexity of managing multiple performance states increases

Engineering Contradiction:
Improveresource efficiencyVSAvoidpower management complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent introduces an intermediary power management component that sits between the service layer and hardware processors. This intermediary analyzes service-level metrics and translates them into appropriate processor state commands, simplifying the complexity by providing a unified decision-making layer that handles state transitions based on service requirements rather than raw hardware metrics.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11640195B2Service-level feedback-driven power management framework
Publication Date: 2023.05.02 CLOUD INTELLIGENCE ASSETS HOLDING (SINGAPORE) PTE LTD
  • US11640195B2 patent drawing
  • US11640195B2 patent drawing
  • US11640195B2 patent drawing

AI summary

A power management system may provide power management recommendations to a computer system including a plurality of computing nodes (which may include processors, etc.), to cause the computing nodes to individually or collectively adjust power states or modes of respective processors to achieve power management of the computer system. The power management system may be provided with a power management framework that continuously utilizes direct and indirect service-level feedbacks to guide power management decisions. The power management system may employ a reinforcement learning algorithm to make power management decisions at a user level, and provide a fast decision overriding mechanism for platform events or service-requested performance boosts.