Network Power Prediction via Simulation and Machine Learning

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

High-performance computing (HPC) datacenters face challenges in accurately predicting network power usage due to unique designs and the lack of pre-existing instrumented datacenters, which can lead to inefficiencies and potential overloads, as traditional methods require extensive data collection and may not account for fluctuating network power consumption.

Innovation Solution

A system combining simulation and machine-learning techniques to predict network power usage by embedding counters in simulators to collect statistics on network components' operations, allowing for training of models using both simulated and actual hardware data, enabling prediction of power usage for new workloads without relying on extensive real-world data collection.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional data collection methods are used to predict network power usage, then prediction accuracy may be improved, but the time and resources required for data collection increase significantly

Engineering Contradiction:
Improveprediction accuracyVSAvoiddata collection time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent applies preliminary action by using simulation to generate synthetic network power usage data before actual deployment. The simulation environment pre-generates training datasets that mimic real-world conditions, allowing the machine learning model to be trained in advance without requiring extensive real-world data collection. This resolves the contradiction by obtaining sufficient training data through simulation beforehand, thereby maintaining prediction accuracy while dramatically reducing the time needed for actual data collection.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent applies copying by creating a virtual copy of the network infrastructure through simulation. Instead of collecting data from physical hardware, the system creates a digital twin that replicates network behavior and power consumption patterns. This virtual copy generates synthetic training data that is sufficiently accurate for model training, thereby achieving good prediction accuracy without the time-consuming process of collecting data from actual deployed systems.

Inventive Principle:
Principle #26Copying

2Measurement precision

If extensive real-world data collection is performed to train prediction models, then model accuracy improves, but the complexity and cost of the system increases

Engineering Contradiction:
Improvemodel accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent uses copying by creating a virtual simulation environment that replicates network infrastructure behavior. This digital twin generates synthetic training data without requiring physical instrumentation of actual network devices. The simulation approach maintains model accuracy by faithfully reproducing power consumption patterns while significantly reducing system complexity compared to deploying sensors and data collection infrastructure across physical network equipment.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent introduces simulation as an intermediary between the physical network infrastructure and the machine learning model. Rather than directly collecting data from complex physical systems, the simulation layer acts as a mediator that translates physical network behavior into usable training data. This intermediary approach maintains model accuracy while simplifying the overall system architecture by replacing complex data collection infrastructure with a software-based simulation layer.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Productivity

If simulation is used to generate training data, then data collection time is reduced, but the accuracy of power usage prediction may be compromised

Engineering Contradiction:
Improvedata collection efficiencyVSAvoidprediction accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent applies preliminary action by performing comprehensive simulation-based data generation and model training before actual deployment. The simulation environment is configured to replicate diverse network conditions and workloads, generating sufficient training data in advance to achieve accurate predictions. By completing the data collection and model training process preliminarily through simulation, the system achieves both high productivity during deployment and maintains prediction accuracy through thorough pre-training.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent uses copying by creating a faithful virtual representation of the network infrastructure that accurately replicates power consumption characteristics. The simulation model is designed to copy real-world network behavior patterns, ensuring that synthetic training data reflects actual operational conditions. This accurate copying maintains prediction accuracy while enabling rapid data generation without physical hardware constraints.

Inventive Principle:
Principle #26Copying

4Ease of operation

If traditional power management methods are used in HPC datacenters, then implementation is simpler, but power allocation efficiency decreases due to inability to predict fluctuating consumption

Engineering Contradiction:
Improveimplementation simplicityVSAvoidpower allocation efficiency
Core Design Contradiction:
Ease of operationVSProductivity

Solution Approach 1:

The patent applies feedback by implementing a predictive power management system that uses machine learning models to forecast network power consumption. The system continuously monitors actual power usage, compares it with predictions, and uses this feedback to refine the model and improve future predictions. This feedback mechanism enables dynamic power allocation that adapts to fluctuating consumption patterns, significantly improving power allocation efficiency while maintaining reasonable implementation complexity through automated model updates.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent applies dynamics by transitioning from static power management to dynamic predictive power management. The machine learning model continuously adapts to changing network conditions and workloads, providing real-time power consumption predictions that enable flexible power allocation. This dynamic approach improves power allocation efficiency by responding to actual usage patterns while maintaining implementation feasibility through automated model training and updating processes.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS11644882B2System and method for predicting power usage of network components
Publication Date: 2023.05.09 HEWLETT PACKARD ENTERPRISE DEV LP
  • US11644882B2 patent drawing
  • US11644882B2 patent drawing
  • US11644882B2 patent drawing

AI summary

One embodiment provides a system and method for predicting network power usage associated with workloads. During operation, the system configures a simulator to simulate operations of a plurality of network components, which comprises embedding one or more event counters in each simulated network component. A respective event counter is configured to count a number of network-power-related events. The system collects, based on values of the event counters, network-power-related performance data associated with one or more sample workloads applied to the simulator; and trains a machine-learning model with the collected network-power-related performance data and characteristics of the sample workloads as training data 1, thereby facilitating prediction of network-power-related performance associated with a to-be-evaluated workload.