Adaptive Thresholds for Container Metrics Using Machine Learning

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Container environments lack sophisticated management systems for setting dynamic or adaptive thresholds, which are essential for predicting abnormalities and optimizing resource allocation, leading to inefficiencies in managing container performance and resource utilization.

Innovation Solution

Implementing a method that uses machine learning algorithms to generate adaptive thresholds for container metrics, allowing for real-time monitoring and alert generation when behavior deviates from accepted ranges, thereby enabling efficient resource allocation and performance optimization.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If static thresholds are used for container monitoring, then the system is simple to implement, but it cannot adapt to changing container behavior patterns and generates false alerts

Engineering Contradiction:
Improveadaptability to container behavior changesVSAvoidcomplexity of threshold management system
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent implements dynamic thresholds that automatically adjust based on historical container performance data and learned behavior patterns. The system transitions from static, fixed thresholds to dynamic, adaptive thresholds that evolve with container workloads, resolving the contradiction between adaptability and complexity by making the system's monitoring parameters flexible rather than fixed

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system performs self-learning by automatically analyzing historical container data and generating adaptive thresholds without requiring manual configuration or intervention. The container monitoring system serves itself by autonomously adapting to changing behavior patterns, eliminating the need for complex manual threshold management while maintaining high adaptability

Inventive Principle:
Principle #25Self-service

2Measurement precision

If machine learning algorithms are implemented for adaptive threshold generation, then prediction accuracy improves, but computational overhead and system complexity increase

Engineering Contradiction:
Improveaccuracy of abnormality detectionVSAvoidcomplexity of monitoring system
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system applies machine learning selectively to generate adaptive thresholds rather than using complex ML models for all monitoring decisions. By using ML only for threshold generation and then applying simple comparative logic for actual monitoring, the system achieves high detection accuracy while minimizing computational overhead and system complexity

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The system performs preliminary analysis by training ML models on historical container data in advance to generate adaptive thresholds. This pre-processing step separates the complex computational work from real-time monitoring, allowing accurate detection during operation without the computational overhead of running complex ML algorithms continuously

Inventive Principle:
Principle #10Preliminary action

3Reliability

If adaptive thresholds are generated using historical data, then false alerts are reduced, but data collection and processing time increases

Engineering Contradiction:
Improvereliability of alert generationVSAvoidtime for threshold generation
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system updates adaptive thresholds periodically based on accumulated historical data rather than continuously retraining models. This periodic update approach allows the system to reduce false alerts through learned patterns while minimizing the time impact on operations, as threshold regeneration occurs at scheduled intervals rather than affecting real-time monitoring

Inventive Principle:
Principle #19Periodic action

Data Source

PatentUS11106560B2Adaptive thresholds for containers
Publication Date: 2021.08.31 EMC IP HLDG CO LLC
  • US11106560B2 patent drawing
  • US11106560B2 patent drawing
  • US11106560B2 patent drawing

AI summary

A method includes identifying container metrics for containers running in a container environment, collecting container data for the containers, and generating an adaptive threshold for a given one of the identified container metrics. The adaptive threshold specifies one or more values for the given container metric for a designated time period. The adaptive threshold is generated utilizing a scoring algorithm that determines a range of accepted container behavior for the designated time period by analyzing the collected container data using one or more machine learning algorithms. The method also includes monitoring behavior of the containers during the designated time period utilizing the adaptive threshold, and generating an alert responsive to detecting that the monitored behavior of a given one of the containers is outside the range of accepted container behavior for the designated time period specified by the given adaptive threshold for the given container metric.