Multi-Tenant Metrics Monitoring Architecture for Scalable Datacenters

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing metrics monitoring frameworks for multi-tenant systems, particularly in cloud-based Kubernetes clusters, struggle with scalability and adaptability to system architecture changes, failing to accommodate multiple tenants effectively.

Innovation Solution

A novel architecture that deploys metrics collection agents within each service instance, coupled with a metrics monitoring service and manager, to collect and analyze metrics across service instances, allowing for flexible and scalable monitoring.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a fully centralized metrics monitoring framework is used, then it can accommodate multiple tenants, but it cannot easily adapt to system architecture changes

Engineering Contradiction:

Improveadaptability to system architecture changesVSAvoidcentralized framework complexity

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent divides the centralized monitoring framework into distributed components: local metrics collection agents deployed in each service instance, regional collectors that aggregate metrics from multiple instances, and a central monitoring server. This segmentation allows each component to be independently adaptable while maintaining overall system coordination, resolving the contradiction between adaptability and complexity.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent implements dynamic configuration capabilities where the metrics collection framework can adapt to system changes through configurable parameters, dynamic service discovery, and flexible metric collection policies. The local agents can dynamically adjust their behavior based on system state changes, enabling adaptability without requiring complete system reconfiguration.

Inventive Principle:

Principle #15Dynamics

2Productivity

If a centralized metrics monitoring framework is used, then it can provide centralized management, but it does not scale well with a large number of tenants

Engineering Contradiction:

Improvescalability with number of tenantsVSAvoidcentralized management capability

Core Design Contradiction:

ProductivityVSEase of operation

Solution Approach 1:

The patent implements a hierarchical segmentation where local metrics collection agents handle metrics from individual service instances, regional collectors aggregate and pre-process metrics from multiple service instances within a region, and the central monitoring server performs high-level analysis. This segmentation distributes the management workload, enabling the system to scale to many tenants while maintaining centralized oversight through the hierarchical structure.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent introduces regional collectors as intermediary components between local service instances and the central monitoring server. These intermediaries aggregate and pre-process metrics locally, reducing the burden on the central server and enabling scalable multi-tenant support while preserving centralized management capabilities through the hierarchical coordination mechanism.

Inventive Principle:

Principle #24Intermediary (Mediator)

3Adaptability or versatility

If existing monitoring toolkits for Kubernetes clusters are used, then they can monitor basic metrics, but they are not adaptable on-the-fly to system changes

Engineering Contradiction:

Improveon-the-fly adaptability to system changesVSAvoidcontinuous monitoring capability

Core Design Contradiction:

Adaptability or versatilityVSReliability

Solution Approach 1:

The patent implements dynamic metric collection where local agents can adjust their monitoring behavior in real-time based on system changes. The framework supports dynamic configuration of metric types, collection intervals, and target services, allowing the system to adapt to architecture changes on-the-fly while maintaining continuous monitoring through persistent agent processes that automatically track system state changes.

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The patent incorporates feedback mechanisms where the monitoring system continuously receives system state information and adjusts its collection strategy accordingly. The local agents monitor system health and can dynamically modify their behavior based on detected changes, ensuring reliable continuous monitoring while adapting to system evolution through feedback-driven adjustments.

Inventive Principle:

Principle #23Feedback

Data Source

PatentUS12519707B2Architecture for monitoring metrics of network management system

Publication Date: 2026.01.06 VMWARE INC

AI summary

Some embodiments provide a method for monitoring a multi-tenant network management system deployed in a cloud to manage groups of datacenters. The network management system includes multiple groups of service instances. For each respective group of service instances deployed in the cloud to manage a respective datacenter group, the method deploys a metrics collection agent within each service instance of the group of service instances to collect metrics from services of the service instance and provide the collected metrics to a metric monitoring service instance of the group of service instances. For each respective group of service instances, the method deploys a metrics collection manager within the metric monitoring service instance of the group of service instances. The metrics collection manager is for configuring each of the metrics collection agents deployed within the service instances of the group of service instances.