Data Center Event Messaging Service for Real-Time Infrastructure Monitoring
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current data center monitoring systems lack real-time, scalable solutions for integrating and processing event data from diverse infrastructure assets across geographically distributed data centers, leading to inefficiencies in operational monitoring and decision-making.
Innovation Solution
A near real-time messaging service that provides access to data center event data through dynamically configurable subscription topics, allowing for real-time processing and publication of events from various infrastructure assets, enabling integration with customer dashboards and IoT devices.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If data center monitoring systems process event data from diverse infrastructure assets across geographically distributed data centers, then the completeness and accuracy of monitoring information is improved, but the system complexity and processing time increase
Solution Approach 1:
The system segments event data processing by creating separate topic-based publish-subscribe channels for different infrastructure asset types and event categories. Each topic handles specific event streams independently, allowing the system to manage complex multi-data center monitoring information without overwhelming a single processing pipeline. This segmentation enables scalable information collection while maintaining manageable system architecture.
2Loss of time
If the monitoring system processes event data from multiple geographically distributed data centers in real-time, then the timeliness of operational monitoring is improved, but the computational resources and processing time required increase
Solution Approach 1:
The system performs preliminary filtering and routing of event data at the source before transmission. Event data is pre-processed and categorized into appropriate topics at each data center location, reducing the volume of data that needs to be transmitted and processed centrally. This preliminary action enables near real-time monitoring while reducing overall computational resource consumption across the distributed system.
3Adaptability or versatility
If the system provides access to event data through dynamically configurable subscription topics, then the adaptability and ease of integration for API consumers is improved, but the device complexity and configuration management increase
Solution Approach 1:
The system implements a universal topic-based publish-subscribe framework that serves multiple functions: event routing, data filtering, consumer subscription management, and integration interface. This single universal mechanism handles diverse data access requirements across different API consumers and application scenarios, providing high adaptability while avoiding the need for multiple specialized configuration systems.
Data Source
AI summary
In some examples, a method includes receiving, by a data center infrastructure monitoring system, a registration request that indicates a method of a subscription application programming interface and specifies one or more event subjects of events describing a system operation of a data center; storing, by the data center infrastructure monitoring system to a data-topic map, respective mappings for the one or more event subjects to a topic of a cloud-based publication platform; monitoring, by a data center infrastructure monitoring system, a plurality of physical infrastructure assets that enable system operation within the data center to obtain an event that describes one of the event subjects; and publishing, by the data center infrastructure monitoring system, the event to the topic.