Telemetry Flow Data Aggregation Agent for Network Analyzer Load Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current systems that aggregate telemetry flow data from network devices face scalability issues as the number of devices increases, leading to a processing and storage burden on network analyzers, which can be exacerbated by the need to handle large volumes of data from each device.
Innovation Solution
Implementing a software agent that subscribes to telemetry flow data from multiple network devices, aggregates the data using a publish-subscribe model, and sends aggregated data to a network analyzer only when a threshold is reached or at regular intervals, reducing the data load on the analyzer.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If telemetry flow data is collected from each network device individually and sent to a network analyzer, then complete telemetry data is obtained, but the processing burden and storage requirements on the network analyzer increase significantly as the number of devices increases
Solution Approach 1:
The patent divides the network into multiple pods, with each pod containing a subset of network devices. A software agent is deployed in each pod to collect and aggregate telemetry data locally before sending it to the network analyzer. This segmentation reduces the amount of data that needs to be processed centrally, as each agent handles only the devices within its pod.
Solution Approach 2:
The software agent acts as an intermediary between network devices and the network analyzer. The agent collects telemetry data from multiple devices, aggregates it, and then sends the consolidated data to the analyzer. This intermediary role reduces the processing burden on the network analyzer while ensuring complete telemetry coverage.
2Loss of information
If all telemetry flow data from multiple network devices is sent to the network analyzer, then comprehensive network visibility is achieved, but bandwidth usage and data storage requirements increase
Solution Approach 1:
The software agent merges telemetry data from multiple network devices into a single aggregated data stream. By combining data at the pod level before transmission to the network analyzer, the system reduces the total volume of data transmitted over the network while maintaining comprehensive network visibility.
Solution Approach 2:
The software agent performs preliminary aggregation of telemetry data before it reaches the network analyzer. This preliminary action reduces the data volume that needs to be transmitted and stored, while ensuring that all necessary telemetry information is captured and consolidated.
3Ease of operation
If telemetry data is aggregated at the network analyzer from multiple devices, then centralized processing is maintained, but scalability is limited as the number of devices increases
Solution Approach 1:
The system segments the network into multiple pods with software agents deployed in each pod. This segmentation allows the system to scale to large numbers of devices while maintaining centralized processing capabilities at the network analyzer, as each agent independently aggregates data from its local devices.
Solution Approach 2:
The patent introduces a new dimension to the architecture by deploying software agents at the pod level, creating a hierarchical processing structure. This dimensional change enables the system to scale horizontally across multiple pods while maintaining centralized analysis capabilities.
Data Source
AI summary
A method includes subscribing, by an agent, to telemetry flow data from each network device of a plurality of network devices and receiving, by the agent, a plurality of streams of telemetry flow data from the plurality of the network devices. Each of the plurality of streams corresponds to a different one of the plurality of network devices. The method further includes aggregating, by the agent, data from at least one stream of the plurality of streams of the telemetry flow data received over a period of time and, at the end of the period of time and/or when the data from the at least one stream exceeds a data threshold, sending, by the agent, the aggregated telemetry flow data to a network analyzer device.