Telemetry Data Collection via Hierarchical Request Merging
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current network management solutions face inefficiencies due to multiple applications independently collecting and retrieving telemetry data from network devices, leading to disparate data collections and overlapping requests, which result in duplicated data retrieval and inefficient resource usage.
Innovation Solution
A centralized collection service manages telemetry data using a hierarchical tree representation and YANG data model, merging requests with common parent nodes and determining a minimum viable cadence across applications to optimize data retrieval, reducing the need for individual data collection from child nodes and minimizing resource consumption.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If multiple applications independently collect telemetry data from network devices, then each application can obtain its required data, but duplicated data retrieval occurs and resource consumption increases
Solution Approach 1:
The patent merges multiple independent data collection requests into a unified request structure. The system consolidates requests from multiple applications, identifies common parent nodes in the telemetry data hierarchy, and combines them into single polling operations. This merging eliminates duplicated data retrieval while ensuring all applications receive their required data, directly resolving the contradiction between data retrieval capability and resource consumption.
2Ease of operation
If applications perform data collection independently, then data can be retrieved according to specific application needs, but overlapping requests for same or similar data occur
Solution Approach 1:
The patent introduces an intermediary data collection service that sits between multiple applications and the network devices. This intermediary receives requests from various applications, processes them through a unified request structure, and manages the actual data collection. The intermediary maintains data collection flexibility by preserving application-specific requirements while dramatically improving efficiency by eliminating overlapping requests through centralized request management and path optimization.
3Measurement precision
If data is collected from multiple child nodes separately, then specific data portions can be retrieved precisely, but the number of polling operations increases
Solution Approach 1:
The patent transforms the data collection approach by introducing a hierarchical dimension to request organization. Instead of treating each child node request independently, the system organizes requests around common parent nodes in the telemetry data hierarchy. This dimensional reorganization allows the system to retrieve data from parent nodes once and then distribute relevant portions to multiple applications, maintaining precise data retrieval while reducing the number of polling operations and associated time loss.
Data Source
AI summary
Presented herein are embodiments for collecting and sharing telemetry data. A plurality of requests are received, from one or more applications, for telemetry data that is stored in a hierarchical tree representation comprising a plurality of nodes, wherein the telemetry data indicates an operational status and performance of a device, and wherein each request includes a cadence indicating a timespan at which the request repeats, and a path in the hierarchical tree where a requested portion of the telemetry data is stored. Processing the requests produces an optimized set of requests by merging any two or more requests whose paths indicate portions of data that share a common parent node in the hierarchical tree, wherein a merged request is assigned a cadence corresponding to a shortest cadence among the two or more requests. The hierarchical tree is polled using the optimized set of requests to satisfy the received requests.