Network Telemetry Metadata Prioritization for Faster Critical Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing network telemetry standards like INT and IOAM lack a mechanism to signal the priority of telemetry data sets, leading to processing delays for critical network device metadata, which hinders timely performance monitoring and troubleshooting.
Innovation Solution
Introduce a metadata priority level field in network telemetry data to prioritize and reorder telemetry data sets based on their importance, ensuring critical metadata is processed promptly.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If telemetry data is collected from multiple network nodes using existing standards (INT/IOAM), then comprehensive network performance tracking is achieved, but processing delays occur for critical metadata due to lack of priority signaling
Solution Approach 1:
The patent applies local quality by introducing a priority field specifically for critical telemetry data sets. Instead of treating all metadata uniformly, the system assigns different priority levels (e.g., high priority for link-down events, low priority for routine status updates) to different metadata types. This allows critical network events to be processed immediately while non-critical events are handled in the background, resolving the contradiction between comprehensive monitoring and timely processing of critical events.
Solution Approach 2:
The patent changes the parameter structure of telemetry data by adding a priority level parameter to existing metadata formats. This parameter modification enables the network device to differentiate between critical and non-critical telemetry data, allowing the system to maintain comprehensive monitoring capabilities while enabling prioritized processing queues that reduce latency for time-sensitive events.
2Ease of operation
If all telemetry data sets are processed in uniform order, then processing simplicity is maintained, but critical metadata experiences delays
Solution Approach 1:
The patent introduces dynamic processing by implementing priority-based queuing mechanisms. Instead of a static first-in-first-out processing order, the system dynamically adjusts processing order based on the priority level assigned to each telemetry data set. High-priority metadata (such as link failure events) are processed immediately when generated, while low-priority metadata are processed during idle periods or in batches, thus maintaining operational simplicity while dramatically reducing critical event latency.
3Loss of time
If priority fields are added to telemetry data structures, then critical metadata can be processed faster, but data structure complexity increases
Solution Approach 1:
The patent applies segmentation by dividing the processing system into priority-based queues and processing threads. The metadata structure is segmented with a dedicated priority field that acts as a sorting key. This segmentation allows the system to handle complex prioritization logic in a modular fashion, where each priority level has its own processing pipeline, thereby managing complexity through structured organization rather than monolithic processing logic.
Solution Approach 2:
The patent extracts the priority determination logic from the main processing flow by implementing it as a separate classification step. The priority field is extracted and processed independently to determine queue assignment, while the actual telemetry data processing remains unchanged. This extraction isolates the complexity of priority management from the core telemetry processing functions, maintaining simplicity in the majority of the system while enabling advanced prioritization where needed.
Data Source
AI summary
Methods are provided to categorize and filter node metadata by adding a priority field to the node metadata, obtained as part of in-band network telemetry data collection. The methods involve obtaining, by a first network device, a packet having a header and a payload and adding, by the first network device, to the header of the packet, metadata which includes first telemetry data and a metadata priority level that indicates a priority of the first telemetry data added to the header of the packet by the first network device. The methods further involve providing the packet to a second network device in a path of a network.