In-band Telemetry Packet Size Optimization via Payload Overwriting
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In-band telemetry packets often exceed the maximum transmission unit (MTU) size, leading to packet discarding or fragmentation, and increased latency, as they accumulate headers and metadata along the communication pathway, deviating from the original data packet behavior.
Innovation Solution
A method that adds metadata to telemetry packets after the header and any upstream metadata, overwriting a portion of the payload, to maintain packet size and prevent excessive growth, ensuring the packet can be transmitted without splitting and minimizing latency impact.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If headers and metadata are added to telemetry packets at each network node, then telemetry data collection capability is improved, but packet size increases causing MTU exceedance and fragmentation
Solution Approach 1:
The patent embeds telemetry metadata within the existing packet structure by overwriting payload portions, rather than adding external headers. Each network node's metadata is nested within the packet's existing framework, allowing multiple layers of telemetry data to be contained without proportional size increase.
Solution Approach 2:
The patent changes the structural parameters of the packet by overwriting existing payload content with metadata, transforming the packet from a pure data carrier to a hybrid structure where payload space is dynamically repurposed for telemetry information based on available space.
2Measurement precision
If telemetry packet size increases due to accumulated headers, then more telemetry data can be collected, but latency increases deviating from original traffic behavior
Solution Approach 1:
By nesting metadata within the packet's existing structure rather than adding external layers, the patent minimizes the time required for packet processing at each node, thereby reducing cumulative latency while maintaining comprehensive telemetry collection.
Solution Approach 2:
The patent writes metadata only up to the available payload length, using partial action to avoid excessive packet size expansion. This selective overwriting ensures telemetry data is collected without unnecessarily increasing packet size and associated latency.
3Measurement precision
If metadata is added after upstream metadata, then telemetry data from all nodes is captured, but packet processing complexity increases
Solution Approach 1:
The patent changes the packet structure parameter by dynamically overwriting payload content with metadata in a standardized sequence, simplifying processing logic compared to managing multiple external header layers with different formats and requirements.
Data Source
AI summary
A method for optimizing telemetry packet for in-band telemetry includes receiving a telemetry packet at a network node in a communication pathway between a sending host sending data packets to a receiving host and determining telemetry data for the network node. The telemetry data includes latency information for data packet processing of the network node. The method includes adding metadata to the telemetry packet, where the metadata is added after a header and a telemetry packet header and after any metadata added by any upstream network nodes. The metadata includes the telemetry data and the metadata overwrites a portion of a payload of the telemetry packet. The method includes, in response to adding the metadata to the telemetry packet, transmitting the telemetry packet to a next destination.