Packet Loss Detection via Network Traffic Digests
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing data center networks face significant challenges in detecting and locating packet losses due to misconfigurations, resource shortages, software errors, and hardware failures, which impact application performance and network operations, and current monitoring tools lack the necessary information to identify lost packets effectively.
Innovation Solution
A packet loss detection system that uses meters placed at network vantage points to generate digests summarizing traffic, which are then analyzed by a collector to detect mismatches and restore lost packet identifiers using Bloom-filter based data structures and hash functions, allowing for near-real-time detection and reporting of packet losses.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If existing monitoring tools are used to detect packet losses, then packet loss detection is provided, but the location and identity of individual lost packets cannot be identified
Solution Approach 1:
The patent segments packet identification into multiple components: flow identifiers (source IP, destination IP, source port, destination port, protocol) and packet-specific identifiers (sequence numbers, timestamps). This segmentation allows the system to track individual packets through multiple dimensions of information, resolving the contradiction between detecting packet loss and identifying specific lost packets.
Solution Approach 2:
The patent introduces an intermediary data structure (the digest) that mediates between raw packet data and loss detection. The digest contains summarized packet information including flow identifiers and packet identifiers, serving as an intermediary representation that enables both loss detection and packet identification without requiring full packet capture.
2Reliability
If packet loss detection is implemented, then network performance monitoring is improved, but the complexity of monitoring tools increases
Solution Approach 1:
The patent extracts only the necessary identification information from full packets into the digest structure. Instead of capturing complete packet data, the system extracts flow identifiers and packet-specific identifiers, reducing the data volume and processing complexity while maintaining the ability to detect and identify lost packets.
Solution Approach 2:
The digest structure serves multiple functions simultaneously: it acts as a packet identifier, a loss detection mechanism, and a data reduction structure. This multi-functionality reduces the need for separate monitoring components, thereby reducing overall system complexity while improving monitoring reliability.
3Measurement precision
If detailed packet tracking is performed, then lost packet identification is improved, but the time required for detection increases
Solution Approach 1:
The patent performs preliminary actions by pre-defining flow identifiers and packet identifiers before packet loss occurs. The digest structure is prepared in advance with the necessary fields and data types, allowing for rapid packet matching and loss detection without time-consuming analysis during the detection phase.
Solution Approach 2:
The patent changes the parameters of packet representation by transforming full packet data into a summarized digest format with specific fields (flow identifiers, packet identifiers). This parameter transformation enables faster processing and detection while maintaining the precision needed for accurate lost packet identification.
Data Source
AI summary
The invention provides a packet loss detection system that in near-real time detects packet loss and reports the identities of the lost packets. The identities of the lost packets are based on a set of packet-specific information that includes five-tuple flow information of the packet and other unique packet identifiers. A set of meters are placed at various vantage points in the network, each meter generates digests summarizing all the traffic passing through itself. The digests are exported to a collector/analyzer, which decodes the digests and performs an analysis to detect packet losses and to determine the lost packets' identities. The collector compares between the traffic digests generated by all the meters surrounding the segment. Mismatches among the digests indicate packet losses. The collector restores the identifiers of the lost packets by further decoding the mismatches between the digests.