Overlay Network Statistics Collection via Per-Tunnel De-encapsulation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for collecting statistics in overlay networks, such as those using RMON and SMON MIB, are limited in their ability to gather information about overlay-encapsulated packets, lacking visibility into inner packets and thus unable to fully understand and manage network elements within these networks.

Innovation Solution

A system and method that create, record, and maintain statistics on a per-tunnel basis for overlay-encapsulated packets, using a hardware processor to count events associated with de-encapsulation and encapsulation, and store these statistics with virtual network and tunnel identifiers in a table, enabling detailed tracking and analysis.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If conventional RMON and SMON MIB methods are used for collecting statistics, then implementation at edge of overlay network is simple, but visibility to inner packets inside overlay-encapsulated packets is lost

Engineering Contradiction:
Improvevisibility to inner packetsVSAvoidstatistics collection mechanism
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent segments the statistics collection function into two parts: outer packet statistics collected by conventional edge devices, and inner packet statistics collected by a new statistics collection device positioned within the overlay network. This segmentation allows inner packet visibility while maintaining simple edge device implementation.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a statistics collection device as an intermediary component within the overlay network that can access and collect statistics from inner packets without disrupting the existing overlay encapsulation mechanism. This intermediary provides the needed visibility while leaving edge devices unchanged.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If per-tunnel statistics with de-encapsulation event counting are implemented, then detailed packet usage and performance insights are gained, but processing overhead increases

Engineering Contradiction:
Improvepacket statistics detailVSAvoidprocessing overhead
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The statistics collection device performs self-service by collecting inner packet statistics directly from the overlay network traffic without requiring de-encapsulation processing. This approach gains detailed measurement precision while avoiding the energy-consuming de-encapsulation operation.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent implements partial action by collecting only the necessary statistics (packet counts, byte counts, event types) without fully processing or de-encapsulating the packets. This selective collection provides sufficient detail for network management while minimizing processing overhead.

Inventive Principle:
Principle #16Partial or excessive action

3Adaptability or versatility

If comprehensive statistics about overlay-encapsulated packets are collected, then network element management capability is enhanced, but data storage and management complexity increases

Engineering Contradiction:
Improvenetwork management capabilityVSAvoidstatistics storage structure
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent segments the statistics storage into distinct categories: outer packet statistics stored at edge devices and inner packet statistics stored at the statistics collection device. This segmentation organizes the comprehensive data while distributing storage responsibilities to manage complexity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent adds a new dimension to statistics storage by introducing a hierarchical structure with multiple levels: tunnel-level statistics, virtual network-level statistics, and inner packet-level statistics. This multi-dimensional organization enhances management capability while providing a systematic approach to handling the complexity of comprehensive statistics.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS11184270B2Switch monitoring statistics gathering at servers and gateways for overlay networks
Publication Date: 2021.11.23 KYNDRYL INC
  • US11184270B2 patent drawing
  • US11184270B2 patent drawing
  • US11184270B2 patent drawing

AI summary

In one embodiment, a method includes creating on a per-tunnel basis, by a hardware processor, statistics about overlay-encapsulated packets which are received by or sent by the hardware processor across an overlay network, including counting events associated with de-encapsulation of one or more inner packets from an overlay-encapsulated packet; recording, by the hardware processor, the statistics in association with a virtual network identifier and a tunnel identifier that identifies a tunnel on which the overlay-encapsulated packets are received or sent; and maintaining, by the hardware processor, a table indexed for the virtual network identifier and the tunnel identifier, the table including the virtual network identifier; the tunnel identifier; and statistic bucket identifiers pointing to locations where statistics associated with the virtual network identifier and the tunnel identifier are stored.