Distributed Stream Processing for Telecommunication Network Monitoring

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current network probing and troubleshooting in telecommunication networks are monolithic, inflexible, and resource-intensive, consuming significant resources and lacking scalability, especially with the anticipated increase in network data in next-generation cellular networks.

Innovation Solution

The implementation of a distributed and scalable probing architecture using stream processing systems that process trace data from virtual network functions, allowing for priority-based processing, flexible data formats, and efficient data distribution through platforms like Apache Kafka, enabling real-time monitoring and reducing computational costs.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a monolithic probe infrastructure is used to monitor network functions, then network monitoring capability is provided, but resource consumption increases significantly (up to 30 percent or more of cellular core network resources)

Engineering Contradiction:

Improvenetwork monitoring capabilityVSAvoidresource consumption

Core Design Contradiction:

ReliabilityVSUse of energy by moving object

Solution Approach 1:

The patent segments the monolithic probe infrastructure into multiple distributed stream processing systems deployed across different zones and regions. Each stream processing system independently processes trace data from virtual network functions in its designated area, eliminating the need for a centralized resource-intensive infrastructure while maintaining comprehensive network monitoring coverage.

Inventive Principle:

Principle #1Segmentation

2Speed

If real-time network traffic monitoring is implemented, then real-time monitoring capability is achieved, but computational cost and system complexity increase significantly

Engineering Contradiction:

Improvereal-time monitoring capabilityVSAvoidsystem complexity

Core Design Contradiction:

SpeedVSDevice complexity

Solution Approach 1:

The system divides real-time processing into distributed stream processing systems that handle local trace data independently. This segmentation reduces the computational burden on any single system and simplifies the overall architecture compared to a centralized real-time processing system.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent extracts only the necessary trace data from virtual network functions based on filtering rules and forwarding policies, rather than processing all network traffic. This selective extraction reduces computational costs while maintaining real-time monitoring capabilities for critical events.

Inventive Principle:

Principle #2Taking out (Extraction)

3Loss of information

If trace data from all virtual network functions is processed centrally, then comprehensive network visibility is achieved, but the system does not scale well with increasing data volumes

Engineering Contradiction:

Improvenetwork visibilityVSAvoidscalability

Core Design Contradiction:

Loss of informationVSAdaptability or versatility

Solution Approach 1:

The patent implements a hierarchical segmented architecture where zone-level stream processing systems handle local trace data and forward aggregated or filtered data to regional systems. This segmentation enables the system to scale horizontally by adding more zone-level processors without overwhelming a central system, while maintaining comprehensive network visibility through the distributed processing network.

Inventive Principle:

Principle #1Segmentation

4Reliability

If a parallel passive probe infrastructure is built to monitor network functions, then network monitoring is enabled, but the infrastructure consumes significant network resources and lacks flexibility

Engineering Contradiction:

Improvenetwork monitoring capabilityVSAvoidflexibility

Core Design Contradiction:

ReliabilityVSAdaptability or versatility

Solution Approach 1:

The patent implements dynamic filtering and forwarding policies that can be adjusted based on network conditions, event types, and priority levels. The stream processing systems can dynamically subscribe to different topics and apply different processing rules, providing flexibility that static probe infrastructures cannot achieve.

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The stream processing systems are designed to handle multiple types of trace data from various virtual network functions through a unified architecture. They can process different event types, apply different filtering rules, and forward data to multiple destinations, making the infrastructure versatile and adaptable to different monitoring needs.

Inventive Principle:

Principle #6Universality (Multi-functionality)

Data Source

PatentUS11616713B2Next generation network monitoring architecture

Publication Date: 2023.03.28 AT&T INTELLECTUAL PROPERTY I L P

AI summary

A stream processing system in a first zone of a telecommunication network may obtain at least one policy for processing trace data of virtual network functions (VNFs) in the first zone, and obtain the trace data of the VNFs from a data distribution platform of the telecommunication network, where the trace data is published in accordance with a topic to the data distribution platform by the VNFs, and where the stream processing system comprises a subscriber to the topic. The first stream processing system may additionally forward at least a first portion of the trace data to a second stream processing system of the telecommunication network in accordance with the at least one policy, where the first portion comprises less than all of the trace data, and where the second stream processing system is for a region of the telecommunication network that includes the first zone and a second zone.