Network Traffic Characterization Using Bloom Filters and Dimensional Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current techniques are inadequate for generating comprehensive profiles of network traffic behaviors and communication patterns in large networks, particularly in identifying significant communication patterns from vast quantities of data, which is crucial for managing and securing networks against cyber-attacks and disruptive applications.
Innovation Solution
A method involving the acquisition of flow data records, generation of unidimensional traffic clusters, population of a dynamic Bloom filter, identification of clusters of interest, and optional multidimensional processing to characterize network traffic, enabling efficient compression and concise traffic reporting.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If comprehensive traffic profiling is performed on large networks, then understanding of network traffic behaviors is improved, but processing complexity and data volume increase
Solution Approach 1:
The patent segments the traffic analysis process into multiple dimensions (unidimensional clusters first, then multidimensional lattice). It divides the complex task of comprehensive traffic profiling into manageable steps: acquiring flow data, generating unidimensional clusters, compressing them, and only then performing multidimensional processing when needed. This segmentation reduces processing complexity while maintaining comprehensive understanding capability.
Solution Approach 2:
The patent transitions from unidimensional clustering to multidimensional lattice processing. It first processes traffic data in one dimension to create clusters, then organizes these clusters into a multidimensional lattice structure that enables comprehensive traffic behavior understanding. This dimensional transition allows the system to handle complex traffic patterns efficiently by building upon simplified unidimensional representations.
2Measurement precision
If multidimensional processing is performed on all traffic data, then traffic pattern identification accuracy is improved, but processing time and computational resources increase
Solution Approach 1:
The patent performs preliminary unidimensional clustering and compression before multidimensional processing. It pre-processes the traffic data to generate and compress unidimensional traffic clusters, creating a simplified representation that can be efficiently processed in subsequent multidimensional operations. This preliminary action reduces the amount of data that needs to be processed in the more time-consuming multidimensional stage.
Solution Approach 2:
The patent applies partial multidimensional processing only when necessary, determined by alert signature priority. Instead of performing comprehensive multidimensional analysis on all traffic data, it selectively applies the more resource-intensive processing only to high-priority alerts, achieving sufficient pattern identification accuracy for critical security events while avoiding unnecessary processing time consumption for lower-priority traffic.
3Productivity
If flow data is compressed to reduce data size, then storage requirements and processing efficiency are improved, but information loss may occur
Solution Approach 1:
The patent changes the representation parameters of traffic data through compression. It transforms detailed flow records into compressed unidimensional nodes that capture essential traffic characteristics using aggregated parameters. This parameter transformation maintains the critical information needed for traffic behavior understanding and pattern identification while significantly reducing data size and improving processing efficiency.
Data Source
AI summary
A method for network traffic characterization is provided. Flow data records are acquired associated with a security alert signature. Unidimensional traffic clusters are generated based on the acquired data. A Bloom filter is populated with the acquired flow data records. Clusters of interest are identified from the generated unidimensional traffic clusters. The identified clusters of interest are compressed into a compressed set. A determination is made whether a multidimensional processing of the acquired flow data needs to be performed based on a priority associated with the alert signature. A multidimensional lattice corresponding to the unidimensional traffic clusters is generated. The multidimensional lattice is traversed and for each multidimensional node under consideration a determination is made if the Bloom filter contains flow records matching the multidimensional node under consideration. A determination is made if the unidimensional node corresponding to the multidimentional node is included in the compressed set of unidimensional nodes.


