IPFIX Protocol Extension for Hierarchical Structured Data Export
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current networking technologies, such as IPFIX and NetFlow, are limited in their ability to efficiently export and manage complex, hierarchical structured data and lists, as they primarily support 'flat' data records, which are inadequate for new network management applications requiring the export of repeated and variable data from devices like routers and firewalls.
Innovation Solution
An extension to the IPFIX protocol and NetFlow is introduced to support hierarchical structured data and variable-length lists, enabling the definition of complex data structures and templates that can represent structured relationships, allowing for the efficient export and interpretation of data records across network devices and management stations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If flat data records are used for exporting network data, then the data structure is simple and easy to process, but the system cannot efficiently represent complex hierarchical structured data and variable-length lists required by new network management applications
Solution Approach 1:
The patent implements nested data structures where templates can contain other templates, and data records can contain nested lists and hierarchical elements. This allows complex hierarchical structured data to be represented by nesting simpler structures within each other, enabling the expression of complex network management data while maintaining manageable structure through recursive definition of template and data record formats
Solution Approach 2:
The patent segments complex data structures into modular templates and data records. Each template defines a specific structure that can be independently defined and reused, and data records are segmented into fields that reference these templates. This segmentation allows complex hierarchical data to be broken down into manageable, reusable components that can be processed individually while maintaining their hierarchical relationships
2Productivity
If traditional flat data export methods are used, then bandwidth consumption is lower for simple data, but the system cannot aggregate metrics into a single flow record efficiently
Solution Approach 1:
The patent merges multiple metrics and data elements into a single aggregated flow record by using templates that can contain multiple fields and nested structures. Instead of exporting separate records for each metric, the system combines related metrics into hierarchical structures within a single data record, reducing the total number of records transmitted and optimizing bandwidth utilization while maintaining data integrity
3Adaptability or versatility
If the protocol is extended to support hierarchical structured data, then advanced applications like intrusion detection and security analysis are enabled, but the protocol complexity increases
Solution Approach 1:
The patent creates a universal template and data record structure that can serve multiple network management functions including intrusion detection, security analysis, and general network monitoring. The hierarchical template system provides a multi-functional framework that can represent various types of network data through configuration rather than requiring separate protocols for different applications, thereby enabling advanced applications while maintaining a unified protocol structure
Data Source
AI summary
An apparatus is provided in one example embodiment and includes a network element configured to receive a plurality of packets. The network element is configured to couple to a module, the module being configured to generate a data record that is based on information associated with the packets and capable of being interpreted according to a template in which multiple information elements can be positioned to create a hierarchical relationship within structured data. The structured data further includes references to the information elements. The network element further including an export module configured to export the data record to a next destination.