Progressive Charting Network Traffic Flow Data
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional methods for reporting on network traffic flow data are inefficient, leading to slow query execution times, which can be costly and hinder timely troubleshooting in large and complex networks.
Innovation Solution
A system that improves responsiveness by sending incremental charts as segmented queries are executed, focusing on the most resource-consuming entities and generating results incrementally, allowing for immediate feedback and significantly reducing initial response times.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of time
If traditional methods are used to report on network traffic flow data, then complete and accurate reporting is achieved, but query execution time becomes unacceptably slow
Solution Approach 1:
The patent divides the network traffic data into hierarchical groups (by protocol, then by entity within each protocol) and processes segments incrementally. The system first identifies and reports top protocols, then drills down into specific entities within those protocols, delivering partial results in a structured sequence rather than waiting for complete data processing.
Solution Approach 2:
The system performs preliminary identification and ranking of protocols and entities before generating detailed reports. By pre-processing data to identify top consumers and organizing it hierarchically, the system can deliver initial high-value insights quickly while continuing to process remaining data in the background.
2Productivity
If hardware improvements are made to handle larger datasets, then data processing capacity increases, but system complexity and cost increase
Solution Approach 1:
The patent segments the data processing workload into manageable hierarchical levels (protocols → entities → individual flows). This segmentation allows the system to process and report data at each level independently, improving throughput without requiring proportional increases in overall system capacity or complexity.
Solution Approach 2:
The system delivers partial results incrementally rather than waiting for complete processing. By providing initial reports on top protocols and entities while continuing background processing, the system achieves effective productivity improvement without requiring the entire system to operate at maximum capacity simultaneously.
3Loss of time
If complete charts are generated before delivery, then reporting accuracy is ensured, but initial response time increases
Solution Approach 1:
The patent segments the reporting process into hierarchical phases (protocol-level summary → entity-level details → individual flow data). Each segment is processed and delivered in sequence, allowing the system to provide accurate high-level insights quickly while progressively adding detailed information, rather than waiting for complete processing of all data levels.
Solution Approach 2:
The system performs preliminary processing to identify and report top protocols and entities before delivering complete detailed charts. This preliminary action provides accurate high-value information immediately, with the understanding that additional detailed data will follow, thus reducing initial response time while maintaining reporting accuracy for the most critical information.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Embodiments of the invention include an apparatus, method, and computer program for progressive charting of network traffic flow data. The method includes, in one example, receiving, at a network traffic analyzer, a query of network traffic flow data over a certain time period. The method further includes modifying the query to produce sub-queries each based on different segments of time within the certain time period, executing at least one of the sub-queries, and incrementally outputting results of each of said executed sub-queries as each of the sub-queries are completed.