Network Counter Logging via Skip and Differential Recording
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current network monitoring solutions face challenges in efficiently and accurately logging network traffic data without overburdening processor and storage resources, often resulting in lossy data recording that is insufficient for comprehensive diagnostic and performance analysis.
Innovation Solution
The implementation of a 'skip' and 'differential' recording technique, where unchanged counter values are skipped and only the difference is stored, along with timestamps, to reduce storage requirements and maintain accurate logging of network traffic data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If all network traffic data is recorded comprehensively, then diagnostic accuracy and performance analysis capability are improved, but storage resource requirements and processing burden increase significantly
Solution Approach 1:
The patent extracts only the essential and changing elements from the complete network traffic data. By identifying and recording only counter changes rather than all data points, it separates the useful diagnostic information from the redundant data, achieving comprehensive monitoring with reduced storage requirements
Solution Approach 2:
The patent transforms the recording approach by changing from absolute value recording to differential value recording. It records the change in counter values (deltas) rather than the absolute values themselves, which significantly reduces the amount of data stored while preserving all diagnostic information needed for accurate network analysis
2Quantity of substance
If data compression algorithms are applied to reduce storage requirements, then storage resource usage is reduced, but processor compute burden increases significantly
Solution Approach 1:
The patent performs preliminary processing at the data generation point by the network device itself. The device proactively identifies counter changes and prepares differential values before transmission, eliminating the need for computationally intensive compression algorithms at the analyzing device and reducing overall processor burden
Solution Approach 2:
The network device performs self-service by autonomously monitoring its own counter values and identifying changes. It independently determines what data to record and in what format, eliminating the need for external compression processing and reducing the compute burden on analyzing devices
3Quantity of substance
If selective recording of data portions is implemented, then processor and storage resource strain is reduced, but data completeness and diagnostic robustness deteriorate
Solution Approach 1:
The patent ensures continuous monitoring and recording of all counter changes without interruption or selective sampling. By continuously tracking and recording every counter change event, it maintains complete diagnostic information while reducing resource strain through efficient differential encoding rather than selective data exclusion
Solution Approach 2:
The patent introduces differential values as an intermediary representation of the actual counter data. This intermediary form preserves all diagnostic information while requiring significantly less storage space, acting as a lossless compression mechanism that maintains data completeness without sacrificing diagnostic robustness
4Measurement precision
If frequent timestamp recording is performed to capture accurate traffic patterns, then measurement granularity and analysis capability are improved, but processing overhead and storage requirements increase
Solution Approach 1:
The patent extracts only the timestamp information associated with counter changes rather than recording timestamps for all data points. By focusing only on moments when actual network traffic changes occur, it maintains precise traffic pattern capture while significantly reducing processing overhead and storage requirements compared to continuous timestamp recording
Data Source
AI summary
The present invention is directed towards “skip” and “differential” recording techniques for recording values of network parameter to a log in a lossless manner while reducing storage resources used to record such values. The counter monitor of the present invention monitors and records values of counters at time intervals to generate a counter log provided via temporary or permanent storage. The counter monitor compares a reading of the value of the counter to a previously obtained value of the counter. If the value of the counter has not changed, the counter monitor records only the timestamp to the counter log, thereby “skipping” the recording of the unchanged value. If there is any change in the value of the counter, then the change in value of the counter, i.e., a “differential” value, along with the timestamp is stored in the counters log. To further reduce storage resource usage, the counter monitor also stores changes to the timestamps as differential changes in time values.