IP Network Data Extraction State Machine
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current IP packet analyzers are not well-suited for real-time observation of multiple data streams due to the need for entire stream extraction and modification upon protocol changes, making them inefficient for high-speed IP networks.
Innovation Solution
A method using a state machine configured with states and transitions based on application layer protocol rules for real-time data extraction, allowing selective data extraction and buffering to manage data fragmentation, enabling efficient extraction of targeted information from IP network streams.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If entire stream extraction is performed for real-time analysis, then complete data analysis capability is achieved, but processing speed and efficiency deteriorate due to the enormous mass of data
Solution Approach 1:
The patent extracts only the relevant portions of data streams that match specified criteria rather than analyzing entire streams. The system identifies and extracts specific data elements based on protocol rules and patterns, discarding irrelevant data to achieve both completeness of relevant analysis and speed of processing
Solution Approach 2:
The data stream analysis is segmented into discrete protocol elements and structures. The system divides the continuous data stream into protocol-specific components (headers, payloads, specific fields) and processes only those segments that match the analysis criteria, rather than treating the entire stream as a monolithic entity
2Measurement precision
If protocol-specific analyzers are modified to accommodate protocol changes, then analysis accuracy is maintained, but device complexity and maintenance burden increase
Solution Approach 1:
The patent creates a universal protocol analysis framework that can handle multiple protocols and their variations through a single system. The framework uses protocol-agnostic pattern matching and rule-based analysis that can be configured to work with different protocols without requiring fundamental changes to the analyzer architecture
Solution Approach 2:
The analysis system is designed to be dynamic and adaptive to protocol changes. Rather than static protocol-specific analyzers that require modification when protocols change, the system dynamically adjusts its analysis patterns and rules based on the detected protocol type and version, allowing it to accommodate protocol evolutions without structural changes
3Reliability
If real-time extraction of entire streams is performed, then complete observation capability is achieved, but data processing overload increases making it unsuitable for high-speed networks
Solution Approach 1:
The system extracts only the necessary data elements from high-speed streams in real-time, removing irrelevant data before further processing. This selective extraction approach maintains reliable observation of target information while dramatically reducing the processing load and energy consumption associated with handling entire data streams
Data Source
Figure 1~2
Figure 3~4
AI summary
In a phase of configuration, a state machine (20) is constructed with states and transitions configured according to at least one type of data to be extracted from a data stream travelling around an IP network. The transitions between states are activated by conditions defined as a function of rules of organization of the data of the stream according to an application layer protocol. One or more states are moreover selected for the extraction of data from the stream. Thereafter, in a phase of real-time analysis of the stream, the stream data arising from IP packets travelling successively around the network are observed. When the state machine is in a current state, a search is conducted as to whether a condition of activation of a transition to a target state is realized by the data observed from the stream, and when such an activation condition is realized, the state machine is toggled into the target state. The data from the stream are extracted when the state machine is in a state selected in the configuration phase.