Serial Module Chain for Automatic Data Stream Configuration
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current network traffic processing systems process data streams independently, lacking linkage between events, and require decoder-specific data models, leading to high memory consumption and increased costs due to incomplete aggregation and limited memory capacities.
Innovation Solution
A system with a serial module chain comprising data processing modules that automatically configure themselves using capability information, enabling efficient data processing and aggregation through a unified tagging data model, allowing for structured data output and reducing memory requirements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a decoder keeps all information gathered until the end of the data flow to avoid missing information, then measurement precision is improved, but device complexity increases due to high memory capacities required
Solution Approach 1:
The system segments the data processing function across multiple decoder units, each handling specific data streams or protocols. This distribution eliminates the need for a single decoder to maintain all information in memory, as each unit processes its assigned data independently and forwards results to the database.
Solution Approach 2:
A centralized database acts as an intermediary between multiple decoder units, collecting and storing data from all decoders. This mediator enables complete data aggregation without requiring any single decoder to maintain high memory capacity, as the database consolidates information from all sources.
2Adaptability or versatility
If decoder-specific data models are used for each decoder type, then adaptability is improved, but device complexity increases due to multiple data models required
Solution Approach 1:
The system employs a universal data model structure that can accommodate multiple decoder types and protocols. The database is designed to store data from various decoders using a common schema, eliminating the need for separate decoder-specific data models while maintaining adaptability to different decoder capabilities.
Solution Approach 2:
The system allows parameter changes in the data model to accommodate different decoder types. By using configurable parameters and metadata descriptors, the universal data model can adapt to various decoder-specific requirements without requiring separate rigid data models for each decoder type.
3Speed
If data is processed individually and independently without linkage between events, then processing speed is improved, but measurement precision deteriorates due to inability to link data from several events
Solution Approach 1:
The centralized database serves as an intermediary that receives data from multiple independent decoders and establishes linkages between related events. While decoders process data independently at high speed, the database correlates and links data from different events based on identifiers and relationships, enabling precise analysis without sacrificing processing speed.
Solution Approach 2:
The system adds a temporal and relational dimension to data processing by storing timestamped data in the database with metadata descriptors. This allows independent parallel processing to occur in the time domain, while event linkage is established in the relational domain through database queries and correlations.
Data Source
Figure 1
Figure 2~4
Figure 5~6
AI summary
A system (10) for analyzing and interpreting at least one data stream comprises a plurality of modules (12), at least one of which is a management module (14) that comprises a user interface. The system (10) comprises several data processing modules (16) that are arranged in a serial module chain (18) with an input (20) and an output (22). The input (20) of the module chain (18) is configured to receive interception data, wherein the output (22) of the module chain (18) is configured to output structured interception data. The serial module chain (18) is configured to process the data only in direction from the input (20) to the output (22). The system (10) is configured to forward capability information of a single data processing module (16) in the serial module chain (18) in data flow direction for configuration of the data processing modules (16). Further, a method of automatic configuration of a system for analyzing and interpreting at least one data stream.