Data Stream Analysis System Using Tagged Fragment Aggregation

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current network traffic processing systems process data streams as independent events, preventing linkage between data fragments and requiring high memory for aggregation, leading to increased costs and potential information loss due to limited memory capacities.

Innovation Solution

A system comprising extraction and aggregation modules that tag and combine data fragments using a unitary tagging data model, allowing for scalable processing and structured data retrieval, with decoding and tagging units ensuring data fragments are linked and processed efficiently.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If data streams are processed as independent events without linkage, then processing simplicity is maintained, but the ability to link and analyze data fragments across events is lost

Engineering Contradiction:

Improveprocessing simplicityVSAvoiddata fragment linkage

Core Design Contradiction:

Ease of operationVSLoss of information

Solution Approach 1:

The system segments data processing into two distinct stages: event-level processing that maintains simplicity, and session-level processing that enables linkage. Extraction circuits process individual events independently, while aggregation circuits later combine these events into sessions to restore data fragment relationships.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent introduces session data as an intermediary structure between individual events. This session data acts as a mediator that preserves relationships between data fragments from different events without requiring complex real-time linkage processing during event extraction.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Measurement precision

If decoder-specific data models are used for each decoder type, then decoding accuracy is improved, but the ability to link and interpret data across different decoder types is lost

Engineering Contradiction:

Improvedecoding accuracyVSAvoiddata linkage across decoder types

Core Design Contradiction:

Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent creates a universal session data structure that can accommodate and integrate data from multiple decoder-specific data models. This session data model serves multiple functions: it preserves the semantic accuracy of individual decoder interpretations while providing a common framework for linking data across different decoder types through standardized fields like session ID and timestamp.

Inventive Principle:

Principle #6Universality (Multi-functionality)

3Loss of information

If all information is kept in decoder memory until end of data flow, then information completeness is maintained, but memory capacity requirements increase system costs

Engineering Contradiction:

Improveinformation completenessVSAvoidmemory capacity

Core Design Contradiction:

Loss of informationVSQuantity of substance

Solution Approach 1:

The patent segments the information storage function across two components: extraction circuits that maintain only essential event-level data in memory, and aggregation circuits that perform the complete information assembly. This segmentation reduces the memory burden on decoders while maintaining information completeness through the aggregation process.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The system performs preliminary processing at the event extraction stage, converting raw events into standardized extracted data with essential identifying information. This preliminary action prepares data for later aggregation without requiring the decoder to hold all raw information in memory, reducing memory requirements while preserving information completeness.

Inventive Principle:

Principle #10Preliminary action

4Productivity

If data is streamed continuously with limited memory aggregation, then processing speed is maintained, but information may be missed due to memory constraints

Engineering Contradiction:

Improveprocessing speedVSAvoidinformation completeness

Core Design Contradiction:

ProductivityVSLoss of information

Solution Approach 1:

The patent divides the aggregation function into two stages: extraction circuits perform lightweight, memory-efficient processing that maintains processing speed, while aggregation circuits perform comprehensive information assembly. This segmentation allows continuous streaming at high speed while ensuring complete information recovery through the second-stage aggregation.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

Extracted data serves as an intermediary representation that bridges the gap between high-speed event streaming and complete information aggregation. This intermediate format preserves essential linkage information in a compact form, enabling fast processing while maintaining the capability for complete information reconstruction during aggregation.

Inventive Principle:

Principle #24Intermediary (Mediator)

Data Source

PatentUS11755587B2System for analyzing and interpreting at least one data stream as well as method of combining data fragments

Publication Date: 2023.09.12 ROHDE & SCHWARZ GMBH & CO KG

AI summary

A system for analyzing and interpreting at least one data stream comprises at least two extraction modules and at least one aggregation module that is configured to receive tagged data fragments from the at least two extraction modules. The aggregation module is configured to combine the tagged data fragments received from the at least two extraction modules to one session data. Further, a method of combining data fragments is described.