Digital Data Packet Filtering via Metadata Schema

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing data processing systems face inefficiencies due to the need to process large amounts of raw data, which can slow down system response time and require unnecessary processing of repetitive or unwanted information.

Innovation Solution

A system and method for filtering and altering digital data packets in real time using a user-defined metadata schema, converting raw data into a common format, and storing filtered packets, with options to modify or drop data and generate alerts based on predefined criteria.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If all raw data is processed without filtering, then complete data is available for analysis, but system response time slows down and processing efficiency decreases

Engineering Contradiction:
Improvedata completenessVSAvoidsystem response time
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent applies preliminary action by implementing a filter that preprocesses incoming data packets before they enter the main processing pipeline. The filter converts raw data to a common format and applies filtering criteria in advance, so that only relevant data packets are passed to the processing system. This preliminary filtering action resolves the contradiction by preparing data upfront, ensuring completeness of relevant data while improving response time by eliminating unnecessary processing of irrelevant packets.

Inventive Principle:
Principle #10Preliminary action

2Loss of information

If all incoming data packets are processed, then no data is lost, but processing resources are wasted on repetitive or unwanted information

Engineering Contradiction:
Improvedata lossVSAvoidprocessing resources
Core Design Contradiction:
Loss of informationVSLoss of energy

Solution Approach 1:

The patent applies the extraction principle by using a filter to separate relevant data packets from irrelevant ones. The filter extracts only the data packets that meet predefined criteria (based on data type, source, or content) and passes them to the processing system, while discarding repetitive or unwanted information. This resolves the contradiction by extracting necessary information to prevent data loss while eliminating waste of processing resources on unnecessary packets.

Inventive Principle:
Principle #2Taking out (Extraction)

3Productivity

If data filtering is implemented using a metadata schema, then processing efficiency improves, but system complexity increases

Engineering Contradiction:
Improvedata processing efficiencyVSAvoidfiltering system complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent applies parameter changes by implementing a configurable metadata schema with adjustable filtering parameters. The system allows users to define and modify filtering criteria (data types, sources, patterns) without changing the underlying system architecture. This resolves the contradiction by enabling efficient filtering through parameter configuration rather than structural complexity, maintaining productivity while managing system complexity through flexibility and ease of adjustment.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS9692856B2System and method for filtering and alteration of digital data packets
Publication Date: 2017.06.27 CA TECH INC
  • US9692856B2 patent drawing
  • US9692856B2 patent drawing
  • US9692856B2 patent drawing

AI summary

A method comprises receiving data from a data source and converting the data, in approximately real time, into digital data packets, wherein the data packets have a common format. The method further comprises filtering the data packets using a user-defined metadata schema and storing the filtered data packets into a data storage medium.