AI Neural Network for Data Log Parsing

Solution Overview

Problem

Traditional data log processing systems are unable to handle the large volumes and varying formats of data logs generated by organizations, leading to potential security vulnerabilities due to dropped or lost data, and are not scalable to accommodate increasing data log traffic.

Innovation Solution

An AI-enabled system utilizing Natural Language Processing (NLP) and neural networks to parse and process data logs of known or unknown formats, including partial and degraded logs, enabling efficient handling and storage of data logs across different sources and formats.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If traditional data log processing systems are used, then system simplicity is maintained, but the system cannot handle large volumes of data logs and is not scalable

Engineering Contradiction:
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent replaces traditional mechanical data processing systems with an AI-based neural network system. The neural network automatically learns and adapts to parse data logs of unknown formats, eliminating the need for manual configuration and significantly increasing processing capacity while handling the complexity through intelligent algorithms rather than mechanical rules.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system changes the fundamental parameter of data processing by transitioning from rule-based parsing to AI-based learning. The neural network's ability to dynamically adjust its interpretation parameters allows it to handle varying data log formats and volumes, achieving both high productivity and adaptability without proportional increases in system complexity.

Inventive Principle:
Principle #35Parameter changes

2Reliability

If traditional data log processing systems are used, then implementation simplicity is maintained, but data loss occurs due to inability to handle data volume

Engineering Contradiction:
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent replaces traditional mechanical data processing systems with an AI-based neural network system. The neural network automatically learns and adapts to parse data logs of unknown formats, eliminating the need for manual configuration and significantly increasing processing capacity while handling the complexity through intelligent algorithms rather than mechanical rules.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Adaptability or versatility

If traditional data log processing systems are used, then system simplicity is maintained, but adaptability to new data log formats is poor

Engineering Contradiction:
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent replaces traditional mechanical data processing systems with an AI-based neural network system. The neural network automatically learns and adapts to parse data logs of unknown formats, eliminating the need for manual configuration and significantly increasing processing capacity while handling the complexity through intelligent algorithms rather than mechanical rules.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system changes the fundamental parameter of data processing by transitioning from rule-based parsing to AI-based learning. The neural network's ability to dynamically adjust its interpretation parameters allows it to handle varying data log formats and volumes, achieving both high productivity and adaptability without proportional increases in system complexity.

Inventive Principle:
Principle #35Parameter changes

4Productivity

If AI-enabled neural network system is used, then data processing capacity and reliability are improved, but system complexity increases

Engineering Contradiction:
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent replaces traditional mechanical data processing systems with an AI-based neural network system. The neural network automatically learns and adapts to parse data logs of unknown formats, eliminating the need for manual configuration and significantly increasing processing capacity while handling the complexity through intelligent algorithms rather than mechanical rules.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS20220138556A1Data log parsing system and method
Publication Date: 2022.05.05
  • US20220138556A1 patent drawing
  • US20220138556A1 patent drawing
  • US20220138556A1 patent drawing

AI summary

A method of processing data logs, a system for processing data logs, a method of training a system for processing data logs, and a processor are described. The method of processing data logs may include receiving a data log from a data source, where the data log is received in a format native to a machine that generated the data log. The method may also include providing the data log to a neural network trained to process natural language-based inputs, parsing the data log with the neural network, and receiving an output from the neural network, where the output is generated in response to the neural network parsing the data log. The method may also include storing the output from the neural network in a data log repository.