Log Data Processing System with Automated Level Correction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Debugging application failures in server systems is inefficient due to the manual processing of large amounts of log data, which requires automated solutions for filtering and correcting log data to identify and resolve errors.

Innovation Solution

A server system with a log server that processes log data by extracting information, filtering based on log levels, correcting level information mismatches, and generating inferred solutions using AI algorithms to automatically diagnose and solve errors.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If manual processing of log data is used, then error diagnosis can be performed, but processing efficiency is low and time consumption is high

Engineering Contradiction:
Improvelog data processing efficiencyVSAvoidtime for error diagnosis
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The system performs automatic log level correction without human intervention. The correction unit autonomously identifies mismatches between log levels and log events, applies appropriate corrections based on predefined rules, and generates correction results, eliminating the need for manual processing while maintaining high accuracy in error diagnosis.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces manual mechanical processing of log data with an automated electronic system. The processing unit, filtering unit, and correction unit work together to automatically filter, analyze, and correct log data, substituting human operators with a computational system that processes logs much faster and more efficiently.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Reliability

If all log data is processed, then comprehensive error analysis is achieved, but processing complexity and resource consumption increase

Engineering Contradiction:
Improvecompleteness of error analysisVSAvoidprocessing system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The filtering unit extracts only the necessary log data that matches specific criteria or contains potential errors. Instead of processing all log data, the system selectively filters and extracts relevant portions, reducing processing complexity while maintaining comprehensive error analysis for the extracted subset.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The log processing system is divided into distinct functional modules: a filtering unit that separates relevant logs, a processing unit that analyzes them, and a correction unit that fixes issues. This segmentation allows each module to handle specific tasks efficiently, reducing overall system complexity while maintaining thorough error analysis capabilities.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentEP3535665B1Methods and systems for processing log data
Publication Date: 2023.09.13 ZHEJIANG DAHUA TECH CO LTD
  • EP3535665B1 patent drawingFigure 1~2
  • EP3535665B1 patent drawingFigure 3~4
  • EP3535665B1 patent drawingFigure 5

AI summary

A method for processing log data in a server system is disclosed. The method includes: extracting level information associated with the log data, wherein the level information comprises at least one log level indicative of severity of a log event; filtering the log data based at least in part on the level information to generate filtered log data; and correcting, using a processor, the level information in response to determining that the level information of the filtered log data does not match the log event.