Log Analysis Apparatus Automatic Re-learning for Web Server Security

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional methods for detecting unknown attacks on Web servers require manual re-training when system specifications change, leading to burdensome operations and reduced accuracy in attack detection.

Innovation Solution

A log analysis apparatus and method that extracts parameters from access logs, learns their appearance frequencies, compares them with stored profiles, and determines attacks based on similarity thresholds, with a re-learning mechanism triggered when multiple user terminals exhibit low similarity, automatically updating the system to adapt to changes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If manual re-training is performed when system specifications change, then the system can adapt to changes, but operational burden increases and detection accuracy decreases

Engineering Contradiction:
Improvesystem adaptabilityVSAvoidoperational burden
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The system automatically detects when re-learning is needed by monitoring parameter similarity thresholds and autonomously initiates re-learning processes without requiring manual operator intervention. The log analysis apparatus self-manages the adaptation to system specification changes, eliminating the need for operators to manually re-train the system while maintaining high detection accuracy.

Inventive Principle:
Principle #25Self-service

2Adaptability or versatility

If manual re-training is performed when system specifications change, then the system can adapt to changes, but detection accuracy decreases

Engineering Contradiction:
Improvesystem adaptabilityVSAvoiddetection accuracy
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The system continuously monitors the similarity between current access log parameters and learned profile parameters. When similarity falls below a threshold, the system automatically triggers re-learning. This feedback mechanism ensures the system adapts to system specification changes while maintaining high detection accuracy by re-training only when necessary, rather than relying on manual intervention that may be delayed or inconsistent.

Inventive Principle:
Principle #23Feedback

3Ease of operation

If automatic re-learning is implemented, then operational burden is reduced, but system complexity increases

Engineering Contradiction:
Improveoperational burdenVSAvoidsystem complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The automatic re-learning system is divided into distinct functional modules: a learning unit that extracts and profiles parameters from access logs, an analyzing unit that compares current parameters against profiles and determines attack likelihood, and a re-learning requirement determining unit that monitors similarity thresholds and triggers re-learning when needed. This segmentation manages system complexity by organizing functions into independent, well-defined components that can operate autonomously.

Inventive Principle:
Principle #1Segmentation

4Reliability

If continuous monitoring of parameter similarity is performed, then detection accuracy is maintained, but computational resources are consumed

Engineering Contradiction:
Improvedetection accuracyVSAvoidcomputational resources
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The system performs parameter similarity monitoring and comparison operations periodically based on incoming access logs rather than continuously at fixed intervals. The re-learning process is triggered only when the similarity threshold is breached, making the computational effort periodic and event-driven. This approach maintains detection accuracy by continuously analyzing parameters while conserving computational resources by executing intensive re-learning operations only when necessary.

Inventive Principle:
Principle #19Periodic action

Data Source

PatentUS12160432B2Log analysis apparatus, log analysis method, and log analysis program
Publication Date: 2024.12.03 NIPPON TELEGRAPH & TELEPHONE CORP
  • US12160432B2 patent drawing
  • US12160432B2 patent drawing
  • US12160432B2 patent drawing

AI summary

A log analysis apparatus extracts a parameter from an access log under analysis, acquires a similarity by comparing the parameter with the parameter included in the profile stored in a profile storage unit, and determines an access in the access log under analysis as an attack when the similarity is lower than a threshold. The log analysis apparatus takes a tally of the number of different requesting user terminals, for each parameter, among the access logs under analysis including a parameter not found in the profile, or having a similarity lower than the threshold, and determines, when there is any parameter for which the number of such different user terminals is equal to or higher than a threshold, to re-learn the parameter.