Log Analysis Apparatus Automatic Re-learning for Web Server Security
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional methods for detecting unknown attacks on Web servers require manual re-training when system specifications change, leading to burdensome operations and reduced accuracy in attack detection.
Innovation Solution
A log analysis apparatus and method that extracts parameters from access logs, learns their appearance frequencies, compares them with stored profiles, and determines attacks based on similarity thresholds, with a re-learning mechanism triggered when multiple user terminals exhibit low similarity, automatically updating the system to adapt to changes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If manual re-training is performed when system specifications change, then the system can adapt to changes, but operational burden increases and detection accuracy decreases
Solution Approach 1:
The system automatically detects when re-learning is needed by monitoring parameter similarity thresholds and autonomously initiates re-learning processes without requiring manual operator intervention. The log analysis apparatus self-manages the adaptation to system specification changes, eliminating the need for operators to manually re-train the system while maintaining high detection accuracy.
2Adaptability or versatility
If manual re-training is performed when system specifications change, then the system can adapt to changes, but detection accuracy decreases
Solution Approach 1:
The system continuously monitors the similarity between current access log parameters and learned profile parameters. When similarity falls below a threshold, the system automatically triggers re-learning. This feedback mechanism ensures the system adapts to system specification changes while maintaining high detection accuracy by re-training only when necessary, rather than relying on manual intervention that may be delayed or inconsistent.
3Ease of operation
If automatic re-learning is implemented, then operational burden is reduced, but system complexity increases
Solution Approach 1:
The automatic re-learning system is divided into distinct functional modules: a learning unit that extracts and profiles parameters from access logs, an analyzing unit that compares current parameters against profiles and determines attack likelihood, and a re-learning requirement determining unit that monitors similarity thresholds and triggers re-learning when needed. This segmentation manages system complexity by organizing functions into independent, well-defined components that can operate autonomously.
4Reliability
If continuous monitoring of parameter similarity is performed, then detection accuracy is maintained, but computational resources are consumed
Solution Approach 1:
The system performs parameter similarity monitoring and comparison operations periodically based on incoming access logs rather than continuously at fixed intervals. The re-learning process is triggered only when the similarity threshold is breached, making the computational effort periodic and event-driven. This approach maintains detection accuracy by continuously analyzing parameters while conserving computational resources by executing intensive re-learning operations only when necessary.
Data Source
AI summary
A log analysis apparatus extracts a parameter from an access log under analysis, acquires a similarity by comparing the parameter with the parameter included in the profile stored in a profile storage unit, and determines an access in the access log under analysis as an attack when the similarity is lower than a threshold. The log analysis apparatus takes a tally of the number of different requesting user terminals, for each parameter, among the access logs under analysis including a parameter not found in the profile, or having a similarity lower than the threshold, and determines, when there is any parameter for which the number of such different user terminals is equal to or higher than a threshold, to re-learn the parameter.


