Web Server Log Parsing for Centralized Performance Metrics

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Web traffic simulators fail to provide realistic and comprehensive data on web server performance, limiting their usefulness in capacity planning and analysis, as they cannot accurately mimic real-user interactions and often lack real-world transaction volume and variety.

Innovation Solution

A system and method for accessing log file information from a web server, parsing it to generate performance metrics such as request counts, error rates, response times, and service level objective compliance on a per-page basis, and storing these metrics in a centralized database for offline analysis.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If web traffic simulators are used to analyze web server performance, then performance analysis can be conducted, but the data provided is not realistic and lacks real-world transaction volume

Engineering Contradiction:

Improverealism of performance dataVSAvoidtransaction volume

Core Design Contradiction:

ReliabilityVSQuantity of substance

Solution Approach 1:

The patent uses actual web server log files as copies of real user interactions instead of simulated traffic. The log files contain authentic transaction data, request patterns, and user behavior that accurately reflect real-world usage, thereby providing realistic performance data with genuine transaction volumes.

Inventive Principle:

Principle #26Copying

2Adaptability or versatility

If web traffic simulators are used, then performance analysis is possible, but the types of transactions are limited and cannot perform transactions that real users could perform

Engineering Contradiction:

Improvetransaction varietyVSAvoidaccuracy of performance data

Core Design Contradiction:

Adaptability or versatilityVSReliability

Solution Approach 1:

Instead of using a simulator to generate transactions, the patent inverts the approach by directly analyzing log files that contain actual transactions performed by real users. This inversion captures the full diversity of real user actions, including edge cases and unusual transaction patterns that simulators cannot replicate.

Inventive Principle:

Principle #13The other way round (Inversion)

3Productivity

If web server performance metrics are collected in real-time, then performance monitoring is achieved, but it impacts web server operations

Engineering Contradiction:

Improveperformance monitoring capabilityVSAvoidweb server operational stability

Core Design Contradiction:

ProductivityVSReliability

Solution Approach 1:

The patent collects performance metrics by analyzing log files that have already been written to disk, rather than intercepting requests in real-time. This preliminary action of logging occurs independently of the performance analysis, allowing metrics collection without impacting web server operations or requiring additional runtime overhead.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The log file acts as an intermediary between web server operations and performance analysis. The web server writes transactions to the log file independently, and the performance analysis system reads and analyzes these logs separately, eliminating direct interference between monitoring and operations.

Inventive Principle:

Principle #24Intermediary (Mediator)

4Ease of operation

If performance metrics are stored in a centralized database, then offline analysis is facilitated, but data collection complexity increases

Engineering Contradiction:

Improveoffline analysis capabilityVSAvoiddata collection system complexity

Core Design Contradiction:

Ease of operationVSDevice complexity

Solution Approach 1:

The patent uses a standardized database schema that can store multiple types of performance metrics (response times, transaction volumes, error rates, resource utilization) in a unified structure. This universal data model simplifies offline analysis by providing consistent access to diverse metrics without requiring separate storage systems for each metric type.

Inventive Principle:

Principle #6Universality (Multi-functionality)

Data Source

PatentUS9330051B1Collection of web server performance metrics to a centralized database for reporting and analysis

Publication Date: 2016.05.03 T MOBILE INNOVATIONS LLC

AI summary

Systems, methods, and computer-readable media are provided for, among other things, generating web server performance metrics from log file information and storing the metrics offline in a centralized database. A collector accesses log file information from a log file for a web server and generates web server performance metrics on a per web page basis. The web server metrics include a number of requests for a web page, error count for the web page, average response time for the web page, total number of bytes transferred for the web page, and a number of times a service level objection for the web page was exceeded. The web server metrics are stored in a centralized database such that the metrics are available for offline web server performance reporting and analysis.