Web Request Classification Using ML Bot Categories

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing systems struggle to accurately distinguish between human and automated web requests and categorize bot traffic based on their nature, lacking the detail needed for informed decision-making on how to handle such traffic.

Innovation Solution

A method utilizing a machine learning engine to analyze web requests, assign bot categories, and determine confidence levels, enabling precise identification and categorization of bot sources based on historical data and supplementary information.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If existing systems use fixed criteria to identify bot traffic, then the system complexity remains low, but the measurement precision of bot categorization is insufficient

Engineering Contradiction:
Improvebot categorization accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent replaces fixed mechanical criteria-based bot identification with a machine learning engine that uses supervised learning algorithms. The machine learning engine analyzes multiple features from web requests (headers, behavior patterns, request characteristics) to categorize bots, substituting rigid rule-based systems with adaptive computational models that improve measurement precision while managing complexity through automated training processes.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent changes the parameters used for bot identification from simple fixed criteria to multiple dynamic features extracted from web requests. The system analyzes various parameters including HTTP headers, request patterns, timing information, and behavioral characteristics, transforming the identification process from single-parameter fixed thresholds to multi-parameter adaptive analysis, thereby improving categorization accuracy.

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If existing systems analyze only individual request information, then the processing speed is high, but the measurement precision of bot identification is limited

Engineering Contradiction:
Improvebot identification accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent implements preliminary action by pre-training machine learning models with historical web request data before deployment. The machine learning engine is trained in advance using supervised learning on labeled datasets containing various bot and human traffic patterns. This preliminary training enables the system to make rapid accurate classifications during actual operation without performing complex analysis in real-time, thus improving identification accuracy while maintaining processing speed.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent segments the bot identification process into distinct phases: feature extraction from web requests, input to machine learning engine, classification decision, and confidence level assignment. This segmentation allows the system to distribute computational complexity across multiple stages, with the machine learning engine handling the complex pattern recognition while other components manage data preparation and result interpretation, improving overall precision without excessive processing time.

Inventive Principle:
Principle #1Segmentation

3Adaptability or versatility

If no bot categorization is performed, then the ease of operation is high, but the adaptability to handle different bot types is poor

Engineering Contradiction:
Improvebot handling flexibilityVSAvoidoperational simplicity
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent implements universality by designing a machine learning engine that can categorize multiple types of bots using a single unified system. The engine handles diverse bot categories including web scrapers, credential stuffers, account takeover bots, and other automated traffic through the same supervised learning framework. This multi-functional approach provides adaptability to handle different bot types while maintaining ease of operation through centralized automated classification and confidence-based decision-making.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent incorporates feedback mechanisms where the machine learning engine assigns confidence levels to each bot categorization decision. This confidence feedback allows the system to adapt its handling of different bot types based on the certainty of classification. High-confidence classifications can be handled automatically with established policies, while lower-confidence cases can trigger additional verification or manual review, providing operational simplicity while maintaining high adaptability to various bot scenarios.

Inventive Principle:
Principle #23Feedback

Data Source

PatentEP4675462A1Method of processing web requests directed to a website
Publication Date: 2026.01.07 NETACEA LTD
  • EP4675462A1 patent drawingFigure 1
  • EP4675462A1 patent drawing
  • EP4675462A1 patent drawing

AI summary

A method of processing web requests directed to a website, the method including: (i) receiving a plurality of web requests directed to the website; (ii) for each of the plurality of web requests, identifying a source from which the web request has originated; (iii) for at least one web request identified as having originated from a given source: determining whether the source is a bot or a non-bot based on the at least one web request; if the source is determined to be a bot, using a machine learning engine to assign one of a plurality of predetermined bot categories to the source based on the at least one web request.