Fuzzy Classification for Web Security Scanner Response Matching

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Web application security scanning faces challenges in efficiently identifying vulnerabilities due to the complexity and variability of HTTP responses, making it difficult to distinguish between authorized and unauthorized access, especially in dynamic and interactive applications.

Innovation Solution

Implementing fuzzy classification processes in web application security scanners to compare and match HTTP responses, using techniques like Local Sensitive Hashes, Bayesian Inference, and Support Vector Machines, to determine whether responses are 'close' or 'of the same type', even when they are not identical, thereby detecting vulnerabilities such as masked error pages and state changes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If traditional exact matching methods are used to compare HTTP responses, then the matching process is simple and fast, but it fails to detect vulnerabilities in dynamic web applications where responses vary even for the same input

Engineering Contradiction:
Improvevulnerability detection accuracyVSAvoidresponse comparison complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent transforms the response comparison problem from exact string matching to fuzzy classification by changing the parameters used for comparison. Instead of comparing responses byte-by-byte, the system extracts features (parameters) from responses and uses machine learning classifiers to determine similarity. This allows detection of vulnerabilities in dynamic applications where responses vary but maintain characteristic patterns.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent replaces the mechanical exact matching system with a classification-based system using machine learning algorithms (C4.5 decision trees, Naive Bayes, Support Vector Machines). This substitution enables the system to handle the complexity of dynamic web application responses while maintaining automated operation.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Reliability

If fuzzy classification models are implemented to handle response variability, then vulnerability detection accuracy improves, but the processing time and computational resources increase

Engineering Contradiction:
Improveresponse matching accuracyVSAvoidscan processing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent performs preliminary actions by pre-processing responses to extract relevant features before classification. The system identifies and extracts key parameters from HTTP responses (headers, status codes, content patterns) that are most indicative of vulnerability types. This pre-extraction reduces the complexity of the actual classification task and speeds up processing.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent segments the response comparison task into multiple stages: feature extraction, classification model application, and vulnerability determination. Different classification models (C4.5, Naive Bayes, SVM) can be applied to different types of responses or vulnerability categories, allowing parallel processing and optimized resource utilization.

Inventive Principle:
Principle #1Segmentation

3Adaptability or versatility

If multiple classification models are used to improve detection coverage, then the ability to detect different vulnerability types increases, but the system complexity and resource requirements increase

Engineering Contradiction:
Improvevulnerability type coverageVSAvoidclassification system complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent implements a universal classification framework where multiple classification models (C4.5 decision trees, Naive Bayes, Support Vector Machines) can be applied to the same set of extracted features. Each model serves multiple vulnerability detection purposes, and the system can select or combine models based on the specific vulnerability type being detected, reducing overall system complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent uses template-based approaches where known vulnerability patterns are captured as templates. The classification models compare actual responses against these templates, allowing the system to detect known vulnerability types efficiently while maintaining the ability to adapt to new patterns through learning.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS8621639B1Using fuzzy classification models to perform matching operations in a web application security scanner
Publication Date: 2013.12.31 BLACK DUCK SOFTWARE INC
  • US8621639B1 patent drawing
  • US8621639B1 patent drawing
  • US8621639B1 patent drawing

AI summary

A system provides for fuzzy classification in comparisons of scanner responses. A web application test suite performs tests against a web application by sending client requests from a testing computer to the server running the web application and checking how the web application responds. A thorough web application security scan might involve thousands of checks and responses. As a result, some sort of programmatic analysis is needed. One such evaluation involves comparing one response against another. Response matching that compares two HTTP responses might use fuzzy classification processes.