URL Categorization Classifier With Noise-Elimination Training

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing policy enforcement systems struggle to effectively manage and secure cloud-based data access due to the dynamic and unpredictable nature of cloud applications, leading to challenges in enforcing unified security policies across diverse protocols and endpoints, with issues such as data leakage and misclassification of websites posing risks to organizational security and productivity.

Innovation Solution

A machine learning-based URL categorization classifier is developed to classify websites into categories, utilizing a multi-step training process to eliminate noise and implement post-processing rules, combined with offline and inline databases to enhance accuracy and resource efficiency, enabling unified policy enforcement across cloud-based environments.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a machine learning-based URL categorization system is implemented to improve security policy enforcement, then website classification accuracy is improved, but the system complexity and computational resources required for training and deployment increase

Engineering Contradiction:
Improvewebsite classification accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The URL categorization system is divided into multiple independent components: a training module that processes training data and generates training outputs, a classifier module that performs actual URL classification, and a policy enforcement module that applies security policies. This segmentation allows each component to be optimized independently and deployed separately, reducing overall system complexity while maintaining high classification accuracy through specialized processing in each module.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces intermediary components such as a data preprocessing layer that cleans and prepares training data before it reaches the classifier, and a post-processing layer that refines classification results before policy enforcement. These intermediaries act as buffers that decouple the complex training process from the classification task, allowing the system to achieve high accuracy without proportionally increasing the complexity of the core classification engine.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If extensive training data and multi-step training processes are used to improve classification accuracy, then measurement precision is improved, but training time and computational resources increase

Engineering Contradiction:
Improveclassification accuracyVSAvoidtraining time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary actions by pre-processing training data before classification training, including cleaning, normalization, and feature extraction. This preliminary preparation of data ensures that the classifier receives high-quality input, improving convergence speed and final accuracy while reducing the number of training iterations needed. The training outputs are also pre-processed and structured in advance to facilitate faster model training.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent employs parameter changes by adjusting training hyperparameters, data sampling strategies, and model architecture parameters to optimize the training process. By dynamically modifying training parameters such as learning rates, batch sizes, and data selection criteria, the system achieves high classification accuracy with reduced training time and computational resource consumption compared to fixed-parameter training approaches.

Inventive Principle:
Principle #35Parameter changes

3Productivity

If offline and inline databases are implemented to store URL categories, then classification speed and resource efficiency are improved, but storage requirements and system complexity increase

Engineering Contradiction:
Improveclassification speedVSAvoidstorage requirements
Core Design Contradiction:
ProductivityVSQuantity of substance

Solution Approach 1:

The system implements local quality by creating specialized database indexes and storage structures optimized for different types of URL categorization queries. The offline database stores comprehensive historical classification data with optimized indexes for batch processing, while the inline database maintains frequently accessed classification results for rapid online lookups. This localized optimization of storage structures allows the system to achieve high classification speed without proportionally increasing total storage requirements.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS12561620B2Machine learning-based URL categorization system with noise elimination
Publication Date: 2026.02.24 NETSKOPE INC
  • US12561620B2 patent drawing
  • US12561620B2 patent drawing
  • US12561620B2 patent drawing

AI summary

The technology discloses training a classifier to label webpages with categories, extracting from a training database with thousands of webpages tentatively labeled with ground truth categories, dataset A and dataset B; training a classifier using A; and applying it to webpages in B to assign a webpage a label and a classification score. Also disclosed is cleaning B, removing webpages based on evaluation of a decision confidence metric derived from the score assigned for the webpage; and training a second classifier using cleaned B, with second classifier weights initialized independent of trained first classifier weights; and applying the second classifier to webpages in A to assign a webpage the label, score, and decision confidence matrix, and cleaning A, removing webpages from A based on the decision confidence metric. Then combining cleaned A and cleaned B into a combined clean dataset, and training the third classifier using the combined clean dataset.