URL Categorization Classifier With Noise-Elimination Training
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing policy enforcement systems struggle to effectively manage and secure cloud-based data access due to the dynamic and unpredictable nature of cloud applications, leading to challenges in enforcing unified security policies across diverse protocols and endpoints, with issues such as data leakage and misclassification of websites posing risks to organizational security and productivity.
Innovation Solution
A machine learning-based URL categorization classifier is developed to classify websites into categories, utilizing a multi-step training process to eliminate noise and implement post-processing rules, combined with offline and inline databases to enhance accuracy and resource efficiency, enabling unified policy enforcement across cloud-based environments.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a machine learning-based URL categorization system is implemented to improve security policy enforcement, then website classification accuracy is improved, but the system complexity and computational resources required for training and deployment increase
Solution Approach 1:
The URL categorization system is divided into multiple independent components: a training module that processes training data and generates training outputs, a classifier module that performs actual URL classification, and a policy enforcement module that applies security policies. This segmentation allows each component to be optimized independently and deployed separately, reducing overall system complexity while maintaining high classification accuracy through specialized processing in each module.
Solution Approach 2:
The patent introduces intermediary components such as a data preprocessing layer that cleans and prepares training data before it reaches the classifier, and a post-processing layer that refines classification results before policy enforcement. These intermediaries act as buffers that decouple the complex training process from the classification task, allowing the system to achieve high accuracy without proportionally increasing the complexity of the core classification engine.
2Measurement precision
If extensive training data and multi-step training processes are used to improve classification accuracy, then measurement precision is improved, but training time and computational resources increase
Solution Approach 1:
The system performs preliminary actions by pre-processing training data before classification training, including cleaning, normalization, and feature extraction. This preliminary preparation of data ensures that the classifier receives high-quality input, improving convergence speed and final accuracy while reducing the number of training iterations needed. The training outputs are also pre-processed and structured in advance to facilitate faster model training.
Solution Approach 2:
The patent employs parameter changes by adjusting training hyperparameters, data sampling strategies, and model architecture parameters to optimize the training process. By dynamically modifying training parameters such as learning rates, batch sizes, and data selection criteria, the system achieves high classification accuracy with reduced training time and computational resource consumption compared to fixed-parameter training approaches.
3Productivity
If offline and inline databases are implemented to store URL categories, then classification speed and resource efficiency are improved, but storage requirements and system complexity increase
Solution Approach 1:
The system implements local quality by creating specialized database indexes and storage structures optimized for different types of URL categorization queries. The offline database stores comprehensive historical classification data with optimized indexes for batch processing, while the inline database maintains frequently accessed classification results for rapid online lookups. This localized optimization of storage structures allows the system to achieve high classification speed without proportionally increasing total storage requirements.
Data Source
AI summary
The technology discloses training a classifier to label webpages with categories, extracting from a training database with thousands of webpages tentatively labeled with ground truth categories, dataset A and dataset B; training a classifier using A; and applying it to webpages in B to assign a webpage a label and a classification score. Also disclosed is cleaning B, removing webpages based on evaluation of a decision confidence metric derived from the score assigned for the webpage; and training a second classifier using cleaned B, with second classifier weights initialized independent of trained first classifier weights; and applying the second classifier to webpages in A to assign a webpage the label, score, and decision confidence matrix, and cleaning A, removing webpages from A based on the decision confidence metric. Then combining cleaned A and cleaned B into a combined clean dataset, and training the third classifier using the combined clean dataset.


