Multi-Layer URL Filtering for Unknown Malicious Link Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional URL filtering systems rely on blocklists to identify malicious URLs, which are ineffective against unknown malicious URLs and can be easily evaded by cyber attackers through domain name modifications.
Innovation Solution
A multi-layered URL filtering system that combines blocklist comparison with machine learning algorithms and visual feature analysis to predict malicious URLs, including a centralized server that updates blocklists dynamically and uses machine learning to identify patterns in malicious URLs.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If a blocklist of known malicious URLs is used for filtering, then known malicious URLs can be effectively blocked, but unknown malicious URLs cannot be detected and the system can be easily evaded by attackers
Solution Approach 1:
The system performs preliminary actions by pre-training machine learning models with extensive URL features, patterns, and characteristics before actual filtering operations. The models are pre-equipped with knowledge of malicious URL patterns, domain structures, and phishing techniques, enabling them to quickly evaluate new URLs without requiring them to be on the blocklist. This preliminary preparation allows the system to detect unknown malicious URLs by comparing them against learned patterns rather than requiring exact matches.
Solution Approach 2:
The patent introduces machine learning models as intermediaries between the blocklist and the URL filtering process. These models act as a bridge that translates the static blocklist data into dynamic detection capabilities. The ML models analyze URL features, extract patterns, and make predictions about maliciousness, thereby mediating between the known blocklist entries and the unknown URLs that need to be evaluated. This intermediary layer enables the system to generalize from known malicious URLs to detect unknown variants.
2Reliability
If a multi-layered filtering system with machine learning and visual feature analysis is implemented, then detection capability is improved, but system complexity increases
Solution Approach 1:
The patent segments the URL filtering system into distinct functional layers, each handling specific aspects of analysis. The first layer performs blocklist matching for known malicious URLs. The second layer applies machine learning models for pattern recognition and prediction. The third layer conducts visual feature analysis of webpage content. This segmentation allows each layer to specialize in particular detection techniques, improving overall effectiveness while maintaining modularity that manages system complexity through clear separation of concerns.
Solution Approach 2:
The filtering system implements a nested structure where multiple filtering mechanisms are embedded within each other. The blocklist comparison is nested within the broader machine learning framework, which in turn is nested within the visual analysis system. Each layer operates independently but contributes to the overall detection decision. This nesting allows the system to build upon previous layers' capabilities without completely redesigning the architecture, managing complexity through hierarchical organization.
Data Source
AI summary
A system for URL filtering includes a processor and a memory having stored therein at least programs or instructions executable by the processor to cause the system to filter a received URL by comparing the URL to a blocklist to predict if a resource associated with the URL is malicious, if the URL does not match a URL on the blocklist, filter the URL by applying an ML algorithm to predict whether a resource associated with the URL is malicious, if the resource is not malicious, filter the URL by comparing a visual feature of a resource with a respective visual feature of known non-malicious webpages to identify similarities and/or differences to determine if a resource is malicious, and if the resource is malicious, generate and transmit a URL filter determination that the resource associated with the URL is malicious and update the blocklist to include the URL.


