Phishing Detection via Visual Keypoint Analysis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current phishing detection systems relying on textual search and analysis are inadequate due to insufficient text data, inability to process text within images, and language limitations, leading to inefficient and unreliable detection of phishing attacks.

Innovation Solution

A phishing detection and analysis system (PDAS) utilizing computer vision techniques to analyze the graphic representation of webpages, generating a machine learning model based on keypoints and feature vectors to determine if a webpage mimics a legitimate one, thereby identifying potential phishing attacks.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If textual search-based analysis is used to detect phishing attacks, then the system can process webpages with sufficient text data, but it fails when the website contains insufficient text or text within images

Engineering Contradiction:
Improvephishing detection accuracyVSAvoidability to handle diverse webpage formats
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The patent replaces the mechanical textual search-based analysis system with a computer vision-based system. Instead of using text processing algorithms to analyze webpage content, the system uses image processing techniques to capture and analyze screenshots of webpages. This substitution enables the system to detect phishing attacks on webpages with insufficient text or text embedded in images, as computer vision can process visual information directly without requiring extractable text.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Loss of information

If textual search-based solutions are used, then the system can analyze webpage content, but it cannot perform analysis when text is contained within images

Engineering Contradiction:
Improvetext information accessibilityVSAvoidtext extraction from images
Core Design Contradiction:
Loss of informationVSDifficulty of detecting and measuring

Solution Approach 1:

The patent substitutes text extraction and analysis with computer vision-based image analysis. Instead of attempting to extract text from images using OCR or text processing methods, the system captures screenshots and analyzes them as images directly. This approach eliminates the difficulty of text extraction from images by treating the entire webpage visual representation as the object of analysis, preserving all visual information including text within images without requiring text extraction.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Reliability

If textual search-based analysis is used, then the system can process webpages with sufficient corpus data, but it lacks effectiveness in many languages due to insufficient data

Engineering Contradiction:
Improvedetection accuracyVSAvoidlanguage coverage
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The patent replaces language-dependent textual search and analysis with language-independent computer vision analysis. By capturing webpages as screenshots and analyzing visual features such as layout, color schemes, logos, and image arrangements, the system can detect phishing attacks across multiple languages without requiring language-specific corpora or text processing capabilities. This visual analysis approach is universally applicable to any language while maintaining detection accuracy.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

4Adaptability or versatility

If computer vision techniques are used to analyze webpage graphics, then the system can detect phishing attacks on webpages with limited text or in various languages, but the device complexity increases

Engineering Contradiction:
Improvehandling of diverse webpage formatsVSAvoidsystem architecture
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent extracts only the essential visual features from webpage screenshots for analysis, rather than processing the entire image data. By identifying and extracting key visual characteristics such as layout patterns, color schemes, logo positions, and structural elements, the system reduces the complexity of analysis while maintaining the ability to detect phishing attacks across diverse webpage formats. This extraction approach simplifies the computational burden compared to analyzing complete high-resolution images.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS10805346B2Phishing attack detection
Publication Date: 2020.10.13 MAGENTA SECURITY HOLDINGS LLC
  • US10805346B2 patent drawing
  • US10805346B2 patent drawing
  • US10805346B2 patent drawing

AI summary

A computerized method for analyzing a subject URL to determine whether the subject URL is associated with a phishing attack is disclosed. The method includes steps of detecting keypoints within a screenshot of a webpage corresponding to the subject URL and determining a set of confidences based on an analysis of the detected keypoints with a model. Each confidence within the set of confidences is assigned to feature vector within a set of training feature vectors representing a training set of URLs used in generating the model. The method comprises performing an image comparison between the screenshot and a screenshot corresponding to a feature vector within the set of training feature vectors, the feature vector being assigned a highest confidence. Responsive to determining the image comparison result exceeds a predefined threshold, transmitting an alert indicating that the subject URL is associated with the phishing attack.