Multi-Level Malware Classification Using VPT Hashing and ML
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing malware detection methods using file hashes and vantage-point trees are insufficient for detecting variations in malicious files, being computationally intensive and lacking generality, which affects their detection rate and commercial viability.
Innovation Solution
A cyber security method and system employing locality-sensitive hashing evaluation with a vantage-point tree structure for initial malware detection, followed by machine learning-based assessment, optimized for speed and computation using non-recursive VPT search and top-K heap operations, to identify files as malicious or non-malicious with high confidence.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If traditional file hashing algorithms (MD5, SHA-1, SHA-2) are used for malware detection, then the detection process is simple and fast, but the detection rate is insufficient for detecting variations in malicious files
Solution Approach 1:
The patent segments the malware detection process into multiple levels: first using traditional hashing for quick rejection of obviously benign files, then applying vantage-point tree based locality-sensitive hashing for intermediate filtering, and finally using machine learning models for comprehensive analysis of suspicious files. This multi-level segmentation allows the system to maintain high detection rates while managing computational complexity efficiently.
Solution Approach 2:
The patent implements a dynamic detection system that adapts its analysis depth based on the suspiciousness score of each file. Files are initially assessed using lightweight hashing, and only those exceeding certain thresholds proceed to more complex vantage-point tree analysis and machine learning evaluation. This dynamic approach optimizes resource utilization while maintaining detection effectiveness.
2Reliability
If vantage-point tree structure is used for malware detection, then the detection rate for malicious files improves, but the computational intensity and memory usage increase
Solution Approach 1:
The patent applies preliminary filtering using traditional hashing algorithms before invoking the computationally intensive vantage-point tree structure. By pre-identifying and eliminating obviously benign files through simple hash comparison, the system reduces the number of files that require expensive VPT analysis, thereby lowering overall computational intensity while maintaining detection rate.
Solution Approach 2:
The patent applies different detection methods with varying computational costs to different subsets of files based on their characteristics. Benign-looking files receive minimal processing with simple hashing, while suspicious files undergo comprehensive VPT and machine learning analysis. This local differentiation of processing quality optimizes energy usage by concentrating computational resources where they are most needed.
3Reliability
If comprehensive machine learning-based assessment is performed on all files, then the detection rate improves, but the processing time and computational resources increase significantly
Solution Approach 1:
The patent segments the file population into different risk categories using a multi-stage filtering process. Only files that pass through initial hashing filters and vantage-point tree evaluation with suspiciousness scores above certain thresholds are subjected to comprehensive machine learning assessment. This segmentation ensures that ML resources are concentrated on high-risk files, maintaining detection rate while preserving processing speed for the overall file population.
Solution Approach 2:
The patent applies partial machine learning assessment rather than comprehensive analysis to all files. By using lightweight hashing and vantage-point tree methods to handle the majority of files, and reserving full ML power only for suspicious cases, the system achieves sufficient detection capability without the prohibitive computational cost of universal ML analysis.
4Reliability
If recursive VPT search is used, then the search comprehensiveness is maintained, but the memory usage increases
Solution Approach 1:
The patent extracts the essential functionality of recursive VPT search by implementing an iterative version that processes the search tree level-by-level using explicit stacks or queues stored in flat arrays. This extraction of the recursive mechanism into iterative form maintains search comprehensiveness while dramatically reducing memory overhead by avoiding the call stack overhead and enabling better memory locality and CPU cache utilization.
Data Source
AI summary
A cyber security method and system for detecting malware via an anti-malware application employing a fast locality-sensitive hashing evaluation using a vantage-point tree (VPT) structure for the indication of malicious files and non-malicious files. The locality-sensitive hashing evaluation using the VPT structure can be performed prior to initiating the deeper, more computationally intensive evaluation and is used to identify with high confidence a scanned file or data object being (i) a malicious file, (ii) a non-malicious file, or a low confidence measure of the two.


