Security Scanning via Hash-Based Duplicate Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional security systems face inefficiencies in performing security scans due to the resource-intensity of hashing operations and redundant scanning of identical files across related computing systems, which can waste time and computing resources.
Innovation Solution
The method involves generating hashes only for non-volatile files and scanning files whose hashes do not match previously scanned files, while directly scanning volatile files without generating hashes for them, thereby avoiding redundant and resource-intensive hashing operations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If hashing operations are performed on all files to avoid redundant security scans, then duplicate scans are prevented, but computing resource consumption increases
Solution Approach 1:
The patent applies different processing strategies to different file types: volatile files are scanned directly without hashing, while non-volatile files undergo hashing for duplicate detection. This local differentiation resolves the contradiction by avoiding unnecessary hashing operations on volatile files, reducing computing resource consumption while maintaining reliable duplicate detection for files where it matters.
2Reliability
If hashing operations are performed on all files, then duplicate files can be identified, but time consumption increases
Solution Approach 1:
The system differentiates between volatile and non-volatile files, applying hashing only to non-volatile files. This selective approach reduces the overall time consumption for security scans while maintaining reliable duplicate file identification for the subset of files where duplicates are likely to occur.
3Reliability
If security scans are performed on all files without differentiation, then comprehensive security coverage is achieved, but resource efficiency decreases
Solution Approach 1:
The patent implements local quality by applying different security processing approaches to different file types. Volatile files receive direct security scanning while non-volatile files undergo hashing-based duplicate detection followed by scanning only of unique files. This resolves the contradiction by maintaining comprehensive security coverage through appropriate processing of all files while significantly improving resource efficiency by avoiding redundant operations.
Solution Approach 2:
The system performs preliminary hashing on non-volatile files before security scanning to identify and eliminate duplicates. This preliminary action reduces the number of files that require full security scanning, thereby improving resource efficiency while maintaining comprehensive security coverage through subsequent scanning of unique files.
Data Source
AI summary
A computer-implemented method for performing security scans may include 1) generating a first hash of a first file, 2) performing a first security scan on the first file, 3) storing the first hash to indicate a result of the first security scan of the first file, 4) identifying a second file and generating a second hash of the second file, 5) determining that the second hash of the second file is equivalent to the first hash of the first file and, in response, determining that the result of the first security scan of the first file applies to the second file, 6) identifying a third file and determining that the third file is volatile, and 7) performing a second security scan on the third file instead of generating a third hash of the third file. Various other methods, systems, and computer-readable media are also disclosed.