Predictive Anti-Virus Scanning for Distributed File Systems

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current anti-virus scanning in distributed file systems is inefficient due to blind scanning that does not consider file access patterns, leading to wasted resources and increased latency for frequently accessed files, as scans are typically performed without prioritization based on usage frequency.

Innovation Solution

Implementing predictive analytics using machine learning to prioritize and schedule anti-virus scans, predicting which files are likely to be accessed next and ordering them for real-time or scheduled scanning, thereby optimizing resource usage and reducing latency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If anti-virus scanning is performed on all files without prioritization, then comprehensive virus protection is achieved, but system resources are wasted and access latency increases for frequently accessed files

Engineering Contradiction:

Improvevirus protection coverageVSAvoidsystem performance

Core Design Contradiction:

ReliabilityVSProductivity

Solution Approach 1:

The system performs preliminary anti-virus scanning on files that are predicted to be accessed in the near future, based on historical access patterns and machine learning predictions. This allows frequently accessed files to be scanned before they are actually needed, eliminating access latency while maintaining comprehensive protection.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The anti-virus scanning system dynamically adjusts its behavior based on real-time predictions of file access patterns. Files are prioritized for scanning based on their predicted likelihood of being accessed, with frequently accessed files receiving immediate scanning attention while less important files are scanned during off-peak hours.

Inventive Principle:

Principle #15Dynamics

2Reliability

If anti-virus scanning is performed in real-time before file access, then access safety is ensured, but access latency increases

Engineering Contradiction:

Improvefile access safetyVSAvoidaccess latency

Core Design Contradiction:

ReliabilityVSLoss of time

Solution Approach 1:

The system performs anti-virus scanning in advance based on predicted access patterns, so that when a file is actually accessed, the scanning has already been completed. This eliminates access latency for predicted files while maintaining security through pre-scan verification.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The system implements periodic background scanning for files not currently in the prediction queue, ensuring that all files are eventually scanned while allowing frequently accessed files to be scanned on-demand before access occurs.

Inventive Principle:

Principle #19Periodic action

3Ease of operation

If background anti-virus scanning is scheduled during off-peak hours, then user impact is minimized, but the time window for scanning is limited

Engineering Contradiction:

Improveuser experience during scanningVSAvoidscanning throughput

Core Design Contradiction:

Ease of operationVSProductivity

Solution Approach 1:

The scanning system dynamically shifts between background operation during off-peak hours and foreground operation during peak hours based on predicted file access patterns. Files predicted to be accessed are scanned in the foreground before access, while other files continue background scanning, maximizing both user experience and scanning throughput.

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

During peak hours, the system prioritizes scanning only the subset of files predicted to be accessed, performing partial scanning rather than complete system-wide scanning. This maintains acceptable security levels while minimizing user impact during critical access periods.

Inventive Principle:

Principle #16Partial or excessive action

4Reliability

If complete anti-virus scanning is performed on the entire file system, then thorough virus detection is achieved, but resource consumption increases significantly

Engineering Contradiction:

Improvevirus detection thoroughnessVSAvoidcompute resource consumption

Core Design Contradiction:

ReliabilityVSUse of energy by moving object

Solution Approach 1:

The system performs preliminary scanning only on files predicted to be accessed within a certain time window, rather than scanning the entire file system. This reduces compute resource consumption significantly while maintaining thorough detection for relevant files through targeted prediction-based selection.

Inventive Principle:

Principle #10Preliminary action

Data Source

PatentUS10834121B2Predictive real-time and scheduled anti-virus scanning

Publication Date: 2020.11.10 EMC IP HLDG CO LLC

AI summary

Implementations are provided herein for systems, methods, and a non-transitory computer product configured to use predictive analysis of quantifiable parameters associated with individual files stored on a distributed file storage system. In some embodiments, parameters are analyzed by machine learning so that real-time and scheduled antivirus scanning can be intelligently conducted. We teach creating a sequential order for scheduled antivirus scanning such that the files most likely to be accessed or needed by users in the future will be scanned for viruses before those files less likely to be accessed. We reconcile scheduled antivirus scanning with predictive analysis for real-time antivirus scanning. Our teachings encompass the use of heuristic data compiled, in some instances through machine learning, and analyzed on a per-file basis. We enable system administrators to determine which parameters to prioritize and to set thresholds for antivirus scanning, such as time limits.