Distributed File Reputation Evaluation via Chunk Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing reputation services face inefficiencies in evaluating the reputation of large files, as obtaining the entire file from a single client can tax resources and incur bandwidth issues, especially when the file is unknown and stored behind authentication credentials or unknown URLs.
Innovation Solution
A distributed file acquisition method where a reputation service partitions the file into chunks, retrieves and evaluates them from multiple clients with user consent, reconstructing the file to assign a reputation, thereby mitigating resource constraints and improving efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the entire file is obtained from a single client, then the reputation service can evaluate the file's reputation, but it taxes resources and incurs bandwidth issues
Solution Approach 1:
The patent divides the file into multiple chunks and distributes the acquisition process across multiple clients. Each client provides only the specific chunk they possess, rather than all clients needing to transfer the entire file. This segmentation reduces the bandwidth burden on individual clients and the reputation service while maintaining the ability to evaluate the complete file's reputation.
2Reliability
If the entire file is obtained from a single client, then the file can be evaluated for reputation, but it overwhelms single clients and resources
Solution Approach 1:
By segmenting the file into chunks and distributing the collection process across multiple clients, the system improves resource efficiency. Each client only needs to upload the specific chunk they have, reducing the computational and bandwidth resources required from any single client while enabling the reputation service to evaluate the complete file.
Solution Approach 2:
The system leverages the existing file chunks that clients already possess and simply requests them for evaluation. Clients self-serve by providing the chunks they already have without needing to download or process the entire file, reducing the productivity burden on individual clients and the overall system.
3Reliability
If the reputation service waits for complete file acquisition from one client, then accurate reputation can be assigned, but it incurs delays and inefficiencies
Solution Approach 1:
The patent segments the file acquisition process into parallel chunk collection operations. Multiple clients can simultaneously provide different chunks to the reputation service, eliminating the sequential waiting time inherent in single-client acquisition. This parallel processing reduces evaluation time while maintaining reputation accuracy through complete file reconstruction.
Solution Approach 2:
The system performs preliminary actions by requesting and collecting file chunks from multiple clients in parallel before the reputation evaluation is needed. This preliminary distributed collection reduces the time required for actual reputation assessment, as the file components are already gathered and ready for evaluation.
Data Source
Figure 1
Figure 2A
Figure 2B
AI summary
One or more techniques and/or systems are provided for file acquisition for reputation evaluation. A reputation service may be configured to evaluate files and provide reputations of such files to clients (e.g., an indication as to whether a file is safe or malicious). If the reputation service receives a reputation request for a file that is unknown to the reputation service (e.g., a file not yet fully acquired by the reputation service), then the reputation service may identify a set of chunks into which the file can be partitioned. The reputation service may obtain chunks from various clients, such as a first chunk from a first client and a second chunk from a second client. Such chunks may be evaluated to assign a reputation to the file. In this way, the reputation service may retrieve portions of a file in a distributed manner for reputation evaluation.