Protocol-Specific File Transfer Simulation for Accurate Time Estimates
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Accurately estimating the time required to transfer large numbers of data files between computing environments is challenging due to the use of different file transfer protocols by various vendors, leading to inaccuracies of up to seventy-five percent in conventional methods.
Innovation Solution
A multi-protocol file transfer modeling solution that uses a sample of test data to identify parameters strongly correlated with transfer time, generates an optimized algorithm for the specific protocol, and simulates file transfers to provide accurate elapsed time estimates through data pooling parameters.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a naïve approach is used to estimate file transfer time based solely on data amount and bandwidth capacity, then the estimation process is simple and quick, but the accuracy of the estimate deteriorates significantly (inaccurate by up to seventy-five percent)
Solution Approach 1:
The patent transforms the estimation approach by changing from a single-parameter calculation (bandwidth capacity) to a multi-parameter model that includes protocol-specific parameters, data set parameters, and correlation coefficients. This allows accurate estimation across different file transfer protocols while maintaining automated operation.
Solution Approach 2:
The patent creates a mathematical model that copies the behavior characteristics of different file transfer protocols through correlation coefficients derived from test data. This model replicates protocol-specific performance patterns without requiring actual protocol execution, enabling accurate estimation across multiple protocols.
2Reliability
If vendor-specific file transfer protocols are used, then each vendor can optimize their own protocol performance, but the ability to accurately estimate transfer times across different vendors deteriorates due to protocol incompatibility
Solution Approach 1:
The patent creates a universal estimation framework that works across multiple file transfer protocols (FTP, SFTP, SCP, RSYNC, etc.) by using protocol-specific correlation coefficients. The same mathematical model structure adapts to different protocols, providing both vendor-specific accuracy and cross-protocol versatility.
Solution Approach 2:
The patent introduces a mathematical modeling layer as an intermediary between different file transfer protocols and the estimation process. This layer uses correlation coefficients to mediate protocol-specific behaviors, allowing accurate estimation without direct protocol execution and enabling cross-protocol comparison.
3Measurement precision
If actual file transfer is performed to obtain accurate time measurements, then the estimation accuracy improves, but the time and resources required for measurement deteriorate (cannot transfer test files to every destination)
Solution Approach 1:
The patent performs preliminary testing with representative data sets to establish correlation coefficients before actual production transfers. This preliminary action captures protocol-specific performance characteristics without requiring extensive actual transfer testing, enabling accurate future estimations with minimal time investment.
Solution Approach 2:
The patent uses actual transfer time measurements from test data to generate feedback in the form of correlation coefficients. This feedback is then incorporated into the mathematical model to improve future estimations, creating a self-improving system that achieves high accuracy without repeated actual transfers.
Data Source
AI summary
A system includes a computing platform having processing hardware, and a system memory storing a software code. The processing hardware is configured to execute the software code to identify a file transfer protocol among multiple file transfer protocols for transferring one or more file(s), to determine, using a test data sample and the file transfer protocol, one or more parameter(s) correlated with a time required for transferring the file(s) using the file transfer protocol, and to provide, based on the parameter(s), an algorithm for transferring the file(s) using the file transfer protocol. The processing hardware is further configured to perform, using the algorithm, a file transfer simulation of the file(s) using the file transfer protocol, to provide, using the file transfer simulation, data pooling parameters for transferring the file(s), and to estimate, based on the file transfer simulation and the data pooling parameters, an elapsed time for transferring the file(s).