Data Transfer Yield Optimization for Scheduled Push Transfers
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
There is a risk of data loss and delayed access in scheduled push transfers due to potential computer or network failures and the possibility of data being deleted before the scheduled transfer date, while early pull transfers may incur data transfer losses, necessitating a method to determine when it is advantageous to initiate a pull transfer before the scheduled date.
Innovation Solution
A system that determines an accumulated data transfer amount for a periodic push transfer scheduled at a future date, calculates an overall data amount considering a data processing yield based on the time period, and initiates a pull transfer if the yield is expected to be greater than the data transfer loss, allowing for early data transfer to a secondary storage location and subsequent transfer to a primary storage location.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of time
If a pull transfer is initiated prior to the scheduled push transfer date, then data access timeliness is improved and data processing yield is increased, but data transfer loss occurs
Solution Approach 1:
The system dynamically changes the transfer timing parameter by comparing the data processing yield against the data transfer loss threshold. When the yield exceeds the loss, the system adjusts the transfer schedule from the original push date to an earlier pull transfer date, optimizing the balance between timeliness and loss.
Solution Approach 2:
The system performs a preliminary calculation of data processing yield before executing the transfer decision. This advance assessment allows the system to determine whether early pull transfer is advantageous, enabling proactive optimization rather than reactive transfer.
2Loss of substance
If data is held until the scheduled push transfer date, then data transfer loss is minimized, but reliability is reduced due to risk of computer or network failure and data deletion
Solution Approach 1:
The system performs advance assessment of data processing yield and executes transfer decisions before the scheduled push date. This preliminary action eliminates the risk window between data generation and transfer, ensuring reliability by preventing potential data loss from system failures or deletions.
Solution Approach 2:
The system provides a cushioning mechanism by calculating and comparing data processing yield against transfer loss thresholds. This beforehand assessment creates a protective decision framework that cushions against the risks of waiting, allowing early transfer when the yield justification exists.
3Productivity
If periodic push transfers are scheduled at fixed intervals, then transfer efficiency is improved, but adaptability is reduced when early transfer becomes advantageous
Solution Approach 1:
The system transforms the static, fixed-interval push transfer schedule into a dynamic system that adapts based on real-time conditions. By continuously evaluating data processing yield and comparing it against transfer loss thresholds, the system dynamically adjusts transfer timing to balance efficiency with adaptability.
Solution Approach 2:
The system changes the transfer timing parameter from a fixed schedule to a flexible date based on yield analysis. When the data processing yield exceeds the transfer loss threshold, the system modifies the transfer parameter to execute earlier, maintaining efficiency while gaining adaptability.
Data Source
AI summary
Systems and methods of initiating a transfer of a quantity of data are described. An accumulated data transfer amount for a periodic data transfer scheduled to be pushed to a primary storage location at a future date is determined. A pull transfer of the accumulated data transfer amount to a secondary storage location is then initiated. An overall data amount in the secondary storage location is then determined. The overall data amount includes the accumulated data transfer amount less a data transfer loss amount and a data processing yield amount. The data processing yield amount is based upon the accumulated data transfer amount. A transfer of a quantity of data then is initiated from the secondary storage location to the primary storage location. The quantity of data comprises at least a portion of the overall data amount.