Adaptive Compression Checkpoint Algorithm for Mainframe File Transfers
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Mainframe computers incur unnecessary CPU cycles and increased network traffic when compressing already compressed data, leading to wasted resources and higher costs due to inefficient compression processes during file transfers.
Innovation Solution
Implementing adaptive compression that allows the compression algorithm to be altered 'in flight' or 'on the fly' without restarting the transfer, by establishing checkpoints and adjusting compression requirements based on performance metrics to optimize CPU usage and network traffic.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If compression is applied to data that is already compressed, then the data size is reduced, but CPU cycles are wasted and execution time increases
Solution Approach 1:
The patent implements dynamic compression by allowing the compression algorithm to be altered 'in flight' or 'on the fly' without restarting the transfer. Checkpoints are established and compression requirements are modified based on performance metrics, making the compression process adaptive rather than static. This resolves the contradiction by dynamically adjusting compression based on whether data is already compressed, thereby reducing CPU waste while maintaining data size reduction benefits.
Solution Approach 2:
The patent changes compression parameters mid-transfer by modifying compression requirements based on checkpoint performance analysis. When data is detected to be already compressed, the compression algorithm parameters are adjusted or disabled to prevent wasted CPU cycles. This parameter adaptation allows the system to optimize between data size reduction and CPU cycle conservation.
2Quantity of substance
If compression is applied to data that is already compressed, then the data size is reduced, but network traffic increases
Solution Approach 1:
The system dynamically adjusts compression based on real-time performance metrics evaluated at checkpoints. When compression is applied to already compressed data, the resulting larger data size increases network traffic. The patent detects this condition and dynamically modifies compression requirements to prevent further compression, thereby reducing network traffic while maintaining optimal data size.
Solution Approach 2:
The patent implements feedback mechanisms by evaluating performance metrics at checkpoints during data transfer. The system monitors whether compression is achieving desired results or if data is already compressed. Based on this feedback, compression requirements are modified to optimize network traffic, preventing the harmful effect of transmitting unnecessarily large compressed data.
3Productivity
If compression algorithm is changed mid-transfer, then compression efficiency is optimized, but system complexity increases
Solution Approach 1:
The patent segments the data transfer process into checkpoints, allowing independent modification of compression requirements for each segment. This segmentation enables compression algorithm changes mid-transfer without requiring system-wide complexity increases, as each checkpoint can be handled independently with modified compression parameters applied only to subsequent data segments.
Solution Approach 2:
The system implements dynamic compression algorithm selection that adapts mid-transfer based on performance metrics. Rather than requiring complex pre-planning or complete system redesign, the patent enables straightforward algorithm changes at checkpoints through modified compression requirements, optimizing compression efficiency while maintaining manageable system complexity.
Data Source
AI summary
A method for performing a file transfer comprises receiving a request for data where the data is to be compressed. A checkpoint is established, where the checkpoint occurs before the end of the transmission of the requested data. Also, a compression requirement is established for the requested data. The operations of extracting a segment of the data to be communicated, processing the extracted segment according to the compression requirement, and communicating the processed segment across the network are performed until the checkpoint is reached. Once the established checkpoint is reached, a checkpoint routine is performed by determining whether a desired level of performance in compression is achieved in communicating the processed segments. If the desired level of performance is achieved, each additional segment is processed based upon the compression requirement. Alternatively, the compression requirement is modified and each additional segment is processed according to the modified compression requirement.