Compressed Drive Data Transfer Without Decompression Overhead
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional systems face challenges in efficiently processing large amounts of data generated by IoT devices and complex machine learning models due to network strain from data migration to cloud locations and processing strain from data decompression and recompression.
Innovation Solution
A method and system that allows for transferring compressed data between drives without decompressing it, leveraging same or similar compression configurations to improve storage capacity and reduce network overhead.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Power
If data is moved from distributed locations to central cloud location, then processing capability is improved, but network strain increases significantly
Solution Approach 1:
The patent segments data processing operations into two parts: compression operations remain at distributed edge locations, while only compressed data is transferred to the cloud for final processing. This segmentation allows local compression to reduce data volume before transmission, thereby improving overall processing capability while reducing network strain from transferring uncompressed data.
2Quantity of substance
If data compression is applied to reduce storage space, then storage capacity is improved, but processing strain from decompression and recompression increases
Solution Approach 1:
The patent applies compression as a preliminary action at the edge location before data is transferred to the cloud. By pre-compressing data at the source, the system improves storage capacity efficiency while avoiding the need for repeated decompression and recompression cycles during cloud operations, since the compressed format is maintained throughout the data lifecycle.
3Ease of operation
If compressed data is decompressed for access and then recompressed before storage, then data accessibility is improved, but processing strain increases
Solution Approach 1:
The patent changes the fundamental parameter of data format from uncompressed to compressed, and maintains this compressed state throughout storage and transfer operations. This parameter change eliminates the need for decompression/recompression cycles while preserving data accessibility, since cloud-based systems can operate directly on compressed data formats without requiring conversion to uncompressed form.
Data Source
AI summary
A computer-implemented method, according to one approach, includes: causing compressed data to be read from a first compressed drive without decompressing the compressed data. A copy of the compressed data is also received from the first compressed drive. In response to determining a target location for the copy of the compressed data is a second compressed drive having a same configuration as the first compressed drive, the copy of the compressed data is transmitted to the second compressed drive. Moreover, the compressed data is written to the target location in the second compressed drive without compressing the compressed data.


