Compressed File Storage for Partial Cloud Updates
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies face challenges in reducing data transfer and storage amounts between file storage and cloud storage, particularly when dealing with compressed files, as they require transferring entire files for partial updates, which increases communication costs and time due to narrow communication bandwidth in WAN networks.
Innovation Solution
A processor in the file storage compresses updated data and transmits it in a compressed state to the cloud storage, allowing the data storage to replace the updated parts of the file, thereby reducing data transfer and storage amounts by processing and storing the updates in a compressed state.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the entire compressed file is transferred for partial updates, then the data can be fully accessed and updated, but the communication cost and time increase due to narrow WAN bandwidth
Solution Approach 1:
The patent divides the compressed file into multiple compression blocks, each with its own compression header containing offset information. This allows the system to identify and transfer only the specific compression block that contains the updated data, rather than transferring the entire file. The segmentation enables precise localization of update regions in the compressed domain.
Solution Approach 2:
The patent extracts only the necessary compression block containing the updated data from the compressed file for transmission. By using the compression header information to identify the specific block, the system extracts and transfers minimal data (only the updated portion plus necessary context blocks), reducing communication overhead while maintaining update reliability.
2Manufacturing precision
If the entire compressed file is transferred for partial updates, then the updated data can be accurately replaced, but the data transfer amount increases
Solution Approach 1:
The patent segments the compressed file into discrete compression blocks with individual headers. Each header contains offset information that precisely identifies where the compressed data maps to in the original file. This segmentation allows the system to transfer only the specific block containing updated data, maintaining update accuracy while minimizing transfer quantity.
Solution Approach 2:
The patent introduces compression headers as intermediary structures that contain metadata (offsets, lengths, compression parameters) about each compression block. These headers act as a map, allowing the system to locate and transfer only the necessary data blocks without transferring the entire file, thus reducing data transfer amount while preserving update accuracy.
3Quantity of substance
If compressed files are stored in cloud storage, then storage space is optimized, but partial data retrieval requires expanding the entire file
Solution Approach 1:
The patent divides the compressed file into multiple compression blocks, each with its own header containing offset and length information. This segmentation allows the system to retrieve only specific compression blocks from cloud storage when partial data is needed, avoiding the need to expand the entire file. The block structure enables independent access to different portions of the compressed data.
4Quantity of substance
If existing compression technologies are used for partial updates, then data can be compressed, but the update parts cannot be specified and the entire file must be expanded
Solution Approach 1:
The patent segments the compressed data into discrete blocks with individual headers that contain offset information mapping to the original file. This segmentation enables the system to identify which compression block contains the updated data by comparing offsets, and perform updates without expanding the entire file. The block structure makes partial updates operable while maintaining compression efficiency.
Solution Approach 2:
The patent introduces compression headers as intermediary structures that contain metadata about each compression block including offsets, lengths, and compression parameters. These headers enable the system to locate and manipulate specific compressed blocks without full expansion, making partial updates operational while preserving the compressed state of data.
Data Source
AI summary
In a file storage that is coupled to a cloud storage storing data and manages a file, the cloud storage compresses and stores the data, and the file storage includes a processor. When data of a part of a file held in the file storage is updated, the processor is configured to compress updated update part data so that the update part data is in a compressed state and transmit the update part data in the compressed state to the cloud storage, and cause the cloud storage to replace the updated part of the file with the update part data and to store a range including the update part data in a compressed state in the cloud storage.