Network Data Block Compression via Fixed-Size Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing file server systems face challenges in efficiently transferring large amounts of data over networks due to bandwidth limitations and are unable to handle data blocks of varying sizes, which complicates the use of compression techniques.
Innovation Solution
A system and method that subdivides data into predetermined-sized blocks for transfer, regardless of compression, allowing for transparent compression and decompression by a storage application program layer, ensuring consistent block sizes and efficient data transfer.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If data is compressed to reduce bandwidth usage, then transfer efficiency is improved, but data block size becomes variable which complicates system processing
Solution Approach 1:
The patent segments the data processing into distinct compression/decompression layers separated from the block processing layer. The compression layer operates on data streams independently of block size constraints, while the block layer handles fixed-size units for network transfer. This segmentation allows compression to improve efficiency without complicating the block processing system.
Solution Approach 2:
The patent introduces an intermediary compression/decompression layer between the data source and the network block layer. This intermediary handles the variable size compression output and converts it to fixed-size blocks for network transfer, mediating between the efficiency benefits of compression and the processing simplicity of fixed blocks.
2Adaptability or versatility
If data is subdivided into fixed-size blocks for network transfer, then system compatibility is maintained, but compression capability is limited
Solution Approach 1:
The patent segments functionality into a compression layer that handles variable-size data and a block layer that enforces fixed-size constraints for network transfer. This allows the system to maintain compatibility with existing fixed-block network protocols while enabling compression efficiency through independent variable-size processing.
Solution Approach 2:
The patent changes the parameter handling approach by allowing compression to operate on variable-size data streams and then transforming the output to fixed-size blocks. This parameter transformation enables both compression efficiency (variable input) and system compatibility (fixed output blocks).
3Loss of energy
If compression is applied to data blocks, then bandwidth usage is reduced, but data blocks of different sizes cannot be processed by the file server
Solution Approach 1:
The patent introduces an intermediary compression layer that handles the transformation from variable-size compressed data to fixed-size blocks. This intermediary ensures that bandwidth savings from compression are achieved while maintaining ease of operation at the file server by providing uniformly sized blocks.
Solution Approach 2:
The patent performs preliminary compression of data before it enters the fixed-block processing pipeline. By compressing data in advance and then padding or fragmenting to fixed sizes, the system reduces bandwidth usage while preparing data for easy processing by the file server.
Data Source
AI summary
Data is transferred over a network for storage purposes in a way that accommodates systems which are equipped to only handle a predetermined data block size. This is accomplished by transmitting the data using the same data block size regardless as to whether the data is compressed or not. In use, data to be transferred is identified on a first computer. Prior to being transferred to a second computer, it is determined whether the data is to be compressed. If it is determined that the data is not to be compressed, the data is subdivided into a plurality of data blocks with a predetermined size. If it is determined that the data is to be compressed, the data is compressed and subdivided into a plurality of data blocks with the predetermined size. Such data blocks are then transferred to the second computer via the network, for storing the data.