Data Block Transmission Using Compressibility-Aware Protocol Bypass
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing data transmission methods waste processor and memory resources by unnecessarily compressing data blocks with poor compressibility, leading to longer response times due to inefficient compression and decompression operations.
Innovation Solution
A method and system that determines data block compressibility at the data block layer and transfers compressibility information to the protocol layer, allowing for appropriate operations based on whether the data block needs compression, thereby reducing unnecessary compression and decompression operations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If protocol layer compression is applied to all data blocks, then data transmission amount is reduced, but processor and memory resources are wasted on compressing data blocks with poor compressibility
Solution Approach 1:
The patent applies preliminary action by pre-evaluating data block compressibility at the data block layer before protocol layer transmission. The system determines whether each data block is compressible in advance, storing this information in metadata, so that protocol layer compression can be skipped for non-compressible blocks, avoiding unnecessary resource consumption while maintaining data reduction for compressible blocks
Solution Approach 2:
The patent implements local quality by treating different data blocks differently based on their individual compressibility characteristics. Instead of applying uniform compression to all data blocks, the system evaluates each block's compressibility and applies protocol layer compression only to blocks that benefit from it, while transmitting other blocks uncompressed, thereby optimizing resource usage
2Loss of time
If protocol layer compression is applied to data blocks, then data transmission time is reduced, but response time increases due to compression and decompression operations
Solution Approach 1:
The patent uses preliminary action by pre-determining compressibility at the data block layer before protocol layer processing. This advance evaluation allows the system to skip compression/decompression operations for non-compressible blocks, reducing response time overhead while still achieving transmission time reduction for compressible blocks through protocol layer compression
3Quantity of substance
If compression operations are performed on data blocks with poor compressibility, then a small reduction in data transmission is achieved, but processor and memory resources are significantly consumed
Solution Approach 1:
The patent applies the taking out principle by extracting and evaluating the compressibility characteristic of each data block at the data block layer. By separating the compressibility assessment from the protocol layer compression process, the system can identify and exclude non-compressible blocks from protocol layer compression, thereby eliminating unnecessary processor and memory resource consumption while maintaining data reduction benefits for compressible blocks
Data Source
AI summary
Techniques for transmitting a data block involve receiving, from a client, a request for reading the data block. Such techniques further involve determining, at a data block layer, whether the data block needs to be compressed at a protocol layer based on a flag indicating whether the data block has been compressed and a storage size of the data block. Such techniques further involve transferring, in response to determining that the data block does not need to be compressed at the protocol layer, an indication that the data block does not need to be compressed at the protocol layer from the data block layer to the protocol layer. Such techniques further involve sending the data block to the client through the protocol layer without compressing the data block at the protocol layer.