Packet Data Compression via Network Memory Interception
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for compressing packet data across communication networks are limited in achieving high compression ratios due to their reliance on data within individual packets, which results in inefficient data transfer and network performance.
Innovation Solution
The system identifies blocks of previously transferred data and uses LZ encoding to compress packet data based on this information, allowing for increased compression efficiency by intercepting and processing packets through network memory devices at both source and destination sites, thereby reducing the need for data to be resent over the network.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If traditional packet compression methods are used that rely only on data within individual packets, then device complexity is reduced, but compression ratio is limited and network performance deteriorates
Solution Approach 1:
The patent merges multiple packets into a concatenated data stream for unified compression processing. Instead of compressing each packet independently, the system combines packets and applies compression algorithms across the merged data, enabling compression patterns to span packet boundaries and achieve higher compression ratios while maintaining manageable system complexity through standardized merging operations
Solution Approach 2:
The system performs preliminary actions by intercepting packets at network memory devices before they are fully processed and transferred. By capturing packets early in the transmission process and pre-processing them for compression, the system can apply compression algorithms to the raw packet data before network transfer, improving overall network performance without adding complexity to end devices
2Loss of substance
If compression is based only on data within individual packets, then implementation is simpler, but compression ratio remains low and data transfer efficiency decreases
Solution Approach 1:
The patent transitions from one-dimensional compression (within single packets) to multi-dimensional compression by concatenating multiple packets into a larger data stream. This dimensional expansion allows compression algorithms to identify and exploit repeating patterns across packet boundaries, significantly reducing data transfer volume while the modular concatenation approach keeps processing complexity manageable
Solution Approach 2:
The system introduces network memory devices as intermediary components that intercept, buffer, and pre-process packets before compression. These intermediaries handle the complex task of packet concatenation and compression preparation, reducing the data transfer volume without requiring complex compression logic at the source or destination endpoints
3Productivity
If packets are compressed using only intra-packet patterns, then processing is faster, but compression efficiency is insufficient for wide area networks
Solution Approach 1:
The system performs preliminary compression actions at network memory devices intercepting packets before they enter the wide area network. By pre-compressing data using multi-packet patterns and storing compressed results in network memory, the system reduces the amount of data that needs to be transmitted over slow wide area networks, effectively increasing data transfer rate while minimizing network transmission time
Solution Approach 2:
The patent uses copying mechanisms where network memory devices create and store copies of frequently accessed or repeating data patterns. Instead of retransmitting identical data packets over the network, the system copies previously transmitted data to network memory and references these copies, dramatically reducing network transmission time while maintaining high effective data transfer rates
Data Source
AI summary
A system, method, and computer program for compressing packet data is provided. In exemplary embodiments, one or more blocks may be identified that include block data similar to packet data of one or more packets. The one or more blocks may comprise archives of previously transferred packets. The packet data may be compressed based, at least partially, on the block data. Accordingly, the compressed packet data may be transferred over a communication network.