Protocol-Specific Parsing for Long-Match Network Compression
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing data compression methods in communication networks face inefficiencies due to short matches between input streams and compression histories, synchronization challenges of shared compression histories, and limitations in leveraging previously transmitted data for compression across multiple devices without explicit hierarchies.
Innovation Solution
Implementing algorithms to identify and utilize long matches in compression histories, synchronizing and sharing compression histories across devices, and establishing an ad-hoc hierarchy of caches to efficiently compress data streams by removing application layer protocol headers and optimizing disk-based compression.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If compression histories are stored on disk with long access latencies, then storage capacity is improved, but compression speed and processing efficiency deteriorate due to multiple disk accesses required for short matches
Solution Approach 1:
The patent segments compression histories into multiple partitions stored on different disks. When a match is found in one partition, the system can stop searching other partitions, thereby reducing the number of disk accesses required and improving compression speed while maintaining total storage capacity.
Solution Approach 2:
The patent pre-processes and organizes compression history data into structured formats with indices and metadata before compression operations. This preliminary organization enables faster retrieval and reduces the need for multiple sequential disk accesses during actual compression, thus improving productivity without sacrificing storage capacity.
2Productivity
If multiple processes access compression histories simultaneously, then throughput is improved, but processing overhead and access conflicts increase
Solution Approach 1:
The patent divides compression history access across multiple disk partitions, allowing different processes to access different partitions simultaneously. This segmentation reduces access conflicts and processing overhead while maintaining high throughput, as processes can operate in parallel without interfering with each other's disk I/O operations.
3Productivity
If compression histories are synchronized across devices, then compression effectiveness is improved, but synchronization overhead and storage space requirements increase
Solution Approach 1:
The patent enables compression histories to serve multiple devices simultaneously through a shared storage architecture. Instead of each device maintaining separate complete copies, the shared history can be accessed by multiple devices, reducing total storage requirements while maintaining compression effectiveness across the device group.
Solution Approach 2:
The patent implements selective synchronization where only relevant portions of compression histories are maintained and shared across devices based on actual usage patterns. Less frequently accessed or device-specific history data can be discarded or compressed more aggressively, reducing storage space requirements while preserving compression effectiveness for commonly accessed data.
Data Source
AI summary
Systems and methods of storing previously transmitted data and using it to reduce bandwidth usage and accelerate future communications are described. By using algorithms to identify long compression history matches, a network device may improve compression efficiently and speed. A network device may also use application specific parsing to improve the length and number of compression history matches. Further, by sharing compression histories, compression history indexes and caches across multiple devices, devices can utilize data previously transmitted to other devices to compress network traffic. Any combination of the systems and methods may be used to efficiently find long matches to stored data, synchronize the storage of previously sent data, and share previously sent data among one or more other devices.