VPN Defragmentation and Deduplication for Bandwidth Optimization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Virtual private networks (VPNs) face bandwidth bottlenecks, latency, and data integrity issues due to packet fragmentation and duplication, especially when connecting remote branch offices to central datacenters over low-bandwidth links, which affects application performance and data access.
Innovation Solution
A VPN defragmentation and de-duplication system that divides data objects into data paragraphs, computes hashes, and transmits only new paragraphs over the network, using caching to minimize data transfer and optimize traffic, while reconstituting the original data at the destination.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If data is transmitted over VPN with encryption, then security is improved, but bandwidth efficiency deteriorates due to encryption overhead and latency
Solution Approach 1:
The patent divides data objects into smaller data paragraphs before transmission. This segmentation allows the receiving end to reconstruct the original data more efficiently and enables better control over what data is transmitted over the encrypted VPN connection, thereby improving bandwidth efficiency while maintaining security through the encryption of these segmented packets.
Solution Approach 2:
The patent performs defragmentation and deduplication actions at the sending end before data is transmitted over the VPN. By preparing the data in advance - breaking it into manageable paragraphs and identifying duplicates - the system reduces the actual data load over the encrypted connection, improving bandwidth efficiency without compromising the security provided by VPN encryption.
2Productivity
If packet size is increased to improve bandwidth efficiency, then transmission speed is improved, but fragmentation increases causing router performance degradation
Solution Approach 1:
The patent applies segmentation by dividing data objects into data paragraphs of controlled size. This prevents excessive fragmentation at routers while maintaining efficient bandwidth utilization. The segmented approach allows each packet to be appropriately sized for the network infrastructure, avoiding the performance degradation caused by over-fragmentation.
Solution Approach 2:
The patent changes the parameter of data packet size by creating data paragraphs with optimized dimensions. By adjusting the size parameter of individual packets rather than transmitting large monolithic data, the system achieves better router performance while maintaining bandwidth efficiency through the structured segmentation approach.
3Reliability
If data is transmitted multiple times over VPN, then data completeness is improved, but network traffic increases causing congestion
Solution Approach 1:
The patent uses copying by creating a virtual copy of the data structure at the receiving end. The receiving end maintains a virtual copy of received data paragraphs and uses this to identify which paragraphs have already been received. This allows the system to transmit data multiple times for completeness while avoiding redundant network traffic by knowing what has already been successfully received.
Solution Approach 2:
The patent implements feedback mechanisms where the receiving end communicates back to the sending end which data paragraphs have been successfully received. This feedback loop enables the sending end to avoid retransmitting already received data, reducing unnecessary network traffic while ensuring data completeness through targeted retransmission only when needed.
Solution Approach 3:
The patent applies discarding and recovering by identifying duplicate data paragraphs at the receiving end and discarding redundant copies. The system recovers from potential data loss by selectively retransmitting only the missing or corrupted paragraphs rather than retransmitting the entire data object, thereby reducing network traffic while maintaining data completeness.
Data Source
AI summary
A transmission apparatus operation method for optimizing a virtual private network operates by defragmenting and de-duplicating transfer of variable sized blocks. A large data object is converted to a plurality of data paragraphs by a fingerprinting method. Each data paragraph is cached and hashed. The hashes are transmitted to at least one satellite apparatus. Only data paragraphs which were not previously cached at each satellite are transferred.