File Synchronization via Chunk Signatures and Edit Operations
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current remote differential compression protocols are inefficient in reconstructing files over a network, particularly in scenarios where only partial changes are made to a file, leading to high bandwidth consumption and suboptimal synchronization processes.
Innovation Solution
The method involves splitting files into chunks, generating signatures, and using a sequence of string edit operations (COPY and ADD) to reconstruct the target file from a reference file, optimizing chunk sizes and hash functions for efficient communication and reconstruction, with the sender computer initiating the chunking process for improved efficiency in 1-to-many one-way file synchronization.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of energy
If conventional remote differential compression protocols (like RSYNC) are used, then file synchronization can be achieved, but bandwidth consumption is high and synchronization efficiency is suboptimal
Solution Approach 1:
The patent divides the target file into multiple chunks and compares them with corresponding chunks from the reference file. This segmentation allows the system to identify and transmit only the differences between chunks rather than the entire file, significantly reducing bandwidth consumption while maintaining synchronization efficiency.
Solution Approach 2:
The patent introduces a parameter k that controls the chunk size and the number of chunks to compare. By adjusting this parameter, the system optimizes the balance between computational overhead and bandwidth savings, achieving superior synchronization efficiency compared to conventional protocols.
2Measurement precision
If the sender computer performs chunking and signature generation, then synchronization precision is improved, but computational complexity increases
Solution Approach 1:
The patent segments the file into chunks and generates signatures for each chunk, enabling precise identification of differences. This segmentation approach maintains high synchronization precision while the computational complexity is managed through efficient signature comparison algorithms.
Solution Approach 2:
The patent uses signatures (hashes) as copies of chunk information to compare without transmitting the actual chunk data. This copying approach allows precise synchronization verification with reduced computational overhead, as only the signatures need to be compared rather than the entire file contents.
Data Source
AI summary
A system includes a sender computer and a recipient computer. The sender computer starts the chunking process by splitting a target file into chunks and providing signatures of the chunks of the target file to the recipient computer. After and in response to receiving the signatures of the chunks of the target file, the recipient computer splits the reference file into chunks, generates signatures of the chunks of the reference file, and identifies chunks that are common between the target file and the reference file. The recipient computer combines adjacent common chunks into larger chunks and creates, for example, MD5 signatures accordingly. The sender computer receives from the recipient computer information on chunks common between the target file and the reference file and provides a sequence of edit operations to the recipient computer to allow the recipient computer to reconstruct the target file.