System and method for synchronizing files through differential compression

Abstract

A computer system identifies a first file set of a first plurality of files. The computer system generates a first view of the first file set and receives, from a destination, a second view of a second file set of a second plurality of files. The computer system generates a difference based on the first view, the second view, and the first file set and transfers the difference to the destination, which is configured to generate the first file set from the second file set and the difference.

Description

RELATED APPLICATIONS[0001]This application claims the benefit of U.S. Provisional Patent Application No. 61 / 921,366, titled “System and Method for Transferring Files through Differential Compression,” filed Dec. 27, 2013, which is incorporated by reference herein in its entirety.FIELD OF THE INVENTION[0002]The present application generally relates to network file transfer, in particular, to system and method for transferring files through differential compression.BACKGROUND OF THE INVENTION[0003]With the advent of big data, the problem of transferring massive amounts of data over the Internet has become even more challenging. Many organizations, e.g., global companies have urgent needs to move massive files from data center to data center or from headquarter to headquarter, or upload large volume of files to the cloud. Examples include file replication, disaster recovery, remote backup, file sharing and synchronizing, file distribution and publishing, and so on. Traditional file tra...

AI Technical Summary

Benefits of technology

The present application is a computer system that can transfer file sets from one source to another. It identifies changes between different versions of a file set and generates a difference based on those changes. This difference is then transferred to the destination, which reconstructs the file set from the difference and the destination's version. The application can also categorize files based on their sizes and transfer file aggregations with a smaller file size. The technical effects of this application include improved file transfer efficiency and reduced bandwidth consumption.

Problems solved by technology

With the advent of big data, the problem of transferring massive amounts of data over the Internet has become even more challenging.

Traditional file transfer technologies, such as File Transfer Protocol (FTP) and RSYNC, are facing challenges when carrying those tasks due to the overwhelming volume of data traffic across the network infrastructure.

Images