Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Difference synchronizing method for oversized file

A file and difference technology, applied to electrical components, transmission systems, etc., can solve problems such as long synchronization time, large storage space, and inability to effectively support large file synchronization, so as to avoid memory fragmentation and reduce time.

Inactive Publication Date: 2013-10-30
上海咏云信息技术有限公司 +1
View PDF0 Cites 24 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, after the file is synchronized many times, there will be a large number of copies, and in many cases there are only small differences between these copies
If the file is only slightly modified but synchronized in full, it will take up a lot of network bandwidth and the synchronization time will be longer
In addition, full backup files also need to take up a lot of storage space to save each version of the file
Especially for enterprise-level cloud storage systems, the files to be synchronized are getting larger and larger, ranging from hundreds of gigabytes to terabytes. If there is no new file synchronization algorithm, the existing network bandwidth cannot effectively support the synchronization of very large files

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Difference synchronizing method for oversized file
  • Difference synchronizing method for oversized file
  • Difference synchronizing method for oversized file

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0039] The present invention is described in further detail now in conjunction with accompanying drawing.

[0040] Explanation of related terms:

[0041] ERDC: Enhanced Remote Differential Compression, a set of file difference synchronization algorithms improved on the basis of RDC and Rsync algorithms.

[0042] Seed file: It exists on the target machine and is used to compare with the Revision file to generate a Delta file, and to generate a Target file on this basis.

[0043] Revision file: A file that exists on the source computer and is copied to the target.

[0044] Target file: The file copied to the target machine, the content is exactly the same as the Revision file.

[0045] Delta file: A file that records the difference between the Revision file and the Seed file, which contains which data comes from the Revision file and which data comes from the Seed file.

[0046] Signature file: A file containing data block information, each data block information has a weak h...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a difference synchronizing method for an oversized file and belongs to the technical field of computer data storage. The method comprises the steps that a cloud computer calculates to obtain a difference file, and sends the difference file to a target computer, and the target computer only synchronizes different data blocks needing to be synchronized by comparing the data blocks of a target file and those of the difference file and eventually generates a new file which is identical with the cloud file. The difference synchronizing method for the oversized file has the advantages of being good in support for oversized files, excellent in Hash algorithm, good in support for multiple platforms and the like.

Description

technical field [0001] The invention relates to the technical field of computer data storage, in particular to a differential synchronization method for super-large files. Background technique [0002] With the rise of cloud storage technology, the application of synchronizing files through a wide area network (WAN), and backing up files is becoming more and more common. The simplest way to do file synchronization is to make a full copy of the file. However, when a file is synchronized many times, there will be a large number of copies, and in many cases there will be only small differences between these copies. If the file is only slightly modified but fully synchronized, it will take up a lot of network bandwidth and the synchronization time will be longer. In addition, full backup files also need to occupy a large amount of storage space to save each version of the file. Especially for enterprise-level cloud storage systems, the files to be synchronized are getting lar...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): H04L29/08
Inventor 张咏
Owner 上海咏云信息技术有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products