Data compression method in on-line backup service software

A technology of data compression and service software, which is applied in the direction of data error detection, data exchange network, electrical components, etc., which can solve the problems of server burden, network bandwidth occupation, waste of storage space, etc., and achieve the elimination of redundancy. The effect of saving data blocks and improving efficiency

Inactive Publication Date: 2010-09-01
HUAZHONG UNIV OF SCI & TECH
View PDF4 Cites 22 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, for backup service software that needs to process a large amount of data information, a large amount of data not only occupies network bandwidth and reduces transmission efficiency, but also causes a huge burden on the server due to excessive redundant data, wasting a large amount of storage space

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data compression method in on-line backup service software
  • Data compression method in on-line backup service software
  • Data compression method in on-line backup service software

Examples

Experimental program
Comparison scheme
Effect test

example

[0064] The following describes a single file backup example. Assume that there is no data on the storage side now. Divide the original file to be backed up into blocks in units of 4M, denoted as b 1 , b 2 ,...,b n . for each data block b i (1≤i≤n), get its hash value h according to the content of the data block i (1≤i≤n), and then judge whether the data block corresponding to the hash value already exists. Since these hash values ​​are "new" to the storage end, all these n blocks need to be compressed at the block level (the compressed data blocks are shaded to show the difference), and then the compressed data blocks are passed through the wide area network (WAN) or The local area network (LAN) is transmitted to the storage side for storage.

[0065] Then modify the original file, assuming that after the modification, except for the data block b n Other than that, the rest of the data blocks are unchanged. Still perform the backup operation on the original file, then...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data compression method in on-line backup service software, belongs to the field of computer storage backup services and computer data compression and aims to improve the efficiency of the storage backup service. In the invention, the method for reducing the system load through a two-stage compression strategy at a client is provided. Upper compression is global compression which is used for blocking a backup original file according to a fixed size, calculating hash value of each block and taking the hash value as an identify of the data block so as to ensure that each data block has only one copy in the global scope of a storage end. Lower compression is of block level, which is used for realizing compression in the data block through a compression algorithm so as to reduce the data quantity needing to be transmitted through the network and save the bandwidth. The combined action of the two stages of compression not only improves the efficiency of the backup service, reduces the data transmission quantity and also improves the utilization ratio of the space at the storage end.

Description

technical field [0001] The invention belongs to the field of computer backup service technology and computer data compression, in particular to a data compression method in online backup service software. Background technique [0002] With the development of computer and other information disciplines, people are exposed to more and more digital information. Data has become a valuable asset of an enterprise or even a country. However, as large as natural disasters, as small as viruses, power failures, and even accidental operator errors, all of them will affect the normal operation of the system, and even cause the system to be completely paralyzed, resulting in a large amount of data loss and irreparable losses. In such a big environment, data backup software came into being. [0003] Most of the current data backup software is a special system tailor-made for large enterprises with strong capital. For many small and medium-sized enterprises and individual users, due to sh...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L29/06H04L12/24G06F11/14
Inventor 王桦周可索念秦明康
Owner HUAZHONG UNIV OF SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products