Data processing method, backup server and storage system

A technology for backing up servers and storage systems, applied in the computer field, can solve problems such as low data storage efficiency

Active Publication Date: 2017-02-15
HUAWEI TECH CO LTD +1
View PDF4 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The embodiment of the present invention provides a data processing method, a backup server and a storage system, which are used to solve the problem of low data storage efficiency due to the consumption of a large number of I / O resources by fingerprint comparison

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method, backup server and storage system
  • Data processing method, backup server and storage system
  • Data processing method, backup server and storage system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment approach

[0082] In the embodiment of the present invention, the data processing methods corresponding to steps 101 to 104 may have at least two implementation manners, which will be introduced respectively below.

Embodiment approach 1

[0084] Figure 4 It is a schematic structural diagram of a storage system 20 corresponding to Embodiment 1, and the storage system 20 includes: a backup server 21 and a plurality of storage devices 22 . In Embodiment 1, steps 101 to 104 are executed by the backup server 21 .

[0085] Wherein, the backup server 21 includes: a processor 211 , a memory 212 , and an auxiliary storage 213 , and the auxiliary storage 213 includes a processing unit 214 , therefore, the auxiliary storage 213 has computing capability. The fingerprint table in the storage system is stored in the auxiliary storage 213. In actual situations, the number of the auxiliary storage 213 may be one, or two or more. The backup server 21 stores a fingerprint index table, which can be stored in the memory 212 , or in the auxiliary storage 213 , or in other storage units of the backup server 21 .

[0086] Figure 5 is a schematic diagram of the fingerprint index table, at least two index fingerprints of each fing...

Embodiment approach 2

[0101] Figure 7 It is a schematic structural diagram of a storage system 30 corresponding to Embodiment 2, and the storage system 30 includes: a backup server 31 and a plurality of storages 32 . In Embodiment 2, steps 101 to 104 are executed by the backup server 31 .

[0102] Wherein, the memory 32 is used to store the data block and the fingerprint table, and the form of the fingerprint table can refer to Figure 5 The fingerprint table stored in the memory 32 may be formed by the fingerprint information corresponding to the data blocks stored in the memory, and the fingerprint table stored in the memory 32 may also be fingerprint information of other data blocks that are not related to the data blocks stored in the memory 32 itself. The backup server 31 includes a processor 311 and a memory 312 . A fingerprint index table is stored in the backup server 31 , and the fingerprint index table may be stored in the memory 312 or in other storage units of the backup server 31 . ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data processing method, a backup server and a storage system, and aims to solve the problems of low data storage efficiency caused by fingerprint comparison consuming mass I/O resources; the data processing method comprises the following steps: determining a first fingerprint set according to index fingerprints in a fingerprint index table and a fingerprint of a to-be-stored data block; obtaining a first probability that the first fingerprint table contains the fingerprint identical to the fingerprint of the to-be-stored data block according to the first index fingerprint, and obtaining a second probability that the second fingerprint table contains the fingerprint identical to the fingerprint of the to-be-stored data block according to the second index fingerprint; determining a second fingerprint set according to the first and second probabilities; obtaining a matching result between the plurality of fingerprints represented by the first index fingerprint and the fingerprint of the to-be-stored data block.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to a data processing method, a backup server and a storage system. Background technique [0002] In the field of data storage, data deduplication technology is a key technology to save data storage space. It can detect and eliminate data redundancy, leaving only one copy of the same data, which can not only greatly save disk space, but also improve Data writing performance and saving network bandwidth are widely used in file backup, online storage service, email service and other fields. [0003] In the prior art, a fingerprint table is stored in the storage system, and the fingerprint table stores the fingerprints of the data already stored in the storage system. When receiving a data storage request, the storage system compares the fingerprint of the data block to be stored with the fingerprint in the fingerprint table to determine whether the data block to be stored is duplica...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30G06F11/16
Inventor 吴晨涛黄洵松薛常亮王元钢
Owner HUAWEI TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap