Method and device for quickly verifying consistency of multi-duplicate storage

A consistent, multi-copy technology, applied in the direction of response error generation, input/output to record carrier, etc., can solve problems such as affecting system performance, wasting resources, consuming large CPU and disk bandwidth, etc.

Inactive Publication Date: 2017-09-26
深圳市联云港科技有限公司
View PDF4 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

But for large files, calculating the hash value will consume a lot of CPU and disk bandwidth, seriously affecting the performance of the system
File incons...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for quickly verifying consistency of multi-duplicate storage
  • Method and device for quickly verifying consistency of multi-duplicate storage
  • Method and device for quickly verifying consistency of multi-duplicate storage

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0029] In order to further illustrate the technical means adopted by the present invention and its effects, the following describes in detail in conjunction with preferred embodiments of the present invention and accompanying drawings.

[0030] To solve the above problems, the present invention provides a fast file hash calculation method based on sparse files and a fast multi-copy consistency detection method based on snapshot technology.

[0031] Please refer to figure 1 , the present invention provides a method for quickly verifying the consistency of multi-copy storage, comprising the following steps:

[0032] S1: When the system is in an idle state, judge the amount of data written in the head file. When the amount of data written in the head file reaches more than 30% of the entire sparse file, use the I / O redirection technology to create a snapshot file and continue writing. The new head file of the input data is used as a blank control sparse file, the hash value of t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a method and a device for quickly verifying the consistency of multi-duplicate storage. The method includes S1, judging data writing volumes of head files when systems are in idle states, creating snapshot files by the aid of I/O (input/output) redirection technologies when the volumes of data written into the head files reach 30% of the volumes of integral spare files at least, utilizing new head files with continuously written data as null comparison sparse files, computing hash values of the snapshot files and storing the hash values of the snapshot files as extended attributes; S2, carrying out snapshot operation on the head files once at intervals of preset time and comparing hash values of the new head files to the hash values of the snapshot files when the consistency of multi-duplicate data need to be timely verified. The method and the device have the advantages that characteristics of distributed block storage are combined with one another, the method for quickly detecting the consistency of multiple duplicates on the basis of snapshot technologies is proposed, hash value computation tasks are divided to be carried out in multiple time slots, accordingly, influence on normal reading and writing tasks of the systems can be prevented, and the multi-duplicate storage consistency verification speeds can be increased.

Description

technical field [0001] The invention relates to the technical field of distributed data storage and data verification, in particular to a multi-copy storage fast verification consistency method and a device thereof. Background technique [0002] Most of the existing distributed storage systems use multi-copy technology to improve system reliability, availability, performance and scalability. [0003] Multi-copy technology can ensure that when individual hosts and disks in the distributed storage system fail, the system can still provide normal read and write services, improving system reliability, and multiple copies can be used for shunting and speeding up response time. However, the distributed storage system communicates through the network, and the instability of the network may easily cause inconsistency of the back-end data, and the distributed storage system generally includes a large number of server hosts and disks, and the probability of hardware damage is relative...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/06G06F11/07
Inventor 陈仲涛
Owner 深圳市联云港科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap