Quick data verification method, device and system for cloud storage system

A cloud storage system and data verification technology, applied in the field of cloud storage, can solve problems such as high error risk and slow verification speed

Active Publication Date: 2022-03-08
深圳市木浪云科技有限公司
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] Embodiments of the present invention provide a fast data verification method, device and system for a cloud storage system, to at least solve the problem that data needs to go thro

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Quick data verification method, device and system for cloud storage system
  • Quick data verification method, device and system for cloud storage system
  • Quick data verification method, device and system for cloud storage system

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0038] Example 1

[0039] According to an embodiment of the present invention, a fast data check method of a cloud storage system is provided, such as image 3 As shown, the method includes:

[0040] Step S302, receive the sample check command;

[0041] Step S304, extract the data file required to verify the target file from the sampling check command, obtain the data set required for the sample, form the metadata of the data set required to be verified, and analyze the Metadata of the data set that needs to be verified;

[0042] Wherein, the extracted data file includes: the target file, a check code file corresponding to the target file, a sample check ratio, wherein the code code file includes a calibration algorithm, a check code length, a school Experience the code array length, check code array and check code.

[0043] In an exemplary embodiment, based on the extracted data file, the sampling rule is called, the data set that needs to be verified is acquired, where the sampli...

Example Embodiment

[0053] Example 2

[0054] According to an embodiment of the present invention, a fast data check method of another cloud storage system is provided, such as Figure 4 As shown, the method includes:

[0055] Step S402, the initiation of the verification task;

[0056] The verification task initiation step is to sample the sample check instruction by the interface of the backup module to sample the disk file of a virtual machine, whether there is a data error.

[0057] In an exemplary embodiment, combined Figure 5 The initiative of the verification task can include the following steps:

[0058] 1) User application initiates sampling check command to the backup module;

[0059] 2) After the backup module receives the sample check command, the sampled verification task scheduler schedule file is required to verify the data file required to verify the target file according to the calibration of the backup data. The generated plan file contains the necessary information of the data check...

Example Embodiment

[0086] Example 3

[0087] According to an embodiment of the present invention, there is a rapid data check method of still another cloud storage system, such as Figure 5 As shown, the method includes:

[0088] Step S502, initiate a verification task;

[0089] The verification task initiation step is to sample the sample check instruction by the interface of the backup module to sample the disk file of a virtual machine, whether there is a data error.

[0090] Step S504, preprocessing the verification task;

[0091] The file system service of the storage system reads the check task plan file, obtains the necessary information of the data check, including the target file, the corresponding check code file, sampling check scale. The file system of the storage system transmits the relevant information of the program file to the data sampling module by sampleting the data sample module of the metadata service cluster by sampling the interface module. The data sampling module calls the ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a quick data verification method, device and system for a cloud storage system. The method comprises the steps that the method is executed in a cloud storage system, and the method comprises the steps that a sampling verification instruction is received; extracting a data file required for checking a target file from the sampling checking instruction, obtaining a data set needing to be sampled based on the extracted data file, forming metadata of the data set needing to be checked, and analyzing the metadata of the data set needing to be checked; dividing a data verification process into a plurality of verification subtasks according to an analysis result of the metadata and the number of service nodes of data blocks of the target file; and executing the plurality of verification subtasks in parallel to verify the data. According to the method and the device, the technical problems of relatively slow verification speed and relatively high error risk caused by the fact that data needs to experience a longer path than that of a traditional file system when a file is read from a client of the distributed file system are solved.

Description

technical field [0001] The present invention relates to the field of cloud storage, in particular to a fast data verification method, device and system for a cloud storage system. Background technique [0002] When computer systems transmit and store data, errors will inevitably occur. In order to avoid this kind of error, on the one hand, start from the hardware to improve the anti-interference ability and reliability of the hardware; on the other hand, take code correction measures in data coding, so that the machine can find errors and even correct them by itself. This kind of data coding with error detection or automatic error correction capability is usually called data check code. The principle is to add some check bits to the data to form a data check code, and to judge whether there is an error or to correct it by checking the validity of the data check code. Commonly used data check codes include parity check code, Hamming check code, cyclic redundancy check code ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F11/10G06F16/182G06F3/06
CPCG06F11/1004G06F16/182G06F3/0608G06F3/067G06F3/0641
Inventor 陈元强蔡涛吴健辉
Owner 深圳市木浪云科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap