Supercharge Your Innovation With Domain-Expert AI Agents!

A distributed storage data verification method and device

A distributed storage and data verification technology, which is applied in the field of distributed storage data verification methods and devices, can solve problems such as unfavorable data verification, inability to perform data verification, long scanning time of the whole cluster, etc., and achieve improved verification efficiency effect

Active Publication Date: 2021-08-17
TENCENT TECH (SHENZHEN) CO LTD
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Because the pressure of the general distributed storage cluster will be relatively low at night, the operation at night will have less impact on the business; however, because the time for data verification to be enabled is relatively short, data verification cannot be performed most of the time
When the amount of cluster data is large, the full cluster scan time is very long, which increases the risk of data inconsistency in distributed storage
Turning on and off at the same time requires a lot of operation and maintenance operations, which increases the cost of operation and maintenance
[0006] (2) Reduced rate verification method
This method is simple and easy to operate. It can ensure the progress of data verification IO without excessively affecting the performance of business IO. However, it is difficult to determine the IO rate of data verification. Too fast will affect business IO, and too slow will not be conducive to the overall data validation

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A distributed storage data verification method and device
  • A distributed storage data verification method and device
  • A distributed storage data verification method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0028] In order to enable those skilled in the art to better understand the solutions of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention.

[0029] It should be noted that the terms "first" and "second" in the description and claims of the present invention and the above drawings are used to distinguish similar objects, but not necessarily used to describe a specific sequence or sequence. It is to be understood that the data so used are interchangeable under appropriate circumstances such that the embodiments of the invention described herein can be practiced in sequences other than those illustrated or described herein. Furthermore, the terms "comprising" and "having", as well as any variations thereof, are intended to cover a non-exclusive inclusion, for example, a process, method, system, product or device compr...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention relates to the field of computer technology, in particular to a method and device for verifying distributed storage data. By monitoring the read-write usage rate of a disk in a distributed storage system, the read-write usage rate is compared with a preset read-write threshold. Compare, and dynamically adjust the amount of read and write of verification data based on the comparison results, so as to ensure the normal reading and writing of business data, make full use of the read and write performance of storage disks, and improve the verification efficiency of verification data.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to a distributed storage data verification method and device. Background technique [0002] In existing distributed storage systems, multiple copies are usually used to ensure data security. For one piece of data, two or three copies are usually set. When one piece of data is lost, other copies can be used for recovery. In order to ensure the correctness of the replica, it is necessary to regularly scan and compare the replica in all directions to verify the correctness of the replica. However, this is a very time-consuming operation and will also affect the performance of the business. [0003] In the prior art, in order to solve the problem of data verification in distributed storage, there are usually two methods: an idle time verification method and a speed reduction verification method. [0004] (1) Idle time calibration method [0005] In order to reduce the impact of veri...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/06
Inventor 潘晓东
Owner TENCENT TECH (SHENZHEN) CO LTD
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com