Data verification method and data verification system in distributed storage system

A distributed storage and data verification technology, which is applied in the field of data verification methods and data verification systems, can solve problems that affect users' normal use of the ceph system and data inaccessibility, and achieve the effect of reducing impact and locking time

Active Publication Date: 2019-07-26
XIAMEN WANGSU CO LTD
View PDF17 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This will cause some data in the ceph system to be inaccessible for a certain period of time, or in a state of high load operation, which will affect the normal use of the ceph system by users

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data verification method and data verification system in distributed storage system
  • Data verification method and data verification system in distributed storage system
  • Data verification method and data verification system in distributed storage system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0015] In order to make the object, technical solution and advantages of the present invention clearer, the implementation manner of the present invention will be further described in detail below in conjunction with the accompanying drawings.

[0016] The present application provides a data verification method in a distributed storage system, and the distributed storage system may be a ceph system. Such as figure 1 As shown, in the ceph system, the file to be stored (file) can be divided into multiple objects (object), these objects can be distributed to each PG through a preset algorithm, and each PG can be distributed to each OSD middle. In this way, the objects obtained by file division can finally be stored in OSD through the organization form of PG.

[0017] In this application, in order to realize the consistency verification of some storage pools, placement groups and files in the distributed storage system, verification configuration information can be created in th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data verification method and a data verification system in a distributed storage system, and the method comprises the steps: judging whether a target placement group in current object storage equipment belongs to a to-be-verified placement group or not according to verification configuration information; if the target placement group belongs to a placement group to be verified, judging whether a current object in the target placement group belongs to a file limited by the verification configuration information or not; if the current object belongs to a file limited bythe verification configuration information, performing data verification on the current object; and if the current object does not belong to the file limited by the verification configuration information, abandoning data verification on the current object, and judging whether the next object in the target placement group belongs to the file limited by the verification configuration information. According to the technical scheme provided by the invention, when the ceph system executes the consistency verification, the influence on the normal use of a user is reduced.

Description

technical field [0001] The invention relates to the technical field of the Internet, in particular to a data verification method and a data verification system in a distributed storage system. Background technique [0002] With the explosive growth of data in the Internet, the importance of data persistent storage systems has become increasingly prominent. The storage capacity of a traditional single storage server is limited. Therefore, at present, multiple storage servers can be combined into a distributed storage system to store data persistently. [0003] The Ceph system is being used by more and more users due to its excellent storage, reliability and scalability. There are multiple storage pools (pools) in the Ceph system, and each storage pool can have its own independent placement group (Placement Group, PG), and the PG can be distributed to different object storage devices (Object storage devices) according to the random algorithm of the ceph system. Storage Devic...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/182G06F16/10
CPCG06F16/10G06F16/182
Inventor 黄侨星
Owner XIAMEN WANGSU CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap