Ceph-based element selection method, device, server and storage medium

An element and cache technology, applied in the field of distributed databases, can solve the problem of unbalanced OSD distribution of items, etc., and achieve the effect of reducing time complexity and excellent performance

Active Publication Date: 2021-02-26
柏科数据技术(深圳)股份有限公司
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The embodiment of the present invention provides a CEPH-based element selection method, device, server equipment, and storage medium to solve the technical problem in the prior art that the OSD cannot be balancedly distributed items for a specific storage pool

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Ceph-based element selection method, device, server and storage medium
  • Ceph-based element selection method, device, server and storage medium
  • Ceph-based element selection method, device, server and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0028] figure 1 It is a flow chart of the CEPH-based element selection method provided by Embodiment 1 of the present invention. This embodiment is applicable to the situation of selecting elements in the CEPH distributed database. The method can be distributed by the data of multiple storage pools based on CEPH device, and can be integrated in the ceph server, which specifically includes the following steps:

[0029] S110, calculate the product result of the CRUSH_HASH input parameters, the CRUSH_HASH input parameters include: bucket x, bucket id and selection times r.

[0030] In the ceph distributed database, buckets are used to represent the intermediate nodes of the hierarchical structure, and the leaf nodes are the corresponding OSDs. Each type of bucket uses a different data structure to organize its contents, which can be other Buckets or OSDs.

[0031] In the ceph distributed database, osd is equivalent to the physical storage unit of PG, and the OSD corresponding t...

Embodiment 2

[0047] figure 2 It is a schematic flowchart of the CEPH-based element selection method provided in Embodiment 2 of the present invention. This embodiment is optimized on the basis of the foregoing embodiments. In this embodiment, the method may further include the following step: caching the CRUSH_HASH input parameter and the product result corresponding to the CRUSH_HASH input parameter.

[0048] Correspondingly, the CEPH-based element selection method provided in this embodiment specifically includes:

[0049] S210, calculate the product result of the CRUSH_HASH input parameters, the CRUSH_HASH input parameters include: bucket x, bucket id and selection times r.

[0050] S220. Using the product result as a random number seed, use the MT19937 algorithm to generate a 32-bit pseudo-random number rand corresponding to the number of items included in the bucket.

[0051] S230. Calculate the product of the weight ratio of the pseudo-random number and its corresponding item, and...

Embodiment 3

[0063] image 3 It is a schematic structural diagram of a CEPH-based multi-storage pool data distribution device provided in Embodiment 3 of the present invention, as shown in image 3 As shown, the device includes:

[0064] The calculation module 310 is used to calculate the product result of the CRUSH_HASH input parameters, the CRUSH_HASH input parameters include: bucket x, bucket id and selection times r;

[0065] Pseudo-random number generating module 320, for using the product result as a random number seed, using the MT19937 algorithm to generate a 32-bit pseudo-random number rand corresponding to the number of items included in the bucket;

[0066] The selection module 330 is configured to calculate the product of the weight ratio of the pseudo-random number and the corresponding item, and determine the selected item according to the result of the product.

[0067] The CEPH-based multi-storage pool data distribution device provided in this embodiment calculates the pr...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the present invention discloses a CEPH-based element selection method, device, device, and storage medium, wherein the method includes: calculating the product result of CRUSH_HASH input parameters, and the CRUSH_HASH input parameters include: bucket x, bucket id and the number of selections r; use the product result as a random number seed, use the MT19937 algorithm to generate a 32-bit pseudo-random number rand corresponding to the number of items included in the bucket; calculate the pseudo-random number and its corresponding The product of the weight ratio of the item, and the selected item is determined according to the result of the product.

Description

technical field [0001] The invention relates to the technical field of distributed databases, in particular to a CEPH-based element selection method, device, equipment and storage medium. Background technique [0002] Ceph is a unified, distributed file system designed for excellent performance, reliability, and scalability. Ceph abandons the traditional centralized storage metadata addressing scheme, adopts the CRUSH algorithm, the data distribution is balanced, and the degree of parallelism is high. It also considers the isolation of disaster recovery domains, and can implement replica placement rules for various loads, such as cross-computer room, rack awareness, etc. It can support the scale of thousands of storage nodes and support TB to PB level data. [0003] The traditional distributed storage system ceph cuts data into objects of fixed size. Ceph uses Bucket to organize the storage resources of the system according to the hierarchical structure to achieve two goal...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/11G06F16/13G06F16/172G06F16/182G06F7/58
CPCG06F7/582G06F16/119G06F16/137G06F16/172G06F16/182
Inventor 胡玉晟龚立义
Owner 柏科数据技术(深圳)股份有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap