Distributed storage CEPH data distribution optimization method

A distributed storage and data distribution technology, applied in electrical components, transmission systems, etc., can solve problems such as data migration, achieve the effects of improving read and write performance, improving read performance, and saving network overhead

Inactive Publication Date: 2016-03-30
EISOO SOFTWARE
View PDF3 Cites 17 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] When the number of PGs increases, since the first layer of mapping uses the traditional hash

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed storage CEPH data distribution optimization method
  • Distributed storage CEPH data distribution optimization method
  • Distributed storage CEPH data distribution optimization method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0032] The present invention mainly makes the following optimizations to the two-level data distribution method of CEPH.

[0033] 1. Replace the ordinary hash algorithm of the first layer mapping with a consistent hash algorithm. In the traditional hash algorithm, when the number of PGs increases, all data needs to recalculate the mapping results, and the data mapping results will change greatly. The consistent hash algorithm adopts the form of hash ring. When the number of PGs increases, the change of the mapping result of the object is less than that of the traditional hash algorithm. The existing first-level mapping schematic diagram is as follows figure 1 shown. When adding a PG, objects 4, 5, and 6 will all be mapped to the new PG. After replacing with the consistent hash algorithm, only the mapping PG of object 5 has changed, such as figure 2 .

[0034] 2. In the second layer of mapping, add a localization parameter to the CRUSH algorithm, so that under certain cir...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a distributed storage CEPH data distribution optimization method, which comprises the steps of 1) replacing the common hash algorithm in the first-layer mapping relationship with the consistent hash algorithm; 2) in the second-layer mapping relationship, adding a localized parameter for the CRUSH algorithm; and enabling the application and a primary copy at the same CEPH node in a set condition. Compared with the prior art, the method solves the CEPH data mapping problem and improves the data reading performance.

Description

technical field [0001] The invention relates to the technical field of computer storage, in particular to a data distribution optimization method for distributed storage CEPH. Background technique [0002] With the development of information technology, the global data is exploding. A centralized storage server cannot meet the requirements of high reliability and scalability of the system, and will be a performance hotspot. Distributed storage solves these problems well. CEPH is an open source distributed storage system that can also provide block, file and object interface services at the same time. Its bottom layer is an object storage system RADOS. Compared with other distributed file systems, CEPH's data distribution algorithm is one of its highlights. Traditional data mapping uses metadata to query specific locations, so metadata query will become a performance hotspot. CEPH applies a two-level data mapping algorithm, so that data mapping does not require metadata q...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L29/08
CPCH04L67/1097
Inventor 鲁莎莎
Owner EISOO SOFTWARE
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap