Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Metadata storage performance optimization method and storage server

A storage server and storage performance technology, applied in the direction of electrical digital data processing, input/output process of data processing, instruments, etc., can solve the problems of increasing hardware cost, cost increase, and reducing the number of data disks, so as to improve access speed, The cost will not increase and the effect of improving storage performance

Active Publication Date: 2020-04-10
FENGHUO COMM SCI & TECH CO LTD
View PDF2 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] 1. When using SSD hard disk, although better storage performance can be obtained, it needs to occupy the disk slot of the server. If each server is equipped with 1 to 2 SSD hard disks, the number of data disks will inevitably decrease, which will reduce the server storage density;
[0006] 2. Increase hardware cost, the increase of hardware cost will inevitably be caused by the increase of SSD hard disk, and at the same time, the number of data disks per server is reduced. In the case of the same storage capacity, more servers need to be configured, which also brings cost increase

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Metadata storage performance optimization method and storage server
  • Metadata storage performance optimization method and storage server
  • Metadata storage performance optimization method and storage server

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0041] figure 1 is a flow chart of a metadata storage performance optimization method provided in this embodiment, see figure 1 As shown, the method includes:

[0042] S1: Reserve storage space in the SSD hard disk of the storage server and create WAL partitions in the storage space, the number of WAL partitions is not less than the number of data disks;

[0043] From the writing process of Rocksdb, when processing a write request, the WAL file needs to be written first, and this part of the data must be persisted to the hard disk, which has the greatest impact on the metadata writing speed. However, the metadata information capacity of OSD is not large, and WAL files are used for data recovery in case of failure, so WAL files do not require a large amount of hard disk capacity, and generally only need a small amount of storage space. Therefore, in this embodiment, an SSD hard disk is used to store WAL files, and at the same time, in order not to occupy the disk slot of the ...

Embodiment 2

[0065] This embodiment provides a kind of storage server, and this storage server comprises SSD hard disk and a plurality of data disks; Wherein, the SSD hard disk is configured with a plurality of WAL partitions, and the number of the WAL partitions is not less than the number of data disks;

[0066] The WAL storage of the OSD components created in each data disk is designated to use a corresponding WAL partition in the SSD hard disk;

[0067] When the data disk receives a data write request, the OSD component in the data disk accesses the SSD hard disk to write the WAL file corresponding to the metadata into the WAL partition corresponding to the data disk.

[0068] Further, each WAL partition in the SSD hard disk has a corresponding logical partition, and the WAL file storage of the OSD component in each data disk uses a logical partition corresponding to the WAL partition.

[0069] Each data disk has a pre-created logical partition, and the metadata storage of OSD componen...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a metadata storage performance optimization method and a storage server, and belongs to the technical field of distributed storage. The method comprises the following steps: creating WAL partitions in an SSD hard disk of a storage server, wherein the number of the WAL partitions is not less than that of data disks; specifying the WAL of the OSD component created in each data disk to store and use one corresponding WAL partition in the SSD hard disk; after the data disk receives the data writing request, the OSD component accesses the SSD hard disk so as to write the WALcorresponding to the metadata into the corresponding WAL partition; according to the method, the WAL file is configured on the SSD hard disk, so that the access speed of OSD metadata can be increased, and the storage performance is improved; besides, due to the fact that the storage space occupied by the WAL file is small, the SSD hard disk is used as a system disk and does not occupy a disk slotof the server, the storage density of the storage server is kept unchanged under the condition that the storage performance is improved, and the cost of the storage server is not increased.

Description

technical field [0001] The invention belongs to the technical field of distributed storage, and more specifically relates to a metadata storage performance optimization method and a storage server. Background technique [0002] Ceph is an open source distributed storage software, which can form a unified storage resource pool of standard servers and server local hard disks, and provide a highly reliable and scalable storage system. The most basic core components of Ceph include monitor and OSD. The monitor component is responsible for the management of the entire storage cluster, and the OSD is mainly responsible for data storage. The same data will be stored in multiple copies to ensure data reliability. [0003] When the Ceph client writes data, it will fragment the data according to a fixed size, and then send each fragmented data to the OSD. The OSD saves the data into two parts: data and metadata. Data refers to user The real data written is directly saved on the hard ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/06
CPCG06F3/067G06F3/0689G06F3/0643G06F3/0644G06F3/0614
Inventor 王振宇
Owner FENGHUO COMM SCI & TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com