RocksDB performance improvement method and system and storage medium

A technology for improving systems and storage media. It is used in instruments, electrical digital data processing, input/output to record carriers, etc. It can solve problems such as low efficiency and low RocksDB performance, and achieve the goal of improving performance and reducing I/O delay. Effect

Active Publication Date: 2021-07-16
SHANDONG YINGXIN COMP TECH CO LTD
View PDF9 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In view of this, the object of the present invention is to propose a RocksDB performance improvement method, system and storage medium to solve the problem of low RocksDB performance in the prior art due to the low efficiency of submitting pre-written logs

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • RocksDB performance improvement method and system and storage medium
  • RocksDB performance improvement method and system and storage medium
  • RocksDB performance improvement method and system and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027] In order to make the object, technical solution and advantages of the present invention clearer, the embodiments of the present invention will be further described in detail below in conjunction with specific embodiments and with reference to the accompanying drawings.

[0028] It should be noted that all expressions using "first" and "second" in the embodiments of the present invention are used to distinguish two entities with the same name or different parameters. It can be seen that "first" and "second" " is only for the convenience of expression, and should not be understood as limiting the embodiment of the present invention. Furthermore, the terms "comprising" and "having", as well as any variations thereof, are intended to cover a non-exclusive inclusion, for example, of a process, method, system, product or other steps or elements inherent in a process, method, system, product, or device comprising a series of steps or elements.

[0029] Based on the above purpo...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a RocksDB performance improvement method and system and a storage medium, and the method comprises the steps: generating a write operation class in response to RocksDB, putting the write operation class into a write queue, and querying whether there are preset n write operation class leading queues in the write queue, wherein n is greater than 1; in response to the fact that no write operation class leader exists in the write queue and the total number m of write operation classes in the write queue is larger than n, selecting n write operation classes from the write queue to serve as the write operation class leader, and merging the other write operation classes in the write queue based on the total number m so that the other write operation classes can be merged into the n write operation class leader; and respectively submitting the n write operation class leaders subjected to merging processing to the corresponding n pre-write logs. According to the invention, the log submission mode of the RocksDB is set from the original serial log submission mode to the parallel log submission mode, the performance of the RocksDB under high voltage is improved, and the I/O time delay of a high-speed equipment storage system is reduced.

Description

technical field [0001] The invention relates to the technical field of distributed storage, in particular to a RocksDB performance improvement method, system and storage medium. Background technique [0002] Distributed storage systems have been widely used in fields such as cloud computing and big data analysis. Distributed storage systems with different hardware specifications will appear in different scenarios and requirements, generally including: slow device storage, hybrid slow and high-speed device storage, and High speed device storage. How to make full use of the performance of high-speed devices in high-speed device storage is a problem that current distributed storage systems are eager to solve. The performance bottleneck of the distributed storage system is mainly concentrated in the I / O (data input / output) processing of the local storage engine. The I / O processing of the local storage engine is divided into metadata and data. Some distributed storage systems u...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/06
CPCG06F3/0611G06F3/0659G06F3/067
Inventor 谢有权
Owner SHANDONG YINGXIN COMP TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap