Unlock instant, AI-driven research and patent intelligence for your innovation.

Log data writing method and object storage daemon device

A technology of data writing and data encapsulation, which is applied in the directions of multi-programming devices, electrical digital data processing, digital data information retrieval, etc., can solve the problems of reducing data writing speed, delaying data writing in KV database, etc., to achieve faster The effect of processing speed

Active Publication Date: 2019-12-13
江苏安超云软件有限公司
View PDF13 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the existing WAL mode uses a WAL thread to process each transaction in the WAL queue in a serial manner, which greatly reduces the speed of data writing
At the same time, since the writing of the KV database will only be performed after the writing of the WAL partition is completed, the existing technology will also delay the writing of data in the KV database

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Log data writing method and object storage daemon device
  • Log data writing method and object storage daemon device
  • Log data writing method and object storage daemon device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0037] Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided for more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.

[0038] Such as figure 1 As shown, the embodiment of the present invention provides a log data writing method, which is applied in the OSD of CEPH, and the WAL mode in the KV database of CEPH is in a closed state, and the method may include:

[0039] S100. The OSD obtains a data writing request sent by a client;

[0040] Among them, CEPH is a distributed object storage system. Ceph's system architecture can be divided into four par...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a log data writing method and an object storage daemon device. The method comprises: enabling a WAL mode in a KV database of CEPH to be in a closed state, writing the data intoa request, and encapsulating data requested to be written into at least one transaction; submitting each transaction to at least one WAL queue according to configuration information of a WAL parallelmode outside the KV database, and performing parallel processing on the transactions in the WAL queue by using a plurality of WAL threads in a WAL thread pool set according to the configuration information so as to write the transactions into a WAL partition. According to the invention, through the number of the WAL threads in the WAL thread pool in the configuration information of the WAL parallel mode, the OSD can use a plurality of WAL threads to process a plurality of transactions in parallel, so that the processing speed of the transactions is increased.

Description

technical field [0001] The invention relates to the technical field of distributed storage, in particular to a log data writing method and an object storage guard device. Background technique [0002] CEPH (also known as Ceph File System) is an open source unified distributed storage system and one of the most mainstream open source storage projects. [0003] The existing CEPH can first write data into a KV (Key-value, key-value) database, and then write the data in the KV database to a disk for local storage. In order to perform data recovery when storage errors occur, the existing CEPH has a built-in WAL (Write-Ahead Logging, pre-write log system) mode in the KV database. This WAL mode can write the data sent by the client into the WAL partition so that Data recovery in case of storage failure. However, the existing WAL mode uses a WAL thread to process each transaction in the WAL queue in a serial manner, which greatly reduces the speed of data writing. At the same tim...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F9/46G06F9/50G06F16/2453
CPCG06F9/466G06F9/5061G06F9/5027G06F16/24532G06F2209/5011G06F2209/5018
Inventor 李忠文
Owner 江苏安超云软件有限公司
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com