Data writing method and device, server and storage medium

A data writing and server technology, applied in the field of distributed databases, can solve the problem of unbalanced OSD distribution of items, etc., achieve good read and write and access performance, reduce occupation, and improve access effects

Active Publication Date: 2021-06-25
柏科数据技术(深圳)股份有限公司
View PDF9 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The embodiment of the present invention provides a data writing method, device, server and storage medium to solv

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data writing method and device, server and storage medium
  • Data writing method and device, server and storage medium
  • Data writing method and device, server and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0028] figure 1 It is a flow chart of the data writing method provided by Embodiment 1 of the present invention. This embodiment is applicable to the situation of implementing data writing based on CephRBD. The method can be executed by a data writing device and can be integrated in a Ceph server. Specifically include the following steps:

[0029] S110. Receive a read and write request sent by the KVM client.

[0030] In this embodiment, a virtual machine can be used as a client to receive various requests sent by users. And use KVM Hypervisor as a virtual machine management tool.

[0031] Exemplarily, the hypervisor can be an intermediate software layer running between the basic physical server and the operating system, allowing multiple operating systems and applications to share hardware. It is effectively a "meta" operating system in a virtual environment. They have access to all physical devices on the server including disks and memory. Hypervisors not only coordinat...

Embodiment 2

[0060] figure 2 It is a schematic flowchart of the data writing method provided by Embodiment 2 of the present invention. This embodiment is optimized on the basis of the above-mentioned embodiments. In this embodiment, the specific optimization of judging whether the SSD storage condition is enabled according to the parameters is as follows: judging whether the SSD storage condition is satisfied according to the ssd cache size.

[0061] Correspondingly, the data writing method provided in this embodiment specifically includes:

[0062] S210, receiving a read and write request sent by the KVM client.

[0063] S220, judging according to the ssd cache size whether the condition for enabling SSD storage is met.

[0064] In some business scenarios, such as business scenarios with relatively high business continuity, when KVM data is continuously written to RBD for 7*24 hours, if the requirements for business connectivity exceed the performance of SSD, the SSD needs to be shut d...

Embodiment 3

[0069] image 3 is a schematic structural diagram of the data writing device provided in Embodiment 4 of the present invention, as image 3 As shown, the device includes:

[0070] Receiving module 310, for receiving the read and write request that KVM client sends;

[0071] Judgment module 320, is used for judging whether to meet opening SSD storage condition according to parameter, described parameter comprises: ssdcache size, ssd cache max dirty, ssd cache target dirty and ssd cache device;

[0072] Read-write module 330, for when satisfying to open SSD storage condition, utilize described SSD to realize the data read-write of CephRBD, described read-write module comprises:

[0073] A coexistence judging unit is used to judge whether it is an SSD storage and cache coexistence solution according to ssd cache max dirty and ssd cache size;

[0074] The concurrent read and write unit is used to read and write CephRBD data according to the ssd cache max dirty when the coexiste...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention discloses a data writing method and device, a server and a storage medium, and the method comprises the steps of receiving a read-write request sent by a KVM client; judging whether an SSD storage starting condition is met or not according to the parameters; and when an SSD storage starting condition is met, realizing data reading and writing of the CephRBD by utilizing the SSD. The storage performance advantages of the SSD storage device are fully utilized, and good read-write and access performance is provided for a database. In the CephRBD process, the occupation of a memory is reduced, and the occupation of memory resources of the KVMHypervisor is reduced. And the access effect of the KVMHypervisor client side is enhanced. Meanwhile, various access application scenes can be flexibly coped with according to configuration, and the access effect of the Ceph database is improved.

Description

technical field [0001] The present invention relates to the technical field of distributed databases, in particular to a data writing method, device, equipment and storage medium. Background technique [0002] Ceph is a unified, distributed file system designed for excellent performance, reliability, and scalability. Ceph abandons the traditional centralized storage metadata addressing scheme, and adopts the CRUSH algorithm, with balanced data distribution and high parallelism. It also considers the isolation of disaster recovery domains, and can implement replica placement rules for various loads, such as cross-computer room, rack awareness, etc. It can support the scale of thousands of storage nodes and support TB to PB level data. [0003] In the Ceph system, the KVM virtual machine can be used as the client at present to provide high-concurrency access services. However, when Ceph provides a block storage device through librbd, in order to ensure the read and write pe...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/06
CPCG06F3/061G06F3/0608G06F3/0656G06F3/067G06F3/0683
Inventor 龚立义胡玉晟
Owner 柏科数据技术(深圳)股份有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap