Data processing method, device and leader node

A leading node, data processing technology, applied in the direction of digital data processing, data processing input/output process, instruments, etc., can solve the problems affecting data read and write performance, unreasonable use of buffer pool space, etc., to avoid long-term occupation The effect of buffer pool space, improving utilization, and reducing the frequency of disk flushing

Active Publication Date: 2022-07-29
NEW H3C TECH CO LTD
View PDF9 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0010] In order to solve the problem that the existing disk brushing operation affects the data read and write performance and the unreasonable utilization of the cache pool space, the present invention proposes a data processing method, device and leader node to improve the data read and write performance and enhance the cache pool space utilization Rate

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method, device and leader node
  • Data processing method, device and leader node
  • Data processing method, device and leader node

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0061] Exemplary embodiments will be described in detail herein, examples of which are illustrated in the accompanying drawings. Where the following description refers to the drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the illustrative examples below are not intended to represent all implementations consistent with the present invention. Rather, they are merely examples of apparatus and methods consistent with some aspects of the invention as recited in the appended claims.

[0062] The terms used in the embodiments of the present invention are only for the purpose of describing specific embodiments, and are not intended to limit the embodiments of the present invention. As used in the embodiments of the present invention and the appended claims, the singular forms "a," "the," and "the" are intended to include the plural forms as well, unless the context clearly dictates o...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present invention provides a data processing method, device and leader node. The cache pool of the distributed storage system is configured with multiple placement groups, each placement group corresponds to multiple objects stored in the cache pool, and the method includes: if the used capacity of the cache pool reaches a predetermined level; The set flushing capacity threshold determines the first number of objects to be flushed in the cache pool; according to the first number and the number of objects corresponding to each placement group, determine the to-be-flushed corresponding to each placement group respectively The second number of objects, the second number is positively correlated with the number of objects corresponding to the placement groups; from the objects corresponding to the placement groups, respectively screen the second number of objects and perform a flush operation . The invention can reduce the frequency of disk flushing, reduce the impact on data read and write performance, and at the same time, prevent objects from occupying the cache pool space for a long time, and improve the utilization rate of the cache pool space.

Description

technical field [0001] The present invention relates to the technical field of data storage, and in particular, to a data processing method, device and leading node. Background technique [0002] Ceph is a distributed storage system that provides software-defined and unified storage solutions for block storage, object storage and file storage. It has the characteristics of excellent performance, high reliability and high scalability. And a unified distributed storage service. [0003] Ceph adopts tiered storage technology, deploying expensive but fast storage hard drives at the front end, such as SSD (Solid State Disk, solid-state drives), to form a cache pool; deploying cheap but slow storage hard drives at the back end, For example, HDD (Hard Disk Drive, hard disk drive) constitutes a storage pool. [0004] User data is first stored in the cache pool. When the used capacity of the cache pool reaches the flushing capacity threshold, the dirty data (data not written to th...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/06
CPCG06F3/067G06F3/0604G06F3/0631
Inventor 杨潇金朴堃
Owner NEW H3C TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap