Data processing method and device and leader node

A leading node and data processing technology, applied in the direction of electrical digital data processing, data processing input/output process, instruments, etc., can solve problems affecting data read and write performance, unreasonable use of buffer pool space, etc., to avoid long-term occupation Cache pool space, improve utilization, and reduce the effect of brushing frequency

Active Publication Date: 2019-07-02
NEW H3C TECH CO LTD
View PDF9 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0010] In order to solve the problem that the existing disk brushing operation affects the data read and write performance and the unreasonable utilization of the cache pool space, the present invention proposes a data processing method, device and leader node to improve the data read and write performance and enhance the cache pool space utilization Rate

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and device and leader node
  • Data processing method and device and leader node
  • Data processing method and device and leader node

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0061] Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the following exemplary examples do not represent all implementations consistent with the present invention. Rather, they are merely examples of apparatuses and methods consistent with aspects of the invention as recited in the appended claims.

[0062] The terms used in the embodiments of the present invention are only for the purpose of describing specific embodiments, and are not intended to limit the embodiments of the present invention. As used in the embodiments of the present invention and the appended claims, the singular forms "a", "said" and "the" are also intended to include the plural forms unless the context clearly indicate...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a data processing method and device and a leader node. A cache pool of the distributed storage system is configured with a plurality of reset groups, each reset group corresponds to a plurality of objects stored in the cache pool, and the method comprises the following steps: if the used capacity of the cache pool reaches a preset flash disk capacity threshold value, determining a first number of objects to be subjected to flash disk refreshing in the cache pool; according to the first number and the number of the objects corresponding to the sorting groups, determiningthe second number of the to-be-brushed objects corresponding to the sorting groups, wherein the second number and the number of the objects corresponding to the sorting groups are in a positive correlation relationship; and respectively screening the second number of objects from the objects corresponding to each sorting group, and executing a disk brushing operation. According to the invention, the disk brushing frequency can be reduced, the influence on the data read-write performance is reduced, the long-term occupation of the cache pool space by the object is avoided, and the utilization rate of the cache pool space is improved.

Description

technical field [0001] The invention relates to the technical field of data storage, in particular to a data processing method, device and leader node. Background technique [0002] Ceph is a distributed storage system that provides software-defined and unified storage solutions for block storage, object storage, and file storage. It has the characteristics of excellent performance, high reliability, and high scalability, and can provide massive, indiscriminate And a unified distributed storage service. [0003] Ceph adopts hierarchical storage technology, deploying expensive but fast storage hard disks on the front end, such as SSD (Solid State Disk, solid state disk), to form a cache pool; deploying cheap but slow storage hard disks on the back end, For example, HDD (Hard Disk Drive, hard disk drive) forms a storage pool. [0004] User data is first stored in the cache pool. When the used capacity of the cache pool reaches the flushing capacity threshold, the dirty data...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/06
CPCG06F3/067G06F3/0604G06F3/0631
Inventor 杨潇金朴堃
Owner NEW H3C TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap