Unlock instant, AI-driven research and patent intelligence for your innovation.

Data processing method and related equipment

A data processing and data technology, applied in the field of storage, can solve problems such as performance degradation, memory resources can not be recovered in time, and the whole metadata data refresh time is long, so as to improve the efficiency and speed of the refresh.

Active Publication Date: 2018-12-18
ZHENGZHOU YUNHAI INFORMATION TECH CO LTD
View PDF4 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the problem with this is that as the business continues to expand, the metadata stored on the disk will continue to expand. At this time, if the memory nodes are downloaded to the disk one by one according to the memory B+ tree, it will take too long to download the entire metadata. Memory resources are too late to reclaim, resulting in performance degradation and other issues

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and related equipment
  • Data processing method and related equipment
  • Data processing method and related equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0038] Embodiments of the present invention provide a data processing method and a data processing device, which can improve the efficiency of flashing metadata in memory.

[0039] The terms "first", "second", "third", "fourth", etc. (if any) in the description and claims of the present invention and the above drawings are used to distinguish similar objects, and not necessarily Used to describe a specific sequence or sequence. It is to be understood that the terms so used are interchangeable under appropriate circumstances such that the embodiments described herein can be practiced in sequences other than those illustrated or described herein. Furthermore, the terms "comprising" and "having", as well as any variations thereof, are intended to cover a non-exclusive inclusion, for example, a process, method, system, product or device comprising a sequence of steps or elements is not necessarily limited to the expressly listed instead, may include other steps or elements not ex...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention provides a data processing method and related equipment, which can improve the down-brushing efficiency of metadata in a memory. The method comprises the following steps of: acquiring the data quantity stored in a target B + tree, wherein the target B + tree is a data structure of metadata in a memory, and the target B + tree comprises at least one memory node; judging whether the amount of data stored in the target B + tree reaches a preset threshold value; if yes, obtaining a target data set, wherein the target data set comprises a preset number of memory nodes, and the preset number of memory nodes are memory nodes in the target B + tree; brushing down the data of each memory node in the target data set to a target disk by a multi-thread, the target diskhaving an association relationship with the target B + tree, and the multi-thread having an association relationship with a preset number.

Description

technical field [0001] The invention relates to the storage field, in particular to a data processing method and related equipment. Background technique [0002] In the era of big data, the storage of massive data requires the support of the file system, and the metadata performance of the file system becomes the key to affecting the performance of file access. [0003] In order to ensure storage performance, a storage system metadata organization and management method is that the metadata is in the form of a B+ tree in the memory disk, and the B+ tree in the memory is used as an increment of the disk B+ tree. When the amount of data stored in the B+ tree in the memory reaches a certain threshold, the data in the B+ tree in the memory needs to be flushed to the disk to release memory resources for saving new incremental data. [0004] The traditional scheme of flashing metadata is to flash each memory node with B+ tree metadata in the memory to the disk one by one. After th...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/30G06F3/06
CPCG06F3/0611
Inventor 刘丹朱斌陈玉强
Owner ZHENGZHOU YUNHAI INFORMATION TECH CO LTD