Unlock instant, AI-driven research and patent intelligence for your innovation.

A data processing method and related equipment

A data processing and data technology, which is applied in the storage field, can solve problems such as performance degradation, too late to recycle memory resources, and long downloading time of whole metadata, so as to achieve the effect of improving downloading efficiency and speed

Active Publication Date: 2022-03-08
ZHENGZHOU YUNHAI INFORMATION TECH CO LTD
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the problem with this is that as the business continues to expand, the metadata stored on the disk will continue to expand. At this time, if the memory nodes are downloaded to the disk one by one according to the memory B+ tree, it will take too long to download the entire metadata. Memory resources are too late to reclaim, resulting in performance degradation and other issues

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A data processing method and related equipment
  • A data processing method and related equipment
  • A data processing method and related equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0038] Embodiments of the present invention provide a data processing method and a data processing apparatus, which can improve the lower brush efficiency of the internal metadata.

[0039] The description and claims of the present invention and the terms "first", "second", "third", "fourth", etc. in the above drawings are used to distinguish similar objects without having to use Describe a specific order or intern order. It should be understood that the data such as use can be interchangeable in appropriate, so that the embodiments described herein can be implemented in the order other than the content illustrated or described herein. Moreover, the terms "including" and "have" and any variation, it is intended that it is intended that it is not included in the process, method, method, system, product, or device that covers his inclusion, such as a series of steps or units. These steps or units may include other steps or units that are not clearly listed or for these processes, me...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

Embodiments of the present invention provide a data processing method and related equipment, which can improve the efficiency of flashing metadata in memory. The method includes: obtaining the amount of data stored in the target B+ tree, the target B+ tree is a data structure of metadata in memory, and the target B+ tree includes at least one memory node; judging the data stored in the target B+ tree whether the amount reaches the preset threshold; if so, obtain the target data group, which includes a preset number of memory nodes, and the preset number of memory nodes are memory nodes in the target B+ tree; through multithreading Flashing the data of each memory node in the target data group to a target disk, the target disk has an association relationship with the target B+ tree, and the multi-thread has an association relationship with a preset number.

Description

Technical field [0001] The present invention relates to the field of storage, and more particularly to a data processing method and related equipment. Background technique [0002] In the big data era, storage of massive data requires support of the file system, and the metadata performance of the file system has become the key to the performance of file access performance. [0003] In order to ensure storage performance, a storage system metadata organization and management method is that metadata is in the form of B + tree in memory disk, and B + tree in memory is an increment of a disk B + tree. When the amount of data stored in the memory b + tree reaches a certain threshold, you need to brush the data of the memory B + tree to the disk to release the memory resources for saving new incremental data. [0004] The conventional demolution of the brush metadata is to brush each memory node in the B + tree in the memory, and then update the new B + tree root address as an entry a...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/13G06F3/06
CPCG06F3/0611
Inventor 刘丹朱斌陈玉强
Owner ZHENGZHOU YUNHAI INFORMATION TECH CO LTD