Unlock instant, AI-driven research and patent intelligence for your innovation.

A log segment management method and device

A segment management and log technology, applied in special data processing applications, file system types, file systems, etc., can solve the problems of metadata performance decline, metadata performance plummeting, and reconstruct log segments, etc., to improve performance and structure. good compatibility

Active Publication Date: 2020-09-22
INSPUR SUZHOU INTELLIGENT TECH CO LTD
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Leading to arbitrary metadata operations, such as adding, deleting, modifying, and renaming files, even if the content of the operation itself needs to be stored is very small, due to the overly large subtree event, the log segment still needs to be reconstructed, and the start of the new log segment is oversized subtree event
Frequent construction of log segments and construction of overly large subtree events cause metadata performance to plummet
[0006] Therefore, for those skilled in the art, in a system supporting multiple metadata nodes, how to prevent metadata performance from being degraded due to too frequent construction of log segments is an urgent technical problem to be solved

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A log segment management method and device
  • A log segment management method and device
  • A log segment management method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0038] refer to figure 1 , a log segment management method disclosed in the present invention, comprising the following steps:

[0039] S0: Set the log event quantity threshold to 1024 and the log event size threshold to 4M;

[0040] S1: write log event;

[0041] S2: Determine whether the log event written in S1 is a subtree event; if so, ignore the size of the log event and not include it in the total size of the log event, and update the value of the number of events; if not, obtain the size information of the log event and Include the total size of log events, and update the value of the number of events and the value of the event size;

[0042] S3: Determine whether the number of events reaches 1024 and determine whether the size of the event reaches 4M; if the number of events does not reach 1024 and the size of the event does not reach 4M, then go to S1; otherwise, go to S4;

[0043] S4: Construct a log segment and transfer to S1.

[0044] In the above embodiment 1, ...

Embodiment 2

[0046] refer to figure 2 , a log segment management method disclosed in the present invention, comprising the following steps:

[0047] Set the log event quantity threshold to 1024 and the log event size threshold to 4M;

[0048] Determine whether the written log event is a subtree event;

[0049] Put subtree events into the first log event pool, and put non-subtree events into the second log event pool;

[0050] Count the total number of log events in the first log event pool and the second log event pool as the event quantity value, and count the total size of the log events in the second log event pool as the event size value;

[0051] If the number of events is smaller than the event number threshold of the log segment and the event size is smaller than the event size threshold of the log segment, write the log event in the current log segment; otherwise, construct a new log segment to write the log event.

[0052] In the above-mentioned embodiment 2, we can know that ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a method for managing a log segment. The method comprises the following steps that S1, a log event is written in; S2, whether the log event written in S1 is a subtree event or not is judged, if yes, the size of the log event is ignored and is not reckoned in the total size of the log event, a data number value is updated, and if not, size information of the log event is acquired and reckoned in the total size of the log event, and the event number value and the event size value are updated; S3, whether the event number value reaches a log event number threshold value or not and whether the event size value reaches a log event size threshold value or not are judged, and if the event number value does not reach the log event number threshold value and the event size value does not reach the log event size threshold value, S1 is executed, otherwise, S4 is executed; S4, the log segment is constructed, and S1 is executed. The invention further discloses a method for managing the log segment.

Description

technical field [0001] The present invention relates to the technical field of metadata management, in particular to a log segment management method, and also to a log segment management device. Background technique [0002] The existing file system is mainly divided into two parts: metadata management and data management. Among them, metadata requests account for more than 50% of all file system requests, so improving the processing performance of metadata requests can effectively improve the performance of the entire file system. [0003] In order to ensure the recoverability of the content stored in the metadata node, each operation of the metadata node will be recorded in the log segment in the form of a log event. Each log segment can store a certain size (the specific size is related to the disk stripe, 4M is used as an example below) or a certain number (configurable, 1024 is used as an example below) log events, when the log event is recorded in the log segment Aft...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/17G06F16/18
CPCG06F16/1734G06F16/1805
Inventor 程瑶
Owner INSPUR SUZHOU INTELLIGENT TECH CO LTD