Distributed storage metadata system log optimization system and method based on ceph

A distributed storage and system log technology, applied in the field of distributed storage metadata system log optimization system, can solve the problems of high metadata management performance overhead and data inconsistency, and achieve the goal of solving data inconsistency, improving performance, and reducing performance overhead. Effect

Active Publication Date: 2020-06-19
INSPUR SUZHOU INTELLIGENT TECH CO LTD
View PDF4 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The purpose of the present invention is to provide a ceph-based distributed storage metadata system log optimization system and method, which aims to solve the problems of high performance overhead and data inconsistency in metadata management in the prior art, realize the reduction of performance overhead, and pass Synchronization ensures data consistency

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed storage metadata system log optimization system and method based on ceph
  • Distributed storage metadata system log optimization system and method based on ceph

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0028] In order to clearly illustrate the technical features of the present solution, the present invention will be described in detail below through specific implementation methods and in conjunction with the accompanying drawings. The following disclosure provides many different embodiments or examples for implementing different structures of the present invention. To simplify the disclosure of the present invention, components and arrangements of specific examples are described below. Furthermore, the present invention may repeat reference numerals and / or letters in different instances. This repetition is for the purpose of simplicity and clarity and does not in itself indicate a relationship between the various embodiments and / or arrangements discussed. It should be noted that components illustrated in the figures are not necessarily drawn to scale. Descriptions of well-known components and processing techniques and processes are omitted herein to avoid unnecessarily lim...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a distributed storage metadata system log optimization system and method based on ceph. According to the method, the problems of performance bottleneck and data inconsistency are solved by adopting a strategy of newly adding the shared log; a group of ceph cluster equipment connected by a network is used as a single log to be shared with a control end of a data center, and aprocess running on a client can add data into the shared log and can also read log record data at any position from the shared log. According to the method, the problem that certain log storage exists when the scale of a ceph distributed system is large is solved, global metadata information is managed in a more reasonable mode, the performance of a log processing flow is improved, the performance overhead is reduced, and the problem of data inconsistency is solved through synchronization.

Description

technical field [0001] The invention relates to the technical field of distributed storage systems, in particular to a ceph-based distributed storage metadata system log optimization system and method. Background technique [0002] With the increase of Internet business volume, the rapid growth of access volume and metadata traffic, the processing intensity of each core part of the distributed system is also relatively increased, which increases the system workload. In the ceph system, the consistent CRUSH algorithm is used for The calculation of metadata distribution. In this process, the CRUSH algorithm maps METADATE to a group of MDS, and divides metadata partitions through METADATE so that the metadata intervals managed by each METADATE are the same, so as to ensure that metadata can be evenly distributed in MDS. superior. However, in the actual application environment, MDS is used as all the metadata management nodes of the distributed system. METADATE will only be pse...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/06G06F11/30G06F16/18G06F16/182
CPCG06F3/0653G06F3/067G06F11/3093G06F11/3034G06F11/3051G06F16/1815G06F16/182
Inventor 魏坤
Owner INSPUR SUZHOU INTELLIGENT TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap