Performance improvement method and system, electronic equipment and storage medium

A technology to improve system and performance, applied in digital data processing, database design/maintenance, special data processing applications, etc., can solve memory overhead increase, unfavorable access metadata response speed, improve distributed file system performance, storage cost Increase and other issues to achieve the effect of improving performance, improving practicability and adaptability, and improving response time

Pending Publication Date: 2021-10-01
SUZHOU LANGCHAO INTELLIGENT TECH CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, in the first method, improving the cache means that the memory overhead increases, resulting in an increase in storage costs; in the second method, the data interaction response time between the MDS service and the storage medium depends on the SSD performance, and the SSD performance bottleneck limits the second performance improvement in this way; therefore, it is not conducive to improving the performance of distributed file systems through the response speed of accessing metadata

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Performance improvement method and system, electronic equipment and storage medium
  • Performance improvement method and system, electronic equipment and storage medium
  • Performance improvement method and system, electronic equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0044] Such as figure 1 As shown, the present invention provides a method for improving performance, which is applied in a distributed file system, including:

[0045] S1, divide the persistent memory into a first-capacity memory and a second-capacity memory, and the first-capacity memory is used to store cache files of metadata services;

[0046] S2. Create a first object storage device with the second capacity memory, and the first object storage device is used to store metadata information in the distributed file system;

[0047] Among them, when the client sends a file creation request to the metadata service, the metadata service applies for creation in the first capacity memory and caches the metadata information of the file to be created. After the metadata information of the file to be created is established, it will The metadata information of the file is stored in the first object storage device.

[0048]In step S1, the working mode of AEP memory (Apache Pass, pers...

Embodiment 2

[0072] Such as image 3 As shown, a performance improvement system is also provided in the technical solution of the present invention, which is applied to a distributed file system, including:

[0073] The dividing module 101 divides the persistent memory into a first-capacity memory and a second-capacity memory, and the first-capacity memory is used to store cache files of metadata services;

[0074] Create a storage module 102, create a first object storage device for the second capacity memory, and the first object storage device is used to store metadata information in the distributed file system;

[0075]Among them, when the client sends a file creation request to the metadata service, the metadata service applies for creation in the first capacity memory and caches the metadata information of the file to be created. After the metadata information of the file to be created is established, it will The metadata information of the file is stored in the first object storage...

Embodiment 3

[0099] Such as Figure 5As shown, the technical solution of the present invention also provides an electronic device, including: a communication interface 1 capable of information interaction with other devices such as network devices; a processor 2 connected to the communication interface 1 to implement information exchange with other devices Interaction, for executing the performance improvement method provided by one or more technical solutions above when running the computer program. Instead, the computer program is stored on the memory 3 . Of course, in actual application, various components in the electronic device are coupled together through the bus system 4 . It can be understood that the bus system 4 is used to realize connection and communication between these components. In addition to the data bus, the bus system 4 also includes a power bus, a control bus and a status signal bus. But for clarity, in Figure 4 The various buses are denoted as bus system 4 in . ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a performance improvement method, which is applied to a distributed file system and comprises the following steps: dividing a persistent memory into a first capacity memory and a second capacity memory; the first capacity memory is used for storing a cache file of the metadata service; creating a first object storage device for the second capacity memory, wherein the first object storage device is used for storing metadata information in the distributed file system; wherein after a client side sends a file creating request to a metadata service, the metadata service applies for establishing and caching metadata information of a to-be-created file in a first capacity memory, and after the metadata information of the to-be-created file is established, the metadata information of the to-be-created file is stored in a first object storage device; the invention further provides a performance improvement system, electronic equipment and a storage medium, and the performance of the distributed file system is improved.

Description

technical field [0001] The present invention relates to the field of distributed file systems, in particular to a performance improvement method, system, electronic equipment and storage medium. Background technique [0002] AEP memory (Apache Pass, persistent memory), which uses 3D Xpoint technology, its performance is between hard disk and ordinary memory; the working mode generally has memory mode (memory mode), APD mode (hard disk mode) and Mix mode (mixed mode) ) Three modes, not only fast transmission speed, but also non-volatile. The capacity of AEP memory far exceeds that of DRAM (Dynamic Random Access Memory, Dynamic Random Access Memory), and the read and write speed is a hundred times that of SSD (Solid State Disk, Solid State Drive). [0003] For a distributed file system, the response speed of the system to client access to metadata directly affects the performance of the file system. In the prior art, the response speed of access to metadata can be improved fr...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/21G06F16/2455G06F16/27
CPCG06F16/217G06F16/24552G06F16/27
Inventor 由宗江孟祥瑞
Owner SUZHOU LANGCHAO INTELLIGENT TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap