Nonvolatile memory management method and system based on MPI-IO middleware

A memory management and non-volatile technology, applied in the direction of memory system, memory address/allocation/relocation, inter-program communication, etc., can solve problems such as lack of pertinence and failure to uniformly manage non-volatile memory devices

Active Publication Date: 2020-04-24
SUN YAT SEN UNIV
View PDF6 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This type of technology realizes the function of the file system and uses non-volatile memory as a high-performance persistent storage device; however, the technology is oriented to all files, lacks pertinence, and runs exclusively on non-volatile memory devices
In addition, the above two technical solutions only manage the non-volatile memory of a single node, and cannot uniformly manage the non-volatile memory devices in multiple nodes

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Nonvolatile memory management method and system based on MPI-IO middleware
  • Nonvolatile memory management method and system based on MPI-IO middleware
  • Nonvolatile memory management method and system based on MPI-IO middleware

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0096] The following will generate 4 processes p when an MPI program is running 0 ,p 1 ,p 2 ,p 3 , 4 processes will cooperatively access, read and write a target file file0 as an example, the non-volatile memory management method and system based on MPI-IO middleware of the present invention are further described in detail. There is no doubt that the MPI process's access to the target file can be a read operation, a write operation, or a combination of read and write operations.

[0097] Such as figure 1 As shown, the implementation steps of the non-volatile memory management method based on MPI-IO middleware in this embodiment include:

[0098] 1) The MPI process applies for or restores the non-volatile memory space in the non-volatile memory device to the operating system during initialization;

[0099] 2) When the MPI process needs to open the target file file0, calculate the size of the target file file0 and divide it into fixed-size blocks, create cache metadata for ea...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a nonvolatile memory management method and system based on MPI-IO middleware. The nonvolatile memory management method comprises the steps that an MPI process applies for or recovers a nonvolatile memory space in nonvolatile memory equipment from an operating system during initialization, and the MPI process releases the corresponding nonvolatile memory space before the process is ended, IO data can be cached by utilizing the nonvolatile memory device, and the MPI process completes reading or writing of the target file according to the cached metadata cached in the nonvolatile memory space. According to the invention, a plurality of nonvolatile memory devices in a high-performance computing environment can be managed in a unified manner; IO data is cached, and IO overhead of a program is reduced; efficient temporary storage and recovery are carried out on files in large-scale calculation; non-volatile memory equipment is used in a non-exclusive mode, and hardware resources are fully utilized; the API provided for the user is not modified, and the method is simple and easy to use.

Description

technical field [0001] The invention relates to the application technology of non-volatile memory in the field of large-scale computing, in particular to a non-volatile memory management method and system based on MPI-IO middleware. Background technique [0002] In recent years, high-performance computing has played a significant role in scientific research and engineering: large-scale scientific and engineering computing problems require the use of high-performance computer clusters for modeling and calculation. High-performance computing needs to process a large amount of data, including reading models, reading and writing checkpoint files (checkpoint files), etc. Model files and checkpoint files have a large amount of data, and the program needs to generate a large number of IO requests and serious IO loads when reading from or writing to the external memory. Due to the physical limitations of external memory devices and complex IO patterns in high-performance computing ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F12/02G06F9/54
CPCG06F12/0246G06F9/546G06F2209/547
Inventor 邓镇龙陈志广肖侬
Owner SUN YAT SEN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap