Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method and system for constructing disk cache based on nonvolatile memory of log file system

A log file, non-volatile technology, applied in memory systems, redundant operations in data error detection, response error generation and other directions, can solve problems such as file system consistency problems, ensure consistency, improve Overall performance, avoid double write effect

Active Publication Date: 2020-07-14
SHANGHAI JIAO TONG UNIV +1
View PDF6 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, since the atomic write granularity of data is smaller than the data block size of the file system, if a failure such as power failure or system crash occurs during the process of writing data to the disk, only a part of the data on the disk will be updated, resulting in the consistency of the file system.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and system for constructing disk cache based on nonvolatile memory of log file system
  • Method and system for constructing disk cache based on nonvolatile memory of log file system
  • Method and system for constructing disk cache based on nonvolatile memory of log file system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0057] The present invention will be described in detail below in conjunction with specific embodiments. The following examples will help those skilled in the art to further understand the present invention, but do not limit the present invention in any form. It should be noted that those skilled in the art can make several changes and improvements without departing from the concept of the present invention. These all belong to the protection scope of the present invention.

[0058] Because the log file system needs to write the dirty data in the memory to the log first, and then write the data to the original location of the file on the disk, the same data brings two disk write operations, which is the problem of double writing of data. Since the disk is a slow device, it takes time to write data, so the double write problem of the log will cause a large performance loss. In addition, because traditional log file systems organize metadata by blocks, and the granularity of m...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a method and system for constructing a disk cache based on a nonvolatile memory of a log file system. The method comprises that: nonvolatile memory cache comprises nonvolatile memory data cache and nonvolatile memory metadata cache; in the initialization stage of the nonvolatile memory cache, a shutdown mark set in the nonvolatile memory is checked, and when it is checked that shutdown is not normal shutdown, the nonvolatile memory cache executes fault recovery operation to guarantee system consistency; and after initialization of a nonvolatile memory cache is completed,data submission is executed in the data cache, metadata submission operation is executed in the metadata cache, when the storage space of the nonvolatile memory cache is insufficient, data write-backoperation is executed by the data cache, and metadata write-back operation is executed by the metadata cache. Double writing of data is avoided, write amplification of metadata is reduced, and the overall performance of the system is improved.

Description

technical field [0001] The present invention relates to a non-volatile memory cache, in particular to a method and system for constructing a disk cache based on a non-volatile memory of a log file system, and more specifically to a non-volatile memory based on a log file system cache. Background technique [0002] A log file system is a file system that uses a separate disk as a log or divides an area from the disk as a log. In a normal file system, data is written directly back to disk and overwrites the original data. However, since the atomic write granularity of data is smaller than the data block size of the file system, if a failure such as power failure or system crash occurs during the process of writing data to the disk, only a part of the data on the disk will be updated, resulting in the consistency of the file system. . In order to solve this problem, the journal file system came into being. Its idea is to record the data to the pre-set log area before writin...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F12/1045G06F3/06G06F11/14
CPCG06F12/1054G06F11/1448G06F3/061G06F3/0638G06F3/0679Y02D10/00
Inventor 黄林鹏郑圣安屠要峰杨洪章沈艳艳陈雨亭闫格
Owner SHANGHAI JIAO TONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products