Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method for reducing fragments of log structure file system and flash memory storage system

A file system and log technology, applied to the file system, file system functions, instruments, etc., can solve the problems of increasing overhead, endangering the life of flash memory, etc., and achieve the effect of reducing file fragmentation and logical space fragmentation

Pending Publication Date: 2020-11-24
HUAZHONG UNIV OF SCI & TECH
View PDF0 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In general, the above method of reducing fragmentation can improve the fragmentation problem of the log-structured file system to a certain extent, but there is still room for improvement, and data replication for defragmentation will introduce a large number of reads and writes, increase overhead, and endanger the life of flash memory

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for reducing fragments of log structure file system and flash memory storage system
  • Method for reducing fragments of log structure file system and flash memory storage system
  • Method for reducing fragments of log structure file system and flash memory storage system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0060] A way to reduce fragmentation of log-structured filesystems such as figure 1 As shown, it includes: separating temporary write data at the logical layer, specifically including the following steps:

[0061] When writing the target data block into the log-structured file system, extract the characteristics of the file to which the target data block belongs, and identify whether the file is a temporary write file based on the extracted characteristics;

[0062] If the file to which the target data block belongs is a temporary write file, after setting the type flag for the target data block, write the target data block into the pre-allocated temporary logical log segment; The hot and cold attributes of the block, after setting the type mark for the target data block, write the target data block to the corresponding logical log segment;

[0063] Wherein, the type mark of the data block is used to indicate the type of the logical log segment to which the data block belongs...

Embodiment 2

[0089] A method for reducing fragmentation of a log-structured file system. This embodiment is similar to the above-mentioned Embodiment 1, except that in this embodiment, the characteristics of the file include the life cycle of the file, and whether the file is identified based on the extracted characteristics For temporary writing files, including:

[0090] Judging whether the life cycle of the file is less than a preset first threshold, if yes, then judging that the file is a temporary writing file; if not, then judging that the file is not a temporary writing file.

[0091] Temporary write files have the characteristics of short life cycle. In this embodiment, the file life cycle is used as the feature for identifying temporary write files, which can accurately identify temporary write files and realize the separation of temporary write file data from other file data; the specific value of the first threshold The value can be obtained after collecting and analyzing the da...

Embodiment 3

[0093] A method for reducing fragmentation of a log-structured file system. This embodiment is similar to the above-mentioned Embodiment 1, except that in this embodiment, the characteristics of the file include the frequency of file creation and deletion, and the file is identified based on the extracted characteristics. Whether to write files temporarily, including:

[0094] It is judged whether the creation and deletion frequency of the file is higher than the preset second threshold, if yes, it is determined that the file is a temporary write file; if not, it is determined that the file is not a temporary write file.

[0095] Temporary write files have the characteristics of frequent creation and deletion. The present invention takes the creation and deletion frequency of files as the feature of identifying temporary write files, can accurately identify temporary write files, and realizes the separation of temporary write file data from other file data; the second threshold...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a method for reducing fragments of a log structure file system and a flash memory storage system, which belong to the field of computer information storage. The method comprisethe following steps of: when a target data block is written into a log structure file system, extracting file characteristics to identify whether a file is a temporary writing file or not; if yes, setting a type mark for the target data block, and writing the target data block into a pre-allocated temporary logic log segment; otherwise, setting a type mark according to the cold and hot attributesof the target data block, and writing the target data block into a corresponding logic log segment; adding type marks in a submitted block request and a data item of an annular buffer area, and respectively creating request queues for different types of data; and when the data in the request queues is written into a flash memory medium, allocating independent physical addresses to different typesof data, so as to enable the data types in the same physical log segment to be the same. According to the method, fragments in the log structure file system can be effectively reduced, logic fragments and physical fragments are cooperatively managed, and the performance of the storage system is improved.

Description

technical field [0001] The invention belongs to the field of computer information storage, and more specifically relates to a method for reducing fragmentation of a log-structured file system and a flash memory storage system. Background technique [0002] In the era of big data, flash memory has gradually replaced traditional disks and become the mainstream storage device due to its advantages of low power consumption and low access latency. The flash friendly file system F2FS (flash friendly file system), based on its log-structured writing method that converts random writes into sequential writes, is a widely used log-structured file system. However, because the file data is frequently created, updated and deleted, the file system will generate severe logical fragmentation, and F2FS performs garbage collection to obtain free space. In addition, the flash storage device generates physical fragmentation, which seriously reduces the performance of the entire flash storage sy...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/17G06F16/172
CPCG06F16/1724G06F16/172
Inventor 谭支鹏杨梨花王芳冯丹钱佳兴
Owner HUAZHONG UNIV OF SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products