Trash recycling method for log file system on basis of repeated data deleting

A technology for data deduplication and log files, applied in the input/output process of data processing, electrical digital data processing, special data processing applications, etc., can solve the negative impact of flash memory access performance and lifespan, and increase the number of internal data migrations in flash memory. Recover the number of erasures and other issues to achieve the effect of improving performance and reliability

Active Publication Date: 2017-11-24
XIAMEN UNIV
View PDF5 Cites 14 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] Although data migration is performed at the file system level during the garbage collection process of the journaling file system, this operation will be reflected on the underlying flash device, so the data migration of the journaling file system will actually cause data migration inside the flash memory, greatly Increase the number of data migrations inside the flash memory and the number of erasures during garbage collection, which will have a great negative impact on the access performance and lifespan of the flash memory

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Trash recycling method for log file system on basis of repeated data deleting
  • Trash recycling method for log file system on basis of repeated data deleting
  • Trash recycling method for log file system on basis of repeated data deleting

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0054] The present invention will be described in further detail below in conjunction with the accompanying drawings.

[0055] figure 1 It is a schematic diagram of the relationship between each step of the present invention. After the initialization step is completed, it enters the parallel data processing step and garbage collection step. When the user sends an instruction to uninstall the file system, it enters the end step.

[0056] figure 2 It is a schematic diagram of an entry in the fingerprint index table. In the fingerprint index table, each entry is composed of three data items: the fingerprint value of the data block, the address of the data block and the reference value.

[0057] image 3 For the schematic diagram of the initialization step process of the present invention, the following operations are performed:

[0058] Mount the log file system according to user instructions, and the initialization module judges whether the fingerprint index table exists, if...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a trash recycling method for a log file system on the basis of repeated data deleting, and relates to computer data storage methods. The trash recycling method includes the steps of initializing, parallel data processing, trash recycling and ending. According to a reference value of a data block obtained by a repeated data deleting technology, data are divided into strong data and weak data, the strong data and the weak data are respectively migrated into different segments when trashes of the log file system are recycled, and divided storage of the strong data and the weak data is realized. Data blocks in a strong data segment are low in failure rate, and the times of trash recycling are less; data blocks in a weak data segment are high in failure rate, and effective data blocks needing migration are less during trash recycling. The trash recycling method for the log file system on the basis of repeated data deleting has the advantages that the times of data block migration during trash recycling in the log file system can be reduced effectively, and performance and reliability of a flash memory system can be improved.

Description

technical field [0001] The invention relates to a computer data storage method, in particular to a garbage collection method of a log file system based on repeated data deletion. Background technique [0002] In recent years, with the rapid development of flash storage media, flash-based solid-state disks are widely used in enterprise-level storage systems and data centers. In order to give full play to the high sequential write performance of flash solid state disks, more and more storage systems based on flash solid state disks use log file systems. [0003] The log file system is mainly divided into two granularities in the storage management unit: data segment and data block. Among them, a data block is a basic unit of read, write and delete operations, a data segment is a basic unit of a garbage collection operation, and a data segment is composed of multiple data blocks. Journaling file systems have two notable features: sequential writes and off-site updates. The s...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30G06F3/06
CPCG06F3/0641G06F3/0647G06F3/0652G06F3/0679G06F16/1748G06F16/1815G06F16/1847G06F16/185
Inventor 吴素贞栾华高毛波饶辉
Owner XIAMEN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products