Garbage collection method based on SSD-SMR mixed key value storage system

A technology of storage system and recycling method, which is applied in the field of garbage collection based on SSD-SMR hybrid key-value storage system, can solve the problems of lack of judgment of hot and cold data, reduce garbage collection efficiency, ignore medium erasure life, etc., and achieve system Performance optimization and improvement, comprehensive system performance, and the effect of reducing system resource consumption

Active Publication Date: 2019-05-21
XI AN JIAOTONG UNIV
View PDF5 Cites 17 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In the garbage collection process of the existing hybrid storage system, the characteristics of the hybrid storage medium and the impact on the read and write requests of the upper application are not considered, but only the timing of garbage collection or the selection of objects to be recycled are optimized, for example Inherent characteristics such as

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Garbage collection method based on SSD-SMR mixed key value storage system
  • Garbage collection method based on SSD-SMR mixed key value storage system
  • Garbage collection method based on SSD-SMR mixed key value storage system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0035] The present invention provides a garbage collection method based on an SSD-SMR hybrid key-value storage system. According to the proportion of free space in SSD or SMR, garbage collection operations are divided into active garbage collection operations and passive garbage collection operations by adopting two-level thresholds; When SSD or SMR needs to perform garbage collection, according to its weight or effective data ratio, select the corresponding recycling block or recycling zone; among them, SSD selects the block with the smallest weight calculated by the ratio of valid data in the block and the number of erasures of the block as the block. For recycling blocks, SMR selects the band with the smallest proportion of valid data as the recycling band; according to the hot and cold judgment of the data during garbage collection and the mode of garbage collection, select the migration target of valid data in the recycling block; when the data is hot data, the effective D...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a garbage collection method based on a SSD-SMR mixed key value storage system. The garbage collection method comprises the following steps: dividing garbage collection operation into active garbage collection operation and passive garbage collection operation by adopting a two-stage threshold value according to an SSD or an idle space proportion in an SMR; when the SSD or the SMR needs to recycle the garbage, selecting a corresponding recycling block or a recycling belt according to the weight of the SSD or the SMR or the effective data proportion of the SSD or the SMR;Selecting a migration target of the effective data in the recovery block or the recovery belt according to the cold and hot judgment of the data in the garbage recovery process and the garbage recovery mode; when the data is hot data, migrating valid data into an SSD block, and when the data is cold data, migrating the data into an SMR band; and when garbage collection is completed, information in the recycling block or the recycling belt is updated, meanwhile, key value mapping table information is updated, and garbage collection is completed. According to the method, the system efficiency is improved, the system resource consumption is reduced, the system performance is comprehensively optimized and improved, and a new scheme is provided for constructing an economic and efficient storage system.

Description

technical field [0001] The invention belongs to the technical field of computer storage, and in particular relates to a garbage collection method based on an SSD-SMR hybrid key-value storage system. Background technique [0002] Considering the inherent characteristics of NAND Flash storage media, that is, read and write operations are based on data pages, and erasure operations are based on data blocks. Therefore, it is necessary to erase data blocks before writing to SSD. This creates a write amplification problem. SMR shingled magnetic recording disk is a high-capacity disk using a new type of magnetic storage technology. The SMR disk keeps the head and media technology of the existing HDD disk unchanged, and partially overlaps the data tracks on the disk, which greatly improves the storage density in the same area compared with the traditional disk, thereby increasing the overall capacity. The technology requires very small changes in the manufacturing process, but it ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/06
Inventor 伍卫国张驰宫继伟解超毛海张晨
Owner XI AN JIAOTONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products