Data classified storage method, device and equipment and storage medium

A data classification and data technology, applied in the input/output process of data processing, electrical digital data processing, instruments, etc., can solve the problems of low garbage collection efficiency and large data volume

Inactive Publication Date: 2020-05-12
北京浪潮数据技术有限公司
View PDF3 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Therefore, there is a problem of write amplification, that is, the amount of data written by the user is N, but because the data has to be moved internally, the actual amount of data written in the device exceeds N, assuming M, this ratio M/N is the write amplification factor
T

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data classified storage method, device and equipment and storage medium
  • Data classified storage method, device and equipment and storage medium
  • Data classified storage method, device and equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0032] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0033] see figure 1 , which shows a flow chart of a method for classifying and storing data according to an embodiment of the present invention, which may include:

[0034] S11: If it is necessary to write user data into the flash memory, then determine that the user data currently to be written is the purpose data, and determine that the classifier currently to be used is the purpose classifier; the classifier utilizes the user data that has been written into...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data classified storage method, device and equipment and a storage medium, and the method comprises the steps: determining the user data needing to be written at present as target data if the user data needs to be written into a flash memory, and determining a classifier needing to be used at present as a target classifier, wherein the classifier is obtained by training data characteristics and categories of the user data written into the flash memory; extracting data features of the target data, and inputting the data features of the target data into a target classifier to obtain a category to which the target data output by the target classifier belongs; and determining a storage area corresponding to the category of the target data in the flash memory, and writing the target data into the determined storage area. When garbage collection is carried out on the user data, the possibility of selecting blocks which are invalid data or most of the blocks are invalid data is relatively high, so that the moving amount of the user data is reduced, the write amplification coefficient is reduced, and the garbage collection efficiency is improved.

Description

technical field [0001] The present invention relates to the technical field of flash memory, and more specifically, to a method, device, device and storage medium for classifying and storing data. Background technique [0002] Flash memory (NAND) technology is constantly improving. Regardless of 2D or 3D flash memory, there is a feature that it can be written according to Page (page, the smallest writing unit in flash memory, and there are multiple Pages in a Block), but it can only be written according to Block (block, the smallest erasing unit in flash memory, there are multiple Blocks in a flash memory) erase. Therefore, when the flash memory is nearly full, some of the multiple pages in a block may be invalid data, and the other part may be valid data. In order to free up more space, it is necessary to move the pages that store valid data in the block to a new block. In , after all valid pages are moved, the Block can be erased; after erasing, the Block can be reused. ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/06G06K9/62
CPCG06F3/064G06F3/0644G06F3/0647G06F3/0652G06F3/0679G06F18/241
Inventor 张博
Owner 北京浪潮数据技术有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products