Hierarchical scheduling method and system suitable for multi-level storage system
A multi-level storage and hierarchical scheduling technology, applied in the input/output process of data processing, instruments, input/output to record carriers, etc., can solve problems such as write amplification, reduce read amplification and improve read efficiency.
Active Publication Date: 2021-01-29
SHENZHEN UNIV
View PDF7 Cites 2 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0003] In view of this, the embodiment of the present invention provides a hierarchical scheduling method and system suitable for multi-level storage systems, which solves the problem of write amplification while optimizing the read path in the prior art
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0022] The technical solutions of the present invention will be clearly and completely described below in conjunction with the accompanying drawings. Apparently, the described embodiments are some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.
[0023] In addition, the technical features involved in the different embodiments of the present invention described below may be combined with each other as long as there is no conflict with each other.
[0024] In practical applications, the scheduling operation of the non-volatile storage part of the general multi-level storage system can only be adjusted downward, that is to say, the data will always move to the lower level without upward adjustment. The non-volatile storage module is moved to the upper lev...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention discloses a hierarchical scheduling method and system suitable for a multi-level storage system, and the method comprises the steps: adding a current storage module read from the multi-level storage system into an up-regulation module queue according to a to-be-queried key value, and updating the reading frequency of the current storage module; if the updated reading frequency of thecurrent storage module is greater than a preset multiple of the lowest reading frequency, determining the current storage module as a current up-regulation module; and when the storage module with the same query key value corresponding to the storage data in the current up-regulation module exists in the hierarchy above the current hierarchy, storing the storage data with the same query key valuein the current up-regulation module in the corresponding storage module. According to the invention, the storage module with the reading frequency reaching the preset value is determined as the up-regulation module, and the data in the up-regulation module is up-regulated, so that the reading efficiency is improved, the reading amplification is reduced, hotspot data is ensured to be hotspot datain a global state, and the write amplification is not caused in the process of optimizing a reading path.
Description
technical field [0001] The invention relates to the technical field of computer storage, in particular to a hierarchical scheduling method and system applicable to a multi-level storage system. Background technique [0002] With the development and application of new technologies such as cloud services, big data, and artificial intelligence, the requirements for storage systems are getting higher and higher. The existing multi-level storage systems read data by searching for target values according to levels. Return after finding the record. Compared with the general storage system, the multi-level storage system has an advantage of 1 to 2 orders of magnitude in write throughput, but at the same time, its read performance will be greatly reduced. Generally, the read path Optimization is to reduce the non-hot data in the current level to the low-level storage system to achieve the purpose of optimizing the read path. However, because hot data usually only belongs to hot dat...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/06
CPCG06F3/0608G06F3/0638G06F3/0659G06F3/0679
Inventor 王毅何嘉键陈家贤廖好周池毛睿
Owner SHENZHEN UNIV