Method for allocating multi-path data in coexistence of various storage media
A technology for multi-channel data distribution and storage media, applied in memory address/allocation/relocation, electrical digital data processing, special data processing applications, etc., can solve problems such as not considering data distribution methods, and achieve load balance and good The effect of scalability
Inactive Publication Date: 2014-09-10
NANJING UNIV OF POSTS & TELECOMM
View PDF3 Cites 8 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0009] However, although the above data distribution strategies have different advantages and disadvantages, most of them are aimed at the data distribution of disk and memory, and the storage nodes are considered uniformly. They have not yet considered the specific method of data distribution under the coexistence of multiple storage media.
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0020] The present invention proposes a multi-channel data distribution method under the coexistence of multiple media, such as figure 2 , the main body of the method can be divided into a data feature extraction and distribution module and a storage resource monitoring module that records the remaining resources of each storage node. The data feature extraction and distribution module also includes a data characteristic and heat mining module. According to the storage medium type n in the storage system, the corresponding n-way data distribution strategy is established. It is worth noting that here, each way corresponds to a storage medium, and the corresponding n-way data distribution strategy that needs to be established can be selected from various existing ones. The data distribution strategy makes full use of the wisdom of the predecessors without re-developing a new distribution strategy, and the n-way data distribution strategy can be selected according to the characte...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention discloses a method for allocating multi-path data in the coexistence of various storage media, which is characterized in that a data feature extraction and distribution module and a storage resource monitoring module for recording the amount of remaining resources of each storage node are arranged in a storage system; a corresponding n-path data allocation policy is set according to the variety n of the storage media in the storage system; the storage resource monitoring module feeds the amount of remaining storage resources and other information back to the data feature extraction and distribution module; the data features and data characteristics extracted by the data feature extraction and distribution module, and the information fed back by a hotness mining module and the storage resource monitoring module jointly determine the path which the data is distributed to. By adopting the method for allocating multi-path data in the coexistence of various storage media, data can be allocated rationally according to different features of the storage media, and the data can also be allocated to each storage node uniformly; moreover, the method has a good expansibility even if more novel storage media appear in the future.
Description
Technical field: [0001] The invention relates to the field of storage systems, in particular to the field of specific data distribution where multiple storage media coexist. Background technique [0002] In recent years, big data has become a hot topic of widespread concern in academia and industry. Synchronously developing with big data technology is a new type of storage technology. In view of the fact that disks have been unable to cope with the challenges brought by big data, the demand for new storage devices in the market has become stronger and stronger. Since 2000, the manufacture and industrialization of new storage devices such as flash memory and phase change memory An important breakthrough has been made, and it has been gradually used in various application fields (such as embedded systems, enterprise computing, etc.). Among them, flash memory and PCM are developing most rapidly, and have reached the practical level at present. [0003] The introduction of a ...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More IPC IPC(8): G06F12/02G06F17/30
Inventor 孙知信王文君宫婧
Owner NANJING UNIV OF POSTS & TELECOMM