Method for optimizing write performance under cache policy write hierarchy hardware architecture
A caching strategy and hardware architecture technology, applied in the field of big data storage, to achieve the effect of improving write performance
Inactive Publication Date: 2018-12-21
NANJING NARI GROUP CORP +2
View PDF5 Cites 10 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0005] Purpose of the invention: In order to solve the balance problem between the consistency of written data and the overall performance of the system brought about by the distributed architecture, the present invention provides a write performance optimization method under the hierarchical hardware architecture of cache policy writing
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0029] The present invention will be further described below in conjunction with the accompanying drawings and specific embodiments.
[0030] Step 1, such as figure 1 , storage builds virtual volumes at the operating system level, in which the storage layer is divided into the following sub-storage layers by using the data layering control algorithm of the volume: DRAM cache, SSD cache, high-speed SSD layer, and slow HDD layer to better adapt to different Data application characteristics. Among them, the data layering control algorithm of the volume controls the data layering based on the temperature of data processing. This control algorithm forms a multi-layer and multi-level interactive storage trend according to the IO quantity, read-write ratio, IO position, IO parameters, and the ratio of high-speed and slow media of each subsystem of all data under each layer. Dynamically integrate resource information, and achieve maximum performance improvement in physical storage a...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention discloses a write performance optimization method under the hierarchical hardware structure of cache strategy writing. The storage layer is stratified according to the data stratification control algorithm of the volume. HDD and SSD are used as target devices in disk manager to aggregate into virtual device Cache memory, and HDD and SSD blocks are mapped at the same time. According to the block mapping, the operation of HDD is converted to the operation of SSD, and the function of storing hot data in SSD is realized. The present invention focuses on optimizing write performance in terms of cache acceleration, When the amount of data exceeds the storage capacity threshold range, the hot and cold data are replaced to form the trend of multi-layer and multi-level interactive storage, and the resource information is dynamically integrated in real time, so as to maximize the performance improvement in physical storage and non-volatile high-speed storage under the premise of ensuring data security and consistency. At the same time, users can conveniently formulate management strategies to achieve storage resources according to their own needs.
Description
technical field [0001] The invention belongs to the technical field of big data storage, and in particular relates to a writing performance improvement method for writing cache policies into hierarchical hardware. Background technique [0002] In recent years, with the continuous development of emerging technologies such as big data and cloud computing, the global data volume has grown rapidly, posing severe challenges to storage capacity and performance. As the underlying massive data storage system supporting the era of big data, the distributed file system has become a research hotspot. Data reading and writing are two basic operations provided by the distributed file system. The performance of the read operation of the distributed file system is extremely high due to the high read performance of physical media such as memory and SSD, and the read operation does not need to consider data security. The optimization of write operations has not received much attention. [...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More IPC IPC(8): G06F3/06
CPCG06F3/0607G06F3/0649G06F3/0685
Inventor 钱琳梅竹俞俊朱广新庞恒茂卜敏陈海洋凌阳王剑江樱宋德炳许明杰王琳
Owner NANJING NARI GROUP CORP