Performance optimization method for multi-input/output stream concurrent writing based on continuous data

An optimization method, multi-input technology, applied in the direction of input/output to the record carrier, etc., can solve the problem that the IO capability of the underlying storage device cannot be fully utilized, the service level of high-priority applications cannot be guaranteed, and the hardware cost of the host and storage side is high. No inferior problems, to achieve the effect of reducing timeout retry, reducing high IOPS demand, and reducing the number of IO writes

Active Publication Date: 2014-04-30
TOYOU FEIJI ELECTRONICS
View PDF6 Cites 30 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The simple combination of application and storage has caused the following limitations: the IO capability of the underlying storage device cannot be fully utilized; the performance of the application cannot be effectively improved; meeting the application IO peak demand leads to high hardware costs for the host and storage; green storage Unable to land; high-priority application service level cannot be guaranteed

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Performance optimization method for multi-input/output stream concurrent writing based on continuous data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0018] The present invention will be described in detail below in conjunction with specific implementation examples.

[0019] Deploy a new module in the storage system. The lower layer device can be a file system, or a storage device volume such as a single hard disk or a disk array. In the following example, there are 4 RAIDs in the lower layer, and each RAID is composed of 15 disks. RAID5, the capacity of each disk is 2TB, the average capacity of each RAID is 25TB, and the total system capacity is 100TB. The upper layer has a total of 30 IO streams. These 30 IO streams are composed of WebServer applications, database applications, and video applications. The process is as follows: figure 1 shown.

[0020] According to step 1, after the module is enabled, a group of cache pools with a dynamically configurable size will be created. The total system cache size is 8GB. The threads are set to 30 and 4 respectively.

[0021] According to step 2, initialize the cache pool and re...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a performance optimization method for multi-input / output stream concurrent writing based on continuous data, and belongs to the field of computer storage technology. According to the performance optimization method for multi-input / output stream concurrent writing based on continuous data, a thread pool accumulates and stores the data into a cache pool through receiving data stream, flashing the cache into a lower device through downwards flashing the thread pool, and when receiving the data stream accumulating and the downwards flashing of the cache, tabbing according to application priority and firstly processing the application data with the highest priority. According to the performance optimization method for multi-input / output stream concurrent writing based on continuous data, through studying the IO (Input / Output) character of upper application data and IO access ability of the lower device, and dynamically adjusting the configuration of the thread cache pool and the thread pool, the performance optimization on continuous data IO and the application priority are ensured. According to the performance optimization method for multi-input / output stream concurrent writing based on continuous data, the IO writing times of the underlying storage device can be reduced, and the IO ability of the underlying storage device can be fully developed; the bandwidth of the storage device is reasonably utilized to effectively improve the performance of the application; the high IOPS (Input / Output Operations per Second) requirement of the underlying device is reduced, and the cost of the whole device is reduced; components with lower energy consumption are adopted, so that environment-friendly storage is achieved.

Description

technical field [0001] The invention relates to a method for optimizing concurrent writing performance based on continuous data multiple input and output (IO) streams, and belongs to the technical field of computer storage. Background technique [0002] At present, most storage systems and applications are in a separate mode during use. Applications and storage only focus on their own implementation and optimization, and have not been organically combined. When encountering performance bottlenecks, priority is given to whether to upgrade hardware to improve its processing capabilities. In practice, The hardware capabilities are not fully utilized. [0003] The simple combination of application and storage has caused the following limitations: the IO capability of the underlying storage device cannot be fully utilized; the performance of the application cannot be effectively improved; meeting the application IO peak demand leads to high hardware costs for the host and storage...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/06
Inventor 王道邦钱文孙斌谢红军罗华周泽湘李辉郭毅
Owner TOYOU FEIJI ELECTRONICS
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products