A performance optimization method for concurrent writing based on continuous data multiple input and output streams

Abstract

The invention relates to a performance optimization method for multi-input / output stream concurrent writing based on continuous data, and belongs to the field of computer storage technology. According to the performance optimization method for multi-input / output stream concurrent writing based on continuous data, a thread pool accumulates and stores the data into a cache pool through receiving data stream, flashing the cache into a lower device through downwards flashing the thread pool, and when receiving the data stream accumulating and the downwards flashing of the cache, tabbing according to application priority and firstly processing the application data with the highest priority. According to the performance optimization method for multi-input / output stream concurrent writing based on continuous data, through studying the IO (Input / Output) character of upper application data and IO access ability of the lower device, and dynamically adjusting the configuration of the thread cache pool and the thread pool, the performance optimization on continuous data IO and the application priority are ensured. According to the performance optimization method for multi-input / output stream concurrent writing based on continuous data, the IO writing times of the underlying storage device can be reduced, and the IO ability of the underlying storage device can be fully developed; the bandwidth of the storage device is reasonably utilized to effectively improve the performance of the application; the high IOPS (Input / Output Operations per Second) requirement of the underlying device is reduced, and the cost of the whole device is reduced; components with lower energy consumption are adopted, so that environment-friendly storage is achieved.

Description

technical field [0001] The invention relates to a method for optimizing concurrent writing performance based on continuous data multiple input and output (IO) streams, and belongs to the technical field of computer storage. Background technique [0002] At present, most storage systems and applications are in a separate mode during use. Applications and storage only focus on their own implementation and optimization, and have not been organically combined. When encountering performance bottlenecks, priority is given to whether to upgrade hardware to improve its processing capabilities. In practice, The hardware capabilities are not fully utilized. [0003] The simple combination of application and storage has caused the following limitations: the IO capability of the underlying storage device cannot be fully utilized; the performance of the application cannot be effectively improved; meeting the application IO peak demand leads to high hardware costs for the host and storage...

AI Technical Summary

Problems solved by technology

[0003] The simple combination of application and storage has caused the following limitations: the IO capability of the underlying storage device cannot be fully utilized; the performance of the application cannot be effectively improved; meeting the application IO peak demand leads to high hardware costs for the host and storage; green storage Unable to land; high-priority application service level cannot be guaranteed

Images