A performance monitoring and tuning system and method for a distributed storage system
A technology of distributed storage and system performance, applied in the field of computer distributed storage systems, can solve the problems of complex logical architecture and many adjustable parameters, and achieve the effect of improving performance
Active Publication Date: 2018-07-17
XI AN JIAOTONG UNIV
View PDF7 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
However, in order to ensure high reliability, consistency, and usefulness, the distributed storage system has a complex logical architecture and many adjustable parameters. Deploying the distributed storage system to the data center and adjusting the software and hardware parameters to maximize the performance of the cluster is of great importance. Operation and maintenance personnel is a problem that must be solved
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0026] In order to make the purpose, technical solution and advantages of the present invention more clear, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the embodiments described here are only used to explain the basic idea of the present invention, and are not intended to limit the present invention.
[0027] Although different distributed storage systems have different system designs and have their own characteristics, the problems they need to solve are the same, and their design logic frameworks are similar with minor differences. This is the premise of the present invention, and it must be established.
[0028] The deployment topology of the performance monitoring and tuning system of the present invention is as follows: figure 1 As shown, the system includes a data processing module and a data acquisition module deployed on nodes of the distributed storage sys...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention provides a performance monitoring and tuning system and method for a distributed storage system. The system comprises a data processing module and a data acquisition module; the data acquisition module acquires performance parameter data related to all layers of an IO stack in real time at all nodes of a system and hardware performance parameter data of the nodes; the data processing module tunes configuration parameters corresponding to the system by adopting a greedy algorithm according to the IO stack part which most consumes time and the IO stack part with the maximum change rate. The method comprises the steps that firstly, the IO stack of the distributed storage system is mapped into a true distributed storage system; secondly, an analyzing and tuning task is completed through data acquired in the system operating process. The system and the method can be applied to the true distributed storage system, cluster bottlenecks are automatically analyzed and found and then tuned, and the performance of the distributed storage system is improved.
Description
technical field [0001] The present invention relates to the field of computer distributed storage systems, in particular to remote performance monitoring and automatic tuning systems for distributed storage systems; cloud storage technology, data management technology and distributed monitoring technology are applied to build a data collection, performance analysis and Automated tuning platform. Background technique [0002] With the explosive growth of data and high-speed processing requirements, applications have higher and higher requirements for data storage and access performance. However, due to limitations of manufacturing processes and current technologies, a single storage server or storage array cannot provide PB-level or greater storage capacity. The processing performance and access performance of a single node are far from satisfying real-world applications. Major companies have deployed distributed storage systems to address capacity and performance issues. ...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): G06F11/34G06F11/30
CPCG06F11/3034G06F11/3485
Inventor 张兴军方敏聂世强蔡毅徐志伟伍卫国董小社
Owner XI AN JIAOTONG UNIV