A server disk performance test system and method based on Hadoop

A test method and test system technology, applied in the direction of instruments, error detection/correction, electrical digital data processing, etc., can solve the problems that the actual application deviation is far away, the test data can only be used as a reference, and it is not close to the actual application environment of customers. Achieve easy problems and bottlenecks, improve test configuration, and achieve reliable design principles

Inactive Publication Date: 2018-12-07
ZHENGZHOU YUNHAI INFORMATION TECH CO LTD
View PDF6 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] At present, most of the tools for testing disk performance are open source tools. They use different block sizes to simulate different file types, and increase data depth by parallelizing multiple threads to simulate different application situations. These methods are not close to the actual application of customers. Environment, test data can only be used as a reference, far from the actual application

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A server disk performance test system and method based on Hadoop
  • A server disk performance test system and method based on Hadoop
  • A server disk performance test system and method based on Hadoop

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 2

[0058]Together, HDFS and MapReduce form the core of the Hadoop distributed system architecture. HDFS implements a distributed file system on the cluster, and MapReduce implements distributed computing and task processing on the cluster. HDFS provides support for file operations and storage in the process of MapReduce task processing. MapReduce realizes task distribution, tracking, execution and other tasks on the basis of HDFS, and collects the results. The interaction between the two completes the Hadoop distributed cluster. main mission.

[0059] The whole environment needs a master server node, a slave server node, and the slave server node is the server to be tested; the two servers need to be in a network segment to facilitate mutual connection; the test environment is simple, if there are many servers to be tested, you can set Multiple slave server nodes are tested synchronously;

[0060] like figure 1 As shown, the present invention also provides a Hadoop-based serve...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a server disk performance testing system and method based on Hadoop. The whole environment needs a master server node, a slave server node, and a slave server node as a server to be tested. The two servers need to be in a network segment to facilitate interconnection. The test environment is simple. If there are more servers to be tested, multiple slave server nodes can be set to test synchronously. The method comprises the following steps: S1, configuring an environment of a server disk performance testing system; S2, performing performance testing on the server disk; S3, processing and analyzing test data and log. Hadoop, an open source framework, is adopted to verify the performance of the disk on the server, and verify the performance of the selected disk on thedistributed storage application scenario by approaching the actual client application scenario. Through the tools of an Hadoop program, files with different sizes are simulated, the performance of disk in various scenarios is verified, and the theoretical data of disk is compared, and evaluation and suggestions are provided.

Description

technical field [0001] The invention belongs to the technical field of disk testing, in particular to a Hadoop-based server disk performance testing system and method. Background technique [0002] With the development of the times, the amount of data generated every day is very huge. A single machine can no longer store such a huge amount of data. A huge number of servers are required to complete the storage work. To query the desired data from such an order of magnitude of data, in addition to In addition to excellent algorithms, matching access speed is also required; there are currently many distributed storage tools on the market, and customers can choose appropriate servers to build a distributed storage environment according to different application scenarios to meet their own application needs; [0003] At present, most of the tools for testing disk performance are open source tools, which use different block sizes to simulate different file types, and simulate diffe...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F11/263
CPCG06F11/263
Inventor 刘云飞
Owner ZHENGZHOU YUNHAI INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap