Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

HDFS throughput performance test method, system, terminal and storage medium

A test method and test system technology, applied in software testing/debugging, error detection/correction, instruments, etc., can solve the problems of insufficient throughput performance testing tools and methods, lack of reference solutions, etc., to achieve the degree of test automation High, reliable design principle, wide application prospects

Active Publication Date: 2019-12-03
SUZHOU LANGCHAO INTELLIGENT TECH CO LTD
View PDF2 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In the performance test of big data platforms, the testing tools and methods for the throughput performance test of HDFS components are insufficient, and there are few solutions that can be used for reference

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • HDFS throughput performance test method, system, terminal and storage medium
  • HDFS throughput performance test method, system, terminal and storage medium
  • HDFS throughput performance test method, system, terminal and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0053] In order to enable those skilled in the art to better understand the technical solutions in the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described The embodiments are only some of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts shall fall within the protection scope of the present invention.

[0054] figure 1 is a schematic flowchart of a method in one embodiment of the present invention. in, figure 1 The execution subject may be a HDFS throughput performance testing system.

[0055] Such as figure 1 As shown, the method 100 includes:

[0056] Step 110, setting test files according to the scale parameters of the storage ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides an HDFS throughput performance test method, an HDFS throughput performance test system, a terminal and a storage medium. The HDFS throughput performance test method comprises the steps of setting a test file according to scale parameters of a storage cluster; distributing the test file to each node of a storage cluster, and obtaining an average read-write rate of a node diskof the storage cluster by utilizing a dd command and the test file; utilizing a cluster benchmark test tool Test DFSIO and the test file to obtain a cluster average read-write rate; and calculating adifference value between the average read-write rate of the disk and the average read-write rate of the cluster, and representing HDFS throughput performance by utilizing the difference value. The test accuracy is higher, the test automation degree is high, and manpower resources are saved.

Description

technical field [0001] The invention relates to the technical field of server testing, in particular to a HDFS throughput performance testing method, system, terminal and storage medium. Background technique [0002] Hadoop Distributed File System (HDFS) is designed as a distributed file system suitable for running on commodity hardware. HDFS has the characteristics of high fault tolerance (fault-tolerant) and is designed to be deployed on low-cost (low-cost) hardware. And it provides high throughput (high throughput) to access application data, suitable for those applications with large data sets (large data set). [0003] The throughput performance of the distributed file system HDFS is one of the important performance indicators of the big data cluster, which marks the storage capacity of the big data platform, so it has an important reference value for evaluating the distributed storage capacity test of the big data platform. In the performance testing of big data plat...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F11/36
CPCG06F11/3688
Inventor 赵明伟
Owner SUZHOU LANGCHAO INTELLIGENT TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com