HBase-oriented performance testing system

A technology for testing systems and performance, applied in special data processing applications, instruments, electrical and digital data processing, etc. Accurate scale, multi-feature testing function, convenient feature testing effect

Active Publication Date: 2015-12-09
FUJIAN NEWLAND SOFTWARE ENGINEERING CO LTD
View PDF3 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

When used to test HBase, it can only be used to discover common problems. It cannot provide customized tests based on the characteristics of HBase products, and it is difficult to support the application and tuning of new features of database products.
[0005] 2. The above-mentioned test tools are relatively weak in the ability to customize test plans and test data, and cannot execute multiple test cases at a time, or perform detailed customization of query and write actions
[0006] 3. The above-mentioned test tools are all developed by foreign companies, and the use documents and materials are scarce. It is difficult to fully grasp the methods and skills of their use, and there are hidden dangers in the correctness of the test results.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • HBase-oriented performance testing system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0037] In order to describe the technical content, structural features, achieved goals and effects of the present invention in detail, the following will be described in detail in conjunction with the embodiments and accompanying drawings.

[0038] HBase is a distributed, column-oriented open source database. It is different from general relational databases. It is a database suitable for structured / unstructured data storage. It is based on columns rather than rows, and is suitable for processing massive data. Bulk operations respond quickly.

[0039] HFile is the storage format of KeyValue data in HBase, and HFile is the binary format file of Hadoop. In fact, StoreFile is made of lightweight packaging, that is, the bottom layer of StoreFile is HFile. HFile files are of variable length, and only two of them are fixed in length. Each KeyValue pair in HFile is a simple byte array, but this byte array contains many items and has a fixed structure. The structure is as follows: th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides an HBase-oriented performance testing system which comprises a task analyzer, a task organizer, a task thread pool, a task thread, an HBase adaption module and a log and test report generator. A test task written by a user is analyzed by a scheme assembly analyzer to obtain a test scheme, then, the test scheme is delivered to the task organizer to create the test operation task thread pool and execute the test operation with the test operation task thread, the task thread pool monitors the completion of the task thread, and the test operation thread achieves scanning operation through interaction between the HBase adaption module and an HBase database. The task organizer monitors the task thread pool to generate and output a test report through the log and test report generator after all test operation threads are completed.

Description

technical field [0001] The invention relates to the field of testing of distributed databases, in particular to an HBase-oriented performance testing system. Background technique [0002] With the rapid development of information technology, the data generated in the information age is increasingly expanding. As an important technical means to solve the field of big data, Hadoop is currently widely used. As a distributed database in the Hadoop technology stack, HBase is responsible for the important responsibility of massive structured data storage services in big data solutions. In the actual production operation process, it is often accompanied by tasks such as sudden fault location and continuous performance optimization, which need to be carried out with the help of performance testing tools. There are general-purpose performance testing tools for NoSQL databases on the market, such as Yahoo ycsb and Intel bigdatabenchmark. These testing tools rely on HBase’s public API...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/217
Inventor 陈晨
Owner FUJIAN NEWLAND SOFTWARE ENGINEERING CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap