Method, apparatus, electronic device and readable storage medium for platform performance testing

Abstract

This application belongs to the field of testing technology, and discloses a method, device, electronic device and readable storage medium for platform performance testing. The method includes: when determining that a platform testing task for a target application product is received, obtaining the business attribute information and resource attribute information of the target application product, where the target application product is a product developed through a product development platform; determining the performance indicators to be tested according to the business attribute information and the resource attribute information; testing the product development platform for the performance indicators to obtain platform test data; and sending the platform test data to the target application product. In this way, different performance tests can be performed on the product development platform for different target application products, realizing personalized performance testing for the target application product and improving the effectiveness of platform test data push.

Description

Technical Field

[0001] The present application relates to the field of testing technologies, and more particularly, to a method, apparatus, electronic device, and readable storage medium for platform performance testing. Background Art

[0002] With the development of Internet technologies, developers can usually develop different application products, such as firewalls, through a product development platform. The product development platform can usually support the development and operation of dozens of application products. In actual applications, it is usually necessary to perform performance testing on the product development platform, so as to determine whether the product development platform can meet the performance requirements of the target application product based on the platform test data.

[0003] In the prior art, multiple performance indicators of the product development platform are usually tested to obtain platform test data, and the platform test data is sent to the target application product. The target application product can determine whether the product development platform meets the performance requirements of the target application product based on the platform test data.

[0004] However, the performance indicators required by different application products for the product development platform are usually different. This testing method cannot perform personalized performance testing on the product development platform according to the performance requirements of different application products, and will provide invalid garbage data to the target application product.

[0005] Therefore, when testing the product development platform, how to perform personalized performance testing on the product development platform for different application products to obtain platform test data that is effective for the application products. Summary of the Invention

[0006] The purpose of the embodiments of the present application is to provide a method, apparatus, electronic device, and readable storage medium for platform performance testing, so as to perform personalized performance testing on the product development platform for different application products when testing the product development platform, and obtain platform test data that is effective for the application products.

[0007] On the one hand, a method for platform performance testing is provided, including:

[0008] When it is determined that a platform test task for a target application product is received, obtain the business attribute information and resource attribute information of the target application product, where the target application product is a product developed through the product development platform;

[0009] Determine the performance indicators to be tested according to the business attribute information and the resource attribute information;

[0010] Test the product development platform for the performance indicators to obtain platform test data;

[0011] Send the platform test data to the target application product.

[0012] In the above implementation process, according to the business attribute information and resource attribute information of the target application product, the performance indicators of the product development platform required by the target application product can be determined, and according to the determined performance indicators, the product development platform can be tested individually to obtain the platform test data required by the target application product. In this way, different performance tests can be carried out on the product development platform for different target application products, realizing the personalized performance test for the target application product, reducing the labor cost and time cost consumed, providing effective platform test data for the target application product, reducing the push of invalid garbage test data, and enabling the target application product to judge whether the product development platform meets the performance requirements of the target application product development and application according to the obtained effective platform test data.

[0013] In one implementation, before obtaining the business attribute information and resource attribute information of the target application product, it includes:

[0014] Obtain the business message of the target application product and the resource configuration information;

[0015] Parse and extract features from the business message to obtain the business features of the business message;

[0016] Generate and store the business attribute information of the target application product according to the business features;

[0017] Extract the resource attributes from the resource configuration information to obtain and store the resource attribute information.

[0018] In the above implementation process, the business attribute information and resource attribute information are extracted, so that in the subsequent steps, the performance indicators to be tested can be determined according to the business attribute information and resource attribute information.

[0019] In one implementation, according to the platform test task, business attribute information and resource attribute information, determine the performance indicators to be tested, including:

[0020] According to the correspondence relationship among the preset business attribute information, resource attribute information and performance indicators, obtain the performance indicators corresponding to the business attribute information and resource attribute information.

[0021] In the above implementation process, determine the performance indicators to be tested according to the business attribute information and resource attribute information.

[0022] In one implementation, for the performance indicators, test the product development platform to obtain the platform test data, including:

[0023] Configure a performance test environment according to resource attribute information and service attribute information, where the performance test environment includes: a test server, a test client, and a module under test;

[0024] Obtain the initial metric value of the performance metric;

[0025] Based on the performance test environment, loop through the following steps until it is determined that the preset metric test condition is met: Based on the metric value, control the test server and the test client to transmit test packets through the module under test, obtain the packet loss rate of the test packets, and adjust the metric value of the performance metric according to the packet loss rate;

[0026] Generate platform test data according to the adjusted metric value.

[0027] In the above implementation process, adjust the metric value through the packet loss rate to generate platform test data.

[0028] In one implementation, configuring a performance test environment according to resource attribute information and service attribute information includes:

[0029] Configure the module under test according to the resource attribute information to generate a software and hardware test environment;

[0030] Configure the test server and the test client according to the service attribute information to generate a service test environment;

[0031] Obtain a performance test environment based on the hardware test environment and the service test environment.

[0032] In the above implementation process, a performance test environment for testing can be configured through resource attribute information and service attribute information.

[0033] In one implementation, after testing the product development platform for a performance metric and obtaining platform test data, it further includes:

[0034] Associate and store the target application product and the platform test data in a database;

[0035] When it is determined that a platform performance query instruction for the target application product is received, output the platform test data associated with the target application product.

[0036] In the above implementation process, platform test data can be stored and queried.

[0037] On the one hand, provide a device for platform performance testing, including:

[0038] An acquisition unit, configured to obtain the business attribute information and resource attribute information of a target application product when it is determined that a platform test task for the target application product is received, where the target application product is a product developed through a product development platform;

[0039] A determination unit, configured to determine the performance indicators to be tested according to the business attribute information and the resource attribute information;

[0040] A test unit, configured to test the product development platform for the performance indicators to obtain platform test data;

[0041] A sending unit, configured to send the platform test data to the target application product.

[0042] In one implementation, the acquisition unit is further configured to:

[0043] Obtain the business message of the target application product and the resource configuration information;

[0044] Parse the business message and extract features to obtain the business features of the business message;

[0045] Generate and store the business attribute information of the target application product according to the business features;

[0046] Extract resource attributes from the resource configuration information, and obtain and store the resource attribute information.

[0047] In one implementation, the determination unit is configured to:

[0048] Obtain the performance indicators corresponding to the business attribute information and the resource attribute information according to the corresponding relationship among the preset business attribute information, resource attribute information, and performance indicators.

[0049] In one implementation, the test unit is configured to:

[0050] Configure a performance test environment according to the resource attribute information and the business attribute information, where the performance test environment includes: a test server, a test client, and a module under test;

[0051] Obtain the initial value of the performance indicator;

[0052] Based on the performance test environment, loop through the following steps until it is determined that a preset indicator test condition is met: Based on the indicator value, control the test server and the test client to transmit test messages through the module under test, obtain the packet loss rate of the test messages, and adjust the indicator value of the performance indicator according to the packet loss rate;

[0053] Generate platform test data according to the adjusted indicator value.

[0054] In one implementation, the test unit is configured to:

[0055] Configure the module under test according to the resource attribute information to generate a software and hardware test environment;

[0056] Configure the test server and the test client according to the service attribute information to generate a service test environment;

[0057] Obtain a performance test environment based on the hardware test environment and the service test environment.

[0058] In one implementation, the test unit is further configured to:

[0059] Associate and store the target application product and the platform test data in a database;

[0060] When it is determined that a platform performance query instruction for the target application product is received, output the platform test data associated with the target application product.

[0061] On the one hand, an electronic device is provided, including a processor and a memory. The memory stores computer-readable instructions. When the computer-readable instructions are executed by the processor, the steps of the method provided in any of the various alternative implementations of the above platform performance test are run.

[0062] On the one hand, a readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps of the method provided in any of the various alternative implementations of the above platform performance test are run.

[0063] On the one hand, a computer program product is provided. When the computer program product runs on a computer, the computer is caused to execute the steps of the method provided in any of the various alternative implementations of the above platform performance test.

[0064] In the method, device, electronic device, and readable storage medium for platform performance test provided by the embodiments of the present application, when it is determined that a platform test task for a target application product is received, the service attribute information and the resource attribute information of the target application product are obtained, where the target application product is a product developed through a product development platform; according to the service attribute information and the resource attribute information, the performance indicators to be tested are determined; for the performance indicators, the product development platform is tested to obtain platform test data; and the platform test data is sent to the target application product. In this way, different performance tests can be performed on the product development platform for different target application products, realizing personalized performance testing for the target application product and improving the effectiveness of platform test data push.

[0065] Other features and advantages of the present application will be set forth in the following description, and in part will be obvious from the description, or may be learned by practice of the present application. The objectives and other advantages of the present application may be realized and attained by the structure particularly pointed out in the written description, claims, as well as the drawings. Description of the Drawings

[0066] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following briefly introduces the drawings required to be used in the embodiments of the present application. It should be understood that the following drawings only show some embodiments of the present application, and thus should not be regarded as limiting the scope. For those of ordinary skill in the art, other related drawings can be obtained based on these drawings without creative efforts.

[0067] Figure 1 Schematic diagram of the architecture of a platform performance testing system provided by an embodiment of the present application Figure 1 ;

[0068] Figure 2 Flow chart of the implementation of a method for extracting product attribute data provided by an embodiment of the present application;

[0069] Figure 3 Schematic diagram of a message parsing process provided by an embodiment of the present application;

[0070] Figure 4 Flow chart of the implementation of a method for platform performance testing provided by an embodiment of the present application;

[0071] Figure 5 Schematic diagram of the architecture of a performance index determination system provided by an embodiment of the present application;

[0072] Figure 6 Schematic diagram of performance index determination provided by an embodiment of the present application;

[0073] Figure 7 Schematic diagram of the architecture of a platform performance testing system provided by an embodiment of the present application Figure 2 ;

[0074] Figure 8 Schematic diagram of business attribute information extraction provided by an embodiment of the present application;

[0075] Figure 9 Schematic diagram of resource attribute information extraction provided by an embodiment of the present application;

[0076] Figure 10 Block diagram of the structure of a device for platform performance testing provided by an embodiment of the present application;

[0077] Figure 11This is a schematic structural diagram of an electronic device in an embodiment of the present application. Specific Embodiments

[0078] The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Components of the embodiments of the present application described and illustrated in the drawings here can be arranged and designed in various different configurations. Therefore, the detailed description of the embodiments of the present application provided in the drawings below is not intended to limit the scope of the claimed present application, but merely represents selected embodiments of the present application. All other embodiments obtained by those skilled in the art based on the embodiments of the present application without creative efforts belong to the scope of protection of the present application.

[0079] It should be noted that: similar reference numerals and letters denote similar items in the following drawings. Therefore, once an item is defined in one drawing, it does not need to be further defined and explained in subsequent drawings. At the same time, in the description of the present application, terms such as "first" and "second" are only used for distinguishing descriptions and cannot be understood as indicating or implying relative importance.

[0080] First, some terms involved in the embodiments of the present application will be explained to facilitate understanding by those skilled in the art.

[0081] Terminal device: It can be a mobile terminal, a fixed terminal or a portable terminal, such as a mobile phone, a site, a unit, a device, a multimedia computer, a multimedia tablet, an Internet node, a communicator, a desktop computer, a laptop computer, a notebook computer, a netbook computer, a tablet computer, a personal communication system device, a personal navigation device, a personal digital assistant, an audio / video player, a digital camera / video camera, a positioning device, a television receiver, a radio broadcast receiver, an e-book device, a game device or any combination thereof, including accessories and peripherals of these devices or any combination thereof. It is also foreseeable that the terminal device can support any type of user interface (such as a wearable device), etc.

[0082] Server: It can be an independent physical server, or a server cluster or a distributed system composed of multiple physical servers. It can also be a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, and big data and artificial intelligence platforms.

[0083] In order to perform personalized performance testing on a product development platform for different application products during the testing of the product development platform and obtain platform test data effective for the application products, the embodiments of the present application provide a method, an apparatus, an electronic device, and a readable storage medium for platform performance testing.

[0084] Referring to Figure 1 shown, which is a schematic architecture of a platform performance testing system provided by the embodiments of the present application Figure 1 . Figure 1 Among them, it includes an application product and a platform performance testing system. The platform performance testing system includes a performance index determination module, a performance index storage module, a performance testing platform, and a platform test data storage module.

[0085] The application product is a product developed by R & D personnel based on the product development platform. R & D personnel can develop one or more application products on the product development platform. In order to support the development of different application products and the performance requirements of application operation, different software and hardware module resources are usually configured in the product development platform. Different application products can select and access different software and hardware module resources in the product development platform.

[0086] That is to say, the application product includes two parts. One part is the software and hardware resources in the product development platform used to support the development and operation of the target application product, and the other part is the service program developed and added by R & D personnel based on the product development platform. After the application product is developed, users can use the product services provided by the application product.

[0087] Optionally, the target application product can be a firewall. Figure 1 Among them, only two application products are taken as examples for illustration. In actual applications, one or more application products can be developed on the product development platform, which is not limited herein.

[0088] Performance index determination module: used to extract the product attribute data of the application product, that is, business attribute information and resource attribute information, and determine the performance indexes that need to be tested on the product development platform according to the product attribute data of the application product.

[0089] Performance index storage module: stores the product attribute data of the application product, and establishes and stores the correspondence between the application product and the performance indexes.

[0090] Performance testing platform: configures a performance testing environment according to the product attribute data of the target application product, and tests the product development platform for the performance indexes through the performance testing environment to obtain platform test data.

[0091] Platform test data storage module: associatively store the application product and the platform test data, and send the associated platform test data to the target application product.

[0092] Optionally, the performance metric storage module and the platform test data storage module can be the same database or different databases, and there is no restriction here.

[0093] In one implementation, if the performance metric storage module and the platform test data storage module are the same database, then the product attribute data of the application product, the correspondence between the application product and the performance metrics, and the target application product and the associated platform test data can all be stored in the same database.

[0094] It should be noted that the execution subject is Figure 1 the platform performance test system in , or other electronic devices such as servers, and there is no restriction here.

[0095] In the embodiments of the present application, before performing platform performance testing on the product development platform, first extract the product attribute data of the target application product developed on the product development platform, so that in subsequent steps, the platform performance testing of the product development platform can be performed according to the product attribute data of the target application product, and the platform test data related to the target application product can be obtained.

[0096] Refer to Figure 2 shown in the flowchart of the implementation of a method for extracting product attribute data provided by the embodiments of the present application. In combination with Figure 1 shown in the product development platform, the specific implementation process of this method is as follows:

[0097] Step 200: Obtain the service message of the target application product and the resource configuration information.

[0098] Specifically, collect the service message of the target application product and read the resource configuration information of the software and hardware resources that support the operation of the target application product in the product development platform.

[0099] Among them, when collecting the service message of the target application product, any of the following methods or combinations can be used:

[0100] Method 1: Collect the service message through the target application product.

[0101] Method 2: Collect the service message through other devices that interact with the target application product.

[0102] Optionally, the other device can be a server or a terminal device, and there is no restriction here.

[0103] Among them, the resource configuration information may include at least one of software configuration information and hardware resource information. The software configuration information may be information such as an operating system and software components. The hardware resource information may include at least one of, but is not limited to, a CPU model, a memory size, and a memory allocation relationship.

[0104] In this way, relevant data of the target application product can be collected.

[0105] Step 201: Parse and extract features from the service message to obtain the service features of the service message.

[0106] Specifically, parse the service message to obtain the message parsing information of the service message, and extract features from the message parsing information to obtain the service features of the service message.

[0107] In one implementation, from the message parsing information of the service message, extract at least one of, but is not limited to, the protocol type, field type, length ranges of each field, and message length range of the 3-7 layers of the Open System Interconnection Reference Model (OSI), and perform abstraction processing on the extracted feature information to obtain the service features of the service message.

[0108] For example, parse the service message to obtain the following parsing information: Internet Protocol version 4 (IPv4), Transmission Control Protocol (TCP), Hyper Text Transport Protocol (HTTP), obtain (GET) service, the average length of the GET request packet is 128 bytes, the average length of the GET response message is 2K, and there are fragments. Then, a service feature can be extracted, that is, HTTP GET downloads a 2k-sized file.

[0109] Refer to Figure 3 As shown, it is a schematic diagram of a message parsing process provided in an embodiment of the present application. Figure 3It includes an OSI three-layer message parsing module, an OSI four-layer message parsing module, and an OSI seven-layer message parsing module. Through the OSI three-layer message parsing module, the IPv4, Internet Protocol version 6 (IPv6), message length, and whether fragmentation occurs of the service message are obtained. Through the OSI four-layer message parsing module, the TCP protocol information, User Datagram Protocol (UDP) protocol information, and Transport Layer Security (TLS) information of the service message are obtained. Through the OSI seven-layer message parsing module, the service type, service message length, service message interaction process, and carried parameters of the service message are obtained.

[0110] In this way, the service characteristics of the service message can be extracted, and the message recognition ability of the target application product is realized.

[0111] Step 202: Generate and store the service attribute information of the target application product according to the service characteristics.

[0112] Specifically, the service attribute information is information containing service characteristics.

[0113] Step 203: Extract the resource attributes from the resource configuration information, and obtain and store the resource attribute information.

[0114] Specifically, from the resource configuration information, the configuration information affecting performance is extracted, and the resource attribute information is obtained and stored.

[0115] Step 204: Obtain the product attribute information of the target application product according to the service attribute information and the resource attribute information.

[0116] Specifically, the product attribute information includes the service attribute information and the resource attribute information.

[0117] In this way, after extracting the product attribute data, the platform performance test of the product development platform can be carried out according to the product attribute data of the target application product, that is, the service attribute information and the resource attribute information of the target application product, and the platform test data required by the target application product can be obtained.

[0118] Refer to Figure 4 As shown, it is the implementation flowchart of a platform performance test method provided by an embodiment of the present application. It will be described in combination with Figure 1 the platform performance test system shown. The specific implementation process of this method is as follows:

[0119] Step 400: When it is determined that a platform test task for the target application product is received, obtain the service attribute information and the resource attribute information of the target application product.

[0120] Specifically, the target application product is a product developed on a product development platform.

[0121] In one implementation, the user terminal or the target application product sends a platform test task to the platform performance testing system. After receiving the platform test task, the platform performance testing system obtains the business attribute information and resource attribute information of the target application product.

[0122] Step 401: Determine the performance metrics to be tested according to the business attribute information and the resource attribute information.

[0123] Specifically, according to the preset correspondence relationship among the business attribute information, the resource attribute information, and the performance metrics, obtain the performance metrics corresponding to the business attribute information and the resource attribute information.

[0124] Optionally, the performance metrics may include, but are not limited to, at least one of the following metrics: new creation rate, concurrency number, throughput, forwarding delay.

[0125] Wherein, before executing step 401, a correspondence relationship among the business attribute information, the resource attribute information, and the performance metrics is established in advance.

[0126] Refer to Figure 5 As shown, it is a schematic architecture diagram of a performance metric determination system provided by an embodiment of the present application. Figure 5 In this, the performance metric determination system includes a business attribute information extraction module, a resource attribute information extraction module, a performance metric establishment module, and may further include a performance metric standardization module. Through the business attribute information extraction module, the business attribute information can be extracted according to the target application product, and through the resource attribute information extraction module, the resource attribute information of the target application product can be extracted, and through the performance metric establishment module, the performance metrics to be tested set for the business attribute information and the resource attribute information can be obtained. Further, the performance metrics can be standardized through the performance metric standardization module.

[0127] Further, when executing step 401, the following steps may also be adopted:

[0128] S4011: Obtain the first metric set included in the platform test task.

[0129] Specifically, the first metric set includes at least one performance metric.

[0130] In one implementation, the first metric set is the performance metrics required to be tested indicated by the user.

[0131] S4012: Obtain the second metric set for the business attribute information and the resource attribute information.

[0132] Specifically, before executing S4012, a correspondence between product attribute information including service attribute information and resource attribute information and performance metrics is established in advance.

[0133] It should be noted that this correspondence is established based on the performance metrics affected by the service attribute information and / or the resource attribute information.

[0134] Among them, when determining the second metric, according to this correspondence, the second metric corresponding to the service attribute information and the resource attribute information is obtained.

[0135] S4013: Determine the second metric included in the first metric set as the performance metric to be tested.

[0136] That is to say, determine the intersection between the first metric set and the second metric as the performance metric to be tested.

[0137] This is because the first metric indicated by the user may not be determined through the product attribute information of the target application product. Therefore, filter out the performance metrics that can be determined by the product attribute information of the target application product from the first metric set.

[0138] In this way, personalized performance metrics to be tested can be set for the target application product.

[0139] Refer to Figure 6 As shown, it is a schematic diagram of determining performance metrics provided in an embodiment of the present application. Figure 6 Among them, each performance metric includes: new build rate, concurrency, throughput, and forwarding delay. The performance metrics corresponding to different product attributes may be different. Then, according to the product attribute information of the target application product, filter out the performance metrics to be tested corresponding to the target application product from each performance metric. The performance metric corresponding to product attribute information 1 is throughput. The performance metric corresponding to product attribute information 2 is new build rate. The performance metric corresponding to product attribute information 3 is throughput. The performance metrics corresponding to product attribute information 4 are concurrency and forwarding delay.

[0140] Step 402: Test the product development platform for the performance metric to obtain platform test data.

[0141] Specifically, when executing step 402, the following steps can be adopted:

[0142] S4021: Configure a performance test environment according to the resource attribute information and the service attribute information.

[0143] Specifically, the performance test environment includes: a test server, a test client, and a module under test. Further, it may also include: a software and hardware test environment and a business test environment.

[0144] Among them, when executing S4021, the following steps can be adopted:

[0145] The first step: Configure the module under test according to the resource attribute information to generate a software and hardware test environment.

[0146] In one implementation, select software and hardware resources that conform to the resource attribute information of the target application product, and configure the process and allocate memory according to the resource attribute information to generate the module under test and obtain the software and hardware test environment.

[0147] In one implementation, configure the CPU model, number of CPU cores, memory size, and memory allocation relationship of the module under test according to the resource attribute information of the target application product.

[0148] Optionally, the software and hardware module can be a module in the product development platform.

[0149] The second step: Configure the test server and the test client according to the business attribute information to generate a business test environment.

[0150] It should be noted that the test server and the test client transmit business messages through the module under test.

[0151] The third step: Obtain the performance test environment based on the hardware test environment and the business test environment.

[0152] S4022: Obtain the initial index value of the performance index.

[0153] Specifically, set the initial index value according to the historical message data of the target application product.

[0154] S4023: Based on the performance test environment, control the test server and the test client to transmit test messages through the module under test, and adjust the index value of the performance index according to the packet loss rate.

[0155] Specifically, when executing S4023, the following steps can be repeatedly executed until it is determined that the preset index test condition is met:

[0156] The first step: Based on the index value, control the test server and the test client to transmit test messages through the module under test.

[0157] Specifically, in the first test, determine the message sending rate according to the initial index value, and control the test server to transmit test messages to the test client through the module under test at this message sending rate.

[0158] During the loop test after the first test, according to the adjusted metric value, determine the message sending rate, and control the test server to transmit test messages with the test client through the module under test at this message sending rate.

[0159] Step 2: Obtain the packet loss rate of the test message.

[0160] Step 3: Adjust the metric value of the performance metric according to the packet loss rate.

[0161] In one implementation, if it is determined that the packet loss rate is higher than the specified packet loss threshold, then reduce the message sending rate; otherwise, increase the message sending rate until it is determined that the metric value meets the preset metric test conditions.

[0162] In one implementation, when the inflection point of the metric value is determined, it is determined that the preset metric test conditions are met.

[0163] In practical applications, the initial metric value, the specified packet loss threshold, and the preset metric test conditions can all be set according to the actual application scenario, and are not limited here.

[0164] In this way, the metric value can be determined according to the packet loss rate.

[0165] S4024: Generate platform test data according to the adjusted metric value.

[0166] Furthermore, also obtain the resource utilization rate during the test process, and obtain platform test data including the metric value and the resource utilization rate.

[0167] Furthermore, the platform test data can also be stored in a database.

[0168] In one implementation, store the target application product and the platform test data in an associated manner, and when it is determined that a platform performance query instruction for the target application product is received from a user, output the platform test data associated with the target application product.

[0169] Step 403: Send the platform test data to the target application product.

[0170] In one implementation, after obtaining the platform test data, push the platform test data to the target application product.

[0171] In one implementation, after obtaining the platform test data, return the platform test data to the user terminal that sent the test task.

[0172] Refer to Figure 7 shown, which is a schematic architecture of a platform performance test system provided in an embodiment of the present application Figure 2 . Figure 7Among them, the platform performance testing system includes: a test server, a test client, a module under test, a resource attribute module, a business environment setup module, a test adjustment module, and a data standardization module.

[0173] Test server: Used to transmit test messages with the test client through the module under test.

[0174] Test client: Used to transmit test messages with the test server through the module under test.

[0175] Module under test: Used to simulate the target application product, process and forward the test messages.

[0176] In one implementation, the test message is generated according to the business attribute information of the target application product to simulate the business message of the target application product for testing.

[0177] In actual applications, the test message can also be set according to the actual application scenario, which is not limited here.

[0178] Resource attribute module: Used to configure the module under test according to the resource attribute information.

[0179] Business environment setup module: Used to configure the test server and the test client according to the business attribute information.

[0180] Test adjustment module: Used to generate a performance test strategy according to the business attribute information and the resource attribute information, and based on the performance test strategy, control the transmission of test messages between the test server and the test client through the module under test to obtain platform test data.

[0181] Data standardization module: Used to perform standardization processing on the platform test data and store the processed platform test data in the metric database.

[0182] In one implementation, the data standardization module establishes a correspondence between the target application product and the platform test data and stores the correspondence in the metric database.

[0183] Next, a specific application scenario is adopted to illustrate the above embodiments. For example, the target application product is the Top Web Application Firewall (WAF). TopWAF is used for WEB attack detection and defense of the Hyper Text Transport Protocol (HTTP) and the HyperText Transfer Protocol over Secure Socket Layer (HTTPS), and can implement basic functions such as log warning, vulnerability scanning, and web page anti-tampering in the management plane.

[0184] First, extract the service characteristics of the service messages of TopWAF to obtain service attribute information. The service characteristics of TopWAF may include, but are not limited to, at least one of the following: HTTP or HTTPS protocol processing performance, the number and length of HTTP parameters, the length of the start line and the method type, the length of the header line and the number of headers, the length of the body, and the number of cookies. Refer to Figure 8 As shown, it is a schematic diagram of the extraction of service attribute information. Figure 8 In it, the service messages of the target application product are parsed and the characteristics are extracted to obtain the service attribute information of the service messages, including: http, https, the length of the start line and the method type, the length of the header line and the number of headers, the length of the body, the number of cookies, and the length of cookies.

[0185] Then, extract the resource attribute information of TopWAF. TopWAF includes multiple hardware product models, such as TWF-62128, TWF-62228,.... Refer to Figure 9 As shown, it is a schematic diagram of the extraction of resource attribute information. Figure 9 In it, the resource attribute information of TopWAF with the hardware product model of TWF-62128 may include: CPU and memory. The number of CPU cores is 4 cores, including 1 core in the management plane and 3 cores in the forwarding plane. The memory includes a total memory of 8G, a virtual memory area (VMA) of 2G, and 1G of buffer.

[0186] According to the business attribute information of TopWAF, 24 business processes for testing TopWAF are determined, and according to the resource attribute information of TopWAF, 4 types of hardware configurations need to be covered. Then, based on the business attribute information and resource attribute information, 384 performance indicators to be tested are constructed. Further, according to the resource attribute information and business attribute information, a performance test environment can be configured on the product development platform, and through this performance test environment, the product development platform can be tested to obtain platform test data.

[0187] In this way, the all-round performance construction of the target application product is realized, and the performance foundation of the target application product is established.

[0188] In the embodiment of the present application, according to the business attribute information and resource attribute information of the target application product, the performance indicators of the product development platform required by the target application product can be determined, and according to the determined performance indicators, the product development platform can be tested individually to obtain the platform test data required by the target application product. In this way, different performance tests can be performed on the product development platform for different target application products, realizing the personalized performance test for the target application product, reducing the labor cost and time cost consumed, and providing effective platform test data for the target application product, reducing the push of invalid garbage test data, so that the target application product can judge whether the product development platform meets the performance requirements of the target application product development and application according to the obtained effective platform test data.

[0189] Based on the same inventive concept, in the embodiment of the present application, a device for platform performance testing is also provided. Since the principle of solving problems by the above-mentioned device and equipment is similar to that of a method for platform performance testing, therefore, the implementation of the above-mentioned device can refer to the implementation of the method, and the repeated parts will not be described again.

[0190] As Figure 10 shown, it is a schematic structural diagram of a device for platform performance testing provided by an embodiment of the present application, including:

[0191] An acquisition unit 1001, configured to obtain the business attribute information and resource attribute information of the target application product when it is determined that a platform test task for the target application product is received, where the target application product is a product developed through the product development platform;

[0192] A determination unit 1002, configured to determine the performance indicators to be tested according to the business attribute information and the resource attribute information;

[0193] A test unit 1003, configured to test the product development platform for the performance indicators to obtain platform test data;

[0194] A sending unit 1004, configured to send platform test data to a target application product.

[0195] In one implementation, the obtaining unit 1001 is further configured to:

[0196] Obtain a service message of the target application product and resource configuration information;

[0197] Parse the service message and extract features to obtain service features of the service message;

[0198] Generate and store service attribute information of the target application product according to the service features;

[0199] Extract resource attributes from the resource configuration information, and obtain and store resource attribute information.

[0200] In one implementation, the determining unit 1002 is configured to:

[0201] Obtain a performance metric corresponding to the service attribute information and the resource attribute information according to a correspondence relationship among preset service attribute information, resource attribute information, and performance metrics.

[0202] In one implementation, the testing unit 1003 is configured to:

[0203] Configure a performance testing environment according to the resource attribute information and the service attribute information, where the performance testing environment includes a testing server, a testing client, and a module under test;

[0204] Obtain an initial metric value of the performance metric;

[0205] Based on the performance testing environment, repeatedly execute the following steps until it is determined that a preset metric test condition is met: Based on the metric value, control the testing server and the testing client to transmit a test message through the module under test, and obtain a packet loss rate of the test message, and adjust the metric value of the performance metric according to the packet loss rate;

[0206] Generate platform test data according to the adjusted metric value.

[0207] In one implementation, the testing unit 1003 is configured to:

[0208] Configure the module under test according to the resource attribute information to generate a software and hardware testing environment;

[0209] Configure the testing server and the testing client according to the service attribute information to generate a service testing environment;

[0210] Obtain a performance testing environment based on the hardware testing environment and the service testing environment.

[0211] In one implementation, the testing unit 1003 is further configured to:

[0212] Associate and store the target application product and platform test data in a database;

[0213] When it is determined that a platform performance query instruction for the target application product is received, output the platform test data associated and stored for the target application product.

[0214] In the method, device, electronic device, and readable storage medium for platform performance testing provided by the embodiments of the present application, when it is determined that a platform test task for the target application product is received, obtain the business attribute information and resource attribute information of the target application product, where the target application product is a product developed through a product development platform; determine the performance indicators to be tested according to the business attribute information and the resource attribute information; perform tests on the product development platform for the performance indicators to obtain platform test data; and send the platform test data to the target application product. In this way, different performance tests can be performed on the product development platform for different target application products, realizing personalized performance testing for the target application product and improving the effectiveness of platform test data push.

[0215] Figure 11 The structural schematic diagram of an electronic device 1100 is shown. Refer to Figure 11 As shown, the electronic device 1100 includes: a processor 1110 and a memory 1120. Optionally, it may further include a power supply 1130, a display unit 1140, and an input unit 1150.

[0216] The processor 1110 is the control center of the electronic device 1100, connecting each component through various interfaces and lines, and performing various functions of the electronic device 1100 by running or executing software programs and / or data stored in the memory 1120, thereby monitoring the electronic device 1100 as a whole.

[0217] In the embodiments of the present application, when the processor 1110 calls the computer program stored in the memory 1120, it executes the method for platform performance testing provided by the embodiments as shown in Figure 4 the embodiments shown in.

[0218] Optionally, the processor 1110 may include one or more processing units; preferably, the processor 1110 may integrate an application processor and a modulation and demodulation processor, where the application processor mainly processes the operating system, user interface, and applications, and the modulation and demodulation processor mainly processes wireless communication. It can be understood that the above modulation and demodulation processor may not be integrated into the processor 1110. In some embodiments, the processor and the memory may be implemented on a single chip, and in some embodiments, they may also be separately implemented on independent chips.

[0219] The memory 1120 may mainly include a program storage area and a data storage area. Among them, the program storage area may store an operating system, various applications, etc.; the data storage area may store data created according to the use of the electronic device 1100, etc. In addition, the memory 1120 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or other volatile solid-state storage devices, etc.

[0220] The electronic device 1100 further includes a power source 1130 (such as a battery) for supplying power to each component. The power source can be logically connected to the processor 1110 through a power management system, so as to implement functions such as management of charging, discharging, and power consumption through the power management system.

[0221] The display unit 1140 can be used to display information input by the user or information provided to the user, as well as various menus of the electronic device 1100, etc. In the embodiment of the present invention, it is mainly used to display the display interfaces of various applications in the electronic device 1100 and objects such as text and pictures displayed in the display interface. The display unit 1140 may include a display panel 1141. The display panel 1141 may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), etc.

[0222] The input unit 1150 can be used to receive information such as numbers or characters input by the user. The input unit 1150 may include a touch panel 1151 and other input devices 1152. Among them, the touch panel 1151, also known as a touch screen, can collect touch operations of the user on or near it (such as operations of the user using a finger, a stylus, or any suitable object or accessory on or near the touch panel 1151).

[0223] Specifically, the touch panel 1151 can detect the touch operation of the user, detect the signals brought by the touch operation, convert these signals into contact coordinates, send them to the processor 1110, and receive and execute the commands sent by the processor 1110. In addition, the touch panel 1151 can be implemented in multiple types such as resistive, capacitive, infrared, and surface acoustic wave. The other input devices 1152 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control keys, power on / off keys, etc.), a trackball, a mouse, a joystick, etc.

[0224] Of course, the touch panel 1151 can cover the display panel 1141. After the touch panel 1151 detects a touch operation on or near it, it is transmitted to the processor 1110 to determine the type of touch event. Subsequently, the processor 1110 provides a corresponding visual output on the display panel 1141 according to the type of touch event. Although in Figure 11 the touch panel 1151 and the display panel 1141 are implemented as two independent components to realize the input and output functions of the electronic device 1100, in some embodiments, the touch panel 1151 and the display panel 1141 can be integrated to realize the input and output functions of the electronic device 1100.

[0225] The electronic device 1100 may further include one or more sensors, such as a pressure sensor, a gravitational acceleration sensor, a proximity light sensor, etc. Of course, according to the needs in specific applications, the above-mentioned electronic device 1100 may further include other components such as a camera. Since these components are not the key components used in the embodiments of the present application, therefore, in Figure 11 they are not shown and will not be described in detail.

[0226] Those skilled in the art can understand that Figure 11 is merely an example of an electronic device and does not constitute a limitation on the electronic device. It may include more or fewer components than shown in the figure, or combine some components, or different components.

[0227] In the embodiments of the present application, a readable storage medium stores a computer program. When the computer program is executed by a processor, the communication device can execute each step in the above embodiments.

[0228] For the convenience of description, the above parts are divided into various modules (or units) according to functions and described separately. Of course, when implementing the present application, the functions of the various modules (or units) can be implemented in the same or multiple software or hardware.

[0229] Those skilled in the art should understand that the embodiments of the present application can be provided as a method, a system, or a computer program product. Therefore, the present application can take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware aspects. Moreover, the present application can take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0230] This application is described with reference to the flowcharts and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the present application. It should be understood that each flow and / or block in the flowchart and / or block diagram, and the combination of flows and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to the processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing device to generate a machine, such that the instructions executed by the processor of the computer or other programmable data processing device produce means for implementing the functions specified in one flow Figure 1 one flow or multiple flows and / or blocks Figure 1 or means for implementing the functions specified in multiple blocks.

[0231] These computer program instructions can also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to work in a specific manner, such that the instructions stored in the computer-readable memory produce a manufactured article including instruction means that implement the functions specified in one flow Figure 1 one flow or multiple flows and / or blocks Figure 1 or means for implementing the functions specified in multiple blocks.

[0232] These computer program instructions can also be loaded onto a computer or other programmable data processing device, such that a series of operation steps are executed on the computer or other programmable device to generate a computer-implemented process, so that the instructions executed on the computer or other programmable device provide steps for implementing the functions specified in one flow Figure 1 one flow or multiple flows and / or blocks Figure 1 or means for implementing the functions specified in multiple blocks.

[0233] Although the preferred embodiments of the present application have been described, those skilled in the art can make additional changes and modifications once they learn the basic creative concepts. Therefore, the appended claims are intended to be construed to include the preferred embodiments and all changes and modifications falling within the scope of the present application.

[0234] Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalent technologies, the present application is also intended to include these changes and modifications.

Claims

1. A method for platform performance testing, characterized in that, Including: When it is determined that a platform test task for a target application product is received, obtain the business attribute information and resource attribute information of the target application product, where the target application product is a product developed through a product development platform; Determine the performance indicators to be tested according to the business attribute information and the resource attribute information; The determining the performance indicators to be tested according to the business attribute information and the resource attribute information includes: Obtain the first indicator set included in the platform test task; Obtain the second indicator set for the business attribute information and the resource attribute information; Determine the second indicator included in the first indicator set as the performance indicator; Test the product development platform for the performance indicator to obtain platform test data; Send the platform test data to the target application product.

2. The method according to claim 1, characterized in that Before obtaining the business attribute information and resource attribute information of the target application product, it includes: Obtain the business message of the target application product and the resource configuration information; Parse and extract features from the business message to obtain the business features of the business message; Generate and store the business attribute information of the target application product according to the business features; Extract resource attributes from the resource configuration information to obtain and store the resource attribute information.

3. The method according to claim 1, characterized in that, The determining the performance indicators to be tested according to the platform test task, the business attribute information and the resource attribute information includes: Obtain the performance indicators corresponding to the business attribute information and the resource attribute information according to the preset correspondence relationship among the business attribute information, the resource attribute information and the performance indicators.

4. The method according to any one of claims 1 to 3, characterized in that, The testing the product development platform for the performance indicator to obtain platform test data includes: Configure a performance test environment according to the resource attribute information and the business attribute information, where the performance test environment includes: a test server, a test client, and a module under test; Obtain the initial indicator value of the performance indicator; Based on the performance test environment, loop through the following steps until it is determined that a preset indicator test condition is met: Based on the indicator value, control the test server and the test client to transmit test messages through the module under test, and obtain the packet loss rate of the test messages, and adjust the indicator value of the performance indicator according to the packet loss rate; Generate platform test data according to the adjusted indicator value.

5. The method according to claim 4, characterized in that The configuring a performance test environment according to the resource attribute information and the business attribute information includes: Configure the module under test according to the resource attribute information to generate a software and hardware test environment; Configure the test server and the test client according to the business attribute information to generate a business test environment; Obtain the performance test environment based on the hardware test environment and the business test environment.

6. The method according to any one of claims 1 to 3, characterized in that, After testing the product development platform for the performance indicator to obtain platform test data, it further includes: Associate and store the target application product and the platform test data in a database; When it is determined that a platform performance query instruction from a user for the target application product is received, output the platform test data stored in association with the target application product.

7. An apparatus for platform performance testing, characterized in that, Including: An acquisition unit, configured to acquire the business attribute information and resource attribute information of the target application product when it is determined that a platform test task for the target application product is received, where the target application product is a product developed through a product development platform; A determination unit, configured to determine the performance indicators to be tested according to the business attribute information and the resource attribute information; The determining the performance indicators to be tested according to the business attribute information and the resource attribute information includes: Acquiring a first indicator set included in the platform test task; Acquiring a second indicator set for the business attribute information and the resource attribute information; Determining the second indicator included in the first indicator set as the performance indicator; A testing unit, configured to test the product development platform for the performance indicators to obtain platform test data; A sending unit, configured to send the platform test data to the target application product.

8. The device according to claim 7, characterized in that, The acquisition unit is further configured to: Acquire the business message of the target application product and the resource configuration information; Parse and extract features from the business message to obtain the business features of the business message; Generate and store the business attribute information of the target application product according to the business features; Extract resource attributes from the resource configuration information to obtain and store the resource attribute information.

9. The device according to claim 7, characterized in that, The determination unit is configured to: Acquire the performance indicators corresponding to the business attribute information and the resource attribute information according to the correspondence relationship among the preset business attribute information, resource attribute information, and performance indicators.

10. The device according to any one of claims 7-9, characterized in that, The testing unit is configured to: Configure a performance test environment according to the resource attribute information and the business attribute information, where the performance test environment includes a test server, a test client, and a module under test; Acquire the initial indicator value of the performance indicator; Based on the performance test environment, repeatedly execute the following steps until it is determined that a preset indicator test condition is met: Based on the indicator value, control the test server and the test client to transmit test messages through the module under test, and acquire the packet loss rate of the test messages, and adjust the indicator value of the performance indicator according to the packet loss rate; Generate platform test data according to the adjusted indicator value.

11. The device according to claim 10, characterized in that, The testing unit is configured to: Configure the module under test according to the resource attribute information to generate a software and hardware test environment; Configure the test server and the test client according to the business attribute information to generate a business test environment; Obtain the performance test environment based on the hardware test environment and the business test environment.

12. The device according to any one of claims 7-9, characterized in that, The testing unit is further configured to: Associate and store the target application product and the platform test data in a database; When it is determined that a platform performance query instruction from a user for the target application product is received, output the platform test data stored in association with the target application product.

13. An electronic device, characterized in that, It includes a processor and a memory, and the memory stores computer-readable instructions. When the computer-readable instructions are executed by the processor, the method according to any one of claims 1-6 is run.

14. A readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, the method according to any one of claims 1-6 is run.

Images