Method and apparatus for testing performance capacity of an operating platform

Abstract

The application discloses a kind of operation platform performance capacity test method and device, it is related to software testing, it can be used in big data field, financial field or other fields.Method comprising: according to the preset transaction link parameter model and link splitting rule, each subsystem in operation platform is judged, and multiple judgment results are obtained;Using transaction link parameter model and judgment result, each subsystem in operation platform is handled link decoupling, and multiple split links are obtained;According to the preset stress rule, the business request initiation mode corresponding to each split link is determined;Business request initiation mode is used to initiate business request to operation platform, test data is obtained, and performance capacity test result is obtained according to test data.The application effectively improves the efficiency of performance bottleneck problem analysis, saves the time cost of positioning problem, realizes the transaction analysis of architecture level full link of operation platform, accurately evaluates the performance capacity of operation platform, provides basis for system optimization, production environment expansion.

Description

Technical Field

[0001] This invention relates to the field of performance capacity testing, and more particularly to a method and apparatus for testing the performance capacity of an operating platform. Background Technology

[0002] With the continuous enrichment of banking services, the sustained development of personal financial services, and the surge in users brought about by internet finance, the scale of banking systems is constantly expanding, especially against the backdrop of distributed architecture transformation, leading to a continuous increase in the number of nodes in each subsystem. As one of the main platforms providing services for personal financial services, the bank's intelligent operations platform is responsible for online activities such as: task centers, consumer vouchers, fan festivals, digital collectibles, and intelligent marketing recommendations. These online operational activities have the following characteristics:

[0003] 1. The business involves a wide range of aspects. For example, after receiving the voucher, the process of using it may involve being redirected to a third party or other business processes.

[0004] 2. There are many business participants, and the online activities of the operating platform serve all individual customers nationwide or within a region.

[0005] 3. The business has high timeliness requirements. Because the number of "prizes" or "coupons" issued differs greatly from the number of customers, "flash sales" and other similar businesses can put more than ten times the daily business volume on the system in a short period of time.

[0006] Based on these characteristics, the architecture and design of the operation platform are becoming increasingly complex, involving multiple communications between upstream and downstream subsystems and the continuous extension of the transaction chain. Since the test system and the production system are two physically isolated environments, objective differences exist. It is necessary to eliminate the influencing factors of these differences before evaluating the performance and capacity of the production system in the test system. However, existing methods are no longer sufficient for stress testing of the bank's intelligent operation platform, specifically due to the following three problems: lack of rules for splitting the transaction chain; lack of rules for distributing stress; and lack of methods for analyzing bottlenecks after the transaction chain is split. Summary of the Invention

[0007] To address the problems existing in the prior art, the main objective of this invention is to provide a method and apparatus for testing the performance and capacity of an operating platform, enabling architectural-level end-to-end transaction analysis of the operating platform and accurately assessing its performance and capacity.

[0008] To achieve the above objectives, embodiments of the present invention provide a method for testing the performance and capacity of an operating platform, the method comprising:

[0009] Based on the preset transaction link parameter model and link splitting rules, rule judgments are made on each subsystem in the operation platform to obtain multiple judgment results;

[0010] Using the transaction link parameter model and the judgment results, the link decoupling process of each subsystem in the operation platform is performed to obtain multiple split links;

[0011] Based on the preset pressure sending rules, determine the business request initiation mode corresponding to each split link;

[0012] The system initiates business requests to the operation platform using the business request initiation mode corresponding to each split link, obtains the test data corresponding to each split link, and obtains the performance capacity test results based on the test data corresponding to each split link.

[0013] Optionally, in one embodiment of the present invention, the rule judgment for each subsystem in the operation platform according to the preset transaction link parameter model and link splitting rules includes:

[0014] Based on the protocol type model in the transaction link parameter model and the communication protocol type judgment rule in the link splitting rule, the communication protocol type of each subsystem in the operation platform is judged to obtain the protocol type judgment result.

[0015] Optionally, in one embodiment of the present invention, the rule judgment of each subsystem in the operation platform according to the preset transaction link parameter model and link splitting rules further includes:

[0016] Based on the database model in the transaction link parameter model and the database judgment rules in the link splitting rules, database judgments are performed on each subsystem in the operation platform to obtain the database judgment results.

[0017] Optionally, in one embodiment of the present invention, the rule judgment of each subsystem in the operation platform according to the preset transaction link parameter model and link splitting rules further includes:

[0018] Based on the barrier model in the transaction link parameter model and the barrier judgment rule in the link splitting rule, barrier judgment is performed on each subsystem in the operation platform to obtain the barrier judgment result.

[0019] Optionally, in one embodiment of the present invention, the rule judgment of each subsystem in the operation platform according to the preset transaction link parameter model and link splitting rules further includes:

[0020] Based on the environment deployment model in the transaction link parameter model and the environment deployment judgment rule in the link splitting rule, the environment deployment judgment of each subsystem in the operation platform is performed to obtain the environment deployment judgment result.

[0021] Optionally, in one embodiment of the present invention, the rule judgment of each subsystem in the operation platform according to the preset transaction link parameter model and link splitting rules further includes:

[0022] Based on the response time model in the transaction link parameter model and the response time judgment rule in the link splitting rule, the response time of each subsystem in the operation platform is judged, and the response time judgment result is obtained.

[0023] Optionally, in one embodiment of the present invention, the transaction link parameter model and the judgment result are used to perform link decoupling processing on each subsystem in the operation platform to obtain multiple split links, including:

[0024] The link splitting value is obtained by calculating the results of protocol type judgment, database judgment, barrier judgment, environment deployment judgment, and response time judgment using the transaction link parameter model.

[0025] The number of links is determined based on the preset link splitting rules and the link splitting values;

[0026] Based on the number of links, the subsystems in the operation platform are decoupled to obtain the split links corresponding to the number of links.

[0027] This invention also provides an operating platform performance capacity testing device, the device comprising:

[0028] The judgment result module is used to perform rule judgments on each subsystem in the operation platform based on the preset transaction link parameter model and link splitting rules, and obtain multiple judgment results;

[0029] The split link module is used to decouple the links of each subsystem in the operation platform by using the transaction link parameter model and judgment results, and obtain multiple split links.

[0030] The initiation mode module is used to determine the business request initiation mode corresponding to each split link according to the preset pressure rules;

[0031] The test results module is used to initiate business requests to the operation platform using the business request initiation mode corresponding to each split link, obtain the test data corresponding to each split link, and obtain the performance and capacity test results based on the test data corresponding to each split link.

[0032] Optionally, in one embodiment of the present invention, the judgment result module is further used to judge the communication protocol type of each subsystem in the operation platform according to the protocol type model in the transaction link parameter model and the communication protocol type judgment rule in the link splitting rule, and obtain the protocol type judgment result.

[0033] Optionally, in one embodiment of the present invention, the judgment result module is further used to perform database judgment on each subsystem in the operation platform according to the database model in the transaction link parameter model and the database judgment rule in the link splitting rule, and obtain the database judgment result.

[0034] Optionally, in one embodiment of the present invention, the judgment result module is further used to perform baffle judgment on each subsystem in the operation platform according to the baffle model in the transaction link parameter model and the baffle judgment rule in the link splitting rule, and obtain the baffle judgment result.

[0035] Optionally, in one embodiment of the present invention, the judgment result module is further used to perform environment deployment judgment on each subsystem in the operation platform according to the environment deployment model in the transaction link parameter model and the environment deployment judgment rule in the link splitting rule, and obtain the environment deployment judgment result.

[0036] Optionally, in one embodiment of the present invention, the judgment result module is further used to judge the response time of each subsystem in the operation platform according to the response time model in the transaction link parameter model and the response time judgment rule in the link splitting rule, and obtain the response time judgment result.

[0037] Optionally, in one embodiment of the present invention, the link splitting module includes:

[0038] The split value unit is used to calculate the link split value by using the transaction link parameter model to calculate the results of the protocol type judgment, database judgment, barrier judgment, environment deployment judgment, and response time judgment.

[0039] The link quantity unit is used to determine the number of links based on preset link splitting rules and link splitting values;

[0040] The split link unit is used to decouple the links of each subsystem in the operation platform according to the number of links, and obtain the split links corresponding to the number of links.

[0041] The present invention also provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement the above-described method.

[0042] The present invention also provides a computer-readable storage medium storing a computer program that performs the above-described methods by a computer.

[0043] The present invention also provides a computer program product, including a computer program / instructions, which, when executed by a processor, implement the steps of the above-described method.

[0044] This invention effectively improves the efficiency of performance bottleneck analysis by decomposing the transaction links of each subsystem in the operation platform, saves the time cost of locating problems, meets the requirements of discovering and quickly locating problems and the timeliness of system deployment, fundamentally reduces the probability of system risks occurring in the operation platform, realizes full-link transaction analysis at the architecture level of the operation platform, accurately assesses the performance capacity of the operation platform, and provides a basis for system optimization and production environment expansion. Attached Figure Description

[0045] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0046] Figure 1 This is a flowchart of an operation platform performance and capacity testing method according to an embodiment of the present invention;

[0047] Figure 2 This is a flowchart of the link decoupling process in an embodiment of the present invention;

[0048] Figure 3 This is a schematic diagram of the system structure for applying the performance and capacity testing method of the operation platform in an embodiment of the present invention;

[0049] Figure 4A and Figure 4B This is a schematic diagram of the link before and after link splitting in a specific embodiment of the present invention;

[0050] Figure 5 This is a system processing flowchart of the operation platform performance and capacity testing method in an embodiment of the present invention;

[0051] Figure 6 This is a schematic diagram of the structure of an operating platform performance capacity testing device according to an embodiment of the present invention;

[0052] Figure 7 This is a schematic diagram of the split link module in an embodiment of the present invention;

[0053] Figure 8 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present invention. Detailed Implementation

[0054] This invention provides a method and apparatus for testing the performance and capacity of an operating platform, which can be used in the financial field and other fields. It should be noted that the method and apparatus for testing the performance and capacity of an operating platform of this invention can be used in the financial field, or in any field other than the financial field. The application field of the method and apparatus for testing the performance and capacity of an operating platform of this invention is not limited.

[0055] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0056] like Figure 1 The diagram shows a flowchart of an operation platform performance capacity testing method according to an embodiment of the present invention. This invention effectively improves the efficiency of performance bottleneck analysis by decomposing the transaction links of each subsystem in the operation platform, saving time costs in locating problems, meeting the requirements of rapid problem discovery and system deployment timeliness, fundamentally reducing the probability of system risks occurring on the operation platform, and realizing full-link transaction analysis at the architecture level of the operation platform. This accurately assesses the performance capacity of the operation platform, providing a basis for system optimization and production environment expansion. The execution subject of the operation platform performance capacity testing method provided in this embodiment of the invention includes, but is not limited to, a computer. The method shown in the diagram includes:

[0057] Step S1: Based on the preset transaction link parameter model and link splitting rules, rule judgments are made on each subsystem in the operation platform to obtain multiple judgment results.

[0058] The preset transaction link parameter model is based on a given non-negative function on an interval, i.e., a splitting rule judgment function. The sum of each rule can be denoted as:

[0059]

[0060] Where a=1 and b=5, it represents that the integration range is within the five link splitting rules. Specifically, the transaction link parameter model includes a protocol type model, a database model, a baffle model, an environment deployment model, and a response time model.

[0061] Furthermore, the link splitting rules include rules for determining communication protocol type, database, baffle, environment deployment, and response time.

[0062] Specifically, by using the transaction link parameter model and link splitting rules, rule judgments can be made on each subsystem in the operation platform, resulting in multiple judgment results, including protocol type judgment results, database judgment results, barrier judgment results, environment deployment judgment results, and response time judgment results.

[0063] Step S2: Using the transaction link parameter model and judgment results, decouple the links of each subsystem in the operation platform to obtain multiple split links.

[0064] The obtained judgment result is substituted into formula (1) for calculation to obtain the link splitting value, i.e., the S value. The link splitting value is compared with the preset link splitting rules to determine the number of links to be split. Based on the number of links to be split, the links of each subsystem in the operation platform are decoupled to obtain the split links corresponding to the number of links.

[0065] Step S3: Determine the business request initiation mode corresponding to each split link according to the preset pressure sending rules.

[0066] Among them, the business request initiation modes include flash sale mode, rate limiting mode and standard mode. The preset pressure release rules show the correspondence between concurrency level, warm-up time, pressure release time and interval between each request and different business request initiation modes, thereby determining the business request initiation mode corresponding to each split link.

[0067] Step S4: Initiate a business request to the operation platform using the business request initiation mode corresponding to each split link, and obtain the test data corresponding to each split link. Based on the test data corresponding to each split link, obtain the performance capacity test results.

[0068] Specifically, business requests are initiated to the operation platform using the business request initiation mode corresponding to each split link, thereby conducting link testing and obtaining test data from each link.

[0069] Furthermore, statistical analysis is performed on the test data to obtain the performance and capacity test results. Specifically, the test data includes server operating status data, performance and capacity indicator data, and database snapshot data. In addition, statistical analysis of the test data includes calculating averages, thereby obtaining the test results.

[0070] As an embodiment of the present invention, the rule judgment of each subsystem in the operation platform according to the preset transaction link parameter model and link splitting rules includes: judging the communication protocol type of each subsystem in the operation platform according to the protocol type model in the transaction link parameter model and the communication protocol type judgment rule in the link splitting rules, and obtaining the protocol type judgment result.

[0071] The communication protocol type determination rule is as follows: Since the protocols used for communication within and between subsystems are not universal, and the services supported by each protocol differ, as well as the communication mechanisms and parameter configurations between different protocols, performance differences arise. Therefore, the transaction link parameter model is invoked, and the model variables include:

[0072] Protocol type determination result α: dependent variable, determined by the protocol type model α=f(x1,x2).

[0073] Specifically, let the independent variables x1>0 and x2>0, and the protocol type model be denoted as:

[0074] α=e x1 +e x2 (2)

[0075] (1) Protocol type x1: Independent variable. Currently, the mainstream protocols used are: application layer protocols: Telnet / HTTP / FTP / JMS / WEBSOCKET, transport layer protocols: RPC / TCP / SOCKET.

[0076] (2) Protocol parameter x2: Independent variable, a configurable parameter for each protocol.

[0077] Where e is the natural constant, defined as:

[0078]

[0079] Its value is approximately (3 decimal places) e≈2.718.

[0080] The independent variable x1 takes the value of a natural number greater than 0, and increments by 1 each time a protocol type is matched.

[0081] The independent variable x2 takes the value of a natural number greater than 0, and increments by 1 whenever a configurable parameter exists.

[0082] In this embodiment, the rule judgment of each subsystem in the operation platform according to the preset transaction link parameter model and link splitting rules also includes: performing database judgment on each subsystem in the operation platform according to the database model in the transaction link parameter model and the database judgment rules in the link splitting rules, and obtaining the database judgment result.

[0083] The database judgment rule is as follows: Data access operations, such as establishing / closing connections, are resource-intensive and involve numerous communication protocol parameters and database-specific parameter configurations, which can easily lead to performance bottlenecks. Therefore, the transaction link parameter model is invoked, and the model variables include:

[0084] Database judgment result β: dependent variable, determined by the database model β=f(y1,y2).

[0085] Specifically, let the independent variables y1>=0 and y2>=0, and the database model be denoted as:

[0086] β=e y1 +e y2 (4)

[0087] (1) Data written to disk or memory y1: Independent variable. Data written to disk consumes more disk I / O, and the physical properties of disk determine that it is necessarily slower than memory. Therefore, for database calls that need to write data to disk and store business logic in the database in the form of stored procedures, bottleneck problems are more likely to occur.

[0088] (2) Database position in the process flow y2: Independent variable. The database call occurs in the middle of the process flow. That is, after the database call is completed, the returned data needs to be processed before continuing the subsequent business process. Bottlenecks are more likely to occur in this part of the processing and in the subsequent request process.

[0089] Where e is a natural constant, defined as shown in formula (3), and its value is approximately (3 decimal places) e≈2.718.

[0090] The independent variable y1 takes the value of a natural number greater than 0. If the data is written to the disk, the value is assigned to 1; if the data is written to memory, the value is assigned to 2.

[0091] The independent variable y2 takes the value of a natural number greater than 0. If the database is in the middle of the transaction chain, the value is assigned to 1; if the database is not in the middle of the transaction chain, the value is assigned to 2.

[0092] In this embodiment, the rule judgment of each subsystem in the operation platform according to the preset transaction link parameter model and link splitting rules also includes: performing baffle judgment on each subsystem in the operation platform according to the baffle model in the transaction link parameter model and the baffle judgment rules in the link splitting rules, and obtaining the baffle judgment result.

[0093] The blocker judgment rule is as follows: For systems that need to be temporarily blocked from third parties, a program blocker needs to be introduced, and the transaction link parameter model needs to be called. The model variables include:

[0094] The result of the baffle judgment χ: the dependent variable, is determined by the baffle model χ=f(z1,z2).

[0095] Specifically, let the independent variables z1>=0 and z2>=0, and the baffle model be denoted as:

[0096] χ = e z1 +ez2 (5)

[0097] (1) Direct delivery of production subsystem z1: Independent variable. The directly delivered subsystem cannot be deployed in the test environment, but in the entire business process, the normal return of this part of the system is required to continue the next business process. Therefore, a barrier needs to be set here to complete the entire business process.

[0098] (2) Business involves third parties z2: Independent variable, involving calls to third parties. Due to external factors, such as: the preparation time of the third party is too long to meet the timeliness requirements of centralized production, or the test environment cannot connect to the third party for security reasons. Therefore, to complete the entire business process, a barrier needs to be set up here.

[0099] Where e is a natural constant, defined as shown in formula (3), and its value is approximately (3 decimal places) e≈2.718.

[0100] If the independent variable z1 does not belong to the direct delivery subsystem, the variable z1 is assigned a value of 0; if it belongs to the direct delivery subsystem, the variable z1 is assigned a value of 1.

[0101] The independent variable z2 is assigned a value of 1 if the business involves a third party, and a value of 0 if it does not involve a third party.

[0102] In this embodiment, the rule judgment of each subsystem in the operation platform according to the preset transaction link parameter model and link splitting rules also includes: judging the environment deployment of each subsystem in the operation platform according to the environment deployment model in the transaction link parameter model and the environment deployment judgment rules in the link splitting rules, and obtaining the environment deployment judgment result.

[0103] The environment deployment judgment rule is as follows: Cross-test environment data center deployment arises because the scale of business and applications is constantly expanding. Test environments also need to be scaled up, but test data centers are limited by physical space and cannot be infinitely expanded in one location, leading to multi-location deployments. Based on this background, heterogeneity between test and production environments has emerged. The transaction link parameter model is invoked, and the model variables include:

[0104] The environmental deployment judgment result δ: the dependent variable, is determined by the environmental deployment model δ=f(p1).

[0105] Specifically, assuming the independent variable p1>=0, the environment deployment model is denoted as:

[0106] δ=e p1 (6)

[0107] Cross-test environment data center deployment p1: Independent variable, in end-to-end testing based on the test environment, excludes the impact of transmission delay caused by multiple physical locations on the test results.

[0108] Where e is a natural constant, defined as shown in formula (3), and its value is approximately (3 decimal places) e≈2.718.

[0109] The independent variable p1 is assigned a value of 1 if the transaction involves cross-datacenter deployment, and a value of 0 if the transaction does not involve cross-datacenter deployment.

[0110] In this embodiment, the rule judgment of each subsystem in the operation platform according to the preset transaction link parameter model and link splitting rules also includes: judging the response time of each subsystem in the operation platform according to the response time model in the transaction link parameter model and the response time judgment rule in the link splitting rules, and obtaining the response time judgment result.

[0111] The response time judgment rule uses the response time as the judgment condition, calls the transaction link parameter model, and the model variables include:

[0112] The response time judgment result ε: the dependent variable, is determined by the response time model ε=f(q1,q2).

[0113] Specifically, assuming independent variables q1>0 and q2>0, the response time model is denoted as:

[0114] ε=e q1 +e q2 (7)

[0115] (1) Link response time greater than 8 seconds q1: Independent variable. Since the processing time of this segment is greater than 8 seconds, and the default timeout setting is 8 seconds, it is necessary to test the segment after splitting it.

[0116] (2) Link response time greater than 1 second and less than 8 seconds q2: Independent variable. Although this segment will not cause timeout, it will have a negative impact on user experience for customer services. Therefore, it needs to be treated as a separate segment to find bottleneck problems.

[0117] Where e is a natural constant, defined as shown in formula (3), and its value is approximately (3 decimal places) e≈2.718.

[0118] The independent variable q1 is initially set to 1. When the link response time is greater than 8 seconds, q1 increments by 1 for every 500 milliseconds.

[0119] The independent variable q2 is initially set to 1. It is set to increment by 1 every 500 milliseconds within a range of 1 to 8 seconds. Therefore, the value range of this variable is [1, 14].

[0120] In this embodiment, as Figure 2 As shown, using the transaction link parameter model and judgment results, the link decoupling process is performed on each subsystem in the operation platform, resulting in multiple split links, including:

[0121] Step S21: Calculate the link splitting value by using the transaction link parameter model to evaluate the protocol type, database, barrier, environment deployment, and response time results.

[0122] Step S22: Determine the number of links according to the preset link splitting rules and link splitting values;

[0123] Step S23: Decouple the links of each subsystem in the operation platform according to the number of links to obtain the split links corresponding to the number of links.

[0124] The obtained judgment result is substituted into formula (1) for calculation to obtain the link splitting value, i.e., the S value. The link splitting value is compared with the preset link splitting rules to determine the number of links to be split. Based on the number of links to be split, the links of each subsystem in the operation platform are decoupled to obtain the split links corresponding to the number of links.

[0125] This invention effectively improves the efficiency of performance bottleneck analysis by splitting the transaction chain, saves time costs in locating problems, meets the requirements of discovering and quickly locating problems and the timeliness of system deployment, and fundamentally reduces the probability of system risks occurring on the operating platform.

[0126] In a specific embodiment of the present invention, such as Figure 3 The diagram shows a system structure schematic of the operation platform performance and capacity testing method in an embodiment of the present invention. The present invention uses a transaction link parameter model to determine relevant rules, automatically decomposes the transaction links according to the rules, decouples all transaction links of the operation platform, and then performs performance and capacity testing on subsystems by formulating different pressure release rules. Finally, it summarizes and evaluates the results, refining bottleneck problems from the system level to specific points, providing a basis for system optimization and production environment expansion.

[0127] In this embodiment, the performance testing system (i.e., the business initiation end) includes a transaction chain splitting model, a test data collection module, a pressure distribution module, and a request initiation module. The system under test (i.e., the bank's intelligent operation platform) includes various subsystems in the platform's backend.

[0128] Among them, such as Figure 5 The diagram shows the overall interaction flow among the participating parties, which includes:

[0129] Step 1: Decouple the various subsystems of the operation platform according to the transaction link parameter model, allowing redundancy during the decoupling process.

[0130] The transaction link parameter model is a given non-negative function on an interval, namely the splitting rule judgment function, and the sum of each rule is as shown in formula (1).

[0131] Furthermore, the decomposition rules for the transaction link parameter model are as follows:

[0132] Communication protocol type determination rules: Since the protocols used for communication within and between subsystems are not a single universal protocol, and the services supported by each protocol are not the same, and the communication mechanisms and parameter configurations of different protocols differ, resulting in performance differences. Specifically, the protocol type determination result can be obtained using the protocol type model shown in formula (2).

[0133] Database judgment rules: Data access operations, such as establishing / closing connections, are resource-intensive operations involving numerous communication protocol parameters and database-specific parameter configurations, which can easily lead to performance bottlenecks. Specifically, the database judgment result can be obtained using the database model shown in formula (4).

[0134] Baffle judgment rule: For systems that need to be temporarily blocked from third parties, a program baffle needs to be introduced. Specifically, the baffle judgment result can be obtained by using the baffle model shown in formula (5).

[0135] Environment deployment judgment rules: Cross-test environment data center deployment. Due to the continuous expansion of business scale, the application scale also grows. For the test environment, it is also necessary to expand accordingly. However, the test data center is limited by physical space and it is difficult to expand infinitely in one place. As a result, there is a situation of multi-site deployment. Based on the above background, the heterogeneity of the test environment and the production environment has emerged. Specifically, the environment deployment judgment result can be obtained by using the environment deployment model shown in formula (6).

[0136] Response time judgment rule: The response time is used as the judgment condition. The response time judgment result can be obtained by using the response time model shown in formula (7).

[0137] Step 2: Based on the protocol type judgment result α, database judgment result β, baffle judgment result χ, environment deployment judgment result δ, and response time judgment result ε from Step 1, call the transaction link parameter model, i.e., formula (1), to calculate the value of S, i.e., the link splitting value.

[0138] Specifically, the number of links is determined by using the value of S and preset link splitting rules, so as to decouple the links of each subsystem in the operation platform and obtain the split links corresponding to the number of links. The preset link splitting rules are shown in Table 1.

[0139] Table 1

[0140] 2.718-7.387 2 7.388-20.079 3 20.08-54.576 4 55.577-148.336 5 148.337-403.178 6 404.179-1095.837 7 1095.838-2978.436 8 2978.437-8095.526 9 Greater than 8095.527 10

[0141] Specifically, based on the result of S, the entire link is decoupled into split links 1 to 10.

[0142] Step 3: Call the pressure distribution module to prepare for testing, and configure the business request initiation mode for each split link according to different rules.

[0143] The pressure delivery rule configuration includes: Rule 1. Concurrency level; Rule 2. Warm-up time; Rule 3. Pressure delivery duration; Rule 4. Interval between requests. Specifically, the preset pressure delivery rules are shown in Table 2.

[0144] Table 2

[0145] Instant kill mode Rule 1 + Rule 2 + Rule 3 Rate limiting mode Rule 1 + Rule 3 + Rule 4 Standard mode Rule 1 + Rule 2 + Rule 3 + Rule 4

[0146] Before the link split, as follows Figure 4A As shown, after the link is split, it is as follows: Figure 4B As shown.

[0147] Furthermore, the request initiation modes are classified according to the main business supported by the operating platform, into three categories: flash sale mode, rate limiting mode, and standard mode.

[0148] Step 4: Call the request initiation module to send a business request to the operations platform.

[0149] Step 5: Call the test data collection module to collect server data from each subsystem during the test, and display the results after statistical analysis.

[0150] The data statistical analysis process includes:

[0151] 1. Simultaneously with sending a request to the operations platform, the data collection module is activated. The test data collected includes:

[0152] 1) Server operating status data: CPU utilization (user mode utilization + kernel mode utilization), memory utilization, disk read / write bytes per second, network card communication bytes per second.

[0153] 2) Performance and capacity metrics: TPS, average response time, median response time, 95% response time, and network throughput per second.

[0154] 3) Database snapshot data: number of bytes read and written per second on the disk where the database is located, number of SQL executions, and duration of each SQL execution.

[0155] 2. Data is sent to the database inside the operation platform in chronological order via a message queue.

[0156] 3. After the test scenario concludes, the statistical analysis module of the operations platform is invoked to perform statistical analysis on the monitoring data within the scenario execution scope. By analyzing the server operation data, the average value of each indicator is calculated. The calculation method is the total number of counts within the scenario divided by the scenario execution duration. The TPS (Transactions Per Second) is calculated using the average response time of the performance capacity indicator, calculated as TPS = 1 / Response Time * Concurrency. The average response time is calculated by summing the response times of each request and dividing by the scenario execution duration. The execution time of each SQL statement is calculated by dividing the total execution time of that SQL statement by the number of executions. Finally, the results are displayed.

[0157] After statistical analysis, the results are presented as the transaction response time and test conclusions for each split link. According to different response time ranges, the test conclusions and the next test plan are given, as shown in Table 3.

[0158] Table 3

[0159] Less than 500 milliseconds Passed, no further analysis required. Greater than 500 milliseconds and less than 1 second It is necessary to pay attention to the operating status of the production environment. Greater than 1 second It failed; a detailed bottleneck analysis is required.

[0160] This invention effectively improves the efficiency of performance bottleneck analysis by decomposing the transaction links of each subsystem in the operation platform, saves the time cost of locating problems, meets the requirements of discovering and quickly locating problems and the timeliness of system deployment, fundamentally reduces the probability of system risks occurring in the operation platform, realizes full-link transaction analysis at the architecture level of the operation platform, accurately assesses the performance capacity of the operation platform, and provides a basis for system optimization and production environment expansion.

[0161] like Figure 6 The figure shows a schematic diagram of an operating platform performance capacity testing device according to an embodiment of the present invention. The device shown in the figure includes:

[0162] The judgment result module 10 is used to perform rule judgment on each subsystem in the operation platform according to the preset transaction link parameter model and link splitting rules, and obtain multiple judgment results;

[0163] The split link module 20 is used to decouple the links of each subsystem in the operation platform by using the transaction link parameter model and judgment results to obtain multiple split links.

[0164] The initiation mode module 30 is used to determine the business request initiation mode corresponding to each split link according to the preset pressure rules;

[0165] The test results module 40 is used to initiate business requests to the operation platform using the business request initiation mode corresponding to each split link, obtain the test data corresponding to each split link, and obtain the performance capacity test results based on the test data corresponding to each split link.

[0166] As an embodiment of the present invention, the judgment result module is also used to judge the communication protocol type of each subsystem in the operation platform according to the protocol type model in the transaction link parameter model and the communication protocol type judgment rule in the link splitting rule, and obtain the protocol type judgment result.

[0167] In this embodiment, the judgment result module 10 is also used to perform database judgment on each subsystem in the operation platform according to the database model in the transaction link parameter model and the database judgment rule in the link splitting rule, and obtain the database judgment result.

[0168] In this embodiment, the judgment result module 10 is also used to perform baffle judgment on each subsystem in the operation platform according to the baffle model in the transaction link parameter model and the baffle judgment rule in the link splitting rule, and obtain the baffle judgment result.

[0169] In this embodiment, the judgment result module 10 is also used to perform environment deployment judgment on each subsystem in the operation platform according to the environment deployment model in the transaction link parameter model and the environment deployment judgment rule in the link splitting rule, and obtain the environment deployment judgment result.

[0170] In this embodiment, the judgment result module 10 is also used to judge the response time of each subsystem in the operation platform according to the response time model in the transaction link parameter model and the response time judgment rule in the link splitting rule, and obtain the response time judgment result.

[0171] In this embodiment, as Figure 7 As shown, the split link module 20 includes:

[0172] The splitting value unit 21 is used to calculate the link splitting value by using the transaction link parameter model to calculate the protocol type judgment result, database judgment result, barrier judgment result, environment deployment judgment result and response time judgment result;

[0173] Link quantity unit 22 is used to determine the number of links according to the preset link splitting rules and link splitting values;

[0174] The split link unit 23 is used to decouple the links of each subsystem in the operation platform according to the number of links, and obtain the split links corresponding to the number of links.

[0175] Based on the same concept as the aforementioned method for testing the performance and capacity of an operating platform, this invention also provides an apparatus for testing the performance and capacity of an operating platform. Since the principle by which this apparatus solves the problem is similar to that of the method for testing the performance and capacity of an operating platform, the implementation of this apparatus can refer to the implementation of the method for testing the performance and capacity of an operating platform, and will not be repeated here.

[0176] This invention effectively improves the efficiency of performance bottleneck analysis by decomposing the transaction links of each subsystem in the operation platform, saves the time cost of locating problems, meets the requirements of discovering and quickly locating problems and the timeliness of system deployment, fundamentally reduces the probability of system risks occurring in the operation platform, realizes full-link transaction analysis at the architecture level of the operation platform, accurately assesses the performance capacity of the operation platform, and provides a basis for system optimization and production environment expansion.

[0177] The present invention also provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement the above-described method.

[0178] The present invention also provides a computer program product, including a computer program / instructions, which, when executed by a processor, implement the steps of the above-described method.

[0179] The present invention also provides a computer-readable storage medium storing a computer program that performs the above-described methods by a computer.

[0180] like Figure 8 As shown, the electronic device 600 may also include: a communication module 110, an input unit 120, an audio processor 130, a display 160, and a power supply 170. It is worth noting that the electronic device 600 does not necessarily need to include these components. Figure 8 All components shown; in addition, the electronic device 600 may also include Figure 8 For components not shown, please refer to existing technologies.

[0181] like Figure 8 As shown, the central processing unit 100, sometimes also referred to as a controller or operating control, may include a microprocessor or other processor device and / or logic device. The central processing unit 100 receives inputs and controls the operation of various components of the electronic device 600.

[0182] The memory 140 may be, for example, one or more of a cache, flash memory, hard drive, removable media, volatile memory, non-volatile memory, or other suitable devices. It may store the aforementioned failure-related information, and also store a program for executing that information. The central processing unit 100 may execute the program stored in the memory 140 to perform information storage or processing, etc.

[0183] Input unit 120 provides input to central processing unit 100. Input unit 120 may be, for example, a keypad or touch input device. Power supply 170 provides power to electronic device 600. Display 160 displays images and text. Display may be, for example, an LCD display, but is not limited thereto.

[0184] The memory 140 can be a solid-state memory, such as a read-only memory (ROM), random access memory (RAM), a SIM card, etc. It can also be a memory that retains information even when power is off, can be selectively erased, and contains more data; examples of this type of memory are sometimes referred to as EPROMs. The memory 140 can also be some other type of device. The memory 140 includes a buffer memory 141 (sometimes referred to as a buffer). The memory 140 may include an application / function storage unit 142 for storing application programs and function programs or processes for executing the operation of the electronic device 600 via the central processing unit 100.

[0185] The memory 140 may also include a data storage unit 143 for storing data, such as contacts, digital data, pictures, sounds, and / or any other data used by the electronic device. The driver storage unit 144 of the memory 140 may include various drivers for the electronic device's communication functions and / or for performing other functions of the electronic device (such as messaging applications, address book applications, etc.).

[0186] The communication module 110 is a transmitter / receiver 110 that transmits and receives signals via antenna 111. The communication module (transmitter / receiver) 110 is coupled to the central processing unit 100 to provide input signals and receive output signals, which can be the same as in a conventional mobile communication terminal.

[0187] Based on different communication technologies, multiple communication modules 110 can be configured in the same electronic device, such as cellular network modules, Bluetooth modules, and / or wireless LAN modules. The communication module (transmitter / receiver) 110 is also coupled to a speaker 131 and a microphone 132 via an audio processor 130 to provide audio output via the speaker 131 and receive audio input from the microphone 132, thereby enabling typical telecommunications functions. The audio processor 130 may include any suitable buffer, decoder, amplifier, etc. Additionally, the audio processor 130 is coupled to a central processing unit 100, enabling on-device recording via the microphone 132 and on-device playback of stored audio via the speaker 131.

[0188] Those skilled in the art will understand that embodiments of the present invention can be provided as methods, systems, or computer program products. Therefore, the present invention can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present invention can take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0189] This invention is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart illustrations and / or block diagrams. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0190] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0191] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0192] Specific embodiments have been used to illustrate the principles and implementation methods of this invention. The descriptions of the embodiments above are only for the purpose of helping to understand the method and core ideas of this invention. At the same time, for those skilled in the art, there will be changes in the specific implementation methods and application scope based on the ideas of this invention. Therefore, the content of this specification should not be construed as a limitation of this invention.

Claims

1. A method for testing the performance and capacity of an operating platform, characterized in that, The method includes: Based on the preset transaction link parameter model and link splitting rules, rule judgments are performed on each subsystem in the operation platform to obtain multiple judgment results; wherein, the transaction link parameter model includes a protocol type model, a database model, a barrier model, an environment deployment model, and a response time model, and the link splitting rules include communication protocol type judgment rules, database judgment rules, barrier judgment rules, environment deployment judgment rules, and response time judgment rules; Using the transaction link parameter model and the judgment result, link decoupling is performed on each subsystem in the operation platform to obtain multiple split links; Based on the preset pressure sending rules, determine the business request initiation mode corresponding to each split link; The system initiates business requests to the operation platform using the business request initiation mode corresponding to each split link, obtains the test data corresponding to each split link, and obtains the performance capacity test results based on the test data corresponding to each split link.

2. The method according to claim 1, characterized in that, The rule-based judgment of each subsystem in the operation platform according to the preset transaction link parameter model and link splitting rules includes: Based on the protocol type model in the transaction link parameter model and the communication protocol type judgment rule in the link splitting rule, the communication protocol type of each subsystem in the operation platform is judged to obtain the protocol type judgment result.

3. The method according to claim 2, characterized in that, The rule-based judgment of each subsystem in the operation platform according to the preset transaction link parameter model and link splitting rules also includes: Based on the database model in the transaction link parameter model and the database judgment rules in the link splitting rules, database judgments are performed on each subsystem in the operation platform to obtain database judgment results.

4. The method according to claim 3, characterized in that, The rule-based judgment of each subsystem in the operation platform according to the preset transaction link parameter model and link splitting rules also includes: Based on the baffle model in the transaction link parameter model and the baffle judgment rule in the link splitting rule, baffle judgment is performed on each subsystem in the operation platform to obtain the baffle judgment result.

5. The method according to claim 4, characterized in that, The rule-based judgment of each subsystem in the operation platform according to the preset transaction link parameter model and link splitting rules also includes: Based on the environment deployment model in the transaction link parameter model and the environment deployment judgment rule in the link splitting rule, the environment deployment judgment is performed on each subsystem in the operation platform to obtain the environment deployment judgment result.

6. The method according to claim 5, characterized in that, The rule-based judgment of each subsystem in the operation platform according to the preset transaction link parameter model and link splitting rules also includes: Based on the response time model in the transaction link parameter model and the response time judgment rule in the link splitting rule, the response time of each subsystem in the operation platform is judged to obtain the response time judgment result.

7. The method according to claim 6, characterized in that, Using the transaction link parameter model and the judgment result, link decoupling processing is performed on each subsystem in the operation platform to obtain multiple split links, including: The link splitting value is obtained by calculating the protocol type judgment result, database judgment result, barrier judgment result, environment deployment judgment result and response time judgment result using the transaction link parameter model; The number of links is determined based on the preset link splitting rules and the link splitting values; Based on the number of links, the subsystems in the operation platform are decoupled to obtain the split links corresponding to the number of links.

8. A performance capacity testing device for an operating platform, characterized in that, The device includes: The judgment result module is used to perform rule judgments on each subsystem in the operation platform according to the preset transaction link parameter model and link splitting rules, and obtain multiple judgment results; wherein, the transaction link parameter model includes a protocol type model, a database model, a barrier model, an environment deployment model and a response time model, and the link splitting rules include communication protocol type judgment rules, database judgment rules, barrier judgment rules, environment deployment judgment rules and response time judgment rules. The link splitting module is used to decouple the links of each subsystem in the operation platform by using the transaction link parameter model and the judgment result to obtain multiple split links. The initiation mode module is used to determine the business request initiation mode corresponding to each split link according to the preset pressure rules; The test results module is used to initiate business requests to the operation platform using the business request initiation mode corresponding to each split link, obtain the test data corresponding to each split link, and obtain the performance capacity test results based on the test data corresponding to each split link.

9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the computer program, it implements the method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that enables a computer to execute the method according to any one of claims 1 to 7.

Images