Full-link stress testing method, device, electronic device, and storage medium

Abstract

The present application provides a full-link stress testing method, device, electronic device and storage medium, the method comprising: collecting business data of the target link in the production environment and production time consumption data of each node; in the stress testing environment, building a full-link stress testing simulation model based on the above data; performing stress testing based on the verification task until the result meets the conditions and generates baseline data; if the target link is updated, calling the model for stress testing, and generating results in combination with the baseline data. In this way, by constructing a full-link stress testing simulation model that matches the production environment and generating baseline data, when the link is updated, the full-link stress testing simulation model is used to perform full-link stress testing, and stress testing results are generated in combination with the baseline data, which effectively solves the problem of insufficient performance verification before going online, and at the same time provides a basis for quantitative evaluation of link saturation.

Description

Technical Field

[0001] The present application relates to the field of Internet of Things technology, and in particular to a full-link stress testing method, device, electronic device, and storage medium. Background Art

[0002] In the internet finance sector, the "golden link" refers to the end-to-end, full-link path supporting core business processes, encompassing nodes throughout the entire process, including front-end business triggering, business logic processing, data interaction, and back-end service response. Given that the "golden link" carries high-frequency transactions and critical processes in core businesses, its performance and stability directly impact the service capabilities and user experience of the entire business system. Therefore, comprehensive performance stress testing and monitoring of the "golden link" is crucial for ensuring stable system operation and coping with high concurrency pressures. However, existing stress testing methods for the "golden link" suffer from numerous shortcomings. Firstly, there is a lack of effective means to quantitatively assess the saturation (i.e., carrying capacity) of the "golden link." For example, if a channel partner suddenly demands increased business volume (e.g., increased transaction volume), it is difficult to quickly estimate the link's saturation level and determine whether the link can handle the increased volume, thus challenging system stability. Secondly, it is difficult to complete performance testing of all transaction scenarios for new products before launch. Consequently, full-link business transactions rely on production discovery and optimization, leading to uncertainty in the performance of the new product's "golden link." Summary of the Invention

[0003] The present application provides a full-link stress testing method, device, electronic device and storage medium to at least solve the above technical problems existing in the prior art.

[0004] According to a first aspect of the present application, a full-link stress testing method is provided, the method comprising:

[0005] Collecting business data of the target link in the production environment and production time data of each node of the target link, the nodes including internal systems and external interfaces, and the production time data including interface call time, data processing time, and communication time;

[0006] In the stress testing environment, a full-link stress testing simulation model of the target link is constructed based on the business data, the production single-center standard, and the production time consumption data of each node. The production single-center standard is used to represent the resource configuration data of the production environment.

[0007] Based on multiple verification tasks and the full-link stress testing simulation model, the target link is stress tested until the stress testing results meet the set conditions, business indicator data and performance indicator data are obtained, and baseline data is generated;

[0008] If it is detected that the target link is updated, the full-link stress testing simulation model is called to perform stress testing on the updated target link, and the business indicator data and performance indicator data during the stress testing process are obtained. In combination with the baseline data, a stress testing result is generated. The stress testing result is used to show the business indicator data and performance indicator data during the stress testing process and the deviation of the business indicator data and performance indicator data during the stress testing process from the baseline data.

[0009] In one embodiment, the method further comprises:

[0010] Receive a target task, perform stress testing on the target link based on the target task and the full-link stress testing simulation model, and collect target business indicator data and target performance indicator data during the stress testing process;

[0011] The target service indicator data and the target performance indicator data are compared with the baseline data, and whether the target link can perform the target task is determined according to the comparison result.

[0012] In one possible implementation, in a stress testing environment, a full-link stress testing simulation model of the target link is constructed based on the business data, the production single center standard, and the production time consumption data of each node, including:

[0013] Synchronize the business data collected in the production environment to the stress testing environment based on the desensitized data synchronization strategy. The desensitized data synchronization strategy includes ensuring that the deviation between the data level of the stress testing environment and the production environment is less than a set deviation threshold and synchronizing at a set period.

[0014] In the stress testing environment, an initial full-link stress testing simulation model of the target link is constructed. The initial full-link stress testing simulation model includes simulation nodes for each node of the target link. The simulation nodes of the external interface are deployed with baffles, which are used to simulate the interface behavior and response time of the external interface.

[0015] Configuring resources for the initial full-link stress testing simulation model based on the production single center standard;

[0016] According to the production time consumption data of each external interface, the 90th percentile time consumption data of each external interface is determined, and according to the 90th percentile time consumption data of each external interface, the baffle configuration response time of the corresponding simulation node in the initial full-link stress testing simulation model is calculated to obtain the full-link stress testing simulation model.

[0017] In one embodiment, the setting condition includes one of the following:

[0018] The fluctuation of business indicators in the consecutive set stress tests is less than the first set threshold and the fluctuation of performance indicators is less than the second set threshold;

[0019] The fluctuation of the 95th percentile approval time in consecutive stress tests is less than the third set threshold.

[0020] In one embodiment, the business indicator data includes the 95th percentile approval time, the number of flow-limiting queues, the number of abnormal incoming applications, and upstream and downstream system difference data;

[0021] The performance indicator data includes the number of link transactions per second and link performance.

[0022] In one possible implementation, if an update to the target link is detected, the full-link stress testing simulation model is called to perform stress testing on the updated target link, business indicator data and performance indicator data during the stress testing process are obtained, and stress testing results are generated in combination with the baseline data, including:

[0023] Detecting whether the target link is updated based on a continuous integration and continuous delivery mechanism;

[0024] If the target link is updated, the business indicator data and performance indicator data during the stress test are obtained, the full-link stress test simulation model is called to perform stress testing on the updated target link, and a stress test result is generated in combination with the baseline data. The stress test result is used to show the business indicator data and performance indicator data during the stress test and the deviation of the business indicator data and performance indicator data during the stress test from the baseline data.

[0025] According to a second aspect of the present application, a full-link stress testing device is provided, the device comprising:

[0026] A collection module is used to collect business data of the target link in the production environment and production time data of each node of the target link, wherein the nodes include internal systems and external interfaces, and the production time data includes interface call time, data processing time, and communication time;

[0027] A construction module is configured to construct a full-link stress testing simulation model of the target link in a stress testing environment based on the business data, a production single-center standard, and production time consumption data of each node, wherein the production single-center standard is used to represent resource configuration data of the production environment;

[0028] An acquisition module is used to perform stress testing on the target link based on multiple verification tasks and the full-link stress testing simulation model until the stress testing results meet the set conditions, obtain business indicator data and performance indicator data, and generate baseline data;

[0029] A calling module is used to call the full-link stress testing simulation model to perform stress testing on the updated target link if it is detected that the target link is updated, obtain the business indicator data and performance indicator data during the stress testing process, and generate stress testing results in combination with the baseline data. The stress testing results are used to show the business indicator data and performance indicator data during the stress testing process and the deviation of the business indicator data and performance indicator data during the stress testing process from the baseline data.

[0030] In one embodiment, the device further comprises:

[0031] A receiving module is configured to receive a target task, perform stress testing on the target link based on the target task and the full-link stress testing simulation model, and collect target business indicator data and target performance indicator data during the stress testing process;

[0032] A comparison module is used to compare the target business indicator data and the target performance indicator data with the baseline data, and determine whether the target link can perform the target task according to the comparison result.

[0033] According to a third aspect of the present application, an electronic device is provided, including:

[0034] at least one processor; and

[0035] a memory communicatively connected to the at least one processor; wherein,

[0036] The memory stores instructions that can be executed by the at least one processor. The instructions are executed by the at least one processor to enable the at least one processor to perform the method described in this application.

[0037] According to a fourth aspect of the present application, a non-transitory computer-readable storage medium storing computer instructions is provided, wherein the computer instructions are used to enable the computer to execute the method described in the present application.

[0038] The full-link stress testing method, device, electronic device and storage medium of the present application collect business data of a target link in a production environment and production time data of each node of the target link, wherein the node includes an internal system and an external interface, and the production time data includes interface call time, data processing time and communication time; in the stress testing environment, a full-link stress testing simulation model of the target link is constructed based on the business data, the production single center standard and the production time data of each node, wherein the production single center standard is used to show the resource configuration data of the production environment; based on multiple verification tasks and the full-link stress testing simulation model, the target link is stress tested, and business indicator data and performance indicator data during the stress testing process are obtained until the stress testing result meets the set conditions, the business indicator data and performance indicator data are obtained, and baseline data is generated; if it is detected that the target link is updated, the full-link stress testing simulation model is called to perform stress testing on the updated target link, and a stress testing result is generated in combination with the baseline data, wherein the stress testing result is used to show the business indicator data and performance indicator data during the stress testing process and the deviation of the business indicator data and performance indicator data during the stress testing process from the baseline data. By building a full-link stress testing simulation model that matches the production environment and generating baseline data, we use the full-link stress testing simulation model to perform full-link stress testing during link updates. Combined with the baseline data, we generate stress testing results, effectively resolving the issue of insufficient performance verification before going online and providing a basis for quantitative evaluation of link saturation.

[0039] It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present application, nor is it intended to limit the scope of the present application. Other features of the present application will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] The above and other objects, features and advantages of the exemplary embodiments of the present application will become readily understood by reading the detailed description below with reference to the accompanying drawings. In the accompanying drawings, several embodiments of the present application are shown in an illustrative and non-limiting manner, in which:

[0041] In the drawings, the same or corresponding reference numerals denote the same or corresponding parts.

[0042] Figure 1 The following is a schematic diagram of the implementation process of the full-link stress testing method provided in an embodiment of the present application;

[0043] Figure 2 A schematic diagram of the implementation process of the full-link simulation model construction operation of the full-link stress testing method provided in an embodiment of the present application is shown;

[0044] Figure 3 A schematic diagram of the structure of the full-link stress testing device provided in an embodiment of the present application is shown;

[0045] Figure 4 A schematic diagram of the structure of an electronic device according to an embodiment of the present application is shown. DETAILED DESCRIPTION

[0046] In order to make the purpose, features, and advantages of this application more obvious and easy to understand, the technical solutions in the embodiments of this application will be clearly and completely described below in conjunction with the drawings in the embodiments of this application. Obviously, the described embodiments are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art without making creative efforts shall fall within the scope of protection of this application.

[0047] First, the application scenario of the embodiment of the present application is explained. Among the many system performance evaluation methods, the golden link full-link stress test has significant advantages. Unlike the single-system stress test, it can simulate real business scenarios, comprehensively identify the performance bottlenecks of the entire link, and discover the dependency problems between systems in advance. At the same time, this stress testing method can also simulate the production fault diffusion scenario, so as to formulate a comprehensive fault handling plan in advance. Based on the high-reliability golden link stress test results, it can provide an accurate capacity planning reference for the system group and provide a reliable basis for the performance evaluation of the production environment, thereby effectively reducing the performance risks in the production environment. In view of this, the embodiment of the present application provides a full-link stress testing method to achieve comprehensive coverage stress testing of multi-system links.

[0048] Figure 1 A schematic diagram of the implementation process of the full-link stress testing method provided in an embodiment of the present application is shown.

[0049] refer to Figure 1 , an embodiment of the present application provides a full-link stress testing method, the method comprising:

[0050] Operation 101 collects business data of a target link in a production environment and production time data of each node of the target link. The nodes include internal systems and external interfaces. The production time data includes interface call time, data processing time, and communication time.

[0051] The business data of the target link and the production time consumption data of each node of the target link can be obtained by conducting a full-link survey of the target link. In order to build a stress testing environment that is as close to the production environment as possible and provide highly reliable full-link stress testing results for production operations, the survey of the target link in the embodiment of this application is carried out in an actual production environment.

[0052] Among them, different core business processes correspond to different target links. The target link can be understood as the golden link to be stress-tested specified by the user or the golden link of the core business process to be tested specified by the user. It includes the full process nodes from front-end business triggering to back-end processing completion. These nodes are constructed in sequence, including internal systems involved in the core business (such as credit system, risk control middle platform, business management system, etc.) and external interfaces (such as third-party payment channels, public service platforms, etc.).

[0053] The survey of the target link in the actual production environment mainly covers the following operations: first, comprehensively sort out the business process of the target link and clarify the interaction logic of each link; second, make detailed statistics on the business data of the target link and the production time data of each node.

[0054] In one embodiment of this application, business data refers to various types of data generated by target links during actual business operations in a production environment. Business data comprehensively reflects key information such as actual traffic characteristics, business logic execution, and user behavior patterns in the production environment. Business data includes, but is not limited to, transaction records, user request information, operation logs, and information about interactions between internal systems.

[0055] In one embodiment of the present application, production time data includes interface call time, data processing time, and communication time. The interface call time refers to the time it takes from initiating an interface request to receiving an interface response; the data processing time refers to the time it takes for the internal system to process data during the execution of core business operations, such as the time spent analyzing, converting, calculating, and approving data; the time spent on approval can be considered as the time spent waiting for manual or automatic review in the approval process; and the communication time refers to the time it takes for data to be transmitted between systems or between a system and external services, such as network transmission time and message queue communication time.

[0056] Operation 102 : In a stress testing environment, a full-link stress testing simulation model of a target link is constructed based on business data, a production single-center standard, and production time consumption data of each node. The production single-center standard is used to represent resource configuration data of the production environment.

[0057] After the full-link survey of the target link is completed, in order to accurately simulate the operation of the target link in the production environment, such as the business processes and system interactions in the actual production environment, it is necessary to finely simulate the stress testing environment of the target link. The embodiment of this application concretizes this simulation process by building a full-link stress testing simulation model that can execute stress testing logic in the stress testing environment.

[0058] The construction of a full-link stress testing simulation model can include the following operations: first, use the collected business data to restore the real business scenarios and traffic characteristics; then, combine the production time consumption data of each node to configure the performance of each node in the full-link stress testing simulation model, including the processing time of the internal system and the response time of the external interface; at the same time, to ensure that the operating environment of the full-link stress testing simulation model is as close to the production environment as possible, the resources of the full-link stress testing simulation model are also configured according to the production single center standard.

[0059] In one embodiment of the present application, the production single center standard refers to a set of specifications and guidelines formulated in advance in a production environment to ensure stable system operation and reasonable resource allocation, that is, resource configuration data of the pre-configured production environment.

[0060] Operation 103 : Perform stress testing on the target link based on multiple verification tasks and the full-link stress testing simulation model until the stress testing result meets the set conditions, obtain business indicator data and performance indicator data, and generate baseline data.

[0061] To ensure the accuracy and reliability of stress testing results, the target link must be comprehensively evaluated through multiple verification tasks to fully identify potential performance bottlenecks and issues. Verification tasks involve testing the target link's performance under different business scenarios and load conditions, simulating a variety of real-world situations to comprehensively examine the target link's stability and processing capabilities.

[0062] To ensure stable and reliable stress test results, pre-configured conditions are set. Only when the stress test results meet these conditions can the stress test process be considered stable. At this point, business and performance indicator data is collected to ensure sufficient credibility, enabling reliable baseline data to be generated.

[0063] In one embodiment of the present application, baseline data may include acquired business indicator data and performance data, or any one of these indicators, or other comprehensive indicators derived from the business indicator data and performance data. The purpose of baseline data is to provide a reference standard for subsequent performance evaluation and optimization. For example, when a target link changes due to a system update or other modification, the new stress test results can be compared with the baseline data to quickly assess the impact of the change on system performance.

[0064] In one embodiment of the present application, business indicator data includes the 95th percentile (P95) approval time, the number of throttling queues, the number of abnormally processed applications, and upstream and downstream system differences; performance indicator data includes link TPS (Transactions Per Second) and link performance. The 95th percentile approval time represents the value at the 95th percentile of a set of approval time data, sorted from smallest to largest. This means that 95% of approvals take less than this value, and only 5% take more than this value.

[0065] Specifically, business indicator data and performance indicator data reflect the performance of the target link in terms of business processing capabilities and system performance, respectively. Business indicator data includes approval time P95, number of throttling queues, number of abnormal incoming applications, and upstream and downstream system differences. Performance indicator data includes link TPS and link performance.

[0066] Among them, considering that the approval time P95 can better reflect the performance of the system in processing most business requests and better reflect the user experience during actual use, the baseline data of this embodiment of the present application is preferably the approval time P95.

[0067] In one embodiment of the present application, corresponding to the baseline data, the setting conditions can be configured to include one of the following: the fluctuation of business indicators in the continuous set rounds of stress testing is less than the first set threshold and the fluctuation of performance indicators is less than the second set threshold; the fluctuation of P95 of the approval time of the continuous set rounds of stress testing is less than the third set threshold.

[0068] Specifically, to ensure that the baseline data is stable and reliable, it is necessary to perform multiple stress tests on the target link based on the verification task. The stress test will only be stopped when the indicators in the set round of stress testing are kept within a relatively stable range, that is, when the indicator fluctuations are small. Among them, when the business indicator fluctuations in the continuous set rounds of stress testing are less than the first set threshold and the performance indicator fluctuations are less than the second set threshold, or when the P95 fluctuations in the approval time of the continuous set rounds of stress testing are less than the third set threshold, it can be determined that the indicator fluctuations are small. The setting rounds can be configured according to historical experience or actual conditions, and this application does not make specific restrictions.

[0069] In one embodiment of the present application, fluctuations can be represented by the deviation of indicators in different rounds of stress testing, that is, by calculating statistics such as standard deviation, variance or percentage change of business indicators and / or performance indicators in multiple stress testing rounds to measure their fluctuations. The first set threshold, the second set threshold, and the third set threshold can be configured according to actual conditions. For example, if the business has extremely high requirements for approval timeliness, the third set threshold of the approval time P95 can be configured to be smaller (such as 50 milliseconds) to strictly control the time fluctuation of the approval process. Similarly, if the system has high requirements for the stability of business indicators, the first set threshold and the second set threshold can be configured to be smaller (such as business indicator fluctuations less than 10%, and performance indicator fluctuations less than 5%) to ensure that various indicators remain as stable as possible during the stress testing process.

[0070] Operation 104: If an update to the target link is detected, the full-link stress test simulation model is called to perform stress testing on the updated target link, and the business indicator data and performance indicator data during the stress test are obtained. The stress test results are generated in combination with the baseline data. The stress test results are used to show the business indicator data and performance indicator data during the stress test and the deviation between the business indicator data and performance indicator data during the stress test and the baseline data.

[0071] In actual production environments, target links may be updated for various reasons, such as internal system upgrades, internal system function optimization, and configuration adjustments. To ensure that these updates do not negatively impact the performance and service processing capabilities of the target link, it is necessary to re-stress test the updated target link in a timely manner.

[0072] When an update to the target link is detected, the automatic stress test process is triggered. The full-link stress test simulation model is re-invoked to perform a stress test based on the updated target link. The business and performance indicator data collected during the stress test are compared with the previously generated baseline data to generate the stress test results. The stress test results include the business and performance indicator data during the stress test, as well as the deviations between the business and performance indicator data and the baseline data.

[0073] In one embodiment of the present application, if the deviation of each indicator is within the set range, it indicates that the performance of the updated system is stable and can be safely deployed to the production environment; if the deviation exceeds the set range, an early warning that the target link needs to be optimized is issued to enable developers to further analyze and optimize the system performance to ensure the reliability and stability of the system.

[0074] The setting range includes the deviation range of each indicator. The deviation range can be determined comprehensively based on factors such as historical data, business needs, performance goals and industry standards. For example, based on past stable performance and business requirements for response time, the deviation range of the approval time P95 is set to ±10% of the baseline data, and the deviation range of TPS is set to ±5% of the baseline data.

[0075] In one embodiment of the present application, when a target task for a target link is received, the following operations are also performed: receiving the target task, stress testing the target link based on the target task and the full-link stress testing simulation model, and collecting target business indicator data and target performance indicator data during the stress testing process; comparing the target business indicator data and target performance indicator data with the baseline data, and determining whether the target link can execute the target task based on the comparison results.

[0076] Specifically, the target task can refer to a volume expansion task, which can be understood as a business volume expansion demand, such as expanding the business processing scale of the target link, increasing the transaction scale of the target link, or improving the data transmission scale of the target link. After receiving the target task, the full-link stress test simulation model is quickly called to perform stress testing on the target link. During the stress testing process, the target business indicator data and target performance indicator data are collected, and the target business indicator data and target performance indicator data are compared with the baseline data. Based on the comparison results, it is determined whether the current target link has the ability to perform the target task, that is, to quickly estimate the link saturation during volume expansion, determine whether the link can carry the target task, and thus determine whether the volume expansion task can be performed.

[0077] The comparison results show the deviation of each indicator from the baseline data. Whether the target link is capable of performing the target task is determined based on whether the deviation falls within the set deviation range. If it does not fall within the set deviation range, it is incapable of performing the target task. If it does fall within the set range, it is capable of performing the target task.

[0078] In this way, the embodiment of the present application builds a full-link stress test simulation model that matches the production environment and generates baseline data based on it. When the link is updated, the full-link stress test simulation model is used to carry out full-link stress testing, and the stress test results are generated in combination with the baseline data, which effectively solves the problem of insufficient performance verification before going online. In addition, when a volume expansion task is received, the full-link stress test simulation model is called to perform the stress test operation, which enables an accurate assessment of the current link's carrying capacity before large-scale business expansion, avoids performance problems caused by exceeding the system's carrying capacity, and achieves a quantitative assessment of the link saturation during volume expansion.

[0079] In one embodiment of the present application, the above operation 104, if it is detected that the target link is updated, calls the full-link stress testing simulation model to perform stress testing on the updated target link, and generates stress testing results in combination with the baseline data, including: detecting whether the target link is updated based on the continuous integration and continuous delivery mechanism; if the target link is updated, calls the full-link stress testing simulation model to perform stress testing on the updated target link, obtains business indicator data and performance indicator data during the stress testing process, and generates stress testing results in combination with the baseline data, and the stress testing results are used to show the business indicator data and performance indicator data during the stress testing process and the deviation of the business indicator data and performance indicator data during the stress testing process from the baseline data.

[0080] Specifically, to promptly stress test the updated target link (i.e., the new version of the target link), this embodiment of the present application integrates the stress testing process of operations 101-104 with CI / CD (Continuous Integration / Continuous Delivery). Thus, based on the CI / CD mechanism, once a target link update is detected, the stress testing process is automatically triggered, link stress testing is performed, and baseline comparison is performed to generate stress test results. Based on any deviations shown in the stress test results, link performance can be identified in advance.

[0081] Figure 2 A schematic diagram of the implementation process of the full-link simulation model construction operation of the full-link stress testing method provided in an embodiment of the present application is shown.

[0082] refer to Figure 2 In one embodiment of the present application, the above operation 102, in a stress testing environment, builds a full-link stress testing simulation model of the target link based on business data, production single center standards, and production time consumption data of each node, including:

[0083] Operation 201 synchronizes the business data collected in the production environment to the stress testing environment based on the desensitized data synchronization strategy. The desensitized data synchronization strategy includes that the deviation between the data level of the stress testing environment and the production environment is less than a set deviation threshold and synchronization is performed at a set period.

[0084] The simulation of the stress testing environment includes the simulation of the production environment, and the simulation of the production environment includes the configuration of the data layer. Through data configuration, the data level of the stress testing environment is ensured to be consistent with the actual production environment.

[0085] The stress testing environment data layer can be configured based on a desensitized data synchronization strategy. This strategy synchronizes business data collected in the actual production environment with the stress testing environment. This strategy ensures that the deviation between the data level in the stress testing environment and the production environment is less than a set deviation threshold, and synchronizes data at a set interval. This ensures that desensitized data synchronization is performed every set interval, maintaining consistency between the data level in the stress testing environment and the production environment, ensuring the accuracy and reliability of the stress testing results. The set interval can be configured based on actual conditions, for example, two months.

[0086] In this embodiment of the present application, if the deviation between the data level of the stress testing environment and the production environment is less than the set deviation threshold, it is determined that the data level of the stress testing environment is consistent with the production environment. The set deviation threshold can be configured according to actual conditions.

[0087] Operation 202: In a stress testing environment, an initial full-link stress testing simulation model of the target link is constructed. The initial full-link stress testing simulation model includes simulation nodes of each node of the target link. The simulation nodes of the external interface are deployed with baffles, which are used to simulate the interface behavior and response time of the external interface.

[0088] In the stress testing environment, an initial full-link stress testing simulation model of the target link is constructed. The initial full-link stress testing simulation model is configured with simulation nodes of each node of the target link, and the interaction logic between each simulation node remains consistent with the target link.

[0089] Furthermore, for external interfaces, which often rely on external service providers, independent and stable testing in a stress testing environment requires deploying a baffle on the simulation node. The baffle, or peripheral system baffle, simulates the interface behavior and response time of the external interface using pre-defined rules and logic.

[0090] Operation 203: Configure resources for the initial full-link stress testing simulation model based on the production single center standard.

[0091] In a production environment, resource allocation adheres to certain standards, known as the production single-center standard, to ensure stable link operation. When building a full-link stress testing simulation model within a stress testing environment, resources must also be configured according to the production single-center standard to ensure that the simulation model's operating state within the stress testing environment closely resembles that of the production environment. This resource configuration includes allocating computing, storage, and network resources to each simulation node, setting parameters, and configuring items.

[0092] Operation 204 determines the 90th percentile time consumption data of each external interface based on the production time consumption data of each external interface, and configures the response time of the baffle of the corresponding simulation node in the initial full-link stress test simulation model based on the 90th percentile time consumption data of each external interface to obtain the full-link stress test simulation model.

[0093] To ensure accurate simulation of external interfaces, the baffle must be configured with response times that match the actual production environment. This accurately simulates the response behavior of the external interface, ensures the stress testing environment closely matches actual production, and enhances the credibility and reference value of the stress testing results. Given the stability advantages of P90 (90th percentile) timing data, P90 timing data is preferred for baffle timing data. Specifically, comprehensive P90 timing data for requests to external interfaces during production ramp-up is collected and configured for the baffle. The 90th percentile timing data represents the value at the 90th percentile of a set of timing data, sorted from smallest to largest. This means that 90% of the timing data is below this value, and only 10% exceeds it.

[0094] Figure 3 A schematic diagram of the composition structure of the full-link stress testing device provided in an embodiment of the present application is shown.

[0095] refer to Figure 3 Based on the above-mentioned full-link stress testing method, an embodiment of the present application further provides a full-link stress testing device, which includes:

[0096] The collection module 301 is used to collect the business data of the target link in the production environment and the production time data of each node of the target link. The nodes include internal systems and external interfaces. The production time data includes interface call time, data processing time and communication time.

[0097] Construction module 302 is used to build a full-link stress testing simulation model for the target link in the stress testing environment based on business data, a production single-center standard, and production time data of each node. The production single-center standard is used to represent resource configuration data of the production environment.

[0098] The acquisition module 303 is used to perform stress testing on the target link based on multiple verification tasks and the full-link stress testing simulation model until the stress testing results meet the set conditions, obtain business indicator data and performance indicator data, and generate baseline data;

[0099] Calling module 304 is used to call the full-link stress test simulation model to perform stress testing on the updated target link if an update to the target link is detected, obtain the business indicator data and performance indicator data during the stress testing process, and generate stress testing results in combination with the baseline data. The stress testing results are used to show the business indicator data and performance indicator data during the stress testing process and the deviation of the business indicator data and performance indicator data during the stress testing process from the baseline data.

[0100] In one embodiment of the present application, the apparatus further includes: a receiving module, configured to receive a target task, perform stress testing on the target link based on the target task and the full-link stress testing simulation model, and collect target business indicator data and target performance indicator data during the stress testing process;

[0101] The comparison module is used to compare the target business indicator data and the target performance indicator data with the baseline data, and determine whether the target link can perform the target task based on the comparison results.

[0102] According to an embodiment of the present application, the present application also provides an electronic device and a readable storage medium.

[0103] Figure 4 A schematic block diagram of an example electronic device 400 that can be used to implement an embodiment of the present application is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital assistants, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present application described and / or claimed herein.

[0104] like Figure 4 As shown, device 400 includes a computing unit 401, which can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 402 or a computer program loaded from a storage unit 408 into a random access memory (RAM) 403. RAM 403 may also store various programs and data required for the operation of device 400. Computing unit 401, ROM 402, and RAM 403 are connected to each other via a bus 404. An input / output (I / O) interface 405 is also connected to bus 404.

[0105] Various components in device 400 are connected to I / O interface 405, including an input unit 406, such as a keyboard, mouse, etc.; an output unit 407, such as various types of displays, speakers, etc.; a storage unit 408, such as a magnetic disk, optical disk, etc.; and a communication unit 409, such as a network card, modem, wireless communication transceiver, etc. Communication unit 409 allows device 400 to exchange information / data with other devices via a computer network such as the Internet and / or various telecommunication networks.

[0106] Computing unit 401 can be any general-purpose and / or specialized processing component with processing and computing capabilities. Some examples of computing unit 401 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various specialized artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, digital signal processors (DSPs), and any suitable processors, controllers, microcontrollers, etc. Computing unit 401 performs the various methods and processes described above, such as the full-link stress testing method. For example, in some embodiments, the full-link stress testing method can be implemented as a computer software program tangibly embodied in a machine-readable medium, such as storage unit 408. In some embodiments, part or all of the computer program can be loaded and / or installed onto device 400 via ROM 402 and / or communication unit 409. When the computer program is loaded into RAM 403 and executed by computing unit 401, one or more steps of the full-link stress testing method described above can be performed. Alternatively, in other embodiments, computing unit 401 can be configured to perform the full-link stress testing method in any other suitable manner (e.g., via firmware).

[0107] Various embodiments of the systems and techniques described herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on a chip (SOCs), complex programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments can include being implemented in one or more computer programs that are executable and / or interpreted on a programmable system that includes at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0108] The program code for implementing the methods of the present application can be written in any combination of one or more programming languages. Such program code can be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that when the program code is executed by the processor or controller, the functions / operations specified in the flow charts and / or block diagrams are implemented. The program code can be executed entirely on the machine, partially on the machine, as a stand-alone software package, partially on the machine and partially on a remote machine, or entirely on a remote machine or server.

[0109] In the context of this application, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or apparatus. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of machine-readable storage media may include an electrical connection based on one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), optical fibers, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0110] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0111] The systems and techniques described herein can be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network (LAN), a wide area network (WAN), and the Internet.

[0112] A computer system may include a client and a server. The client and server are generally remote from each other and typically interact through a communication network. The client-server relationship arises through computer programs running on the respective computers and having a client-server relationship with each other. The server may be a cloud server, a server in a distributed system, or a server integrated with a blockchain.

[0113] It should be understood that the various forms of the processes shown above can be used to reorder, add, or delete steps. For example, the steps described in this disclosure can be performed in parallel, sequentially, or in a different order, as long as the desired results of the technical solutions disclosed in this application can be achieved. This is not a limitation herein.

[0114] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features being referred to. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. Throughout the description of this application, "plurality" means two or more, unless otherwise specifically defined.

[0115] The above description is merely a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.

Claims

1. A full-link stress testing method, characterized in that: The method comprises: Collect business data of the target link in the production environment and production time data of each node of the target link. The nodes include internal systems and external interfaces. The production time data includes interface call time, data processing time, and communication time. The target link is the user-specified golden link to be stress-tested or the user-specified golden link of the core business process to be tested, including the entire process nodes from front-end business triggering to back-end processing completion. In the stress testing environment, a full-link stress testing simulation model of the target link is constructed based on the business data, the production single-center standard, and the production time consumption data of each node. The production single-center standard is used to represent the resource configuration data of the production environment. Based on multiple verification tasks and the full-link stress testing simulation model, the target link is stress tested until the stress testing results meet the set conditions, business indicator data and performance indicator data are obtained, and baseline data is generated; If an update to the target link is detected, the full-link stress testing simulation model is called to perform a stress test on the updated target link, business indicator data and performance indicator data during the stress test are obtained, and a stress test result is generated in combination with the baseline data. The stress test result is used to show the business indicator data and performance indicator data during the stress test and the deviation of the business indicator data and performance indicator data during the stress test from the baseline data; Based on the business data, the production center standard, and the production time data of each node, a full-link stress test simulation model of the target link is constructed, including: Synchronize the business data collected in the production environment to the stress testing environment based on the desensitized data synchronization strategy. The desensitized data synchronization strategy includes ensuring that the deviation between the data level of the stress testing environment and the production environment is less than a set deviation threshold and synchronizing at a set period. In the stress testing environment, an initial full-link stress testing simulation model of the target link is constructed. The initial full-link stress testing simulation model includes simulation nodes for each node of the target link. The simulation nodes of the external interface are deployed with baffles, which are used to simulate the interface behavior and response time of the external interface. Configuring resources for the initial full-link stress testing simulation model based on the production single center standard; According to the production time consumption data of each external interface, the 90th percentile time consumption data of each external interface is determined, and according to the 90th percentile time consumption data of each external interface, the baffle configuration response time of the corresponding simulation node in the initial full-link stress testing simulation model is calculated to obtain the full-link stress testing simulation model.

2. The method according to claim 1, characterized in that The method further comprises: Receive a target task, perform stress testing on the target link based on the target task and the full-link stress testing simulation model, and collect target business indicator data and target performance indicator data during the stress testing process; The target service indicator data and the target performance indicator data are compared with the baseline data, and whether the target link can perform the target task is determined according to the comparison result.

3. The method according to claim 1, characterized in that The setting condition includes one of the following: The fluctuation of business indicators in consecutive set stress tests is less than the first set threshold and the fluctuation of performance indicators is less than the second set threshold; The fluctuation of the 95th percentile approval time in consecutive stress tests is less than the third set threshold.

4. The method according to claim 1, wherein The business indicator data includes the 95th percentile approval time, the number of limited queues, the number of abnormal applications, and the difference between upstream and downstream systems; The performance indicator data includes the number of link transactions per second and link performance.

5. The method according to claim 1, wherein If an update to the target link is detected, the full-link stress test simulation model is called to perform stress testing on the updated target link, business indicator data and performance indicator data during the stress testing process are obtained, and stress testing results are generated in combination with the baseline data, including: Detecting whether the target link is updated based on a continuous integration and continuous delivery mechanism; If the target link is updated, the full-link stress test simulation model is called to perform stress testing on the updated target link, and the business indicator data and performance indicator data during the stress testing process are obtained. In combination with the baseline data, a stress testing result is generated. The stress testing result is used to show the business indicator data and performance indicator data during the stress testing process and the deviation of the business indicator data and performance indicator data during the stress testing process from the baseline data.

6. A full-link stress testing device, characterized in that: The device comprises: The acquisition module is used to collect business data of the target link in the production environment and production time data of each node of the target link. The nodes include internal systems and external interfaces. The production time data includes interface call time, data processing time, and communication time. The target link is a user-specified golden link to be stress-tested or a user-specified golden link of a core business process to be tested, including nodes in the entire process from front-end business triggering to back-end processing completion. A construction module is configured to construct a full-link stress testing simulation model of the target link in a stress testing environment based on the business data, a production single-center standard, and production time consumption data of each node, wherein the production single-center standard is used to represent resource configuration data of the production environment; An acquisition module is used to perform stress testing on the target link based on multiple verification tasks and the full-link stress testing simulation model until the stress testing results meet the set conditions, obtain business indicator data and performance indicator data, and generate baseline data; a calling module configured to, if an update of the target link is detected, call the full-link stress testing simulation model to perform a stress test on the updated target link, obtain business indicator data and performance indicator data during the stress testing process, and generate a stress testing result in combination with the baseline data, wherein the stress testing result is used to show the business indicator data and performance indicator data during the stress testing process and the deviation of the business indicator data and performance indicator data during the stress testing process from the baseline data; The construction module builds a full-link stress testing simulation model of the target link based on the business data, the production single center standard, and the production time data of each node, including: Synchronize the business data collected in the production environment to the stress testing environment based on the desensitized data synchronization strategy. The desensitized data synchronization strategy includes ensuring that the deviation between the data level of the stress testing environment and the production environment is less than a set deviation threshold and synchronizing at a set period. In the stress testing environment, an initial full-link stress testing simulation model of the target link is constructed. The initial full-link stress testing simulation model includes simulation nodes for each node of the target link. The simulation nodes of the external interface are deployed with baffles, which are used to simulate the interface behavior and response time of the external interface. Configuring resources for the initial full-link stress testing simulation model based on the production single center standard; According to the production time consumption data of each external interface, the 90th percentile time consumption data of each external interface is determined, and according to the 90th percentile time consumption data of each external interface, the baffle configuration response time of the corresponding simulation node in the initial full-link stress testing simulation model is calculated to obtain the full-link stress testing simulation model.

7. The device according to claim 6, characterized in that The device further comprises: A receiving module is configured to receive a target task, perform stress testing on the target link based on the target task and the full-link stress testing simulation model, and collect target business indicator data and target performance indicator data during the stress testing process; A comparison module is used to compare the target business indicator data and the target performance indicator data with the baseline data, and determine whether the target link can perform the target task according to the comparison result.

8. An electronic device, characterized in that: include: at least one processor; as well as a memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method according to any one of claims 1 to 5.

9. A non-transitory computer-readable storage medium storing computer instructions, characterized in that: The computer instructions are used to enable a computer to execute the method according to any one of claims 1 to 5.

Images