Method, device, equipment and medium for stability testing of financial service system

Abstract

This application relates to the field of financial services technology, and particularly to a method, apparatus, device, and medium for stability testing of a financial services system. The method determines N target interfaces and their service requirements based on historical business service statistics over a preset period and all used interfaces. It then determines a service range for each service requirement, intersects all service ranges to obtain a service intersection range, adjusts the time base value of each node in the service link of the target interfaces to reflect the deviation, monitors the service performance of the target interfaces after each adjustment, and determines the steady-state value as the deviation value corresponding to the adjustment when the service performance just exceeds the service intersection range. Based on the steady-state value, the financial services system is tested. This method determines a safe range of stability based on system performance, thus preventing irreversible damage to the system during the introduction of chaos engineering blasting experiments, and ensuring a certain level of stability for the system service.

Description

Technical Field

[0001] This application relates to the field of financial services technology, and in particular to a method, apparatus, equipment and medium for testing the stability of a financial services system. Background Technology

[0002] Currently, the software-based transformation of information technology (IT) infrastructure has gradually become an industry consensus. With the development of cloud-native technologies, IT infrastructure software transformation has been implemented in a cloud-native model. The current industry-standard cloud-native construction solution uses the Kubernetes (K8S) ecosystem to build infrastructure that conforms to cloud-native standards. As business complexity increases, the microservice architecture design has become an irreversible trend.

[0003] The containerization of computing resources based on Kubernetes container orchestration environments, coupled with the microservices approach to software architecture, has fundamentally transformed the current IT service ecosystem: the basic ecosystem for software design, deployment, and stable operation. Containerization based on Kubernetes and microservices have become the de facto standard for the implementation of a significant portion of IT services. These changes have brought advantages such as improved software development efficiency, reduced total IT costs, higher resource utilization, and higher maintenance efficiency. However, since both Kubernetes and microservice architectures are based on distributed systems, the inherent characteristics of distributed systems, combined with the complexity of the software itself, have led to a sharp increase in the complexity of the final IT services. For IT maintenance personnel whose primary responsibility is to ensure service stability, it has become increasingly impossible to analyze and locate system weaknesses and bottlenecks through traditional methods such as system profiling and component analysis, in order to optimize the architecture, build high availability (HA), and prepare contingency plans to maintain, protect, and improve the resilience of the system, environment, and even the services. Therefore, this paper introduces chaos engineering theory, which aims to enhance the resilience of highly complex systems, to improve the resilience of systems and services in a container orchestration (Kubernetes) environment. The challenge in maximizing the effectiveness of chaos engineering lies in its application in a production environment. However, it is clearly unacceptable for chaos engineering to lead to service anomalies in a production environment, as the stability of production services is the ultimate goal, and such actions would negatively impact the implementation of chaos engineering. Therefore, how to assess system stability to ensure system security during chaos engineering practices and prevent system anomalies during testing becomes a pressing issue. Summary of the Invention

[0004] In view of this, embodiments of this application provide a method, apparatus, device, and medium for testing the stability of a financial service system, in order to assess the stability of the system, ensure the security of the system in chaos engineering practice, and prevent system anomalies during testing.

[0005] In a first aspect, embodiments of this application provide a stability testing method for a financial service system, the stability testing method comprising:

[0006] For all services of the financial service system, obtain historical business service statistics and all used interfaces within a preset period. Based on the business service statistics, determine N target interfaces from all used interfaces, where N is an integer greater than 1.

[0007] The service requirements of each target interface are determined from the business service statistics information. Based on each service requirement, the service scope of the corresponding target interface is determined. The intersection of all service scopes is obtained to obtain the service intersection range.

[0008] For any target interface, obtain the service link of the target interface, adjust the time base value of each node in the service link according to the deviation, monitor the service performance of the target interface after each deviation adjustment, and determine the deviation value of the corresponding deviation adjustment as the steady state value of the target interface based on the service performance and the service intersection range.

[0009] Iterate through all target interfaces to obtain the steady-state value corresponding to each target interface. Use all steady-state values ​​as the test threshold to perform stability testing on the financial service system and obtain the test results for the financial service system.

[0010] Secondly, embodiments of this application provide a stability testing device for a financial service system, the stability testing device comprising:

[0011] The target interface determination module is used to obtain historical business service statistics and all used interfaces for all services of the financial service system within a preset period, and determine N target interfaces from all used interfaces based on the business service statistics, where N is an integer greater than 1.

[0012] The service scope determination module is used to determine the service requirements of each target interface from the business service statistics information, determine the service scope of the corresponding target interface based on each service requirement, and find the intersection of all service scopes to obtain the service intersection scope.

[0013] The steady-state value determination module is used to obtain the service link of any target interface, adjust the deviation of the time base value of each node in the service link, monitor the service performance of the target interface after each deviation adjustment, and determine the deviation value of the corresponding deviation adjustment as the steady-state value of the target interface based on the service performance and the service intersection range.

[0014] The stability testing module is used to traverse all target interfaces, obtain the steady-state value corresponding to each target interface, and use all steady-state values ​​as the test threshold to perform stability testing on the financial service system, thereby obtaining the test results for the financial service system.

[0015] Thirdly, embodiments of this application provide a computer device, the computer device including a processor, a memory, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the stability testing method as described in the first aspect.

[0016] Fourthly, embodiments of this application provide a computer-readable storage medium storing a computer program that, when executed by a processor, implements the stability testing method as described in the first aspect.

[0017] The beneficial effects of this application embodiment compared with the prior art are as follows: This application acquires historical business service statistics and all used interfaces within a preset period for all services of the financial service system. Based on the business service statistics, N target interfaces are determined from all used interfaces. The service requirements of each target interface are determined from the business service statistics. Based on each service requirement, the service range of the corresponding target interface is determined. The intersection of all service ranges is obtained to obtain the service intersection range. For any target interface, the service link of the target interface is acquired. The time base value of each node in the service link is adjusted to avoid deviation. The service performance of the target interface is monitored after each deviation adjustment. Based on the service performance and the service intersection range, the deviation value of the corresponding deviation adjustment is determined as the steady-state value of the target interface. All target interfaces are traversed to obtain the steady-state value corresponding to each target interface. The stability test of the financial service system is performed using all steady-state values ​​as the test threshold to obtain the test results for the financial service system. This realizes the determination of the safe range of stability based on the system performance. Thus, in the process of introducing chaos engineering blasting experiments, irreversible damage to the system can be avoided, and the stability of the system service is guaranteed to a certain extent. Attached Figure Description

[0018] To more clearly illustrate the technical solutions in the embodiments of this application, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0019] Figure 1 This is a schematic diagram of an application environment for a stability testing method for a financial service system provided in Embodiment 1 of this application;

[0020] Figure 2 This is a flowchart illustrating a stability testing method for a financial service system provided in Embodiment 2 of this application;

[0021] Figure 3 This is a flowchart illustrating a stability testing method for a financial service system provided in Embodiment 3 of this application;

[0022] Figure 4 This is a schematic diagram of the structure of a stability testing device for a financial service system provided in Embodiment 4 of this application;

[0023] Figure 5 This is a schematic diagram of the structure of a computer device provided in Embodiment 5 of this application. Detailed Implementation

[0024] In the following description, specific details such as particular system architectures and techniques are set forth for illustrative purposes and not for limitation, in order to provide a thorough understanding of the embodiments of this application. However, those skilled in the art will understand that this application may also be implemented in other embodiments without these specific details. In other instances, detailed descriptions of well-known systems, apparatuses, circuits, and methods have been omitted so as not to obscure the description of this application with unnecessary detail.

[0025] It should be understood that, when used in this application specification and the appended claims, the term "comprising" indicates the presence of the described features, integrals, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, integrals, steps, operations, elements, components and / or a collection thereof.

[0026] It should also be understood that the term “and / or” as used in this application specification and the appended claims means any combination of one or more of the associated listed items and all possible combinations, and includes such combinations.

[0027] As used in this application specification and the appended claims, the term "if" may be interpreted, depending on the context, as "when," "once," "in response to determination," or "in response to detection." Similarly, the phrase "if determined" or "if detected [the described condition or event]" may be interpreted, depending on the context, as meaning "once determined," "in response to determination," "once detected [the described condition or event]," or "in response to detection [the described condition or event]."

[0028] Furthermore, in the description of this application and the appended claims, the terms "first," "second," "third," etc., are used only to distinguish descriptions and should not be construed as indicating or implying relative importance.

[0029] References to "one embodiment" or "some embodiments" as described in this specification mean that one or more embodiments of this application include a specific feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.

[0030] The embodiments of this application can acquire and process relevant data based on artificial intelligence technology. Artificial intelligence (AI) refers to the theories, methods, technologies, and application systems that use digital computers or machines controlled by digital computers to simulate, extend, and expand human intelligence, perceive the environment, acquire knowledge, and use that knowledge to obtain optimal results.

[0031] Foundational technologies for artificial intelligence generally include sensors, dedicated AI chips, cloud computing, distributed storage, big data processing, operating / interactive systems, and mechatronics. AI software technologies mainly encompass computer vision, robotics, biometrics, speech processing, natural language processing, and machine learning / deep learning.

[0032] It should be understood that the sequence number of each step in the following embodiments does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.

[0033] To illustrate the technical solution of this application, specific embodiments are described below.

[0034] The stability testing method for a financial service system provided in Embodiment 1 of this application can be applied to, for example, Figure 1 In this application environment, the client communicates with the server. Clients include, but are not limited to, handheld computers, desktop computers, laptops, ultra-mobile personal computers (UMPCs), netbooks, cloud computing devices, and personal digital assistants (PDAs). The server can be implemented using a standalone server or a server cluster consisting of multiple servers.

[0035] See Figure 2This is a flowchart illustrating a stability testing method for a financial service system provided in Embodiment 2 of this application. The stability testing method for the aforementioned financial service system is applied to... Figure 1 The server in this application is a computer device supporting the financial service system. The stability testing method retrieves relevant data from the financial service system during runtime. The client connects to the server, provides corresponding test requirements, and carries the test results output by the server. Figure 2 As shown, the stability testing method for this financial service system may include the following steps:

[0036] Step S201: For all services of the financial service system, obtain historical business service statistics and all used interfaces within a preset period. Based on the business service statistics, determine N target interfaces from all used interfaces.

[0037] In this application, a financial service system can refer to a system applied in financial scenarios that provides business services to users. This financial service system is configured with corresponding service interfaces, which can be called by client users to implement the corresponding services. These services include computational, querying, storage, and downloading processes tailored to different business needs. For example, a financial service system can refer to insurance underwriting systems and insurance claims systems in the insurance industry, or mobile banking systems and online banking systems in the banking industry.

[0038] For a financial service system that has already been delivered and put into use, the corresponding service items and service interfaces are fixed. Therefore, by analyzing the operation logs of the financial service system, we can obtain the corresponding service information, business information, interface information and other system operation information, which is also the source of business service statistics information.

[0039] The preset period is a statistical period, such as one month or one week. Within a preset historical period, relevant business service statistics and all interfaces used within that period can be obtained by analyzing historical logs. For example, by using service protocols and related system service interface protocols, one can find the business volume, peak business volume, and important interfaces for the relevant services.

[0040] This approach does not employ typical system performance evaluation methods. Instead, it extracts evaluation metrics from an external, holistic perspective. Due to the extreme complexity of system interactions within an orchestration environment, analysis becomes prohibitively costly or even impossible. Furthermore, services are more strongly correlated with user experience. To ensure service stability while allowing sufficient fluctuation range for internal metrics, it is necessary to identify key target interfaces from all used interfaces. Studying these target interfaces characterizes the entire system. For example, analyzing the interaction requirements of a financial services system, to ensure user experience and address related system interaction requirements, we can ultimately extract key service interfaces, key page loading status, and core transaction metrics.

[0041] Target interfaces can be selected by evaluating factors such as the service volume, the importance of the interface's working time, and the interface's level, thereby identifying some core and important interfaces.

[0042] Optionally, based on business service statistics, N target interfaces are determined from all used interfaces, including:

[0043] Based on business service statistics, determine the total business volume and the time corresponding to the business peak, as well as the service volume and service time corresponding to each interface among all the interfaces used;

[0044] Based on the time corresponding to the business peak and the service time corresponding to each interface, the interface whose service time matches the time corresponding to the business peak is determined as the first candidate interface;

[0045] Based on the service volume and total business volume corresponding to each interface, interfaces whose service volume ratio is greater than a preset ratio are identified as the second candidate interfaces.

[0046] The interface formed by the intersection of the first and second candidate interfaces is taken as the target interface.

[0047] Among them, by analyzing the business service statistics, the time corresponding to the total business volume and the business peak can be determined, which is the total data volume of the business served within the aforementioned historical preset period and the busiest time period. By comparing the service volume of an interface with the total data volume, the service volume ratio of that interface can be determined. By comparing the service time of an interface with the busiest time period, it can be determined whether the interface was used during the busy time period. Thus, interfaces with a high service volume ratio and interfaces that are working during the busiest time period can be identified.

[0048] An interface with a large existing service volume and operating during the busiest time period can be considered an important interface (i.e., a target interface). Of course, for interfaces that do not meet the above two conditions, other conditions can be considered to determine whether they can become target interfaces. The specific other conditions are set according to the requirements and will not be elaborated here.

[0049] Step S202: Determine the service requirements of each target interface from the business service statistics information, determine the service scope of the corresponding target interface based on each service requirement, and find the intersection of all service scopes to obtain the service intersection range.

[0050] In this application, the service requirements of each interface are also recorded in the business service statistics information. Accordingly, the service requirements of each target interface can be obtained. The service requirements can refer to at least one condition for completing a service. For example, for a VIP customer service interface set up for VIP customers, the requirement corresponding to this VIP customer service interface is that the customer must meet the VIP conditions. Specifically, the VIP condition is that the customer ID is in a preset table. When the customer sends information through the VIP customer service interface, the customer ID is used as the trigger. If the VIP condition is met, the service can be used.

[0051] Because of the existence of conditions, each interface has its own service scope, which is the scope limited by the conditions. For example, the VIP customer service interface set up for VIP customers has the service scope of VIP customers.

[0052] After determining the service scope of all target interfaces, the intersection of all service scopes is calculated to obtain the service intersection range. This means that within this service intersection range, all target interfaces can provide the corresponding services. During this process, for services within the service intersection range, there will be no situation where a target interface completes other services due to deviation from the baseline. This avoids, to a certain extent, the situation where an interface completes other services due to deviation and is therefore considered normal. For example, if the service intersection range of several target interfaces is service 1, service 2, and service 3, and the target interface can complete service 4 due to deviation of its parameters, but because it does not fall within the service intersection range, the target interface should be considered abnormal, not normal.

[0053] Step S203: For any target interface, obtain the service link of the target interface, adjust the time base value of each node in the service link according to the deviation, monitor the service performance of the target interface after each deviation adjustment, and determine the deviation value of the corresponding deviation adjustment as the steady state value of the target interface based on the service performance and the service intersection range.

[0054] In this application, each target interface follows its own service link, which is a process line composed of various process points. Each process point can be used as a node. Each node has an execution time, and each node has its own execution time base value when configured. Changing the time base value of a node means that the execution time of that node is based on the changed time base value.

[0055] For example, for a node, the original time base value is 10s. At this time, the node uses 10s as the base when executing. If the time base value is changed to 12s, the deviation adjustment is 2s (i.e., the deviation value). At this time, the node uses 12s as the base when executing.

[0056] Service performance refers to whether the target interface implements a certain service. If service 1 is implemented after calling the target interface, the corresponding service performance record will show that service 1 has been implemented. If service 1 is not implemented, service 1 will not be recorded in the corresponding service performance.

[0057] The service intersection range includes at least one service. If the service performance obtained after deviation adjustment exceeds the service intersection range, it indicates that the service deviation of the target interface is large, and the deviation value corresponding to the deviation adjustment exceeds the stability of the system. Based on the service performance and the service intersection range, a deviation value under critical conditions can be determined. At this time, if the target interface exceeds this deviation value, the service performance will exceed the service intersection range. However, within this deviation value, the system is stable, and the service performance will not exceed the service intersection range.

[0058] Optionally, after obtaining the service link of the target interface, the following may also be included:

[0059] Identify each process point in the service chain, and select the main process point as a node from each process point;

[0060] The execution time of each node within a preset period is determined from the business service statistics.

[0061] Based on the execution time of each execution for each node, the average execution time of the corresponding node within a preset period is calculated, and the average execution time is used as the time benchmark value.

[0062] Among them, the main process points, namely the main process points, are selected from all process points in the service chain as nodes. For each node, the execution time of each execution within a preset period is obtained, and the average execution time within the preset period is used as the time benchmark value.

[0063] Step S204: Traverse all target interfaces to obtain the steady-state value corresponding to each target interface. Use all steady-state values ​​as the test threshold to perform stability testing on the financial service system and obtain the test results for the financial service system.

[0064] In this application, each target interface in the system has its own steady-state value. The steady-state values ​​of all target interfaces constitute a set of steady-state values ​​that ensure the overall stability of the financial service system.

[0065] Using this set of steady-state values ​​as the test threshold, the financial service system is configured with parameters corresponding to the target interface. Appropriate testing methods are then used to conduct stability tests on the financial service system, and the corresponding test results are obtained. The testing methods include chaos engineering brute-force testing. Based on the test threshold obtained in this application, the parameters of the target interface modified in the chaos engineering brute-force test are limited to within the test threshold. This avoids situations where exceeding the test threshold would cause damage to the system and significant service errors.

[0066] In certain situations, where chaos engineering often requires a minimum explosion radius as a safety measure, if the minimum explosion radius cannot be obtained for some reason, it is generally because the set of indicators involved is too complex when analyzing the potential hazards or blast points, or the implementation target is a system service that has been in operation for some time. In such cases, the minimum explosion radius indicator may not be obtainable. Alternatively, for systems with particularly high stability requirements, steady-state indicators need to be used simultaneously to ensure system stability. Overall, the confirmation of steady-state indicators strongly guarantees the implementation of chaos engineering.

[0067] Optionally, after traversing all target interfaces and obtaining the steady-state value corresponding to each target interface, the process also includes:

[0068] The steady-state value of each target interface is used as the alarm threshold for the corresponding target interface in the monitoring system.

[0069] When the monitoring system detects that the deviation information of a target interface exceeds the alarm threshold of the corresponding interface, an alarm prompt is generated.

[0070] Among them, the steady-state value can also be used as a monitoring parameter for monitoring the financial service system. That is, the steady-state value of each target interface is used as the alarm threshold of the corresponding target interface. The real-time execution time of each target interface is monitored in real time during normal operation of the financial service system. The real-time execution time is calculated with the time base value to obtain the deviation information. If the deviation information exceeds the alarm threshold, it indicates that the real-time execution time is too long and there is an abnormality in operation. Therefore, an alarm can be generated to prompt the management personnel to investigate the financial service system.

[0071] This application embodiment targets all services of a financial service system. It acquires historical business service statistics and all used interfaces within a preset period. Based on the business service statistics, N target interfaces are determined from all used interfaces. The service requirements for each target interface are determined from the business service statistics. Based on each service requirement, the service scope of the corresponding target interface is determined. The intersection of all service scopes is obtained to obtain the service intersection range. For any target interface, the service link of the target interface is obtained. The time base value of each node in the service link is adjusted to avoid deviation. The service performance of the target interface is monitored after each adjustment. Based on the service performance and the service intersection range, the deviation value corresponding to the adjustment is determined as the steady-state value of the target interface. All target interfaces are traversed to obtain the steady-state value corresponding to each target interface. All steady-state values ​​are used as test thresholds to conduct stability tests on the financial service system, obtaining test results for the financial service system. This achieves the determination of a safe range of stability based on system performance, thereby avoiding irreversible damage to the system during the introduction of chaos engineering blasting experiments, and ensuring a certain level of stability for the system services.

[0072] See Figure 3 This is a flowchart illustrating a stability testing method for a financial service system provided in Embodiment 3 of this application. Figure 3 As shown, the stability testing method for this financial service system may include the following steps:

[0073] Step S301: For all services of the financial service system, obtain historical business service statistics and all used interfaces within a preset period. Based on the business service statistics, determine N target interfaces from all used interfaces.

[0074] Step S302: Determine the service requirements of each target interface from the business service statistics information, determine the service scope of the corresponding target interface based on each service requirement, and find the intersection of all service scopes to obtain the service intersection range.

[0075] Step S303: For any target interface, obtain the service link of the target interface, adjust the time base value of each node in the service link according to the deviation, monitor the service performance of the target interface after each deviation adjustment, and determine the deviation value of the corresponding deviation adjustment as the steady state value of the target interface based on the service performance and the service intersection range.

[0076] Step S304: Traverse all target interfaces to obtain the steady-state value corresponding to each target interface. Use all steady-state values ​​as the test threshold to perform stability testing on the financial service system and obtain the test results for the financial service system.

[0077] The contents of steps S301 to S304 are partially the same as those of steps S201 to S204 above. Please refer to the description of steps S201 to S204 for details. They will not be repeated here.

[0078] Step S305: Monitor the execution time of each target interface during the test.

[0079] In this application, the execution time of the configuration of each target interface during testing is monitored. Specifically, the configuration operation of each target interface during testing is monitored, and the execution time of the configured target interface is obtained after each configuration operation is completed.

[0080] Step S306: When the change in execution time exceeds the test threshold, control the stop of the stability test.

[0081] For any given testing method, the execution time of each target interface is monitored, including the original execution time and the modified execution time. If the difference between the modified execution time and the original execution time exceeds the test threshold (i.e., the corresponding deviation value), the stability test is stopped, which can effectively prevent the stability of the system from being compromised.

[0082] Optionally, deviation adjustments are made to the time base value of each node in the service chain, and the service performance of the target interface is monitored after each deviation adjustment. Based on the service performance and the service intersection range, the deviation value corresponding to the deviation adjustment is determined to be the steady-state value of the target interface, including:

[0083] Obtain the time base value of each node in the service link. For any node, calculate the deviation value of the node's time base value according to a preset deviation ratio to obtain the node's deviation value.

[0084] Based on the node's time base value and deviation value, determine the node's deviation execution time, adjust the node's original execution time according to the deviation execution time, and traverse all nodes;

[0085] Monitor the service performance of the target interface after this deviation adjustment, and detect whether the service performance exceeds the service intersection range. If the service performance exceeds the service intersection range, determine the corresponding deviation value as the steady-state value of the target interface.

[0086] If the service performance is found to be within the service intersection range, the deviation value is increased, and the process returns to the step of determining the deviation execution time of the node based on the node's time base value and the deviation value, until the service performance is found to be outside the service intersection range.

[0087] For each node, its time base value is deviated from the target time, resulting in a deviation value. For example, if the preset deviation ratio is 10%, the deviation value is the time base value * 10%, and the corresponding deviation execution time is the time base value * (1 + 10%). The original execution time of the node is then adjusted using the deviation execution time, and testing is performed to obtain the service performance of the target interface after the test. If the service performance does not exceed the service intersection range, the deviation value needs to be increased, i.e., a larger deviation ratio is used to adjust the time base value, thereby adjusting the node's execution time. This process of adjusting the deviation and testing is repeated until the obtained service performance exceeds the service intersection range.

[0088] The deviation value is adjusted incrementally from small to large until the service performance exceeds the service overlap range. This process requires certain requirements on the step size of each adjustment to prevent excessive adjustment, and at the same time, the number of adjustments should be minimized.

[0089] Optionally, if service performance is detected to exceed the service intersection range, the deviation value is determined to be the steady-state value of the target interface, including:

[0090] If the service performance is detected to be outside the service intersection range, the deviation value of all nodes is halved to obtain the halved deviation value of the corresponding node.

[0091] The halved deviation value of each node is used as the deviation value of the corresponding node. The process of determining the deviation execution time of the node based on the node's time base value and deviation value is repeated until the service performance is detected to exceed the service intersection range. The corresponding deviation value is then determined to be the steady-state value of the target interface.

[0092] In order to prevent excessive adjustment, the number of adjustments should be minimized. When the deviation value after each adjustment causes the service performance to exceed the service intersection range, the adjusted deviation value is halved, and the deviation value is adjusted again in a progressive manner from small to large until the deviation value approaches a stable critical value. The corresponding deviation value at this time is the steady state value.

[0093] This application embodiment targets all services of a financial service system. It acquires historical business service statistics and all used interfaces within a preset period. Based on the business service statistics, N target interfaces are determined from all used interfaces. The service requirements for each target interface are determined from the business service statistics. Based on each service requirement, the service scope of the corresponding target interface is determined. The intersection of all service scopes is obtained to obtain the service intersection range. For any target interface, the service link of the target interface is obtained. The time base value of each node in the service link is adjusted to avoid deviation. The service performance of the target interface is monitored after each adjustment. Based on the service performance and the service intersection range, the deviation value corresponding to the adjustment is determined as the steady-state value of the target interface. All target interfaces are traversed to obtain the steady-state value corresponding to each target interface. The stability test of the financial service system is performed using all steady-state values ​​as the test threshold, obtaining the test results for the financial service system. The execution time of each target interface is monitored during the test. When the change in execution time exceeds the test threshold, the stability test is stopped. This achieves the determination of a safe range of stability based on system performance, thereby avoiding irreversible damage to the system during the introduction of chaos engineering blasting experiments, ensuring a certain level of stability for the system services.

[0094] Corresponding to the stability testing method of the financial service system in the above embodiment, Figure 4 This paper shows a structural block diagram of a stability testing device for a financial service system provided in Embodiment 4 of this application. The stability testing device is applied to... Figure 1 The server in this application is a computer device supporting the financial service system. The stability testing method retrieves relevant data from the financial service system during runtime. The client connects to the server, provides corresponding test requirements, and carries the test results output by the server. For ease of explanation, only the parts relevant to the embodiments of this application are shown.

[0095] See Figure 4 The stability testing device includes:

[0096] The target interface determination module 41 is used to obtain historical business service statistics and all used interfaces for all services of the financial service system within a preset period, and determine N target interfaces from all used interfaces based on the business service statistics, where N is an integer greater than 1.

[0097] The service scope determination module 42 is used to determine the service requirements of each target interface from the business service statistics information, determine the service scope of the corresponding target interface based on each service requirement, and find the intersection of all service scopes to obtain the service intersection scope.

[0098] The steady-state value determination module 43 is used to obtain the service link of any target interface, adjust the deviation of the time base value of each node in the service link, monitor the service performance of the target interface after each deviation adjustment, and determine the deviation value of the corresponding deviation adjustment as the steady-state value of the target interface based on the service performance and the service intersection range.

[0099] The stability testing module 44 is used to traverse all target interfaces, obtain the steady-state value corresponding to each target interface, and use all steady-state values ​​as the test threshold to perform stability testing on the financial service system, and obtain the test results for the financial service system.

[0100] Optionally, the stability testing device also includes:

[0101] The execution time monitoring module is used to monitor the execution time of each target interface during the test after the financial service system has been tested with all steady-state values ​​as the test threshold.

[0102] The test control module is used to stop the stability test when the change in execution time exceeds the test threshold.

[0103] Optionally, the target interface determination module 41 includes:

[0104] The service information determination unit is used to determine the total business volume and the time corresponding to the business peak based on the business service statistics information, as well as the service volume and service time corresponding to each interface among all the interfaces used.

[0105] The first candidate interface determination unit is used to determine the interface whose service time matches the time corresponding to the business peak as the first candidate interface based on the time corresponding to the business peak and the service time corresponding to each interface.

[0106] The second candidate interface determination unit is used to determine the interface whose service volume ratio is greater than a preset ratio as the second candidate interface based on the service volume and total business volume corresponding to each interface.

[0107] The target interface determination unit is used to determine the intersection interface of the first candidate interface and the second candidate interface as the target interface.

[0108] Optionally, the stability testing device also includes:

[0109] The node determination module is used to determine each process point in the service link after obtaining the service link of the target interface, and to select the main process point as the node from each process point.

[0110] The historical execution time determination module is used to determine the execution time of each node for each execution within a preset period from the business service statistics information;

[0111] The time baseline value determination module is used to calculate the average execution time of the corresponding node within a preset period based on the execution time of each execution for each node, and use the average execution time as the time baseline value.

[0112] Optionally, the steady-state value determination module 43 includes:

[0113] The deviation value determination unit is used to obtain the time base value of each node in the service link. For any node, the deviation value of the node's time base value is calculated according to a preset deviation ratio to obtain the deviation value of the node.

[0114] The deviation time determination unit is used to determine the deviation execution time of a node based on its time base value and deviation value, adjust the original execution time of the node according to the deviation execution time, and traverse all nodes.

[0115] The service performance monitoring unit is used to monitor the service performance of the target interface after the deviation adjustment, detect whether the service performance exceeds the service intersection range, and if the service performance exceeds the service intersection range, determine the corresponding deviation value as the steady state value of the target interface.

[0116] The loop execution unit is used to increase the deviation value if the service performance is detected to be within the service intersection range, and return to the execution step of determining the deviation execution time of the node based on the node's time base value and the deviation value, until the service performance is detected to be outside the service intersection range.

[0117] Optionally, the service performance monitoring unit includes:

[0118] The deviation value optimization subunit is used to halve the deviation value of all nodes if the service performance is detected to be outside the service intersection range, so as to obtain the halved deviation value of the corresponding node.

[0119] The loop execution subunit is used to take the halved deviation value of each node as the deviation value of the corresponding node, and return to execute the step of determining the deviation execution time of the node based on the node's time base value and deviation value, until the service performance is detected to exceed the service intersection range, and the corresponding deviation value is determined to be the steady state value of the target interface.

[0120] Optionally, the stability testing device also includes:

[0121] The monitoring system configuration module is used to traverse all target interfaces, obtain the steady-state value corresponding to each target interface, and then use the steady-state value of each target interface as the alarm threshold of the corresponding target interface in the monitoring system.

[0122] The alarm module is used to generate an alarm prompt when the monitoring system detects that the deviation information of a target interface exceeds the alarm threshold of the corresponding interface.

[0123] It should be noted that the information interaction and execution process between the above modules are based on the same concept as the method embodiments of this application. For details on their specific functions and technical effects, please refer to the method embodiments section, which will not be repeated here.

[0124] Figure 5 This is a schematic diagram of the structure of a computer device provided in Embodiment 5 of this application. Figure 5 As shown, the computer device of this embodiment includes: at least one processor ( Figure 5 Only one is shown in the diagram), a memory, and a computer program stored in the memory and capable of running on at least one processor. When the processor executes the computer program, it implements the steps in the embodiments of the stability testing methods for any of the above-described financial services systems.

[0125] This computer device may include, but is not limited to, a processor and memory. Those skilled in the art will understand that... Figure 5 The examples of computer devices are merely examples and do not constitute a limitation on computer devices. Computer devices may include more or fewer components than shown in the illustration, or combinations of certain components, or different components, such as network interfaces, displays, and input devices.

[0126] The processor referred to can be a CPU, but it can also be other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor can be a microprocessor or any conventional processor.

[0127] Memory includes readable storage media, internal memory, etc., wherein internal memory can be the RAM of a computer device, providing an environment for the operation of the operating system and computer-readable instructions stored in the readable storage media. The readable storage media can be the hard drive of a computer device, or in other embodiments, it can be an external storage device of the computer device, such as a plug-in hard drive, Smart Media Card (SMC), Secure Digital (SD) card, or Flash Card. Furthermore, memory can include both internal storage units and external storage devices of a computer device. Memory is used to store the operating system, applications, bootloader, data, and other programs, such as program code for computer programs. Memory can also be used to temporarily store data that has been output or will be output.

[0128] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the above-described division of functional units and modules is used as an example. In practical applications, the above functions can be assigned to different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiments can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit. Furthermore, the specific names of the functional units and modules are only for easy differentiation and are not intended to limit the scope of protection of this application. The specific working process of the units and modules in the above device can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here. If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, all or part of the processes in the methods of the above embodiments of this application can be implemented by a computer program instructing related hardware. The computer program can be stored in a computer-readable storage medium, and when executed by a processor, it can implement the steps of the above method embodiments. The computer program includes computer program code, which can be in the form of source code, object code, executable files, or certain intermediate forms. A computer-readable medium can include at least: any entity or device capable of carrying computer program code, a recording medium, a computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signals, telecommunication signals, and software distribution media. Examples include USB flash drives, portable hard drives, magnetic disks, or optical disks. In some jurisdictions, according to legislation and patent practice, computer-readable media cannot be electrical carrier signals or telecommunication signals.

[0129] The implementation of all or part of the processes in the methods of the above embodiments can also be accomplished by a computer program product. When the computer program product is run on a computer device, it enables the computer device to execute the steps in the above method embodiments.

[0130] In the above embodiments, the descriptions of each embodiment have different focuses. For parts that are not described in detail or recorded in a certain embodiment, please refer to the relevant descriptions of other embodiments.

[0131] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0132] In the embodiments provided in this application, it should be understood that the disclosed apparatus / computer devices and methods can be implemented in other ways. For example, the apparatus / computer device embodiments described above are merely illustrative. For instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.

[0133] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment, depending on actual needs.

[0134] The above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application, and should all be included within the protection scope of this application.

Claims

1. A stability testing method for a financial service system, characterized in that, The stability testing method includes: For all services of the financial service system, obtain historical business service statistics and all used interfaces within a preset period. Based on the business service statistics, determine N target interfaces from all used interfaces, where N is an integer greater than 1. The service requirements of each target interface are determined from the business service statistics information. Based on each service requirement, the service scope of the corresponding target interface is determined. The intersection of all service scopes is obtained to obtain the service intersection range. For any target interface, obtain the service link of the target interface, adjust the time base value of each node in the service link according to the deviation, monitor the service performance of the target interface after each deviation adjustment, and determine the deviation value of the corresponding deviation adjustment as the steady state value of the target interface based on the service performance and the service intersection range. Traverse all target interfaces to obtain the steady-state value corresponding to each target interface. Use all steady-state values ​​as the test threshold to perform stability testing on the financial service system and obtain the test results for the financial service system. The time base value of each node in the service link is adjusted for deviation. The service performance of the target interface is monitored after each deviation adjustment. Based on the service performance and the service intersection range, the deviation value corresponding to the deviation adjustment is determined to be the steady-state value of the target interface, including: Obtain the time base value of each node in the service link, and for any node, calculate the deviation value of the time base value of the node according to a preset deviation ratio to obtain the deviation value of the node. Based on the time base value and deviation value of the node, determine the deviation execution time of the node, adjust the original execution time of the node according to the deviation execution time, and traverse all nodes; Monitor the service performance of the target interface after this deviation adjustment, and detect whether the service performance exceeds the service intersection range. If the service performance exceeds the service intersection range, determine the corresponding deviation value as the steady-state value of the target interface. If the service performance is detected to be within the service intersection range, the deviation value is increased incrementally from small to large. The process then returns to the step of determining the deviation execution time of the node based on the node's time base value and the deviation value, until the service performance is detected to be outside the service intersection range.

2. The stability testing method according to claim 1, characterized in that, After performing stability tests on the financial service system using all steady-state values ​​as test thresholds, the following steps are also included: Monitor the execution time of each target interface during testing; When the change in execution time exceeds the test threshold, the stability test is stopped.

3. The stability testing method according to claim 2, characterized in that, Based on the aforementioned business service statistics, N target interfaces are determined from all used interfaces, including: Based on the business service statistics, determine the total business volume and the time corresponding to the business peak, as well as the service volume and service time corresponding to each interface among all the interfaces used. Based on the time corresponding to the business peak and the service time corresponding to each interface, the interface whose service time matches the time corresponding to the business peak is determined as the first candidate interface; Based on the service volume corresponding to each interface and the total business volume, interfaces whose service volume ratio is greater than a preset ratio are determined as the second candidate interfaces. The interface formed by the intersection of the first candidate interface and the second candidate interface is taken as the target interface.

4. The stability testing method according to claim 1, characterized in that, After obtaining the service link of the target interface, the process also includes: Identify each process point in the service chain, and select the main process point as a node from each process point; The execution time of each node within the preset period is determined from the business service statistics. Based on the execution time of each execution for each node, the average execution time of the corresponding node within the preset period is calculated, and the average execution time is used as the time reference value.

5. The stability testing method according to claim 1, characterized in that, If the service performance is detected to exceed the service intersection range, then the deviation value is determined to be the steady-state value of the target interface, including: If the service performance is detected to be outside the service intersection range, the deviation value of all nodes is halved to obtain the halved deviation value of the corresponding node. The halved deviation value of each node is used as the deviation value of the corresponding node. The process of determining the deviation execution time of the node based on the time base value and the deviation value is repeated until the service performance is detected to exceed the service intersection range. The corresponding deviation value is then determined to be the steady-state value of the target interface.

6. The stability testing method according to any one of claims 1 to 5, characterized in that, After traversing all target interfaces and obtaining the steady-state value corresponding to each target interface, the process also includes: The steady-state value of each target interface is used as the alarm threshold for the corresponding target interface in the monitoring system. When the monitoring system detects that the deviation information of a target interface exceeds the alarm threshold of the corresponding interface, an alarm prompt is generated.

7. A stability testing device for a financial service system, characterized in that, The stability testing device includes: The target interface determination module is used to obtain historical business service statistics and all used interfaces for all services of the financial service system within a preset period, and determine N target interfaces from all used interfaces based on the business service statistics, where N is an integer greater than 1. The service scope determination module is used to determine the service requirements of each target interface from the business service statistics information, determine the service scope of the corresponding target interface based on each service requirement, and find the intersection of all service scopes to obtain the service intersection scope. The steady-state value determination module is used to obtain the service link of any target interface, adjust the deviation of the time base value of each node in the service link, monitor the service performance of the target interface after each deviation adjustment, and determine the deviation value of the corresponding deviation adjustment as the steady-state value of the target interface based on the service performance and the service intersection range. The stability testing module is used to traverse all target interfaces, obtain the steady-state value corresponding to each target interface, and use all steady-state values ​​as the test threshold to perform stability testing on the financial service system, and obtain the test results for the financial service system. The steady-state value determination module includes: The deviation value determination unit is used to obtain the time base value of each node in the service link, and for any node, calculate the deviation value of the time base value of the node by a preset deviation ratio to obtain the deviation value of the node. The deviation time determination unit is used to determine the deviation execution time of the node based on the time base value and the deviation value of the node, adjust the original execution time of the node based on the deviation execution time, and traverse all nodes; The service performance monitoring unit is used to monitor the service performance of the target interface after the deviation adjustment, detect whether the service performance exceeds the service intersection range, and if the service performance exceeds the service intersection range, determine the corresponding deviation value as the steady-state value of the target interface. The loop execution unit is used to, if it is detected that the service performance does not exceed the service intersection range, increase the deviation value in ascending order, return to execute the step of determining the deviation execution time of the node based on the time base value and the deviation value of the node, until it is detected that the service performance exceeds the service intersection range.

8. A computer device, characterized in that, The computer device includes a processor, a memory, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the stability testing method as described in any one of claims 1 to 6.

9. A computer-readable storage medium storing a computer program, characterized in that, When the computer program is executed by the processor, it implements the stability testing method as described in any one of claims 1 to 6.

Images