Impact assessment method, device, equipment and medium for financial platform testing

Abstract

The present application is applicable to the field of financial services technology, and in particular relates to a method, device, equipment and medium for evaluating the impact of financial platform testing. The method analyzes the service components of the financial platform, determines a set of affected objects, performs blasting tests on N service components, monitors the fluctuation of steady-state indicators and the working status of all objects in the affected object set, and repeats the blasting test by increasing the initial blasting duration until any object in the affected object set fails or the fluctuation of the steady-state indicator meets the preset conditions, then stops the blasting test, determines the initial blasting duration when the blasting test is stopped as the evaluation result of the test impact, and realizes the evaluation of the blasting duration. In the process of introducing chaos engineering to conduct blasting experiments, the evaluation results are used as a basis to avoid irreversible damage to the platform, so that the stability of the platform is guaranteed to a certain extent.

Description

Technical Field

[0001] The present application is applicable to the field of financial services technology, and in particular relates to a method, apparatus, device, and medium for evaluating the impact of financial platform testing. Background Art

[0002] The softwareization of information technology (IT) infrastructure has become an industry consensus. With the development of cloud native, IT infrastructure softwareization has also been implemented in a cloud native model. The current industry-wide, de facto, standard cloud native solution is to build cloud native-compliant infrastructure using the Kubernetes (K8S) ecosystem. As business complexity increases, the microservices-based design of software architectures has become an irreversible trend.

[0003] The containerization of computing resources based on the K8S container orchestration environment and the microservices of software architecture design have completely changed the current IT services: the basic ecology of software design, construction and deployment, and stable operation. The K8S-based containerization and the microservices of software have actually become the de facto standard for the implementation of a considerable number of IT services. The above changes have brought about the advantages of improved software development efficiency, reduced total IT costs, higher resource utilization, and higher post-maintenance efficiency. However, since K8S and microservice architectures are both based on distributed systems, the inherent characteristics of distributed systems and the complexity of the software itself have led to a sharp increase in the complexity of IT services. For IT maintenance personnel whose primary responsibility is to ensure the stability of services, if they still use traditional system combing, component analysis and other methods to analyze and locate the weaknesses and bottlenecks of the system, and then optimize the architecture, build HA, and prepare emergency plans to maintain, ensure and improve the resilience of the system, environment and even services, it has become an increasingly impossible task. Therefore, we introduce chaos engineering theory, which aims to improve the resilience of highly complex systems, to enhance the resilience of systems and services in container orchestration (Kubernetes) environments. The challenge in maximizing the effectiveness of chaos engineering lies in applying it in a production environment. However, applying chaos engineering in a production environment and ultimately causing external service anomalies is clearly unacceptable. The ultimate goal is stability in production services, and this can negatively impact the implementation of chaos engineering. Therefore, assessing the impact of chaos engineering testing on financial platforms to guide proactive platform security measures and prevent irreversible damage from chaos engineering testing has become a pressing issue. Summary of the Invention

[0004] In view of this, the embodiments of the present application provide a method, device, equipment and medium for evaluating the impact of chaos engineering testing on financial platforms, so as to evaluate the impact of chaos engineering testing on financial platforms, guide the platform security protection work in advance, and prevent chaos engineering testing from causing irreversible damage to the platform.

[0005] In a first aspect, an embodiment of the present application provides an impact assessment method for a financial platform test, the impact assessment method comprising:

[0006] Determining N service components from the financial platform, determining theoretical problems corresponding to failures from configuration information of the N service components, and determining actual problems corresponding to failures of the N service components from historical operating data of the financial platform, where N is an integer greater than zero;

[0007] For any service component, based on theoretical and practical issues of the service component, determine the service impact object corresponding to the service component, traverse all service components, and calculate the union of the service impact objects of all service components to obtain the impact object set;

[0008] Obtaining steady-state indicators and initial burst duration of the financial platform, performing burst tests on the N service components based on the initial burst duration, and monitoring fluctuations in the steady-state indicators and the working status of all objects in the affected object set;

[0009] If no failure is detected in any object in the set of affected objects and the fluctuation of the steady-state indicator does not meet the preset condition, the initial blasting duration is increased to obtain an increased blasting duration, and the increased blasting duration is used as the initial blasting duration;

[0010] Return to the step of performing a blasting test on the N service components based on the initial blasting duration, and stop the blasting test when a fault is detected in any object in the set of affected objects or the fluctuation of the steady-state indicator meets the preset conditions. The initial blasting duration when the blasting test is stopped is determined as the evaluation result of the test impact degree.

[0011] In a second aspect, an embodiment of the present application provides an impact assessment device for a financial platform test, the impact assessment device comprising:

[0012] a component and problem determination module, configured to determine N service components from the financial platform, determine theoretical problems corresponding to failures from configuration information of the N service components, and determine actual problems corresponding to failures of the N service components from historical operating data of the financial platform, where N is an integer greater than zero;

[0013] An impact object determination module is used to determine, for any service component, the service impact objects corresponding to the service component based on theoretical and practical issues of the service component, traverse all service components, and calculate the union of the service impact objects of all service components to obtain an impact object set;

[0014] A burst test module, configured to obtain steady-state indicators and an initial burst duration of the financial platform, perform burst tests on the N service components based on the initial burst duration, and monitor fluctuations in the steady-state indicators and the working status of all objects in the affected object set;

[0015] a blasting duration adjustment module, configured to increase the initial blasting duration to obtain an increased blasting duration if no fault is detected in any object in the set of influencing objects and the fluctuation of the steady-state indicator does not meet a preset condition, and use the increased blasting duration as the initial blasting duration;

[0016] The impact degree assessment module is used to return to the step of performing a blasting test on the N service components based on the initial blasting duration, and stop the blasting test when a fault is detected in any object in the set of affected objects or the fluctuation of the steady-state indicator meets the preset conditions, and determine the initial blasting duration when the blasting test is stopped as the assessment result of the test impact degree.

[0017] In a third aspect, an embodiment of the present application provides a computer device, comprising a processor, a memory, and a computer program stored in the memory and executable on the processor, wherein the processor implements the impact assessment method described in the first aspect when executing the computer program.

[0018] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the impact degree assessment method as described in the first aspect is implemented.

[0019] Compared with the prior art, the embodiments of the present application have the following beneficial effects: the present application determines N service components from the financial platform, determines the theoretical problems corresponding to the failure from the configuration information of the N service components, determines the actual problems corresponding to the N service components when the failure occurs from the historical operation data of the financial platform, and for any service component, determines the service impact object of the corresponding service component based on the theoretical problems and actual problems of the service component, traverses all service components, calculates the union of the service impact objects of all service components, obtains the impact object set, obtains the steady-state index and initial blasting duration of the financial platform, and performs blasting tests on the N service components based on the initial blasting duration to monitor the fluctuation of the steady-state index and the impact of all objects in the object set. In the working state, if no failure of any object in the affected object set is detected and the fluctuation of the steady-state indicator does not meet the preset conditions, the initial blasting duration is increased to obtain the increased blasting duration. The increased blasting duration is used as the initial blasting duration, and the execution is returned to the step of performing blasting tests on N service components based on the initial blasting duration until a failure of any object in the affected object set is detected or the fluctuation of the steady-state indicator meets the preset conditions. The blasting test is stopped, and the initial blasting duration when the blasting test is stopped is determined as the evaluation result of the test impact degree, thereby realizing the evaluation of the blasting duration. In the process of introducing chaos engineering to conduct blasting experiments, the evaluation results are used as a basis to avoid irreversible damage to the platform, so that the stability of the platform is guaranteed to a certain extent. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the embodiments or descriptions of the prior art. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0021] Figure 1 This is a schematic diagram of an application environment for an impact assessment method for financial platform testing provided in Example 1 of the present application;

[0022] Figure 2 This is a flow chart of a method for assessing the impact of a financial platform test provided in Example 2 of the present application;

[0023] Figure 3 This is a flowchart of a method for evaluating the impact of a financial platform test provided in Example 3 of the present application;

[0024] Figure 4 This is a schematic diagram of the structure of an impact assessment device for a financial platform test provided in the fourth embodiment of the present application;

[0025] Figure 5This is a structural diagram of a computer device provided in Example 5 of the present application. DETAILED DESCRIPTION

[0026] In the following description, specific details such as specific system structures and techniques are provided for purposes of illustration rather than limitation to facilitate a thorough understanding of the embodiments of the present application. However, it will be apparent to those skilled in the art that the present application may be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to avoid obscuring the description of the present application with unnecessary detail.

[0027] It should be understood that when used in the present specification and the appended claims, the term "comprising" indicates the presence of described features, integers, steps, operations, elements and / or components, but does not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or collections thereof.

[0028] It will also be understood that the term "and / or" used in this specification and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.

[0029] As used in this specification and the appended claims, the term "if" can be interpreted as "when" or "upon" or "in response to determining" or "in response to detecting," depending on the context. Similarly, the phrase "if it is determined" or "if [described condition or event] is detected" can be interpreted as meaning "upon determination" or "in response to determining" or "upon detection of [described condition or event]" or "in response to detecting [described condition or event]," depending on the context.

[0030] In addition, in the description of the present application specification and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the descriptions and cannot be understood as indicating or implying relative importance.

[0031] References to "one embodiment" or "some embodiments" in this specification mean that a particular feature, structure, or characteristic described in conjunction with that embodiment is included in one or more embodiments of the present application. Thus, phrases such as "in one embodiment," "in some embodiments," "in other embodiments," and "in other embodiments" appearing in various places in this specification do not necessarily refer to the same embodiment, but rather mean "one or more but not all embodiments," unless otherwise specifically emphasized. The terms "including," "comprising," "having," and variations thereof all mean "including but not limited to," unless otherwise specifically emphasized.

[0032] The embodiments of the present application can acquire and process relevant data based on artificial intelligence technology. Artificial Intelligence (AI) is the theory, method, technology, and application system that uses digital computers or machines controlled by digital computers to simulate, extend, and expand human intelligence, perceive the environment, acquire knowledge, and use knowledge to achieve optimal results.

[0033] Fundamental AI technologies generally include sensors, dedicated AI chips, cloud computing, distributed storage, big data processing, operating / interaction systems, and mechatronics. AI software technologies primarily encompass computer vision, robotics, biometrics, speech processing, natural language processing, and machine learning / deep learning.

[0034] It should be understood that the size of the serial numbers of the steps in the following embodiments does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.

[0035] In order to illustrate the technical solution of the present application, specific embodiments are provided below.

[0036] The impact assessment method of a financial platform test provided in the first embodiment of the present application can be applied to Figure 1 In an application environment, a client communicates with a server. Clients include, but are not limited to, PDAs, desktop computers, laptops, ultra-mobile personal computers (UMPCs), netbooks, cloud computing devices, and personal digital assistants (PDAs). The server can be implemented as a standalone server or a server cluster consisting of multiple servers.

[0037] See also Figure 2 , is a flow chart of a method for evaluating the impact of a financial platform test provided in Example 2 of this application. The method for evaluating the impact of a financial platform test is applied to Figure 1 The server in the example is the computer device that supports the financial platform. The impact assessment method of this application obtains the corresponding data from the financial platform during operation. The client connects to the server and can provide the server with the corresponding test requirements and carry the test results output by the server. Figure 2 As shown, the impact assessment method for the financial platform test may include the following steps:

[0038] Step S201 , determining N service components from the financial platform, determining theoretical problems corresponding to failures from the configuration information of the N service components, and determining actual problems corresponding to failures of the N service components from historical operation data of the financial platform.

[0039] In this application, a financial platform can refer to a system used in financial scenarios to provide business services to users. The financial platform is configured with corresponding service components that can be called by client users to implement corresponding services. The services include calculation, query, storage, download and other process operations set up for different businesses. For example, a financial platform can refer to the insurance industry's insurance underwriting system, insurance claims system, etc., or the banking industry's mobile banking system, online banking system, etc.

[0040] For a delivered financial platform, its architecture is already established, with fixed services and components. Therefore, by analyzing the platform's operational logs, we can obtain information about the corresponding services, business operations, components, and other system operations. From this information, we can identify the corresponding service components. A service component typically targets a specific vulnerability, such as a commonly used, critical component or its corresponding component interface.

[0041] Because platform interactions in orchestration environments are overly complex, analysis is prohibitively expensive or nearly impossible. Furthermore, services are more closely tied to user experience. While ensuring service stability, internal metrics still have ample room for fluctuation. Therefore, it's necessary to identify key service components from among all used components. Studying these service components can characterize the entire system. For example, analyzing the interaction requirements of a financial platform to ensure user experience and related system interaction requirements ultimately allows for the extraction of key service components, key page load times, and core transaction metrics.

[0042] When building a financial platform, each service component will have corresponding configuration information. The configuration information can store problems that may occur in the event of a failure of the corresponding service component. This problem is a theoretical problem, that is, a problem defined by the developer.

[0043] After the financial platform has been running for a period of time, by analyzing historical operation data, we can determine the actual problems corresponding to each service component when a failure occurs. There may be intersections between theoretical problems and practical problems, and of course, there are also different problems.

[0044] Step S202 : for any service component, determine the service impact object of the corresponding service component based on theoretical and practical issues of the service component, traverse all service components, and calculate the union of the service impact objects of all service components to obtain an impact object set.

[0045] In this application, for each theoretical problem and practical problem, the objects that each problem can affect can be known by looking up tables, etc. For any service component, the objects affected by all theoretical problems and practical problems are combined to form the service impact object of the service component. The service impact objects of all service components are combined to obtain a set of impact objects.

[0046] A service-affected object can be an object that is unavailable due to a problem with a service component, such as the inability to calculate, upload, store, or download data. For example, if a service component problem occurs, such as a disconnected database A, then all objects that require access to that database through the financial platform, such as query users and user modifications, will be affected.

[0047] Step S203: Obtain the steady-state indicators and initial burst duration of the financial platform. Based on the initial burst duration, perform burst tests on N service components to monitor the fluctuation of the steady-state indicators and the working status of all objects in the affected object set.

[0048] In this application, steady-state indicators may refer to indicators used to manage or monitor the stability of the financial platform, such as memory usage, response time of each service component, processing time, and other indicators that can characterize stability. If the memory usage is too high, it may affect the use of the financial platform, and in severe cases may cause downtime.

[0049] The initial burst duration is a parameter set based on demand or derived through experimentation. For example, before all operations, a burst test can be performed to determine the time required for steady-state indicators to fluctuate. Using this time as the initial burst duration can effectively avoid repeated testing caused by setting a short initial burst duration, which could lead to excessive testing. This means that the initial burst duration is sufficient to influence steady-state indicators.

[0050] Step S204: If no fault is detected in any object in the affected object set and the fluctuation of the steady-state index does not meet the preset conditions, the initial blasting duration is increased to obtain an increased blasting duration, which is used as the initial blasting duration.

[0051] In this application, if the conditions for stopping the blasting test are not met, the blasting time needs to be increased, and the blasting test is continued based on the increased blasting time. The preset conditions can be set according to needs, specifically the target fluctuation situation of the fluctuation of the steady-state index.

[0052] If any object in the affected object set fails, it means that the test has affected the normal operation of the financial platform and may cause some adverse results. Therefore, the blasting test can be stopped at this time.

[0053] Optionally, after performing a burst test on N service components based on the initial burst duration, monitoring the fluctuation of steady-state indicators and the working status of all objects in the affected object set, the following steps are also included:

[0054] Obtaining the first time when the fluctuation of the steady-state indicator is first monitored and the second time when the initial blasting test begins, and determining the interval between the first time and the second time as the time slice length;

[0055] Accordingly, the initial blasting duration is increased to obtain the increased blasting duration, including:

[0056] Use the time slice length to increase the initial blasting duration to obtain the increased blasting duration.

[0057] Among them, the duration of the blasting test increases with the increase in the number of blasting times, and the increased step length can be a preset length, which can be the time interval between the start time of the blasting test and the time when the steady-state index fluctuates, that is, the time slice length. Increasing the blasting duration with the time slice length as the step length is conducive to reducing the number of blasting times to achieve the purpose of rapid iteration. At the same time, it can also ensure that the step length will not be too long, and to a certain extent, ensure the accuracy of subsequent evaluation.

[0058] Optionally, the initial burst duration is increased using the time slice length to obtain an increased burst duration, including:

[0059] If the fluctuation of the steady-state indicator is detected to exceed the preset fluctuation value, half of the initial blasting duration will be used as the halved blasting duration;

[0060] The time slice length of the first preset multiple is added to the halved blasting duration to obtain the increased blasting duration, and the first preset multiple is less than 1.

[0061] If the fluctuation of the steady-state indicator is large, it can be considered that the blasting duration at this time is close to the final evaluation result. Therefore, in order to obtain a more accurate evaluation result, the blasting duration at this time is halved, and the blasting duration is increased based on the halved blasting duration. The first preset multiple can be 1 / 5.

[0062] Optionally, after monitoring the fluctuation of the steady-state indicator, the following is also included:

[0063] Check whether the fluctuation of the steady-state index after this blasting test has a peak value;

[0064] If it is detected that the fluctuation of the steady-state index after this blasting test does not have a peak value, it is determined that the fluctuation of the steady-state index does not meet the preset condition.

[0065] Among them, the peak value of the steady-state index represents the maximum impact effect of the corresponding blasting test. Therefore, by analyzing the peak value of the steady-state index, it can be determined whether the blasting duration of the blasting test reaches the target.

[0066] If the fluctuation of the steady-state index does not reach a peak, it means that a burst test is still needed, that is, the fluctuation of the steady-state index does not meet the preset conditions.

[0067] Optionally, after detecting whether the fluctuation of the steady-state indicator after the blasting test has a peak value, the following steps are further included:

[0068] If a peak value is detected in the fluctuation of the steady-state indicator after the current blasting test, whether the interval between the peak value occurrence time and the second time is greater than a second preset multiple of the time slice length is detected, and the second preset multiple is greater than 1;

[0069] If the interval between the detected peak occurrence time and the second time is not greater than a preset multiple of the time slice length, it is determined that the fluctuation of the steady-state indicator meets the preset condition.

[0070] If the interval between the peak and the second time is greater than a preset multiple of the time slice length, the test duration is considered too long and cannot meet the requirements. If the interval between the peak and the second time is not greater than a preset multiple of the time slice length, the duration is considered sufficient, meaning that the fluctuation of the other indicator meets the preset conditions.

[0071] The second preset multiple may be 5, that is, when the peak value of the fluctuation is reached within 5 time slices, it is considered that the explosion radius has been reached, that is, the fluctuation is considered to meet the preset conditions.

[0072] Step S205, returning to the step of performing a blasting test on N service components based on the initial blasting duration, and stopping the blasting test when a fault is detected in any object in the affected object set or the fluctuation of the steady-state indicator meets the preset conditions, and determining the initial blasting duration when the blasting test is stopped as the evaluation result of the test impact degree.

[0073] In this application, if the conditions for stopping the blasting test cannot be met, the blasting test needs to be repeated until the conditions are met and the blasting test is stopped. If a failure is detected in any object in the set of affected objects, only the corresponding initial blasting duration can be used as the evaluation result. This evaluation result may not be able to guide subsequent chaos engineering blasting tests. If the fluctuation of the steady-state indicator meets the preset conditions, the corresponding initial blasting duration is used as the evaluation result. This evaluation result can inform the subsequent chaos engineering blasting test to improve safety.

[0074] Optionally, after determining N service components from the financial platform, the following is further included:

[0075] Obtain the corresponding fallback plan set for each service component and the timeliness of the financial platform's service level agreement;

[0076] For any service component, perform a time-consuming analysis on each fallback solution in the fallback solution set corresponding to the service component to obtain the fallback time of the corresponding fallback solution;

[0077] Determine the fallback solution with the shortest fallback time and a fallback time shorter than the validity period among all fallback solutions as the target solution for the corresponding service component;

[0078] Accordingly, after monitoring the working status of all objects in the affected object set, it also includes:

[0079] If a failure is detected in any object in the affected object set, after stopping the brute force test, the target solution of each service component is started to perform a rollback operation.

[0080] Among them, in the event that any object in the affected object set fails, it may be necessary to perform a rollback operation on the financial platform to ensure the security and normal operation of the financial platform.

[0081] The rollback operation requires the use of a rollback plan. For service components, there may be multiple rollback plans. Therefore, it is necessary to analyze all rollback plans and find the rollback plan with the shortest time and less than the preset effectiveness, so as to perform the rollback operation after stopping the blasting test.

[0082] The embodiment of the present application determines N service components from the financial platform, determines the theoretical problems corresponding to the failure from the configuration information of the N service components, determines the actual problems corresponding to the N service components when the failure occurs from the historical operation data of the financial platform, and for any service component, determines the service impact object of the corresponding service component based on the theoretical problems and actual problems of the service component, traverses all service components, calculates the union of the service impact objects of all service components, obtains the impact object set, obtains the steady-state index and initial blasting duration of the financial platform, performs blasting test on the N service components based on the initial blasting duration, monitors the fluctuation of the steady-state index and the working status of all objects in the impact object set, and if no If any object in the affected object set fails and the fluctuation of the steady-state indicator does not meet the preset conditions, the initial blasting duration is increased to obtain the increased blasting duration. The increased blasting duration is used as the initial blasting duration, and the execution is returned to the step of performing blasting tests on N service components based on the initial blasting duration. The blasting test is stopped when it is detected that any object in the affected object set fails or the fluctuation of the steady-state indicator meets the preset conditions. The initial blasting duration when the blasting test is stopped is determined as the evaluation result of the test impact degree, thereby realizing the evaluation of the blasting duration. In the process of introducing chaos engineering to conduct blasting experiments, the evaluation results are used as a basis to avoid irreversible damage to the platform, so that the stability of the platform is guaranteed to a certain extent.

[0083] See also Figure 3 , is a flow chart of a method for evaluating the impact of a financial platform test provided in Example 3 of the present application, such as Figure 3 As shown, the impact assessment method for the financial platform test may include the following steps:

[0084] Step S301: determine N service components from the financial platform, determine theoretical problems corresponding to failures from the configuration information of the N service components, and determine actual problems corresponding to failures of the N service components from historical operation data of the financial platform.

[0085] Step S302 : for any service component, determine the service impact object of the corresponding service component based on theoretical and practical issues of the service component, traverse all service components, and calculate the union of the service impact objects of all service components to obtain an impact object set.

[0086] Step S303: Obtain the steady-state indicators and initial burst duration of the financial platform. Based on the initial burst duration, perform burst tests on N service components to monitor the fluctuation of the steady-state indicators and the working status of all objects in the affected object set.

[0087] Step S304: If no fault is detected in any object in the affected object set and the fluctuation of the steady-state index does not meet the preset conditions, the initial blasting duration is increased to obtain an increased blasting duration, which is used as the initial blasting duration.

[0088] Step S305, returning to the step of performing a blasting test on N service components based on the initial blasting duration, and stopping the blasting test when a fault is detected in any object in the affected object set or the fluctuation of the steady-state indicator meets the preset conditions, and determining the initial blasting duration when the blasting test is stopped as the evaluation result of the test impact degree.

[0089] The contents of steps S301 to S305 are partially identical to the contents of steps S201 to S205 described above, and reference may be made to the description of steps S201 to S205, which will not be repeated here.

[0090] Step S306: Using the evaluation results as alarm thresholds corresponding to N service components in the monitoring system.

[0091] The evaluation result can also be used as a monitoring parameter for monitoring the financial platform, that is, the evaluation result of each service component is used as the alarm threshold of the corresponding service component.

[0092] Step S307: When the monitoring system detects that the test duration of any service component among the N service components during the chaos engineering test exceeds the alarm threshold, the chaos engineering test is fused and an alarm prompt is generated.

[0093] Among them, the test time of each service component of the financial platform during normal operation is monitored in real time, and the test time is compared with the alarm threshold. If the test time exceeds the alarm threshold, it means that the real-time execution time is too long, which may cause abnormalities in the financial platform and fluctuations in stability indicators. Therefore, an alarm prompt can be generated to prompt management personnel to check the financial platform.

[0094] In addition, chaos engineering tests can be circuit-breakered to stop the test and avoid damage to the financial platform.

[0095] In common chaos engineering scenarios where a minimum explosion radius is required as a safety measure, if the minimum explosion radius cannot be obtained for some reason, this is usually because the analysis of potential hazards or explosion points reveals that the set of indicators involved is too complex, or the implementation target is a system service that has been in production for some time. In this case, the minimum explosion radius indicator may not be available. Alternatively, for systems with particularly high stability requirements, steady-state indicators must be used to ensure system stability. Generally speaking, the confirmation of steady-state indicators effectively guarantees the implementation of chaos engineering.

[0096] The embodiment of the present application determines N service components from the financial platform, determines the theoretical problems corresponding to the failure from the configuration information of the N service components, and determines the actual problems corresponding to the N service components when the failure occurs from the historical operation data of the financial platform. For any service component, the service impact object of the corresponding service component is determined according to the theoretical problems and actual problems of the service component, all service components are traversed, and the service impact objects of all service components are combined to obtain the impact object set, and the steady-state index and initial blasting duration of the financial platform are obtained. Based on the initial blasting duration, the N service components are subjected to blasting tests to monitor the fluctuation of the steady-state index and the working status of all objects in the impact object set. If no failure of any object in the impact object set is detected and the fluctuation of the steady-state index does not meet the preset conditions, the initial blasting duration is increased to obtain the increased Increase the blasting duration, and use the increased blasting duration as the initial blasting duration. Return to execute the steps of blasting test on N service components based on the initial blasting duration until the blasting test is stopped when it is monitored that any object in the affected object set fails or the fluctuation of the steady-state indicator meets the preset conditions. The initial blasting duration when the blasting test is stopped is determined as the evaluation result of the test impact degree. The evaluation result is used as the alarm threshold corresponding to the N service components in the monitoring system. When the monitoring system monitors that the test duration of any service component in the N service components exceeds the alarm threshold during the chaos engineering test, the chaos engineering test is fused and an alarm prompt is generated to realize the evaluation of the blasting duration. In the process of introducing chaos engineering for blasting experiments, the evaluation results are used as the basis to avoid irreversible damage to the platform, so that the stability of the platform is guaranteed to a certain extent.

[0097] Corresponding to the impact assessment method of the financial platform test in the above embodiment, Figure 4 The structure diagram of the impact assessment device for financial platform testing provided by the fourth embodiment of the present application is shown. The impact assessment device is applied to Figure 1 The server in the example is the computer device that supports the financial platform. The impact assessment method of this application obtains relevant data from the financial platform during operation. The client connects to the server, provides the server with corresponding test requirements, and carries the test results output by the server. For ease of illustration, only the portions relevant to the embodiments of this application are shown.

[0098] See also Figure 4 , the impact assessment device comprises:

[0099] Component and problem determination module 41 is configured to determine N service components from the financial platform, determine theoretical problems corresponding to failures from the configuration information of the N service components, and determine actual problems corresponding to failures of the N service components from historical operating data of the financial platform, where N is an integer greater than zero;

[0100] An impact object determination module 42 is configured to determine, for any service component, the service impact objects of the corresponding service component based on theoretical and practical issues of the service component, traverse all service components, and calculate the union of the service impact objects of all service components to obtain an impact object set;

[0101] The burst test module 43 is used to obtain the steady-state indicators and initial burst duration of the financial platform. Based on the initial burst duration, it performs burst tests on N service components to monitor the fluctuation of the steady-state indicators and the working status of all objects in the affected object set.

[0102] The blasting duration adjustment module 44 is configured to increase the initial blasting duration to obtain an increased blasting duration if no fault is detected in any object in the affected object set and the fluctuation of the steady-state indicator does not meet a preset condition, and use the increased blasting duration as the initial blasting duration;

[0103] The impact degree assessment module 45 is used to return to the step of performing a blasting test on N service components based on the initial blasting duration, and stop the blasting test when a failure of any object in the affected object set is detected or the fluctuation of the steady-state indicator meets the preset conditions. The initial blasting duration when the blasting test is stopped is determined as the assessment result of the test impact degree.

[0104] Optionally, the impact assessment device further includes:

[0105] A time slice determination module is configured to, after performing a burst test on N service components based on the initial burst duration, monitor the fluctuation of steady-state indicators and the working status of all objects in the affected object set, obtain the first time when the fluctuation of the steady-state indicators is first detected, and the second time when the initial burst test begins, and determine the interval between the first time and the second time as the time slice length;

[0106] Accordingly, the blasting duration adjustment module 44 includes:

[0107] The blasting duration adjustment unit is used to increase the initial blasting duration by using the time slice length to obtain an increased blasting duration.

[0108] Optionally, the blasting duration adjustment unit includes:

[0109] The first duration calculation subunit is configured to use half of the initial burst duration as the halved burst duration if it is detected that the fluctuation of the steady-state indicator exceeds a preset fluctuation value;

[0110] The second duration calculation subunit is used to add the time slice length of the first preset multiple to the halved blasting duration to obtain the increased blasting duration, where the first preset multiple is less than 1.

[0111] Optionally, the impact assessment device further includes:

[0112] The fluctuation peak detection module is used to detect whether the fluctuation of the steady-state index after the blasting test has a peak value after monitoring the fluctuation of the steady-state index;

[0113] The first determination module is configured to determine that the fluctuation of the steady-state indicator does not meet a preset condition if it is detected that the fluctuation of the steady-state indicator after the current blasting test does not reach a peak.

[0114] Optionally, the impact assessment device further includes:

[0115] A peak occurrence time module is used to detect whether a peak occurs in the fluctuation of the steady-state indicator after the current blasting test. If a peak occurs in the fluctuation of the steady-state indicator after the current blasting test, detect whether the interval between the peak occurrence time and the second time is greater than a second preset multiple of the time slice length, where the second preset multiple is greater than 1;

[0116] The second determination module is configured to determine that the fluctuation of the steady-state indicator meets a preset condition if the interval between the detected peak occurrence time and the second time is not greater than a preset multiple of the time slice length.

[0117] Optionally, the impact assessment device further includes:

[0118] A solution acquisition module is used to obtain a set of fallback solutions corresponding to each service component and the timeliness of the service level agreement of the financial platform after determining N service components from the financial platform;

[0119] The fallback time determination module is used to analyze the time consumption of each fallback solution in the fallback solution set corresponding to any service component and obtain the fallback time consumption of the corresponding fallback solution;

[0120] A target solution determination module is used to determine the fallback solution with the shortest fallback time and a fallback time less than the time limit among all fallback solutions as the target solution for the corresponding service component;

[0121] Accordingly, the impact assessment device further includes:

[0122] The rollback operation module is used to monitor the working status of all objects in the affected object set. If any object in the affected object set is detected to have a fault, the target solution of each service component is started to perform a rollback operation after stopping the blast test.

[0123] Optionally, the impact assessment device further includes:

[0124] An alarm threshold determination module is configured to determine, after determining that the initial blasting duration when stopping the blasting test is an evaluation result of the test impact, use the evaluation result as the alarm threshold for N service components corresponding to the monitoring system;

[0125] The circuit breaker alarm module is used to breaker the chaos engineering test and generate an alarm prompt when the monitoring system detects that the test duration of any service component among N service components during the chaos engineering test exceeds the alarm threshold.

[0126] It should be noted that the information interaction, execution process and other contents between the above modules are based on the same concept as the method embodiment of this application. Their specific functions and technical effects can be found in the method embodiment part and will not be repeated here.

[0127] Figure 5 This is a schematic diagram of the structure of a computer device provided in Example 5 of this application. Figure 5 As shown, the computer device of this embodiment includes: at least one processor ( Figure 5 Only one is shown), a memory, and a computer program stored in the memory and executable on at least one processor. When the processor executes the computer program, the steps in the above-mentioned embodiment of the method for assessing the impact of any financial platform test are implemented.

[0128] The computer device may include, but is not limited to, a processor and a memory. It will be understood by those skilled in the art that Figure 5 The above is merely an example of a computer device and does not constitute a limitation on the computer device. The computer device may include more or fewer components than shown in the figure, or a combination of certain components, or different components. For example, it may also include network components, display screens, and input devices.

[0129] The processor may be a CPU, or other general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic device, a discrete gate or transistor logic device, or a discrete hardware component. A general-purpose processor may be a microprocessor, or any conventional processor.

[0130] The memory includes a readable storage medium, an internal memory, etc., wherein the internal memory can be the memory of a computer device, and the internal memory provides an environment for the operation of the operating system and computer-readable instructions in the readable storage medium. The readable storage medium can be the hard disk of the computer device, and in other embodiments, it can also be an external storage device of the computer device, for example, a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc. equipped on the computer device. Furthermore, the memory can also include both the internal storage unit of the computer device and the external storage device. The memory is used to store the operating system, application programs, boot loaders (BootLoader), data, and other programs, such as the program code of the computer program. The memory can also be used to temporarily store data that has been output or is about to be output.

[0131] Those skilled in the art can clearly understand that, for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In actual applications, the above-mentioned functions can be distributed and completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated into a processing unit, or each unit can exist physically alone, or two or more units can be integrated into one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of a software functional unit. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other and are not used to limit the scope of protection of this application. The specific working process of the units and modules in the above-mentioned device can refer to the corresponding process in the aforementioned method embodiment, which will not be repeated here. If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, which can be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium. When the computer program is executed by the processor, it can implement the steps of the above-mentioned method embodiment. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium may include at least: any entity or device capable of carrying computer program code, recording medium, computer memory, read-only memory (ROM), random access memory (RAM), electric carrier signal, telecommunication signal and software distribution medium. For example, a USB flash drive, a mobile hard disk, a magnetic disk or an optical disk. In some jurisdictions, according to legislation and patent practice, computer-readable media cannot be electric carrier signals and telecommunication signals.

[0132] The present application implements all or part of the processes in the above-mentioned embodiment method, and can also be completed through a computer program product. When the computer program product runs on a computer device, the computer device can implement the steps in the above-mentioned method embodiment when executing it.

[0133] In the above embodiments, the description of each embodiment has its own focus. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant description of other embodiments.

[0134] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0135] In the embodiments provided in this application, it should be understood that the disclosed apparatus / computer equipment and methods can be implemented in other ways. For example, the apparatus / computer equipment embodiments described above are merely schematic. For example, the division of modules or units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some components, apparatuses or units, which can be electrical, mechanical or other forms.

[0136] Units described as separate components may or may not be physically separate, and components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.

[0137] The above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. These modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the various embodiments of the present application, and should all be included in the scope of protection of the present application.

Claims

1. A method for evaluating the impact of financial platform testing, characterized in that: The impact assessment methods include: Determining N service components from the financial platform, determining theoretical problems corresponding to failures from configuration information of the N service components, and determining actual problems corresponding to failures of the N service components from historical operating data of the financial platform, where N is an integer greater than zero; For any service component, based on theoretical and practical issues of the service component, determine the service impact object corresponding to the service component, traverse all service components, and calculate the union of the service impact objects of all service components to obtain the impact object set; Obtaining steady-state indicators and initial burst duration of the financial platform, performing burst tests on the N service components based on the initial burst duration, and monitoring fluctuations in the steady-state indicators and the working status of all objects in the affected object set; If no failure is detected in any object in the set of affected objects and the fluctuation of the steady-state indicator does not meet the preset condition, the initial blasting duration is increased to obtain an increased blasting duration, and the increased blasting duration is used as the initial blasting duration; Return to the step of performing a blasting test on the N service components based on the initial blasting duration, and stop the blasting test when a fault is detected in any object in the set of affected objects or the fluctuation of the steady-state indicator meets the preset conditions. The initial blasting duration when the blasting test is stopped is determined as the evaluation result of the test impact degree.

2. The impact assessment method according to claim 1, characterized in that: After performing a blast test on the N service components based on the initial blast duration and monitoring the fluctuation of the steady-state indicator and the working status of all objects in the affected object set, the method further includes: Obtaining a first time when the fluctuation of the steady-state indicator is first detected and a second time when the initial blasting test begins, and determining the interval between the first time and the second time as the time slice length; Accordingly, increasing the initial blasting duration to obtain an increased blasting duration includes: The initial blasting duration is increased by using the time slice length to obtain an increased blasting duration.

3. The impact assessment method according to claim 2, characterized in that: Using the time slice length to increase the initial blasting duration to obtain an increased blasting duration includes: If it is detected that the fluctuation of the steady-state indicator exceeds the preset fluctuation value, half of the initial blasting duration is used as the halved blasting duration; The time slice length of a first preset multiple is added to the halved blasting duration to obtain an increased blasting duration, wherein the first preset multiple is less than 1.

4. The impact assessment method according to claim 2, characterized in that: After monitoring the fluctuation of the steady-state indicator, the method further includes: Detecting whether a peak value appears in the fluctuation of the steady-state index after this blasting test; If it is detected that the fluctuation of the steady-state indicator does not reach a peak value after the current blasting test, it is determined that the fluctuation of the steady-state indicator does not meet the preset condition.

5. The impact assessment method according to claim 4, characterized in that: After detecting whether the fluctuation of the steady-state index after the blasting test reaches a peak, the following steps are also included: If it is detected that a peak value appears in the fluctuation of the steady-state indicator after the current blasting test, detecting whether an interval between the time of occurrence of the peak value and the second time is greater than a second preset multiple of the time slice length, where the second preset multiple is greater than 1; If it is detected that the interval between the occurrence time of the peak value and the second time is not greater than a preset multiple of the time slice length, it is determined that the fluctuation of the steady-state indicator meets the preset condition.

6. The impact assessment method according to claim 1, characterized in that: After determining N service components from the financial platform, the method further includes: Obtaining a set of fallback solutions corresponding to each service component and the validity period of the service level agreement of the financial platform; For any service component, perform a time consumption analysis on each fallback solution in the fallback solution set corresponding to the service component to obtain the fallback time consumption of the corresponding fallback solution; Determine the fallback solution with the shortest fallback time among all fallback solutions and a fallback time less than the time limit as the target solution corresponding to the service component; Accordingly, after monitoring the working status of all objects in the affected object set, the method further includes: If it is detected that any object in the set of affected objects fails, after stopping the blast test, the target solution of each service component is started to perform a rollback operation.

7. The impact assessment method according to any one of claims 1 to 6, characterized in that: After determining the initial blasting duration when stopping the blasting test as the evaluation result of the test impact, it also includes: Using the evaluation results as alarm thresholds corresponding to the N service components in the monitoring system; When the monitoring system detects that the test duration of any service component among the N service components during the chaos engineering test exceeds the alarm threshold, the chaos engineering test is fused and an alarm prompt is generated.

8. A device for evaluating the impact of financial platform testing, characterized in that: The impact assessment device comprises: a component and problem determination module, configured to determine N service components from the financial platform, determine theoretical problems corresponding to failures from configuration information of the N service components, and determine actual problems corresponding to failures of the N service components from historical operating data of the financial platform, where N is an integer greater than zero; An impact object determination module is used to determine, for any service component, the service impact objects corresponding to the service component based on theoretical and practical issues of the service component, traverse all service components, and calculate the union of the service impact objects of all service components to obtain an impact object set; A burst test module, configured to obtain steady-state indicators and an initial burst duration of the financial platform, perform burst tests on the N service components based on the initial burst duration, and monitor fluctuations in the steady-state indicators and the working status of all objects in the affected object set; a blasting duration adjustment module, configured to increase the initial blasting duration to obtain an increased blasting duration if no fault is detected in any object in the set of influencing objects and the fluctuation of the steady-state indicator does not meet a preset condition, and use the increased blasting duration as the initial blasting duration; The impact degree assessment module is used to return to the step of performing a blasting test on the N service components based on the initial blasting duration, and stop the blasting test when a fault is detected in any object in the set of affected objects or the fluctuation of the steady-state indicator meets the preset conditions, and determine the initial blasting duration when the blasting test is stopped as the assessment result of the test impact degree.

9. A computer device, characterized in that: The computer device includes a processor, a memory, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the impact assessment method according to any one of claims 1 to 7 is implemented.

10. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the impact degree assessment method according to any one of claims 1 to 7 is implemented.

Images