Method and device for verifying system drill without stopping machine

Abstract

A method and device for non-stop system drill verification, which relate to the field of data testing and can be applied to the financial field and other fields. The method includes: obtaining server information of an application and production traffic metrics, generating environment information of the application according to the server information, and generating a traffic simulation task according to the production traffic metrics; initiating background simulation traffic to the application according to the environment information and the traffic simulation task, and performing application upgrade and installation; monitoring the inlet traffic of the application, the performance parameters of the server, and the load conditions of the server-associated devices; obtaining the production drill result of the application through the inlet traffic, the performance parameters, and the load conditions. In this way, it is possible to simulate production traffic during the production drill, monitor the impacts of version upgrade and installation on aspects such as the network, the server, and the load, evaluate the degree of decline in service capabilities during the upgrade process, determine a suitable production window and production time, and provide guidance for the safe and stable production launch.

Description

Technical Field

[0001] The present invention relates to the field of data testing, and can be applied to the financial field and other fields, especially a method and device for system rehearsal without stopping the machine. Background Art

[0002] During the version upgrade process of financial application software, many application software require 7*24-hour uninterrupted service. During the version upgrade process, the ability to provide external services cannot be affected, and at the same time, the functions and performance of the application software should be ensured to be normal. Therefore, before the software upgrade in the production environment, a production rehearsal needs to be carried out in the test environment. The currently commonly used production rehearsal methods do not consider the real business traffic during production, and the tests during the production rehearsal process only test from the perspective of functional testing, without performing load balancing tests, network tests, server performance tests, etc. For financial application software, there are three phenomena: First, the version changes rapidly. In the continuous release scenario, new functions are launched every week, and the software needs to be upgraded. Second, the call relationships between applications are relatively frequent and complex. If there is a problem with the upgrade of one application, it will affect multiple applications. Third, many applications are deployed in a multi-campus distributed manner, and the load, network, and server will all be affected during the upgrade process. For the above three phenomena, if only the version installation and function normality are verified in the production rehearsal test, there are the following defects: The upgrade is not carried out under the background of production traffic, and the performance during the upgrade process cannot be evaluated. The problems of network, server, load, etc. are not considered during the production rehearsal process. Summary of the Invention

[0003] The purpose of the present invention is to provide a method and device for system rehearsal without stopping the machine, which can simulate the real traffic during production during the production rehearsal, and ensure that the system upgrade during production does not affect the ability to provide external services. More specifically, it will simulate the production traffic during the system upgrade, observe that the system can be successfully upgraded normally under the background of the simulated traffic, and at the same time monitor the changes in the simulated traffic and the error reporting situation of the service. The invention can verify the problems of the impact of system upgrade on service functions, service performance, load balancing, network, etc., and at the same time determine the best production window and production time.

[0004] To achieve the above object, a method for verifying system rehearsal without stopping the machine provided by the present invention includes: obtaining the server information and production traffic indicators of the application, generating the environment information of the application according to the server information, and generating a traffic simulation task according to the production traffic indicators; initiating background simulated traffic to the application according to the environment information and the traffic simulation task, and performing application upgrade installation; monitoring the inlet traffic of the application, the performance parameters of the server, and the load conditions of the server-related devices; obtaining the production rehearsal result of the application through the inlet traffic, the performance parameters, and the load conditions.

[0005] In the above method for verifying the drill of the non-stop system, preferably, generating a traffic simulation task according to the production traffic index includes: converting the production traffic index into a query rate index and a response time index, and generating a traffic simulation task according to the query rate index and the response time index.

[0006] In the above method for verifying the drill of the non-stop system, preferably, monitoring the entrance traffic of the application, the performance parameters of the server, and the load conditions of the server-related devices further includes: obtaining the historical access traffic data of the application according to the environment information; comparing the background simulation traffic with the historical access traffic data, and when the difference between the two is less than a preset difference threshold, monitoring the entrance traffic of the application, the performance parameters of the server, and the load conditions of the server-related devices.

[0007] In the above method for verifying the drill of the non-stop system, preferably, monitoring the performance parameters of the server includes: collecting the performance parameters of the server through the Prometheus monitoring system, associating the performance parameters with the identification information of the server, and storing them in a predetermined time series database in chronological order.

[0008] In the above method for verifying the drill of the non-stop system, preferably, the performance parameters include the memory usage ratio, the CPU usage ratio, and the coefficient disk processing efficiency; the entrance traffic includes the successful transaction traffic and the failed transaction traffic; the load conditions include the access traffic and the load of each network device in the distributed architecture server.

[0009] In the above method for verifying the drill of the non-stop system, preferably, obtaining the production drill result of the application through the entrance traffic, the performance parameters, and the load conditions further includes: comparing the entrance traffic, the performance parameters, and the load conditions in the production drill result with a predetermined alarm threshold respectively, and generating an alarm signal when any one of the entrance traffic, the performance parameters, and the load conditions meets the predetermined alarm condition; providing the alarm signal to a predetermined location.

[0010] The present invention also provides a device for verifying the drill of a non-stop system, the device includes a simulation traffic module and a monitoring module; the simulation traffic module is used to obtain the server information and the production traffic index of the application, generate the environment information of the application according to the server information, and generate a traffic simulation task according to the production traffic index; initiate background simulation traffic to the application according to the environment information and the traffic simulation task, and perform application upgrade and installation; the monitoring module is used to monitor the entrance traffic of the application, the performance parameters of the server, and the load conditions of the server-related devices; obtain the production drill result of the application through the entrance traffic, the performance parameters, and the load conditions.

[0011] In the above non-stop system drill verification device, preferably, the simulated traffic module further includes obtaining historical access traffic data of the application according to the environmental information; comparing the background simulated traffic with the historical access traffic data, and when the difference between the two is less than a preset difference threshold, monitoring the inlet traffic of the application, the performance parameters of the server, and the load conditions of the server-related devices.

[0012] The present invention also provides an electronic device, including a memory, a processor, and a computer program stored on the memory and executable on the processor. When the processor executes the computer program, the above method is implemented.

[0013] The present invention also provides a computer-readable storage medium storing a computer program for executing the above method.

[0014] The beneficial technical effects of the present invention are as follows: It can conduct production drills under the condition of simulating production traffic, making the drill results more applicable to the actual production situation; it can evaluate the decline in service capabilities caused by software upgrades of applications, facilitating the confirmation of production time and production windows; and whether there are bottlenecks in system resources caused by software upgrades of applications. If there are bottlenecks, capacity expansion can be carried out in a timely manner; and whether load imbalance will be caused during software upgrades of applications, and whether each network device and server can withstand the increased traffic, which is conducive to guiding the smooth production of production. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] The drawings described herein are used to provide a further understanding of the present invention, constitute a part of this application, and do not limit the present invention. In the drawings:

[0016] Figure 1 is a schematic diagram of the application timing process of the non-stop system drill verification method provided by an embodiment of the present invention;

[0017] Figure 2 is a schematic diagram of the principle process of the non-stop system drill verification method provided by an embodiment of the present invention;

[0018] Figure 3 is a schematic diagram of the structure of the non-stop system drill verification device provided by an embodiment of the present invention;

[0019] Figure 4 is a schematic diagram of the principle structure of the non-stop system drill verification device provided by an embodiment of the present invention;

[0020] Figure 5 is a schematic diagram of the structure of the electronic device provided by an embodiment of the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0021] The embodiments of the present invention will be described in detail below with reference to the accompanying drawings and examples, so as to fully understand how the present invention uses technical means to solve technical problems and achieve the implementation process of technical effects and implement accordingly. It should be noted that as long as there is no conflict, the various embodiments in the present invention and the various features in each embodiment can be combined with each other, and the technical solutions formed are all within the protection scope of the present invention.

[0022] In addition, the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions, and although the logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in a different order than here.

[0023] Please refer to Figure 2 As shown, a method for verifying a non-stop system drill provided by the present invention includes:

[0024] S201 Obtain the server information and production traffic metrics of the application, generate the environment information of the application according to the server information, and generate a traffic simulation task according to the production traffic metrics;

[0025] S202 Initiate background simulation traffic for the application according to the environment information and the traffic simulation task, and perform application upgrade and installation;

[0026] S203 Monitor the entrance traffic of the application, the performance parameters of the server, and the load conditions of the server-associated devices;

[0027] S204 Obtain the production drill result of the application through the entrance traffic, the performance parameters, and the load conditions.

[0028] Among them, the performance parameters include the memory usage ratio, the CPU usage ratio, and the coefficient disk processing efficiency; the entrance traffic includes the successful transaction traffic and the failed transaction traffic; the load conditions include the access traffic and load of each network device in the distributed architecture server. Thus, it is possible to simulate production traffic during the production drill, monitor the impact of version upgrade and installation on aspects such as the network, server, and load, evaluate the degree of decline in service capabilities during the upgrade process, determine a suitable production window and production time, and provide guiding opinions for the safe and stable production of the production.

[0029] In an embodiment of the present invention, generating a traffic simulation task according to the production traffic index includes: converting the production traffic index into a query rate index and a response time index, and generating a traffic simulation task according to the query rate index and the response time index. Further, monitoring the entry traffic of the application, the performance parameters of the server, and the load conditions of the server-associated devices further includes: obtaining the historical access traffic data of the application according to the environmental information; comparing the background simulation traffic and the historical access traffic data, and when the difference between the two is less than a preset difference threshold, monitoring the entry traffic of the application, the performance parameters of the server, and the load conditions of the server-associated devices. In the actual process, concurrent access to the application software service will be simulated with real production traffic, and the real production traffic is obtained from the data statistically obtained from the production of the software traffic, and then multi-threaded high concurrency is used to simulate the production traffic to initiate access. Before the access starts, the number of concurrent accesses gradually increases from 1, and the traffic situation is monitored in real time until the simulated traffic is consistent with the production traffic, so as to ensure that the initiated traffic is consistent with the production.

[0030] In an embodiment of the present invention, monitoring the performance parameters of the server includes: collecting the performance parameters of the server through the Prometheus monitoring system, associating the performance parameters with the identification information of the server, and storing them in a predetermined time series database in chronological order. In actual work, the above monitoring service can use the open-source Prometheus system, and Prometheus has the following characteristics: a multi-dimensional data model and a flexible query language, does not rely on distributed storage, and a single server node is autonomous; collects time series data through an HTTP-based pull method, and can push time series data through an intermediate gateway; discovers target service objects through service discovery or static configuration, and supports a variety of icon and page displays, such as Grafana, etc.

[0031] In the above embodiments, the basic principle of Prometheus is to periodically capture the status of monitored components through the HTTP protocol. Any component can be connected to the monitoring as long as it provides the corresponding HTTP interface. The HTTP interface for outputting the information of the monitored component is called an exporter. The monitoring module will automatically send the exporter to the corresponding server according to the IP information of the environment server entered by the user and start the exporter service (the exporter mainly collects information such as the CPU, memory, IO, and traffic of the system). Then, Prometheus will pull the above data from the corresponding exporter, and the pulled information will be stored in its own time series database in chronological order. The CPU, memory, and IO information collected by the exporter is the main information for server monitoring; the collected traffic information is the main information for traffic monitoring; if multiple servers are deployed or distributed, compare whether the traffic of each server is balanced. If it is balanced, it is considered load-balanced; if it is not balanced, it is considered load-unbalanced. The three types of monitoring are collected and stored through Prometheus and the exporter, and then used for different monitoring parts, namely traffic monitoring, server monitoring, and load balance monitoring. The relationship between the three types of monitoring and the overall solution: The three types of monitoring can ensure normal traffic, normal server performance, and normal load balance during the drill. If any one of the three types of monitoring is abnormal, it is considered that there is a problem in the entire drill process. The three types of monitoring are parallel monitoring, and data collection and analysis are carried out simultaneously.

[0032] In an embodiment of the present invention, obtaining the production drill result of the application through the inlet traffic, the performance parameter, and the load condition further includes: comparing the inlet traffic, the performance parameter, and the load condition in the production drill result with a predetermined alarm threshold respectively. When any one of the inlet traffic, the performance parameter, and the load condition meets the predetermined alarm condition, an alarm signal is generated; and the alarm signal is provided to a predetermined position.

[0033] For a clearer understanding of the specific application manner of the above embodiments provided by the present invention, please refer to the following Figure 1 As shown, an example of the actual application process of the above embodiments is given. Those skilled in the relevant art should know that this example is only an application manner for facilitating the understanding of the embodiments provided by the present invention, and does not make any limitation thereto.

[0034] S101 Register environmental information such as the IP of the application software server for subsequent S102 service registration.

[0035] S102 Register the environmental information such as the application software server registered in S101 into the management cluster, and the management cluster can implement health checks and dynamic management of server information.

[0036] S103 refines the traffic into metrics such as QPS (Queries Per Second) and response time.

[0037] S104 means that the traffic initiation module dynamically pulls environment information such as application software servers from the registration cluster and performs regular detection. Once the environment information changes, this module will dynamically update the environment information.

[0038] S105 means generating corresponding traffic simulation tasks according to the metrics of S103.

[0039] S106 executes the task of S106 and initiates background simulation traffic.

[0040] S107 installs the application software upgrade normally under simulated traffic.

[0041] S108 monitors the changes in background traffic during the upgrade process. What is monitored is the traffic at the entrance, that is, all the traffic of the entire application software.

[0042] S109 counts the entrance volume.

[0043] S110 monitors the consumption of system resources during the application software upgrade process.

[0044] S111 refines the system monitoring of S110, including Web, middleware, and storage.

[0045] S112 monitors the load devices of the application software and is applicable to applications such as distributed deployment, multi-server deployment, and multi-campus deployment.

[0046] S113 refines the monitoring devices of S112, including network device monitoring, traffic monitoring of each server, etc.

[0047] Specifically, combined with the production rehearsal scenario of the distributed cache system, the above process is as follows when applied:

[0048] 1. According to the production rehearsal plan, the production rehearsal personnel need to register the environment information such as the IP of the distributed cache system and input the production traffic metrics at the same time.

[0049] 2. The management and control module will register the registered environment information into the management cluster. The management cluster will detect the health of the environment information. At the same time, the management and control module will refine the traffic metrics into metrics such as QPS and response time.

[0050] 3. The task module obtains the traffic metric information from the management and control module and generates the corresponding traffic simulation initiation task script.

[0051] 4. The traffic initiation module first obtains the application software environment information from the master-slave cluster and then obtains the task script from the task module.

[0052] 5. When there is no problem in the third step, the traffic initiation module will execute the task script to simulate production traffic.

[0053] 6. In the context of simulating production traffic, the personnel for production rehearsal perform normal upgrade and installation of application software.

[0054] 7. During the upgrade and installation of application software, it will inevitably affect the simulated traffic, system, network, etc. It is necessary to monitor the traffic, system, and load respectively.

[0055] 8. Traffic monitoring mainly monitors the changes in the entire simulated traffic at the entrance of the application software to evaluate the decline in service capacity during the upgrade of the application software and whether there will be problems during the upgrade of the application software.

[0056] 9. System monitoring mainly monitors the system performance of devices such as web, middleware, and storage during the upgrade of the application software to evaluate whether the entire system meets the upgrade conditions.

[0057] 10. Load monitoring mainly monitors whether the pressure and load of network devices are normal during the upgrade of the application software, and whether each server can support the corresponding traffic when the traffic of each server changes under the condition of rolling upgrade.

[0058] 11. Finally, after the production rehearsal is completed, evaluate the changes in service capacity, system resource usage, load balance, etc. during the upgrade of the application software.

[0059] Please refer to Figure 3 As shown, the present invention also provides a non-stop system rehearsal verification device, and the device includes a simulated traffic module and a monitoring module; the simulated traffic module is used to obtain the server information and production traffic indicators of the application, generate the environment information of the application according to the server information, and generate a traffic simulation task according to the production traffic indicators; initiate background simulated traffic for the application according to the environment information and the traffic simulation task, and perform upgrade and installation of the application; the monitoring module is used to monitor the entrance traffic of the application, the performance parameters of the server, and the load conditions of the server-associated devices; obtain the production rehearsal results of the application through the entrance traffic, the performance parameters, and the load conditions. Among them, the simulated traffic module further includes obtaining the historical access traffic data of the application according to the environment information; comparing the background simulated traffic with the historical access traffic data, and when the difference between the two is less than a preset difference threshold, monitoring the entrance traffic of the application, the performance parameters of the server, and the load conditions of the server-associated devices.

[0060] Among them, the simulation traffic module may include a task module, which is used to convert the production traffic index into a query rate index and a response time index, and generate a traffic simulation task according to the query rate index and the response time index; specifically, in actual work, the traffic task can be refined into indicators such as QPS, response time, throughput (TPS), QPS, and concurrency number, so as to quantify the traffic simulation task and generate corresponding traffic data to complete the traffic simulation. In this process, relevant technical personnel in this field can choose to use according to actual needs. For example, the query rate index and the response time are used as quantification indicators, or the concurrency number is used as a quantification indicator. Specifically, it can be determined by the drill requirements and will not be elaborated one by one here.

[0061] For specific reference, Figure 4 As shown, the application structure of the non-stop system drill verification device provided by the present invention in actual work can be composed of the following components:

[0062] The simulation traffic module is mainly used to simulate production traffic during the production drill of application software. Among them, 001 is the control module, which is used to register the application software environment information and refine the production traffic into indicators such as QPS and response time. 002 is the registration cluster, which is used to dynamically manage the application software environment information. 003 is the task module, which is used to generate a simulation traffic script according to the indicator information. 004 is the traffic initiation module, which, after obtaining the application software environment information from the registration cluster and the task script from the task module, executes the task script to initiate a simulation traffic access to the application software; when the simulation traffic reaches the same traffic as the production, the production drill personnel can normally install and upgrade the application software, and during the installation and upgrade process, monitoring is carried out synchronously; 005, 006, and 007 belong to the monitoring module of the invention, which is used to monitor relevant data during the production drill process. Among them, 005 is the traffic monitoring, which is used to monitor whether the traffic of the entire application software has changed. More precisely, whether the simulation traffic has decreased during the installation and upgrade of the application software, and how much the decrease is. 006 is the system monitoring, which is used to monitor the front-end server, middleware, storage, etc. of the application software. 007 is the load monitoring, which is used to monitor the network load device of the application software and the traffic conditions of each server. More precisely, during the upgrade process, if rolling upgrade is adopted, the network load device and some servers will inevitably bear a greater traffic impact. The detailed introduction is as follows:

[0063] 001 is a control module that registers environmental information such as application software servers into the 002 registration cluster and generates metrics such as QPS and response time by refining traffic, which are used to generate task scripts subsequently. 002 is a registration cluster for dynamically managing environmental information such as application software servers, capable of ensuring the health and availability of the application software environment. 003 is a task module for generating corresponding simulated traffic task scripts according to the metric information output by 001. 004 is a traffic initiation module that, after obtaining environmental information such as application software servers from 002, obtains the simulated traffic task script from 003 and executes the task script. 005 is a traffic monitoring module for monitoring the changes in simulated traffic during the installation and upgrade of application software. Here, the simulated traffic refers to the overall traffic. 006 is a system monitoring module for monitoring the system performance of nodes such as front-end servers, middleware, and storage during the installation and upgrade of application software. 007 is a load monitoring module for monitoring the performance consumption of network load devices during the installation and upgrade of application software, as well as the traffic modules of each application software server. Specifically, during the rolling upgrade of application software, after the original traffic necessarily passes through the load, the traffic is distributed to the un-upgraded servers, and this module can monitor the load situation of the traffic.

[0064] The method and device for non-stop system rehearsal verification provided by the present invention can conduct production rehearsal under the condition of simulating production traffic, making the rehearsal results more applicable to the actual production situation; can evaluate the decline in service capabilities caused by the upgrade of application software, facilitating the confirmation of the production time and production window; and whether there are bottlenecks in system resources caused by the upgrade of application software. If there are bottlenecks, capacity can be expanded in a timely manner; and whether load imbalance will be caused during the upgrade of application software, and whether network devices and each server can withstand the increased traffic, which is beneficial to guiding the smooth production of the production.

[0065] The present invention also provides an electronic device, including a memory, a processor, and a computer program stored on the memory and executable on the processor. When the processor executes the computer program, the above method is implemented.

[0066] The present invention also provides a computer-readable storage medium storing a computer program for executing the above method.

[0067] As Figure 5 shown, the electronic device 600 may further include: a communication module 110, an input unit 120, an audio processor 130, a display 160, and a power supply 170. It should be noted that the electronic device 600 does not necessarily have to include all the components shown in Figure 5 ; in addition, the electronic device 600 may further include components not shown in Figure 5 , and reference may be made to the prior art.

[0068] AsFigure 5 As shown, the central processing unit 100, sometimes also referred to as a controller or operation control, may include a microprocessor or other processor device and / or logic device. The central processing unit 100 receives inputs and controls the operation of various components of the electronic device 600.

[0069] Among them, the memory 140 can be, for example, one or more of a buffer, a flash memory, a hard drive, a removable medium, a volatile memory, a non-volatile memory, or other suitable devices. It can store the above information related to failures, and can also store programs for executing relevant information. And the central processing unit 100 can execute the programs stored in the memory 140 to achieve information storage or processing, etc.

[0070] The input unit 120 provides inputs to the central processing unit 100. The input unit 120 is, for example, a key or a touch input device. The power supply 170 is used to supply power to the electronic device 600. The display 160 is used to display display objects such as images and texts. The display can be, for example, an LCD display, but is not limited thereto.

[0071] The memory 140 can be a solid-state memory. For example, it can be a read-only memory (ROM), a random access memory (RAM), a SIM card, etc. It can also be a memory that stores information even when powered off, can be selectively erased and has more data. Examples of such a memory are sometimes referred to as EPROMs, etc. The memory 140 can also be some other type of device. The memory 140 includes a buffer memory 141 (sometimes referred to as a buffer). The memory 140 can include an application / function storage section 142, which is used to store application programs and function programs or the processes for operating the electronic device 600 through the central processing unit 100.

[0072] The memory 140 can also include a data storage section 143, which is used to store data, such as contacts, digital data, pictures, sounds, and / or any other data used by the electronic device. The driver storage section 144 of the memory 140 can include various drivers of the electronic device for communication functions and / or for performing other functions of the electronic device (such as a messaging application, an address book application, etc.).

[0073] The communication module 110 is a transmitter / receiver 110 that transmits and receives signals via the antenna 111. The communication module (transmitter / receiver) 110 is coupled to the central processing unit 100 to provide input signals and receive output signals, which can be the same as in the case of a conventional mobile communication terminal.

[0074] Based on different communication technologies, in the same electronic device, multiple communication modules 110 can be provided, such as a cellular network module, a Bluetooth module, and / or a wireless local area network module, etc. The communication module (transmitter / receiver) 110 is also coupled to a speaker 131 and a microphone 132 via an audio processor 130 to provide an audio output via the speaker 131 and receive an audio input from the microphone 132, so as to implement normal telecommunication functions. The audio processor 130 can include any suitable buffers, decoders, amplifiers, etc. In addition, the audio processor 130 is also coupled to a central processor 100, so that recording can be performed on the local machine through the microphone 132, and the sound stored on the local machine can be played through the speaker 131.

[0075] Those skilled in the art should understand that the embodiments of the present invention can be provided as a method, a system, or a computer program product. Therefore, the present invention can take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware aspects. Moreover, the present invention can take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0076] The present invention is described with reference to the flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to the embodiments of the present invention. It should be understood that each flow and / or block in the flowcharts and / or block diagrams, and the combination of flows and / or blocks in the flowcharts and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing devices to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing devices generate a device for implementing the functions specified in Figure 1 one flow or multiple flows and / or blocks Figure 1 one block or multiple blocks.

[0077] These computer program instructions can also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer-readable memory generate a manufactured article including an instruction device, and the instruction device implements the functions specified in Figure 1 one flow or multiple flows and / or blocks Figure 1 one block or multiple blocks.

[0078] These computer program instructions can also be loaded onto a computer or other programmable data processing apparatus, so that a series of operation steps are executed on the computer or other programmable apparatus to produce a computer-implemented process, thereby providing instructions for implementing the steps of the functions specified in one process or a plurality of processes and / or blocks Figure 1 in one block or a plurality of blocks Figure 1 in the method and system for implementing the functions specified in one block or a plurality of blocks.

[0079] The specific embodiments described above further elaborate the objectives, technical solutions and beneficial effects of the present invention. It should be understood that the above are only specific embodiments of the present invention and are not intended to limit the protection scope of the present invention. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A method for verifying the drill of a non-stop system, characterized in that, the method includes: Obtain the server information of the application and the production traffic metrics, generate the environment information of the application according to the server information, and generate a traffic simulation task according to the production traffic metrics; Initiate background simulation traffic for the application according to the environment information and the traffic simulation task, and perform application upgrade and installation; Monitor the inlet traffic of the application, the performance parameters of the server, and the load conditions of the server-related devices; Obtain the production drill result of the application through the inlet traffic, the performance parameters, and the load conditions; The inlet traffic includes successful transaction traffic and failed transaction traffic; the load conditions include the access traffic and load of each network device in the distributed architecture server; Generating a traffic simulation task according to the production traffic metrics includes: converting the production traffic metrics into query rate metrics and response time metrics, and generating a traffic simulation task according to the query rate metrics and the response time metrics.

2. The method for verifying the drill of a non-stop system according to claim 1, characterized in that, Monitoring the inlet traffic of the application, the performance parameters of the server, and the load conditions of the server-related devices further includes: Obtain the historical access traffic data of the application according to the environment information; Compare the background simulation traffic with the historical access traffic data, and when the difference between the two is less than a preset difference threshold, monitor the inlet traffic of the application, the performance parameters of the server, and the load conditions of the server-related devices.

3. The method for verifying the drill of a non-stop system according to claim 1, characterized in that, Monitoring the performance parameters of the server includes: Collect the performance parameters of the server through the Prometheus monitoring system, associate the performance parameters with the identification information of the server, and store them in a predetermined time series database in chronological order.

4. The method for verifying the drill of a non-stop system according to claim 1, characterized in that, The performance parameters include the memory usage ratio, the CPU usage ratio, and the coefficient disk processing efficiency.

5. The method for verifying the drill of a non-stop system according to claim 1, characterized in that, Obtaining the production drill result of the application through the inlet traffic, the performance parameters, and the load conditions further includes: Compare the inlet traffic, the performance parameters, and the load conditions in the production drill result with the predetermined alarm thresholds respectively, and generate an alarm signal when any of the inlet traffic, the performance parameters, and the load conditions meets the predetermined alarm conditions; Provide the alarm signal to a predetermined location.

6. A device for verifying the drill of a non-stop system, characterized in that, the device includes a simulation traffic module and a monitoring module; The simulation traffic module is used to obtain the server information of the application and the production traffic metrics, generate the environment information of the application according to the server information, and generate a traffic simulation task according to the production traffic metrics; initiate background simulation traffic for the application according to the environment information and the traffic simulation task, and perform application upgrade and installation; Generating a traffic simulation task according to the production traffic index includes: converting the production traffic index into a query rate index and a response time index, and generating a traffic simulation task according to the query rate index and the response time index; The monitoring module is used to monitor the entry traffic of the application, the performance parameters of the server, and the load conditions of the server-associated devices; and obtain the production rehearsal results of the application through the entry traffic, the performance parameters, and the load conditions; The entry traffic includes successful transaction traffic and failed transaction traffic; the load conditions include the access traffic and load of each network device in the distributed architecture server.

7. The non-stop system rehearsal verification device according to claim 6, wherein, The simulated traffic module further includes obtaining historical access traffic data of the application according to the environmental information; comparing the background simulated traffic and the historical access traffic data, and when the difference between the two is less than a preset difference threshold, monitoring the entry traffic of the application, the performance parameters of the server, and the load conditions of the server-associated devices.

8. An electronic device, comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein, When the processor executes the computer program, it implements the method according to any one of claims 1 to 5.

9. A computer-readable storage medium, wherein, The computer-readable storage medium stores a computer program for the computer to execute the method according to any one of claims 1 to 5.

10. A computer program product, wherein, The computer program product includes a computer program, and when the computer program is executed by a processor, it implements the method according to any one of claims 1 to 5.

Images