Business change method and device, equipment, medium and program product

Abstract

The invention provides a business change method and device, equipment, a medium and a program product, which can be applied to the technical fields of information system management, cloud computing and finance. The business change method comprises the following steps: in response to obtaining a business change document, inputting the business change document into a test case generation model to obtain a test case corresponding to a target business system; inputting a plurality of test scripts written according to the test case into the performance prediction model to obtain a respective prediction performance index of each test script; under the condition that the plurality of prediction performance indexes meet a first preset condition, executing the plurality of test scripts to obtain a test result; under the condition that the test result meets a second preset condition, evaluating the test result and the plurality of prediction performance indexes to obtain an evaluation result; and under the condition that the evaluation result represents that the change is permitted, performing service change on the initial service system to obtain a target service system.

Description

Technical Field

[0001] The present disclosure relates to information system management, cloud computing technology and finance, and more specifically, to a business change method, device, equipment, medium and program product. Background Art

[0002] With the rapid development of information technology, business systems need to be able to respond to changes in the external environment (such as business volume adjustments, new business functions, etc.) to meet the needs of constantly updated business systems and increasing data volumes. This requires that the infrastructure, application systems, business data, etc. that support the operation of business systems undergo business changes. However, while business changes promote business development, they also bring the risk of failures caused by the implementation of changes.

[0003] In the process of implementing the concepts disclosed herein, the inventors discovered that there are at least the following problems in the related technologies: the related business change methods still have some shortcomings, such as the lack of dynamic and adaptive capabilities to handle changing business needs and technical environments, and limitations in controlling business change risks. Summary of the invention

[0004] In view of the above problems, the present disclosure provides a service change method, apparatus, device, medium and program product.

[0005] According to a first aspect of the present disclosure, a business change method is provided, comprising: in response to obtaining a business change document, inputting the business change document into a test case generation model to obtain a test case corresponding to a target business system, wherein the business change document represents the change content of the target business system relative to an initial business system; inputting a plurality of test scripts written according to the test case into a performance prediction model respectively to obtain respective predicted performance indicators of each test script, wherein each test script has its own business magnitude; in a case where the plurality of predicted performance indicators satisfy a first preset condition, executing the plurality of test scripts to obtain test results; in a case where the test results satisfy a second preset condition, evaluating the test results and the plurality of predicted performance indicators to obtain evaluation results; and in a case where the evaluation result represents a permitted change, implementing a business change on the initial business system to obtain a target business system.

[0006] According to an embodiment of the present disclosure, after implementing a business change on an initial business system to obtain a target business system, the business change method further includes: monitoring the target business system based on a monitoring platform; in response to receiving an alarm message from the monitoring platform, parsing the alarm message to determine the cause of the alarm; based on the abnormal event associated with the alarm cause, pushing the alarm message and the abnormal event; and based on the adjustment strategy for the alarm message and the abnormal event, updating the business change document to re-implement the business change according to the updated business change document.

[0007] According to an embodiment of the present disclosure, the business change method also includes: updating the business change document when multiple prediction performance indicators do not meet the first preset condition; updating the business change document when the test result does not meet the second preset condition; and updating the business change document when the evaluation result indicates that the change is not permitted.

[0008] According to an embodiment of the present disclosure, the predicted performance indicators include at least one of the following: single business processing time, business throughput per unit time, CPU occupancy, memory occupancy, database processing efficiency and period increment of system storage resources, and the test results include peak test results and continuity test results. The peak test results characterize the performance of the target business system under business extreme load conditions, and the continuity test results characterize the performance of the target business system under business interruption conditions. The first preset condition includes: the predicted performance indicators corresponding to each test script meet the preset performance expectations; the second preset condition includes: the peak test results and continuity test results corresponding to each test script meet the preset test expectations.

[0009] According to an embodiment of the present disclosure, a business change document is input into a test case generation model to obtain a test case corresponding to a target business system, including: inputting the business change document into the test case generation model to extract change information representing the change content; based on the change information and the test case corresponding to the initial business system, generating candidate test cases corresponding to the target business system; and verifying the candidate test cases to obtain a test case corresponding to the target business system when the candidate test case passes the verification.

[0010] According to an embodiment of the present disclosure, a performance prediction model is obtained by training based on historical business data, and the historical business data includes historical test scripts and historical performance data; a plurality of test scripts written according to the test case are respectively input into the performance prediction model to obtain the respective predicted performance indicators of each test script, including: inputting the script parameters of the initial test script written according to the test case into the performance prediction model to obtain the predicted performance indicators corresponding to the initial test script, and the script parameters include business level parameters, business function parameters and business configuration parameters; adjusting the business level parameters of the initial test script according to a plurality of preset business levels to obtain a plurality of reference test scripts; and inputting the script parameters of the plurality of reference test scripts into the performance prediction model to obtain the respective predicted performance indicators corresponding to the plurality of reference test scripts; the evaluation system is constructed based on preset business rules and a rule engine, and the preset business rules are determined based on preset risk assessment standards, historical change data and historical alarm information, and the historical change data includes historical change content and historical evaluation information associated with the historical change content, and the evaluation results include change risks and change suggestions.

[0011] According to another aspect of the present disclosure, a business change device is provided, including: a generation module, for inputting the business change document into a test case generation model in response to obtaining a business change document, to obtain a test case corresponding to a target business system, wherein the business change document represents the change content of the target business system relative to the initial business system; a prediction module, for inputting a plurality of test scripts written according to the test case into a performance prediction model, respectively, to obtain respective predicted performance indicators of each test script, wherein each test script has its own business magnitude; a testing module, for executing a plurality of test scripts to obtain test results when a plurality of predicted performance indicators satisfy a first preset condition; an evaluation module, for evaluating the test results and a plurality of predicted performance indicators to obtain evaluation results when the test results satisfy a second preset condition; and a change module, for implementing a business change on the initial business system to obtain a target business system when the evaluation result represents a permitted change.

[0012] According to another aspect of the present disclosure, an electronic device is provided, comprising: one or more processors; and a memory for storing one or more computer programs, wherein the one or more processors execute the one or more computer programs to implement the steps of the above method.

[0013] According to another aspect of the present disclosure, a computer-readable storage medium is provided, on which a computer program or instruction is stored. When the computer program or instruction is executed by a processor, the steps of the method are implemented.

[0014] According to another aspect of the present disclosure, a computer program product is provided, including a computer program or instructions, and the steps of the above method are implemented when the computer program or instructions are executed by a processor. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] The above contents and other objects, features and advantages of the present disclosure will become more apparent through the following description of the embodiments of the present disclosure with reference to the accompanying drawings, in which:

[0016] Figure 1 The application scenario diagram of the service change method, apparatus, device, medium and program product according to the embodiment of the present disclosure is schematically shown;

[0017] Figure 2 A flowchart of a service change method according to an embodiment of the present disclosure is schematically shown;

[0018] Figure 3 The service change process according to the embodiment of the present disclosure is schematically shown;

[0019] Figure 4 A schematic diagram shows a structural block diagram of a service change device according to an embodiment of the present disclosure; and

[0020] Figure 5 A block diagram of an electronic device suitable for implementing the method described above according to an embodiment of the present disclosure is schematically shown. DETAILED DESCRIPTION

[0021] Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. However, it should be understood that these descriptions are exemplary only and are not intended to limit the scope of the present disclosure. In the following detailed description, for ease of explanation, many specific details are set forth to provide a comprehensive understanding of the embodiments of the present disclosure. However, it is apparent that one or more embodiments may also be implemented without these specific details. In addition, in the following description, descriptions of known structures and technologies are omitted to avoid unnecessary confusion of the concepts of the present disclosure.

[0022] The terms used herein are only for describing specific embodiments and are not intended to limit the present disclosure. The terms "comprise", "include", etc. used herein indicate the existence of the features, steps, operations and / or components, but do not exclude the existence or addition of one or more other features, steps, operations or components.

[0023] All terms (including technical and scientific terms) used herein have the meanings commonly understood by those skilled in the art unless otherwise defined. It should be noted that the terms used herein should be interpreted as having a meaning consistent with the context of this specification and should not be interpreted in an idealized or overly rigid manner.

[0024] When using expressions such as "at least one of A, B, and C, etc.", they should generally be interpreted according to the meaning of the expression commonly understood by those skilled in the art (for example, "a system having at least one of A, B, and C" should include but is not limited to a system having A alone, B alone, C alone, A and B, A and C, B and C, and / or A, B, C, etc.).

[0025] It should be noted that in the embodiments of the present disclosure, certain software, components, models and other existing solutions in the industry may be mentioned, and they should be regarded as exemplary. Their purpose is only to illustrate the feasibility of implementing the technical solution of the present disclosure, but it does not mean that the applicant has or will necessarily use the solution.

[0026] In the technical solution of the embodiments of the present disclosure, the data involved (for example, including but not limited to user personal information, user image information, user device information, such as location information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) are all information and data authorized by the user or fully authorized by all parties, and the collection, storage, use, processing, transmission, provision, disclosure and application of the relevant data comply with relevant laws, regulations and standards, take necessary confidentiality measures, do not violate public order and good morals, and provide corresponding operation entrances for users to choose to authorize or refuse.

[0027] In the scenario of using personal information for automated decision-making, the methods, devices, and systems provided by the embodiments of the present disclosure provide users with corresponding operation portals for users to choose to agree or reject the automated decision-making results; if the user chooses to reject, the expert decision-making process will be entered. The expression "automated decision-making" here refers to the activity of automatically analyzing and evaluating a person's behavioral habits, interests and hobbies, or economic, health, credit status, etc. through computer programs, and making decisions. The expression "expert decision-making" here refers to the activity of making decisions by people who specialize in a certain field, have specialized experience, knowledge and skills, and have reached a certain level of professionalism.

[0028] With the rapid development of information technology, business systems need to be able to respond to changes in the external environment (such as business volume adjustments, new business functions, etc.) to make adjustments to meet the needs of constantly updated business systems and increasing data volumes. This requires that the infrastructure, application systems, business data, etc. that support the operation of business systems undergo business changes accordingly. However, while business changes promote business development, they also bring the risk of failures caused by the implementation of changes.

[0029] In the process of implementing the concepts disclosed herein, the inventors discovered that there are at least the following problems in the related technologies: the related business change methods still have some shortcomings, such as the lack of dynamic and adaptive capabilities to handle changing business needs and technical environments, and limitations in controlling business change risks.

[0030] According to an embodiment of the present disclosure, a business change may include a change to a business system and a change to configuration resources associated with the business system. Exemplarily, a business change may be a change driven by demand or failure.

[0031] According to one embodiment of the present disclosure, the changes may include adding, modifying or deleting any content that may have a direct or indirect impact on the service. For example, the changes may include: the launch of new functions of the business system, the commissioning of programs of the existing business system, configuration changes, business parameter adjustments, data maintenance, patch upgrades, account migrations, system switching, version rollbacks, etc. For example, the changes may also include: changes to the computer room, network, IAAS platform, PAAS platform, and platform software such as operating system, database, middleware, etc. associated with the business system, such as computer room migration, equipment replacement, new module installation, basic platform hardware and software upgrades and reinforcements, preventive maintenance, increased capacity, improved system performance, etc.

[0032] According to the embodiments of the present disclosure, implementing business changes is often a high-risk and error-prone process. Business changes may introduce new errors or unstable factors, which may lead to business continuity failures and cause operation and maintenance accidents. Exemplarily, operation and maintenance accidents that may be caused by business changes include data loss, security vulnerabilities, functional failures, performance degradation, user misoperation and even system crashes, which may cause serious economic losses, data losses, security issues, credibility crises and even brand damage. For example, in the financial field, due to the high competitiveness of the financial market and the strict requirements on service quality, any service interruption or performance degradation caused by business changes may have a negative impact on customer satisfaction and even lead to legal and compliance risks. Therefore, how to implement business changes efficiently and accurately, and control the risk of failures caused by business changes, has become a problem that technicians in this field urgently need to solve.

[0033] In order to at least partially solve the technical problems existing in the related art, the embodiments of the present disclosure provide a business change method, apparatus, device, medium and program product, and the business change method includes: in response to obtaining a business change document, inputting the business change document into a test case generation model to obtain a test case corresponding to a target business system, wherein the business change document represents the change content of the target business system relative to the initial business system; inputting multiple test scripts written according to the test case into a performance prediction model respectively to obtain a predicted performance indicator of each test script, wherein each test script has its own business magnitude; when multiple predicted performance indicators meet a first preset condition, executing multiple test scripts to obtain test results; when the test results meet a second preset condition, evaluating the test results and multiple predicted performance indicators to obtain evaluation results; and when the evaluation result represents a permitted change, implementing a business change on the initial business system to obtain a target business system.

[0034] It should be noted that the business change method and device provided in the embodiments of the present disclosure can be used for financial business system changes in the financial field, and can also be used for business system changes in any field other than the financial field. The application field of the business change method and device provided in the embodiments of the present disclosure is not limited.

[0035] Figure 1 The application scenario diagram of the service change method, apparatus, device, medium and program product according to the embodiments of the present disclosure is schematically shown.

[0036] like Figure 1 As shown, the application scenario 100 according to this embodiment may include a first terminal device 101, a second terminal device 102, a third terminal device 103, a network 104, and a server 105. The network 104 is used to provide a medium for a communication link between the first terminal device 101, the second terminal device 102, the third terminal device 103, and the server 105. The network 104 may include various connection types, such as wired, wireless communication links, or optical fiber cables, etc.

[0037] The user can use the first terminal device 101, the second terminal device 102, and the third terminal device 103 to interact with the server 105 through the network 104 to receive or send messages, etc. Various communication client applications can be installed on the first terminal device 101, the second terminal device 102, and the third terminal device 103, such as shopping applications, web browser applications, search applications, instant messaging tools, email clients, social platform software, etc. (only for example).

[0038] The first terminal device 101, the second terminal device 102, and the third terminal device 103 may be various electronic devices having display screens and supporting web browsing, including but not limited to smart phones, tablet computers, laptop computers, desktop computers, and the like.

[0039] The server 105 may be a server that provides various services, such as a background management server (only as an example) that provides support for websites browsed by users using the first terminal device 101, the second terminal device 102, and the third terminal device 103. The background management server may analyze and process the received data such as user requests, and feed back the processing results (such as web pages, information, or data obtained or generated according to user requests) to the terminal device.

[0040] It should be noted that the service change method provided in the embodiment of the present disclosure can generally be executed by the server 105. Accordingly, the service change device provided in the embodiment of the present disclosure can generally be set in the server 105. The service change method provided in the embodiment of the present disclosure can also be executed by a server or server cluster that is different from the server 105 and can communicate with the first terminal device 101, the second terminal device 102, the third terminal device 103 and / or the server 105. Accordingly, the service change device provided in the embodiment of the present disclosure can also be set in a server or server cluster that is different from the server 105 and can communicate with the first terminal device 101, the second terminal device 102, the third terminal device 103 and / or the server 105.

[0041] It should be understood that Figure 1 The number of terminal devices, networks and servers in the embodiment is only for illustration. Any number of terminal devices, networks and servers may be provided according to implementation requirements.

[0042] The following will be based on Figure 1 The scene described by Figure 2~Figure 5 The service change method of the disclosed embodiment is described in detail.

[0043] Figure 2 The flowchart of the service change method according to the embodiment of the present disclosure is schematically shown.

[0044] like Figure 2 As shown, the service change method 200 of the embodiment of the present disclosure includes operations S210 to S250.

[0045] In operation S210 , in response to obtaining a business change document, the business change document is input into a test case generation model to obtain a test case corresponding to a target business system, wherein the business change document represents a change content of the target business system relative to an initial business system.

[0046] In operation S220, a plurality of test scripts written according to the test case are respectively input into the performance prediction model to obtain a prediction performance index of each test script, wherein each test script has its own business volume level.

[0047] In operation S230, when the plurality of prediction performance indicators satisfy a first preset condition, a plurality of test scripts are executed to obtain test results.

[0048] In operation S240, when the test result satisfies the second preset condition, the test result and a plurality of prediction performance indicators are evaluated to obtain an evaluation result.

[0049] In operation S250 , when the evaluation result indicates that the change is permitted, the business change is implemented on the initial business system to obtain the target business system.

[0050] According to the embodiments of the present disclosure, operation and maintenance personnel can write business change documents according to change requirements. The business change documents mainly involve several aspects of business system operation, such as: business and application adjustment, network security, database, middleware, system performance, server, infrastructure, etc.

[0051] According to an embodiment of the present disclosure, the initial business system can be understood as the business system before the implementation of the business change, and the target business system can be understood as the business system after the implementation of the business change. The business change document can characterize the changes in the target business system relative to the initial business system. In response to obtaining the business change document, the business change system can be input into the test case generation model to obtain test cases corresponding to the target business system. The test case generation model can realize the rapid generation of test cases, and compared with inputting the business description document corresponding to the target business system, the business change document can allow the test case generation model to dynamically and adaptively automatically generate test cases corresponding to the target business system according to the change content, so as to meet the needs of short-cycle and high-frequency business changes, thereby facilitating the efficient implementation of business changes.

[0052] According to an embodiment of the present disclosure, a general business change document template (such as a form or table format) can be formulated, and operation and maintenance personnel can fill in the relevant change items in the business change document template as needed to ensure the standardization, accuracy and comprehensiveness of the business change document, thereby facilitating the test case generation model to more accurately identify and process the change content, which is conducive to improving the effectiveness and correctness of the generated test cases.

[0053] According to an embodiment of the present disclosure, multiple test scripts can be written according to test cases, and different test scripts can correspond to different business levels of the target system, and the business level can characterize the amount of data processed by the target business system. For example, the business level corresponding to test script 1 is ten thousand, the business level corresponding to test script 2 is one hundred thousand, and the business level corresponding to test script 3 is one thousand. Optionally, different test scripts can also correspond to different application scenarios, different test conditions, etc., to further improve the comprehensiveness and coverage of multiple test scripts. Among them, different application scenarios can, for example, include different business processes, different user behaviors, etc., and different test conditions can, for example, include different hardware environments, different operating systems, etc.

[0054] According to the embodiments of the present disclosure, multiple test scripts can be input into the performance prediction model to obtain the predicted performance index of each test script. By performing performance prediction on test scripts at different business levels, the change content can be adjusted in a targeted manner according to the performance of the target business system in processing data at different business levels, thereby providing fault tolerance for subsequent business increments or decrements, which is conducive to improving the stability of the business and leaving room for the future development of the business system.

[0055] According to an embodiment of the present disclosure, the first preset condition may include a first preset sub-condition, and multiple predictive performance indicators satisfying the first preset condition may include: the predictive performance indicators of each test script satisfy the first test sub-condition. Multiple predictive performance indicators satisfying the first preset condition can represent that the predictive performance of the target business system at multiple business levels meets expectations. Exemplarily, for each test script, the predictive performance indicator may include at least one of the following: response time, number of concurrent users, resource utilization, system availability, error rate, transaction processing time, data throughput, page loading time, network delay, system capacity, scalability, fault tolerance, recovery time, security, etc.

[0056] According to an embodiment of the present disclosure, when multiple predicted performance indicators meet the first preset condition, multiple test scripts can be executed to obtain test results. Optionally, performance prediction can be performed on multiple test scripts based on simulated business data, and when multiple predicted performance indicators meet the first preset condition, multiple test scripts can be executed based on real business data. Executing automated test scripts can simulate user operations and business processes while monitoring system performance and stability. Testing under different loads and scenarios can ensure a comprehensive evaluation.

[0057] As an example, multiple test scripts can be executed in a preset test environment based on an automated testing tool. For example, the test environment configuration information can be determined according to the test requirements, such as the hardware configuration, network settings, storage requirements, and pre-installed software stack required for the test environment. The automated testing tool can be used to read the test environment configuration information and quickly deploy a test environment similar to the production environment based on cloud computing resources. Furthermore, containerization technology can also be used to achieve elastic scaling and isolation of the test environment.

[0058] For example, a test environment configuration information template can be established, which can describe in detail the hardware configuration, network settings, storage requirements and pre-installed software stack required for the test environment. The template can be customized based on different test scenarios, and the test environment configuration information can be determined based on the test requirements and the configuration template. The test environment configuration information can be read using an automated testing tool, and the corresponding resources can be dynamically applied for on the cloud service platform, including but not limited to virtual machines, storage space and network resources, to deploy a test environment similar to the production environment. The container orchestration tool can be used to encapsulate the application and dependent components in the container, so that the test script can be run in the same state in any environment. Furthermore, according to the test requirements, the automation rules can be preset to achieve elastic scaling of the test environment, such as automatically increasing resources when the load increases, or reducing unnecessary resources within a certain period of time to save costs. The test environment can also be set to be completely isolated from the production environment, and at the same time, network security policies such as firewalls, access control lists and security groups can be implemented to ensure the security of the environment.

[0059] According to an embodiment of the present disclosure, the test result may include a test sub-result for each test script, the second preset condition may include a second preset sub-condition, and the test result satisfying the second preset condition may include: the test sub-result for each test script satisfies the second preset sub-condition. The test result satisfying the second preset condition may indicate that the test performance of the target business system at multiple business levels meets expectations. Exemplarily, for each test script, the test sub-result may include at least one of the following: a test conclusion (such as passed, failed, error, etc.), a test defect, a defect analysis, a test suggestion, etc. Optionally, the test sub-result may be selected in the form of a report, a form, a chart, etc.

[0060] According to an embodiment of the present disclosure, when the test result meets the second preset condition, the test result and multiple prediction performance indicators can be evaluated to obtain an evaluation result. Exemplarily, the evaluation result may include change risks and change suggestions, and the change suggestions may include evaluation conclusions (such as permission to change or non-permission to change) and adjustment suggestions. Optionally, an evaluation report can also be generated based on the evaluation results, listing in detail the risk points, recommended mitigation measures, and feasibility of going online.

[0061] According to an embodiment of the present disclosure, the predicted performance indicators and test sub-results of each test script can be automatically evaluated based on the evaluation system to obtain an evaluation result. In the case where the evaluation system cannot meet the evaluation requirements, the test results and multiple test performance indicators can be manually evaluated to obtain an evaluation result. In the case where the evaluation result represents a license change, a business change can be implemented on the initial business system to obtain a target business system.

[0062] According to the embodiments of the present disclosure, by inputting the business change document into the test case generation model, the test cases corresponding to the target business system can be dynamically and adaptively automatically generated according to the change content, so as to meet the short-cycle and high-frequency business change requirements, thereby facilitating the efficient implementation of business changes. By performing performance prediction, execution testing and change evaluation on multiple test scripts, the change content can be fully evaluated and targetedly adjusted before the business change is officially implemented until it meets expectations, so that the risk of business changes can be controlled in advance and effectively, thereby reducing the risk of causing failures after the business change is implemented. In addition, by performing performance prediction, testing and evaluation on test scripts under different business volumes, the change content can also be targetedly adjusted according to the performance of the target business system in processing data of different business volumes, so as to provide fault tolerance for subsequent business increments or decrements, which is conducive to improving the stability of the business and leaving room for the future development of the business system.

[0063] According to an embodiment of the present disclosure, after implementing a business change on an initial business system to obtain a target business system, the business change method further includes: monitoring the target business system based on a monitoring platform; in response to receiving an alarm message from the monitoring platform, parsing the alarm message to determine the cause of the alarm; based on the abnormal event associated with the alarm cause, pushing the alarm message and the abnormal event; and based on the adjustment strategy for the alarm message and the abnormal event, updating the business change document to re-implement the business change according to the updated business change document.

[0064] According to an embodiment of the present disclosure, the monitoring platform can monitor the target business system based on the monitoring configuration information. Exemplarily, the monitoring configuration information can be generated together with the test case through a test case generation model.

[0065] According to the embodiments of the present disclosure, the monitoring configuration information can be used to monitor the target business system to ensure the continuous, stable and safe operation of the system. For example, based on the monitoring configuration information, it can be achieved: real-time monitoring of the operating status of the target business system; collection of operating information of the target business system; prediction of existing failure risks through analysis results of the collected information, and taking actions; failure warning based on risk assessment; once a failure occurs, an alarm message is issued as soon as possible; through monitoring data, the cause of the failure is located and solutions are generated. Furthermore, the monitoring configuration information can be used to monitor the target business system to facilitate subsequent data analysis and problem review. For example, statistics, analysis, and visualization of monitoring data can also be achieved based on the monitoring configuration information.

[0066] According to an embodiment of the present disclosure, the monitoring configuration information may include monitoring indicators and alarm thresholds, alarm levels, alarm triggering conditions and notification methods, alarm processing procedures, etc.

[0067] As an example, the monitoring indicator may include at least one of the following: CPU usage, memory usage, disk space, network traffic, response time, error rate, etc. As another example, the monitoring indicator may be set corresponding to the predicted performance indicator, and may include at least one of the following: response time, number of concurrent users, resource utilization, system availability, error rate, transaction processing time, data throughput, page loading time, network delay, system capacity, scalability, fault tolerance, recovery time, security, etc. Regarding the corresponding alarm threshold of each monitoring indicator, those skilled in the art may reasonably set it according to actual needs or application scenarios, etc., and no specific limitation is made here.

[0068] According to an embodiment of the present disclosure, in response to receiving an alarm message from a monitoring platform, the alarm message can be parsed to determine the cause of the alarm. Among them, the alarm cause characterizes the association between the alarm message and the event, and the event may include an abnormal event and a false alarm event. Rules and logic for associating alarm information with events can be defined. When it is determined that an abnormal event is associated with the alarm message, the alarm message and the associated abnormal event are pushed so that relevant personnel can quickly and accurately locate and solve the problem and reduce false alarms. Exemplarily, the rules and logic for associating alarm information with events can be determined by analysis methods such as flowcharts, fishbone diagrams (also known as cause-and-effect diagrams or Ishikawa diagrams), hierarchical methods, Pareto diagrams (80-20 rules), and control charts (also known as Schuchat diagrams), which are not specifically limited here.

[0069] According to an embodiment of the present disclosure, the dimensions and indicators that need to be monitored can be clearly defined, involving aspects such as business performance, system resources and security events, such as transaction response time, system load, memory usage, network traffic and abnormal events. Monitoring agents and tools, including log collectors, performance monitoring tools and monitoring platforms, can be deployed on relevant systems and network nodes. Reasonable thresholds and monitoring policies can be set for each monitoring indicator, and the thresholds can be determined based on historical performance data and business needs. Rules and logic for associating alarm information with events can be defined so that event data from different sources can be aggregated and analyzed to identify potential problems and correlations. When abnormal behavior is found or a preset monitoring policy is violated, an alarm is automatically triggered, and the alarm information can be parsed to determine the event associated with the alarm information. In the case where it is determined that the alarm information is associated with an abnormal event, the alarm information and abnormal events can be pushed to the relevant clerks through emails, text messages, and application notifications. In addition, a complex event processing engine (Complex Event Processing, CEP) can be used to implement analysis of real-time data to quickly detect abnormal patterns and potential problems. Furthermore, a centralized database can be established to store all collected monitoring data and event records as historical alarm information to facilitate subsequent analysis and long-term trend evaluation, as well as to feed back historical alarm information to the evaluation system.

[0070] According to an embodiment of the present disclosure, alarm information and abnormal events can be pushed based on the abnormal events associated with the alarm cause. After receiving the alarm information and the associated abnormal events, the operation and maintenance personnel can update the business change document based on the adjustment strategy for the alarm information and the abnormal events, and then re-implement the business change according to the updated business change document. In addition, the alarm information, abnormal events and the business change documents corresponding to the current business system can be associated and stored as historical alarm information, and the historical alarm information can be fed back to the evaluation system. Thereby, it can be beneficial to improve the accuracy of the evaluation system, further reduce the risk of business changes, and realize the closed-loop management of business change risks, which is beneficial to ensure the safe and stable operation of the target business system.

[0071] According to an embodiment of the present disclosure, the business change method also includes: updating the business change document when multiple prediction performance indicators do not meet the first preset condition; updating the business change document when the test result does not meet the second preset condition; and updating the business change document when the evaluation result indicates that the change is not permitted.

[0072] According to an embodiment of the present disclosure, the first preset condition may include a first preset sub-condition, and the multiple prediction performance indicators not satisfying the first preset condition may include: there is at least one test script whose prediction performance indicator does not satisfy the first preset sub-condition.

[0073] According to the embodiments of the present disclosure, the failure of multiple predicted performance indicators to meet the first preset condition may indicate that the performance indicators of the business system after the implementation of the change content may not meet expectations, and the risk of implementing the business change is high. For example, under extreme business load conditions, the failure of predicted performance indicators to meet expectations may further cause the risk of process tamping or system downtime. For another example, in the case of business interruption, the subsequent business incremental trend significantly exceeds expectations, which may cause a serious decline in system performance and affect the normal operation of the business system.

[0074] According to an embodiment of the present disclosure, when multiple predicted performance indicators do not meet the first preset condition, the change content can be adjusted according to the multiple predicted performance indicators (such as deleting, modifying or adding a change item), and the business change document is updated according to the adjusted change content, and the test case and monitoring configuration information are regenerated according to the updated business change document. Among them, the adjusted change content may involve application adjustment, database, middleware, system performance, server, etc.

[0075] According to an embodiment of the present disclosure, the second preset condition may include a second preset sub-condition, and the test result may include a test sub-result of each test script. The test result not meeting the second preset condition may include: there is a test sub-result of at least one test script that does not meet the second preset sub-condition.

[0076] According to the embodiments of the present disclosure, if the test result does not meet the second preset condition, it can be indicated that the operation of the business system after the change content is implemented may not meet expectations, and the risk of implementing the business change is high. For example, under extreme business load conditions, the operation that does not meet expectations may further cause the risk of process ramming or system downtime. For another example, in the case of business interruption, the subsequent business increment trend is significantly beyond expectations, which may cause a serious decline in system performance and affect the normal operation of the business system.

[0077] According to an embodiment of the present disclosure, when the test result does not meet the second preset condition, the change content can be adjusted according to the test result (such as deleting, modifying or adding a change item), and the business change document is updated according to the adjusted change content, and the test case and monitoring configuration information are regenerated according to the updated business change document. The adjusted change content may involve application adjustment, database, middleware, system performance, server, etc.

[0078] According to an embodiment of the present disclosure, the evaluation results may include change risks and change suggestions. An evaluation result indicating that changes are not permitted may indicate that the operation of the business system after the implementation of the change content may not meet expectations, and the risk of implementing business changes is high. For example, under extreme business load conditions, failure to meet expectations may further cause the risk of process freeze or system downtime. For another example, in the case of business interruption, a subsequent business incremental trend that significantly exceeds expectations may cause a serious degradation in system performance and affect the normal operation of the business system.

[0079] According to the embodiments of the present disclosure, the change content can be adjusted according to the change suggestion (such as deleting, modifying or adding a change item), and the business change document can be updated according to the adjusted change content, and the test case and monitoring configuration information can be regenerated according to the updated business change document. The adjusted change content may involve application adjustment, database, middleware, system performance, server, etc.

[0080] According to the embodiments of the present disclosure, by performing performance prediction, execution testing and change evaluation on multiple test scripts, the change content can be fully evaluated and targetedly adjusted before the business change is officially implemented until it meets expectations, so that the risk of business changes can be controlled in advance and effectively, thereby reducing the risk of causing failures after the business change is implemented. In addition, by performing performance prediction, testing and evaluation on test scripts under different business volumes, the change content can also be targetedly adjusted according to the performance of the target business system in processing data of different business volumes, so as to provide fault tolerance for subsequent business increments or decrements, which is conducive to improving the stability of the business and leaving room for the future development of the business system.

[0081] According to an embodiment of the present disclosure, the predicted performance indicators include at least one of the following: single business processing time, business throughput per unit time, CPU occupancy, memory occupancy, database processing efficiency and period increment of system storage resources, and the test results include peak test results and continuity test results. The peak test results characterize the performance of the target business system under business extreme load conditions, and the continuity test results characterize the performance of the target business system under business interruption conditions. The first preset condition includes: the predicted performance indicators corresponding to each test script meet the preset performance expectations; the second preset condition includes: the peak test results and continuity test results corresponding to each test script meet the preset test expectations.

[0082] According to an embodiment of the present disclosure, the first preset condition may include a first preset sub-condition, and the first preset sub-condition may characterize a preset performance expectation. The first preset condition may include that the predicted performance indicators corresponding to each test script meet the preset performance expectations. Exemplarily, the operation and maintenance personnel may reasonably set the preset performance expectations based on the expectations for the performance indicators. For example, an expected threshold value (such as not more than 90%) may be set for each predicted performance indicator, or a comprehensive score may be given to the predicted performance indicators of each test script, and a score threshold value (such as more than 90 points) may be set, which is not specifically limited here.

[0083] According to an embodiment of the present disclosure, the second preset condition may include a second preset sub-condition, and the second preset sub-condition may characterize the preset test expectation. The second preset condition may include that the peak test result and the continuity test result corresponding to each test script meet the preset test expectation. Exemplarily, the operation and maintenance personnel may reasonably set the preset test expectation based on the expectations for the test results. For example, the peak test result and the continuity test result of each test script may pass. Furthermore, the change content may be adjusted in a targeted manner based on the test defects and test suggestions in the test results.

[0084] According to an embodiment of the present disclosure, a business change document is input into a test case generation model to obtain a test case corresponding to a target business system, including: inputting the business change document into the test case generation model to extract change information representing the change content; based on the change information and the test case corresponding to the initial business system, generating candidate test cases corresponding to the target business system; and verifying the candidate test cases to obtain a test case corresponding to the target business system when the candidate test case passes the verification.

[0085] According to an embodiment of the present disclosure, the change information may include information that can characterize the change content, such as change items or change keywords in the business change document. The test case generation model can extract the change information in the business change document based on text analysis methods such as named entity recognition, sentiment analysis, and syntactic analysis. The test case generation model can call the test case corresponding to the initial business system, and generate candidate test cases corresponding to the target business system in combination with the change information. Optionally, the test case generation model can also output candidate monitoring configuration information associated with the candidate test case. Furthermore, the generated candidate test cases and candidate monitoring configuration information can be verified to ensure their accuracy and effectiveness, and obtain test cases and monitoring configuration information corresponding to the target business system.

[0086] According to an embodiment of the present disclosure, the test case generation model may include at least one of the following: a test case generation model based on natural language processing, a test case generation model based on a neural network, a test case generation model based on a converter, a test case generation model based on ensemble learning, etc. The training method of the test case generation model can be configured according to actual business needs and is not limited here. For example, the training method may include at least one of the following: unsupervised training, supervised training, and semi-supervised training.

[0087] According to one embodiment of the present disclosure, the business change document may include but is not limited to unstructured or semi-structured text data. Before the business change document is input into the test case generation model, the document may be pre-processed by format standardization, noise removal, and meaningless character removal. The test case generation model may use text analysis methods in natural language processing technology to identify important information points (i.e., change information) from the document, such as specific commands, expected business results, and related data fields. The extracted change information may be converted into a structured form, including database entries, tables, or XML (eXtensible Markup Language) files in a specific format. Based on the above-extracted and structured information, the test case generation model may dynamically generate monitoring configurations and test cases corresponding to the target business system in combination with test cases corresponding to the initial business system. In addition, the generated monitoring configuration information and test cases need to undergo a manual review or automatic verification process to ensure their accuracy and effectiveness, and be adjusted when necessary to meet actual business needs and technical environments. The verified monitoring configuration information and test cases will be deployed to the corresponding monitoring system or test environment for real-time monitoring or automated testing.

[0088] According to the embodiments of the present disclosure, by inputting the business change document into the test case generation model, the test cases and monitoring configuration information corresponding to the target business system can be dynamically and adaptively automatically generated according to the change content to meet the short-cycle and high-frequency business change requirements, thereby facilitating the efficient implementation of business changes. In addition, by verifying the generated test cases and monitoring configuration information, the correctness and accuracy of the test cases and monitoring configuration information can be guaranteed, ensuring the effectiveness of subsequent performance prediction, testing, evaluation and subsequent monitoring of the test scripts.

[0089] According to an embodiment of the present disclosure, a performance prediction model is obtained by training based on historical business data, and the historical business data includes historical test scripts and historical performance data; a plurality of test scripts written according to the test case are respectively input into the performance prediction model to obtain the respective predicted performance indicators of each test script, including: inputting the script parameters of the initial test script written according to the test case into the performance prediction model to obtain the predicted performance indicators corresponding to the initial test script, and the script parameters include business level parameters, business function parameters and business configuration parameters; adjusting the business level parameters of the initial test script according to a plurality of preset business levels to obtain a plurality of reference test scripts; and inputting the script parameters of the plurality of reference test scripts into the performance prediction model to obtain the respective predicted performance indicators corresponding to the plurality of reference test scripts; the evaluation system is constructed based on preset business rules and a rule engine, and the preset business rules are determined based on preset risk assessment standards, historical change data and historical alarm information, and the historical change data includes historical change content and historical evaluation information associated with the historical change content, and the evaluation results include change risks and change suggestions.

[0090] According to an embodiment of the present disclosure, historical test scripts and historical performance data can be used as sample data to train a performance prediction model. The performance prediction model may include at least one of the following: a performance prediction model based on ensemble learning, a performance prediction model based on a neural network, a performance prediction model based on a converter, a performance prediction model based on regression analysis, etc. The training method of the performance prediction model can be configured according to actual business needs and is not limited here. For example, the training method may include at least one of the following: unsupervised training, supervised training, and semi-supervised training.

[0091] According to an embodiment of the present disclosure, historical test scripts and historical performance data, including change logs, performance indicators and fault records, can be analyzed to extract useful features, such as change frequency, type, time, affected services and components, performance of the system after the change, etc. A performance prediction model can be constructed based on the performance impact and potential risk types to be predicted, and the model can be trained using historical business data, and model parameters can be adjusted to improve the accuracy of the prediction, thereby obtaining a trained performance prediction model.

[0092] According to an embodiment of the present disclosure, a test script can be written according to a test case, and the script parameters of the test script may include business level parameters, business function parameters, and business configuration parameters. Exemplarily, the business level parameters may include parameters that characterize the data level (such as the number of concurrent users, request frequency, data volume, etc.), the business function parameters may include parameters related to the realization of the target business system function (such as operation sequence, business rules, interval range, expected results, input data, etc.), and the business configuration parameters may include parameters related to system configuration resources (such as linear pool, connection pool, database, CPU, memory, etc.).

[0093] According to the embodiments of the present disclosure, multiple test scripts can be written or updated based on test cases and business requirements to ensure that the test covers all critical paths and potentially affected functional points. The script parameters of multiple test scripts can be input into the trained performance prediction model to predict the performance impact and potential risks that may be brought about by the change, and obtain the predicted performance indicators of each of the multiple test scripts. The predicted performance indicators can be used to guide subsequent test focus and resource allocation.

[0094] According to an embodiment of the present disclosure, an initial test script may be first written based on the current business level, and further, the business level parameter may be adjusted to obtain a first test script, and the business level parameter may be adjusted to obtain a second test script. The script parameters of the initial test script, the first test script, and the second test script may be respectively input into the trained performance prediction model to obtain the predicted performance indicators of the initial test script, the first test script, and the second test script.

[0095] According to an embodiment of the present disclosure, historical change data may include historical change content and historical assessment information associated with the historical change content. For example, historical assessment information may include change risks and change suggestions. Preset business rules may be specified based on preset risk assessment criteria, historical change data, and historical alarm information, and the preset business rules may be inherited by a rule engine to implement risk assessment.

[0096] According to an embodiment of the present disclosure, business operation rules, risk assessment standards, historical change data and historical alarm information can be collected and organized to build a database containing expert knowledge and experience, and this knowledge database will serve as the basis for the evaluation system to reason. A rule engine that can read and parse preset rules can be developed, and the rule engine can process complex logic and derive conclusions based on the specific circumstances of the input. The decision logic of the knowledge in the knowledge database can be identified and formalized, and these decision processes can be converted into operable execution rules (preset business rules) and integrated into the rule engine. When the test results meet the second preset condition, multiple predicted performance indicators and test results can be input into the evaluation system, and the rule engine can be used to analyze them and evaluate potential risks according to predefined rules. Further, the evaluation system can also connect to the monitoring platform to obtain the latest performance data and system status, and at the same time, any new alarm information or error information can be included in the knowledge database. Data can be extracted from the knowledge database regularly, including completed changes, relevant test results and previous fault records, and the preset business rules can be updated to enhance the accuracy of the evaluation results and decision support.

[0097] Figure 3 The service change process according to the embodiment of the present disclosure is schematically illustrated.

[0098] According to the embodiments of the present disclosure, Figure 3 As shown, in response to obtaining a business change document, operation S310 can be performed to input the business change document into a test case generation model to obtain a test case corresponding to the target business system, wherein the business change document represents the change content of the target business system relative to the initial business system. Further, operation S320 can be performed to input multiple test scripts written according to the test case into a performance prediction model to obtain a respective predicted performance indicator of each test script, wherein each test script has its own business magnitude.

[0099] According to an embodiment of the present disclosure, when multiple prediction performance indicators do not meet the first preset condition, operation S330 may be performed to update the business change document. When multiple prediction performance indicators meet the first preset condition, operation S340 may be performed to execute multiple test scripts to obtain test results.

[0100] According to an embodiment of the present disclosure, if the test result does not meet the second preset condition, operation S330 may be performed to update the business change document. If the test result meets the second preset condition, operation S350 may be performed to evaluate the test result and multiple prediction performance indicators to obtain an evaluation result.

[0101] According to an embodiment of the present disclosure, if the evaluation result indicates that the change is not permitted, operation S330 may be performed to update the business change document. If the evaluation result indicates that the change is permitted, operation S360 may be performed to implement the business change on the initial business system to obtain the target business system.

[0102] Based on the above service change method, the present disclosure also provides a service change device. Figure 4 The device is described in detail.

[0103] Figure 4 The structural block diagram of the service change device according to the embodiment of the present disclosure is schematically shown.

[0104] like Figure 4 As shown, the service change device 400 of the embodiment of the present disclosure may include a generation module 410 , a prediction module 420 , a test module 430 , an evaluation module 440 and a change module 450 .

[0105] The generation module 410 is used to input the business change document into the test case generation model in response to obtaining the business change document to obtain the test case corresponding to the target business system, wherein the business change document represents the change content of the target business system relative to the initial business system.

[0106] The prediction module 420 is used to input a plurality of test scripts written according to the test case into the performance prediction model respectively to obtain a prediction performance index of each test script, wherein each test script has its own business volume level.

[0107] The test module 430 is used to execute multiple test scripts to obtain test results when multiple prediction performance indicators meet a first preset condition.

[0108] The evaluation module 440 is used to evaluate the test result and multiple prediction performance indicators to obtain an evaluation result when the test result meets the second preset condition.

[0109] The change module 450 is used to implement business changes on the initial business system to obtain a target business system when the evaluation result indicates that the change is permitted.

[0110] According to an embodiment of the present disclosure, the service changing device 400 may further include a monitoring module.

[0111] The monitoring module may include a monitoring submodule, an analyzing submodule, a pushing submodule and a feedback submodule.

[0112] The monitoring submodule is used to monitor the target business system based on the monitoring platform.

[0113] The analysis submodule is used to analyze the alarm information and determine the cause of the alarm in response to receiving the alarm information from the monitoring platform.

[0114] The push submodule is used to push alarm information and abnormal events based on the abnormal events associated with the alarm cause.

[0115] The feedback submodule is used to update the business change document based on the adjustment strategy for the alarm information and abnormal events, so as to re-implement the business change according to the updated business change document.

[0116] According to an embodiment of the present disclosure, the service change apparatus 400 may further include an update module.

[0117] The update module may include a first update submodule, a second update submodule and a third update submodule.

[0118] The first updating submodule is used to update the business change document when the plurality of prediction performance indicators do not meet the first preset condition.

[0119] The second updating submodule is used to update the business change document when the test result does not meet the second preset condition.

[0120] The third more detailed sub-module is used to update the business change document when the evaluation result indicates that the change is not permitted.

[0121] According to an embodiment of the present disclosure, the generation module may include an extraction submodule, a generation submodule and a verification submodule.

[0122] The extraction submodule is used to input the business change document into the test case generation model and extract the change information representing the change content.

[0123] The generation submodule is used to generate candidate test cases corresponding to the target business system based on the change information and the test cases corresponding to the initial business system.

[0124] The verification submodule is used to verify the candidate test cases. If the candidate test cases pass the verification, the test cases corresponding to the target business system are obtained.

[0125] According to an embodiment of the present disclosure, the prediction module may include a first prediction submodule, a parameter adjustment submodule and a second prediction submodule.

[0126] The first prediction submodule is used to input the script parameters of the initial test script written according to the test case into the performance prediction model to obtain the predicted performance indicators corresponding to the initial test script, and the script parameters include business level parameters, business function parameters and business configuration parameters.

[0127] The parameter adjustment submodule is used to adjust the business level parameters of the initial test script according to multiple preset business levels, and obtain multiple reference test scripts accordingly.

[0128] The second prediction submodule is used to input script parameters of multiple reference test scripts into the performance prediction model to obtain the prediction performance indicators corresponding to each of the multiple reference test scripts.

[0129] According to an embodiment of the present disclosure, any multiple modules of the generation module 410, the prediction module 420, the test module 430, the evaluation module 440 and the change module 450 can be combined in one module for implementation, or any one of the modules can be split into multiple modules. Alternatively, at least part of the functions of one or more of these modules can be combined with at least part of the functions of other modules and implemented in one module. According to an embodiment of the present disclosure, at least one of the generation module 410, the prediction module 420, the test module 430, the evaluation module 440 and the change module 450 can be at least partially implemented as a hardware circuit, such as a field programmable gate array (FPGA), a programmable logic array (PLA), a system on a chip, a system on a substrate, a system on a package, an application specific integrated circuit (ASIC), or can be implemented by hardware or firmware such as any other reasonable way of integrating or packaging the circuit, or implemented in any one of the three implementation methods of software, hardware and firmware or in a suitable combination of any of them. Alternatively, at least one of the generation module 410 , the prediction module 420 , the test module 430 , the evaluation module 440 , and the change module 450 may be at least partially implemented as a computer program module, and when the computer program module is executed, the corresponding function may be performed.

[0130] It should be noted that the service change device part in the embodiment of the present disclosure corresponds to the service change method part in the embodiment of the present disclosure. The description of the service change device part specifically refers to the service change method part, which will not be repeated here.

[0131] Figure 5 A block diagram of an electronic device suitable for implementing the method described above according to an embodiment of the present disclosure is schematically shown.

[0132] like Figure 5As shown, the electronic device 500 according to an embodiment of the present disclosure includes a processor 501, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 502 or a program loaded from a storage part 508 to a random access memory (RAM) 503. The processor 501 may include, for example, a general-purpose microprocessor (such as a CPU), an instruction set processor and / or a related chipset and / or a special-purpose microprocessor (for example, an application-specific integrated circuit (ASIC)), etc. The processor 501 may also include an onboard memory for caching purposes. The processor 501 may include a single processing unit or multiple processing units for performing different actions of the method flow according to an embodiment of the present disclosure.

[0133] In RAM 503, various programs and data required for the operation of electronic device 500 are stored. Processor 501, ROM 502 and RAM 503 are connected to each other via bus 504. Processor 501 performs various operations of the method flow according to the embodiment of the present disclosure by executing the program in ROM 502 and / or RAM 503. It should be noted that the program can also be stored in one or more memories other than ROM 502 and RAM 503. Processor 501 can also perform various operations of the method flow according to the embodiment of the present disclosure by executing the program stored in the one or more memories.

[0134] According to an embodiment of the present disclosure, the electronic device 500 may further include an input / output (I / O) interface 505, which is also connected to the bus 504. The electronic device 500 may further include one or more of the following components connected to the input / output (I / O) interface 505: an input portion 506 including a keyboard, a mouse, etc.; an output portion 507 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage portion 508 including a hard disk, etc.; and a communication portion 509 including a network interface card such as a LAN card, a modem, etc. The communication portion 509 performs communication processing via a network such as the Internet. A drive 510 is also connected to the input / output (I / O) interface 505 as needed. A removable medium 511, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 510 as needed, so that a computer program read therefrom is installed into the storage portion 508 as needed.

[0135] The present disclosure also provides a computer-readable storage medium, which may be included in the device / apparatus / system described in the above embodiments; or may exist independently without being assembled into the device / apparatus / system. The above computer-readable storage medium carries one or more programs, and when the above one or more programs are executed, the method according to the embodiment of the present disclosure is implemented.

[0136] According to an embodiment of the present disclosure, the computer-readable storage medium may be a non-volatile computer-readable storage medium, for example, it may include but is not limited to: a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program, which may be used by or in combination with an instruction execution system, an apparatus or a device. For example, according to an embodiment of the present disclosure, the computer-readable storage medium may include the ROM 502 and / or RAM 503 described above and / or one or more memories other than ROM 502 and RAM 503.

[0137] The embodiment of the present disclosure also includes a computer program product, which includes a computer program, and the computer program contains program code for executing the method shown in the flowchart. When the computer program product is run in a computer system, the program code is used to enable the computer system to implement the service change method provided by the embodiment of the present disclosure.

[0138] The above functions defined in the system / device of the embodiment of the present disclosure are performed when the computer program is executed by the processor 501. According to the embodiment of the present disclosure, the system, device, module, unit, etc. described above can be implemented by a computer program module.

[0139] In one embodiment, the computer program may rely on tangible storage media such as optical storage devices, magnetic storage devices, etc. In another embodiment, the computer program may also be transmitted and distributed in the form of signals on a network medium, and downloaded and installed through the communication part 509, and / or installed from the removable medium 511. The program code contained in the computer program may be transmitted using any appropriate network medium, including but not limited to: wireless, wired, etc., or any suitable combination of the above.

[0140] In such an embodiment, the computer program can be downloaded and installed from the network through the communication part 509, and / or installed from the removable medium 511. When the computer program is executed by the processor 501, the above functions defined in the system of the embodiment of the present disclosure are performed. According to the embodiment of the present disclosure, the system, device, means, module, unit, etc. described above can be implemented by a computer program module.

[0141] According to an embodiment of the present disclosure, the program code for executing the computer program provided by the embodiment of the present disclosure can be written in any combination of one or more programming languages. Specifically, these computing programs can be implemented using high-level process and / or object-oriented programming languages, and / or assembly / machine languages. Programming languages ​​include, but are not limited to, Java, C++, python, "C" language or similar programming languages. The program code can be executed entirely on the user computing device, partially on the user device, partially on the remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device can be connected to the user computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computing device (for example, using an Internet service provider to connect through the Internet).

[0142] The flow charts and block diagrams in the accompanying drawings illustrate the possible architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flow chart or block diagram can represent a module, a program segment, or a part of a code, and the above-mentioned module, program segment, or a part of a code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flow chart, and the combination of the boxes in the block diagram or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0143] It will be appreciated by those skilled in the art that the features described in the various embodiments of the present disclosure may be combined and / or combined in a variety of ways, even if such combinations or combinations are not explicitly described in the present disclosure. In particular, without departing from the spirit and teachings of the present disclosure, the features described in the various embodiments of the present disclosure may be combined and / or combined in a variety of ways. All of these combinations and / or combinations fall within the scope of the present disclosure.

[0144] The embodiments of the present disclosure are described above. However, these embodiments are only for illustrative purposes and are not intended to limit the scope of the present disclosure. Although the embodiments are described above, this does not mean that the measures in the various embodiments cannot be used in combination to advantage. Without departing from the scope of the present disclosure, those skilled in the art may make a variety of substitutions and modifications, which should all fall within the scope of the present disclosure.

Claims

1. A service change method, characterized in that: The method comprises: In response to obtaining a business change document, inputting the business change document into a test case generation model to obtain a test case corresponding to a target business system, wherein the business change document represents a change content of the target business system relative to an initial business system; Inputting a plurality of test scripts written according to the test case into the performance prediction model respectively to obtain a prediction performance index of each test script, wherein each test script has its own business level; When the plurality of prediction performance indicators meet the first preset condition, executing the plurality of test scripts to obtain test results; When the test result satisfies the second preset condition, evaluating the test result and the plurality of prediction performance indicators to obtain an evaluation result; and In the case where the evaluation result indicates that a change is permitted, a business change is implemented on the initial business system to obtain the target business system.

2. The service change method according to claim 1, characterized in that: After implementing the business change on the initial business system to obtain the target business system, the method further includes: Based on the monitoring platform, monitoring the target business system; In response to receiving the alarm information from the monitoring platform, analyzing the alarm information to determine the cause of the alarm; Based on the abnormal event associated with the alarm cause, push the alarm information and the abnormal event; and Based on the adjustment strategy for the alarm information and the abnormal event, the business change document is updated to re-implement the business change according to the updated business change document.

3. The service change method according to claim 1, characterized in that: The method further comprises: When the plurality of predicted performance indicators do not satisfy the first preset condition, updating the business change document; If the test result does not satisfy the second preset condition, updating the service change document; and When the evaluation result indicates that the change is not permitted, the business change document is updated.

4. The service change method according to any one of claims 1 to 3, characterized in that: The predicted performance index includes at least one of the following: single business processing time, business throughput per unit time, CPU occupancy, memory occupancy, database processing efficiency and system storage resource period increment; the test results include peak test results and continuity test results; the peak test results represent the performance of the target business system under business extreme load conditions; the continuity test results represent the performance of the target business system under business interruption conditions; The first preset condition includes: the predicted performance indicators corresponding to each of the test scripts meet the preset performance expectations; the second preset condition includes: the peak test results and continuity test results corresponding to each of the test scripts meet the preset test expectations.

5. The service change method according to any one of claims 1 to 3, characterized in that: The business change document is input into the test case generation model to obtain the test cases corresponding to the target business system, including: Inputting the business change document into the test case generation model to extract change information representing the change content; generating the candidate test cases corresponding to the target business system based on the change information and the test cases corresponding to the initial business system; and The candidate test case is verified, and when the candidate test case passes the verification, the test case corresponding to the target business system is obtained.

6. The service change method according to any one of claims 2-3, characterized in that: The performance prediction model is obtained by training based on historical business data, and the historical business data includes historical test scripts and historical performance data; the multiple test scripts written according to the test case are respectively input into the performance prediction model to obtain the predicted performance indicators of each test script, including: Inputting script parameters of an initial test script written according to the test case into the performance prediction model to obtain a predicted performance indicator corresponding to the initial test script, wherein the script parameters include a business level parameter, a business function parameter, and a business configuration parameter; According to a plurality of preset business levels, the service level parameters of the initial test script are adjusted respectively, and a plurality of reference test scripts are obtained accordingly; and Inputting script parameters of a plurality of the reference test scripts into the performance prediction model to obtain prediction performance indicators corresponding to each of the plurality of the reference test scripts; The assessment system is constructed based on preset business rules and a rule engine. The preset business rules are determined based on preset risk assessment standards, historical change data and historical alarm information. The historical change data includes historical change content and historical assessment information associated with the historical change content. The assessment results include change risks and change suggestions.

7. A service change device, characterized in that: The device comprises: A generating module, configured to, in response to obtaining a business change document, input the business change document into a test case generating model to obtain a test case corresponding to a target business system, wherein the business change document represents a change content of the target business system relative to an initial business system; A prediction module, used for inputting a plurality of test scripts written according to the test case into a performance prediction model respectively, to obtain a prediction performance index of each test script, wherein each test script has its own business level; A testing module, used for executing the plurality of test scripts to obtain test results when the plurality of prediction performance indicators meet the first preset condition; an evaluation module, configured to evaluate the test result and the plurality of prediction performance indicators to obtain an evaluation result when the test result satisfies a second preset condition; and The change module is used to implement business changes on the initial business system to obtain the target business system when the evaluation result indicates that the change is permitted.

8. An electronic device comprising: one or more processors; a memory for storing one or more computer programs, It is characterized in that the one or more processors execute the one or more computer programs to implement the steps of the method according to any one of claims 1 to 6.

9. A computer-readable storage medium having a computer program or instruction stored thereon, characterized in that: When the computer program or instruction is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.

10. A computer program product comprising a computer program or instructions, characterized in that When the computer program or instruction is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.

Images