Application scene testing method and device, equipment, medium and program product

Abstract

The invention relates to the technical field of artificial intelligence, and discloses an application scene testing method, device and equipment, a medium and a program product. The method comprises the steps of obtaining a to-be-tested scene of a to-be-tested application, and obtaining a service transaction message corresponding to the to-be-tested scene according to a service transaction log; testing the to-be-tested scene based on the business transaction message, and obtaining a test log after the test is completed; and obtaining a test result according to the test log through a pre-established application exception knowledge base and a pre-trained intelligent question and answer model, and sending the test result to a specified user. According to the scheme of the embodiment, the automatic detection of the environment availability can be realized, the problems of lagging and incomplete revelation of upstream and downstream test environment problems in a traditional mode can be solved, the scene-level test environment detection can be realized, the discovery difficulty of the environment problems can be reduced, and the test environment availability can be effectively guaranteed.

Description

Technical Field

[0001] The present invention relates to the field of artificial intelligence technology, and in particular to a testing method, device, equipment, medium and program product for an application scenario. Background Art

[0002] In various projects involving upstream and downstream interactions, if there is no stable upstream and downstream joint testing environment, it will seriously affect the development and testing progress and make the agile project less agile.

[0003] At present, the existing testing methods for application scenarios usually require each upstream and downstream application system to write its own environmental detection service to detect the availability of itself or related application systems. However, in the existing technology, the use of the method of each application detecting itself is very dependent on the tester to initiate transactions, and it is impossible to discover upstream and downstream environmental problems in advance and take relevant measures in advance; moreover, the environmental availability between applications is not transparent, and the services included in the monitoring of the application are not comprehensive, which cannot reflect the overall availability of the application environment; secondly, the designed inspection service is not targeted enough for the caller, and it is often not known that the relevant service is unavailable until the joint test is initiated, making it impossible to guarantee the progress of the project. Summary of the invention

[0004] The present invention provides a testing method, device, equipment, medium and program product for an application scenario, which can solve the problem of delayed and incomplete disclosure of upstream and downstream test environment problems in traditional methods, can realize scenario-level test environment detection, can reduce the difficulty of discovering environmental problems, and effectively ensure the availability of the test environment.

[0005] According to one aspect of the present invention, a testing method for an application scenario is provided, comprising:

[0006] Obtain a test scenario of the application to be tested, and obtain a business transaction message corresponding to the test scenario according to the business transaction log;

[0007] Testing the scenario to be tested based on the business transaction message, and obtaining a test log after the test is completed;

[0008] Through the pre-established application anomaly knowledge base and the pre-trained intelligent question-answering model, the test results are obtained according to the test log, and the test results are sent to the designated user.

[0009] According to another aspect of the present invention, a testing device for an application scenario is provided, comprising:

[0010] A business transaction message acquisition module is used to acquire a test scenario of the application to be tested, and acquire a business transaction message corresponding to the test scenario according to the business transaction log;

[0011] A test log acquisition module, used to test the scenario to be tested based on the business transaction message, and obtain the test log after the test is completed;

[0012] The test result acquisition module is used to obtain the test result according to the test log through a pre-established application anomaly knowledge base and a pre-trained intelligent question-answering model, and send the test result to a designated user.

[0013] According to another aspect of the present invention, an electronic device is provided, the electronic device comprising:

[0014] at least one processor; and

[0015] a memory communicatively connected to the at least one processor; wherein,

[0016] The memory stores a computer program that can be executed by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the testing method of the application scenario described in any embodiment of the present invention.

[0017] According to another aspect of the present invention, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores a computer program, wherein the computer program is used to enable a processor to implement the test method for the application scenario described in any embodiment of the present invention when executed.

[0018] According to another aspect of the present invention, a computer program product is provided, including a computer program, wherein when the computer program is executed by a processor, the computer program implements the test method for the application scenario described in any embodiment of the present invention.

[0019] The technical solution of the embodiment of the present invention obtains the test scenario of the application to be tested, and obtains the business transaction message corresponding to the test scenario according to the business transaction log; tests the test scenario based on the business transaction message, and obtains the test log after the test is completed; obtains the test result according to the test log through a pre-established application anomaly knowledge base and a pre-trained intelligent question and answer model, and sends the test result to a designated user; through the application anomaly knowledge base and the intelligent question and answer model, using actual business transaction messages, without any code intrusion into the application system, automatic detection of environmental availability is achieved, which can solve the problem of delayed and incomplete disclosure of upstream and downstream test environment problems by traditional methods, can achieve scenario-level test environment detection, can reduce the difficulty of discovering environmental problems, and effectively ensure the availability of the test environment.

[0020] It should be understood that the contents described in this section are not intended to identify the key or important features of the embodiments of the present invention, nor are they intended to limit the scope of the present invention. Other features of the present invention will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0022] Figure 1 is a flow chart of a testing method for an application scenario provided according to Embodiment 1 of the present invention;

[0023] Figure 2 is a schematic diagram of the structure of a testing device for an application scenario provided in Embodiment 2 of the present invention;

[0024] Figure 3 It is a structural schematic diagram of an electronic device for implementing a testing method for an application scenario of an embodiment of the present invention. DETAILED DESCRIPTION

[0025] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0026] It should be noted that the terms "first", "second", "target", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0027] Embodiment 1

[0028] Figure 1A flowchart of a test method for an application scenario is provided for the first embodiment of the present invention. This embodiment is applicable to the case of performing fault inspection on application functions and test environments. The method can be executed by a test device for the application scenario. The test device for the application scenario can be implemented in the form of hardware and / or software. Typically, the test device for the application scenario can be configured in an electronic device, such as a computer device or a server. Figure 1 As shown, the method includes:

[0029] S110: Obtain a test scenario of the test application, and obtain a business transaction message corresponding to the test scenario according to a business transaction log.

[0030] The application to be tested may be a banking system application. The scenario to be tested may be a functional scenario that the application to be tested currently needs to test, for example, a payment scenario, a transfer scenario, etc. In this embodiment, a scenario to be tested consisting of a single or multiple interface methods may be obtained according to the configuration operation of the scenario to be tested by the user.

[0031] Specifically, the business transaction log generated when the application to be tested is actually running can be collected, and the content of the business transaction log can be screened to obtain message data related to the scenario to be tested, so as to serve as the business transaction message corresponding to the scenario to be tested. The message format of the business transaction message can include extensible markup language and lightweight data exchange format, etc.

[0032] Optionally, obtain the test scenario of the application to be tested, which may include:

[0033] According to the configuration operation of the user on the business process, multiple target interface methods and corresponding execution orders are obtained, and the multiple target interface methods are combined according to the execution order to obtain the test scenario of the application to be tested.

[0034] In this embodiment, users are supported to perform flexible business process configuration. For example, users can select multiple target interface methods required for the current test scenario in the interface method list and configure the execution order corresponding to each target interface method. After detecting the user's configuration operation, the processor can combine all target interface methods according to the execution order corresponding to each target interface method to obtain the current scenario to be tested.

[0035] The advantage of the above setting is that it can realize scene-level environmental detection and improve the flexibility of environmental detection.

[0036] Optionally, obtaining the business transaction message corresponding to the scenario to be tested according to the business transaction log may include:

[0037] According to the business transaction log, multiple initial transaction messages and corresponding initial interface methods are obtained, and according to the scenario to be tested, multiple target interface methods and corresponding execution orders are obtained;

[0038] According to the initial interface method corresponding to each of the initial transaction messages, searching for a target transaction message corresponding to each of the target interface methods in the multiple initial transaction messages;

[0039] According to the execution order corresponding to each of the target interface methods, each of the target transaction messages is combined to obtain a business transaction message corresponding to the scenario to be tested.

[0040] Among them, the business transaction log may include different types of business scenarios, and each business scenario may be composed of a series of interface method calls and corresponding transaction messages. Therefore, the business transaction log can be extracted to obtain multiple initial transaction messages, and the initial interface method corresponding to each initial transaction message can be determined. At the same time, according to the configuration of the scenario to be tested, multiple target interface methods and the execution order corresponding to each target interface method can be obtained.

[0041] Then, the target transaction message corresponding to the target interface method can be screened out from the initial transaction message, and the execution order corresponding to each target transaction message can be determined according to the execution order corresponding to each target interface method. Finally, according to the execution order corresponding to each target transaction message, the target transaction messages can be spliced ​​and combined in order from front to back to obtain the final business transaction message corresponding to the scenario to be tested.

[0042] The advantage of the above setting is that it can realize the automatic generation of business transaction messages corresponding to the scenario to be tested, which can improve the efficiency of message generation.

[0043] S120: Test the scenario to be tested based on the business transaction message, and obtain a test log after the test is completed.

[0044] Specifically, a preset data transmission protocol, such as the Transmission Control Protocol / Internet Protocol, Hypertext Transfer Protocol Security, File Transfer Protocol, etc., can be used to send business transaction messages to the target node where the application to be tested is located to simulate the operation of the scenario to be tested, thereby realizing the test of the scenario to be tested. After the test is completed, the processor can collect the logs of the target node and the logs of the nodes related to the scenario test to be tested as test logs.

[0045] Optionally, obtain test logs, which may include:

[0046] Collecting the target node log corresponding to the application to be tested, and obtaining the service call information corresponding to the scenario to be tested according to the target node log;

[0047] According to the service call information, the associated application corresponding to the scenario to be tested is obtained, and the associated node log corresponding to the associated application is collected;

[0048] The test log is obtained according to the target node log and the associated node log.

[0049] It should be noted that the realization of an application function or scenario usually requires the cooperation of other applications or systems (upstream and downstream systems). In this embodiment, when collecting test logs, first, the log data of the target node where the application to be tested is located can be collected as the target node log, and the service call information can be extracted from the target node log. The service call information can be the service call related information performed when the scenario to be tested is realized. Then, the service call information can be parsed to obtain the associated application corresponding to the scenario to be tested, and the associated nodes where each associated application is located. Thus, according to the target node and each associated node, a historical call link network can be obtained. Afterwards, according to the historical call link network, the link map passed by the service can be recalled, and the relevant logs of each associated node can be accurately obtained as the associated node log, thereby expanding the key logs and their contexts obtained. Finally, the target node log and the associated node log can be integrated to obtain the final test log.

[0050] The advantage of the above settings is that it can improve the integrity of test log collection, improve the accuracy of troubleshooting in the test environment, and realize fault detection in the upstream and downstream environments.

[0051] S130. Obtain test results according to the test log through a pre-established application anomaly knowledge base and a pre-trained intelligent question-answering model, and send the test results to a designated user.

[0052] In this embodiment, the log description content corresponding to each exception category can be obtained according to the error exception scenario description in the interface design document, and the corresponding relationship between the log description content and the exception category can be generated to form an application exception knowledge base. Secondly, log documents corresponding to different exception categories can also be collected as training samples, and the basic large language model can be fine-tuned using the training samples to obtain an intelligent question-answering model.

[0053] Specifically, after obtaining the test log, the matching content can be searched in the application anomaly knowledge base based on the log content of the test log. If it is detected that the current log content successfully hits a certain anomaly category, the test result can be generated according to the current anomaly category. If it is detected that all log contents do not hit any anomaly category, the test log can be input into the intelligent question-and-answer model, and multiple candidate anomaly categories output by the intelligent question-and-answer model and the probability value corresponding to each candidate anomaly category can be obtained; if it is detected that the probability value corresponding to a candidate anomaly category is greater than the preset probability threshold, the current candidate anomaly category can be determined as the anomaly category of the environment to be tested, and the test result can be generated according to the anomaly category. Finally, the test results can be sent to a designated user, such as the test initiator user, by email.

[0054] The test result may include at least one of whether an abnormality exists, the abnormality category, the abnormality location, the abnormality cause, the solution and the solver. In this embodiment, when it is determined that an abnormality exists, while obtaining the abnormality category, the location where the abnormality occurs, the cause of the abnormality, and the corresponding solution and solver information may also be obtained, thereby forming a complete test result. For example, the possible location, abnormality cause, solution and solver corresponding to different abnormality categories may be pre-set.

[0055] The advantage of the above settings is that it can improve the efficiency of solving abnormalities in the test environment and improve the efficiency of troubleshooting in the test environment.

[0056] Optionally, obtaining the test result according to the test log by using a pre-established application anomaly knowledge base and a pre-trained intelligent question-answering model may include:

[0057] According to the application exception knowledge base, obtaining the exception category corresponding to each interface method;

[0058] Generate an anomaly detection question based on the test log and the anomaly category corresponding to each interface method, input the anomaly detection question into the pre-trained intelligent question-answering model, and obtain the answer information output by the intelligent question-answering model;

[0059] The test result is obtained according to the answer information.

[0060] In this embodiment, the possible exception categories of each interface method can be obtained according to the interface design document, so as to generate the corresponding relationship between the interface method and the exception category to form an application exception knowledge base. Thus, after obtaining the test log, an exception detection question can be generated according to the test log, for example, "perform a fault check on the test log, and if it is determined that there is an exception, please output the exception category, exception location, exception cause, solution and solver", and the exception category corresponding to each interface method can be used as a prompt word to assist the intelligent question-and-answer model in answering questions. Among them, the prompt word can reduce the ambiguity and uncertainty of the model's answer. Finally, the answer information output by the intelligent answer model can be obtained, and the various information required to generate the test results can be extracted from the answer information, and the final test results can be generated according to the extracted information and the preset test result format.

[0061] The advantage of the above settings is that it can improve the accuracy of troubleshooting in the test environment and the accuracy of application scenario testing.

[0062] The technical solution of the embodiment of the present invention obtains the test scenario of the application to be tested, and obtains the business transaction message corresponding to the test scenario according to the business transaction log; tests the test scenario based on the business transaction message, and obtains the test log after the test is completed; obtains the test result according to the test log through a pre-established application anomaly knowledge base and a pre-trained intelligent question and answer model, and sends the test result to a designated user; through the application anomaly knowledge base and the intelligent question and answer model, using actual business transaction messages, without any code intrusion into the application system, automatic detection of environmental availability is achieved, which can solve the problem of delayed and incomplete disclosure of upstream and downstream test environment problems by traditional methods, can achieve scenario-level test environment detection, can reduce the difficulty of discovering environmental problems, and effectively ensure the availability of the test environment.

[0063] In a specific implementation of this embodiment, when performing application scenario testing, log data can be imported according to the business functions and test objectives of the application system, and the test device and the application under test are respectively deployed in a network environment with connectivity. Afterwards, the complete test parameters can be imported, and a network connection can be established with the application under test. Then, according to the scenario configuration, the scenario-level monitoring can be entered, and the application under test can communicate according to the configured messages. Furthermore, the application log under test can be obtained and the service call information can be analyzed to form a historical call link network. Finally, the detection results can be obtained based on the link node log, and the test results can be notified by email.

[0064] The solution of this embodiment monitors the relevant upstream and downstream application test environments of the entire system, and ultimately realizes automatic monitoring, positioning and feedback of environmental availability without relying on any testers and without any code intrusion into the application system. It effectively solves the problems of delayed discovery and difficult positioning of environmental problems, reduces the environmental dependence of upstream and downstream interactive projects, and improves the efficiency of joint debugging and testing of development and testing.

[0065] Embodiment 2

[0066] Figure 2 This is a schematic diagram of the structure of a test device for an application scenario provided by Embodiment 2 of the present invention. Figure 2 As shown, the device includes: a business transaction message acquisition module 210, a test log acquisition module 220 and a test result acquisition module 230; wherein,

[0067] The business transaction message acquisition module 210 is used to acquire the test scenario of the test application and acquire the business transaction message corresponding to the test scenario according to the business transaction log;

[0068] A test log acquisition module 220, configured to test the scenario to be tested based on the business transaction message, and to acquire a test log after the test is completed;

[0069] The test result acquisition module 230 is used to obtain the test result according to the test log through the pre-established application anomaly knowledge base and the pre-trained intelligent question-answering model, and send the test result to the designated user.

[0070] The technical solution of the embodiment of the present invention obtains the test scenario of the application to be tested, and obtains the business transaction message corresponding to the test scenario according to the business transaction log; tests the test scenario based on the business transaction message, and obtains the test log after the test is completed; obtains the test result according to the test log through a pre-established application anomaly knowledge base and a pre-trained intelligent question and answer model, and sends the test result to a designated user; through the application anomaly knowledge base and the intelligent question and answer model, using actual business transaction messages, without any code intrusion into the application system, automatic detection of environmental availability is achieved, which can solve the problem of delayed and incomplete disclosure of upstream and downstream test environment problems by traditional methods, can achieve scenario-level test environment detection, can reduce the difficulty of discovering environmental problems, and effectively ensure the availability of the test environment.

[0071] Optionally, the business transaction message acquisition module 210 is specifically used to obtain multiple target interface methods and corresponding execution orders according to the user's configuration operation on the business process, and combine the multiple target interface methods according to the execution order to obtain the test scenario of the application under test.

[0072] Optionally, the business transaction message acquisition module 210 is specifically used to acquire multiple initial transaction messages and corresponding initial interface methods according to the business transaction log, and acquire multiple target interface methods and corresponding execution orders according to the scenario to be tested;

[0073] According to the initial interface method corresponding to each of the initial transaction messages, searching for a target transaction message corresponding to each of the target interface methods in the multiple initial transaction messages;

[0074] According to the execution order corresponding to each of the target interface methods, each of the target transaction messages is combined to obtain a business transaction message corresponding to the scenario to be tested.

[0075] Optionally, the test log acquisition module 220 is specifically used to collect the target node log corresponding to the application to be tested, and obtain the service call information corresponding to the scenario to be tested according to the target node log;

[0076] According to the service call information, the associated application corresponding to the scenario to be tested is obtained, and the associated node log corresponding to the associated application is collected;

[0077] The test log is obtained according to the target node log and the associated node log.

[0078] Optionally, the test result acquisition module 230 is specifically used to obtain the exception category corresponding to each interface method according to the application exception knowledge base;

[0079] Generate an anomaly detection question based on the test log and the anomaly category corresponding to each interface method, input the anomaly detection question into the pre-trained intelligent question-answering model, and obtain the answer information output by the intelligent question-answering model;

[0080] The test result is obtained according to the answer information.

[0081] Optionally, the test result includes at least one of whether an abnormality exists, abnormality category, abnormality location, abnormality cause, solution and solver.

[0082] The testing device for the application scenario provided by the embodiment of the present invention can execute the testing method for the application scenario provided by any embodiment of the present invention, and has the functional modules and beneficial effects corresponding to the execution method.

[0083] In the technical solution of the present disclosure, the collection, storage, use, processing, transmission, provision and disclosure of user personal information involved are in compliance with the provisions of relevant laws and regulations and do not violate public order and good morals.

[0084] Embodiment 3

[0085] Figure 3 A schematic diagram of the structure of an electronic device 30 that can be used to implement an embodiment of the present invention is shown. The electronic device 30 is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device 30 can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices (such as helmets, glasses, watches, etc.) and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present invention described and / or required herein.

[0086] like Figure 3 As shown, the electronic device 30 includes at least one processor 31, and a memory connected to the at least one processor 31, such as a read-only memory (ROM) 32, a random access memory (RAM) 33, etc., wherein the memory stores a computer program that can be executed by at least one processor, and the processor 31 can perform various appropriate actions and processes according to the computer program stored in the read-only memory 32 or the computer program loaded from the storage unit 38 to the random access memory 33. In the RAM 33, various programs and data required for the operation of the electronic device 30 can also be stored. The processor 31, the ROM 32 and the RAM 33 are connected to each other through a bus 34. The input / output (I / O) interface 35 is also connected to the bus 34.

[0087] A number of components in the electronic device 30 are connected to the I / O interface 35, including: an input unit 36, such as a keyboard, a mouse, etc.; an output unit 37, such as various types of displays, speakers, etc.; a storage unit 38, such as a disk, an optical disk, etc.; and a communication unit 39, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 39 allows the electronic device 30 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0088] The processor 31 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the processor 31 include, but are not limited to, a central processing unit, a graphics processing unit, various special artificial intelligence computing chips, various processors running machine learning model algorithms, digital signal processors, and any appropriate processors, controllers, microcontrollers, etc. The processor 31 executes the various methods and processes described above, such as the test method of the application scenario.

[0089] In some embodiments, the test method for the application scenario may be implemented as a computer program, which is tangibly contained in a computer-readable storage medium, such as a storage unit 38. In some embodiments, part or all of the computer program may be loaded and / or installed on the electronic device 30 via the ROM 32 and / or the communication unit 39. When the computer program is loaded into the RAM 33 and executed by the processor 31, one or more steps of the test method for the application scenario described above may be performed. Alternatively, in other embodiments, the processor 31 may be configured to execute the test method for the application scenario in any other appropriate manner (e.g., by means of firmware).

[0090] Various embodiments of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays, application specific integrated circuits, application specific standard products, systems on a chip, load programmable logic devices, computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0091] Computer programs for implementing the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that when the computer program is executed by the processor, the functions / operations specified in the flow chart and / or block diagram are implemented. The computer program may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0092] In the context of the present invention, a computer-readable storage medium may be a tangible medium that may contain or store a computer program for use by or in conjunction with an instruction execution system, device, or equipment. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices, or equipment, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory, a read-only memory, an erasable programmable read-only memory, an optical fiber, a portable compact disk read-only memory, an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0093] To provide interaction with a user, the systems and techniques described herein may be implemented on an electronic device 30 having: a display device (e.g., a cathode ray tube or a liquid crystal display) for displaying information to the user; and a keyboard and a pointing device (e.g., a mouse or a trackball) through which the user can provide input to the electronic device 30. Other types of devices may also be used to provide interaction with the user; for example, the feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form (including acoustic input, voice input, or tactile input).

[0094] The systems and techniques described herein may be implemented in a computing system that includes backend components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes frontend components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such backend components, middleware components, or frontend components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local area networks, wide area networks, blockchain networks, and the Internet.

[0095] A computing system may include clients and servers. Clients and servers are generally remote from each other and typically interact through a communication network. The relationship of client and server is generated by computer programs running on respective computers and having a client-server relationship to each other. The server may be a cloud server.

[0096] This embodiment may also include a computer program product, which includes a computer program. When the computer program is executed by a processor, it implements the testing method of the application scenario provided by any embodiment of the present invention.

[0097] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps described in the present invention can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solution of the present invention can be achieved, and this document does not limit this.

[0098] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. A testing method for an application scenario, characterized in that: include: Obtain a test scenario of the application to be tested, and obtain a business transaction message corresponding to the test scenario according to the business transaction log; Testing the scenario to be tested based on the business transaction message, and obtaining a test log after the test is completed; Through the pre-established application anomaly knowledge base and the pre-trained intelligent question-answering model, the test results are obtained according to the test log, and the test results are sent to the designated user.

2. The method according to claim 1, characterized in that Get the test scenario of the application to be tested, including: According to the configuration operation of the user on the business process, multiple target interface methods and corresponding execution orders are obtained, and the multiple target interface methods are combined according to the execution order to obtain the test scenario of the application to be tested.

3. The method according to claim 2, characterized in that According to the business transaction log, obtain the business transaction message corresponding to the scenario to be tested, including: According to the business transaction log, multiple initial transaction messages and corresponding initial interface methods are obtained, and according to the scenario to be tested, multiple target interface methods and corresponding execution orders are obtained; According to the initial interface method corresponding to each of the initial transaction messages, searching for a target transaction message corresponding to each of the target interface methods in the multiple initial transaction messages; According to the execution order corresponding to each of the target interface methods, each of the target transaction messages is combined to obtain a business transaction message corresponding to the scenario to be tested.

4. The method according to claim 1, characterized in that: Get test logs, including: Collecting the target node log corresponding to the application to be tested, and obtaining the service call information corresponding to the scenario to be tested according to the target node log; According to the service call information, the associated application corresponding to the scenario to be tested is obtained, and the associated node log corresponding to the associated application is collected; The test log is obtained according to the target node log and the associated node log.

5. The method according to claim 1, characterized in that Through the pre-established application anomaly knowledge base and the pre-trained intelligent question-answering model, the test results are obtained according to the test log, including: According to the application exception knowledge base, obtaining the exception category corresponding to each interface method; Generate an anomaly detection question based on the test log and the anomaly category corresponding to each interface method, input the anomaly detection question into the pre-trained intelligent question-answering model, and obtain the answer information output by the intelligent question-answering model; The test result is obtained according to the answer information.

6. The method according to claim 1 or 5, characterized in that: The test result includes at least one of whether an abnormality exists, an abnormality category, an abnormality location, an abnormality cause, a solution, and a solver.

7. A testing device for an application scenario, characterized in that: include: A business transaction message acquisition module is used to acquire a test scenario of the application to be tested, and acquire a business transaction message corresponding to the test scenario according to the business transaction log; A test log acquisition module, used to test the scenario to be tested based on the business transaction message, and obtain the test log after the test is completed; The test result acquisition module is used to obtain the test result according to the test log through a pre-established application anomaly knowledge base and a pre-trained intelligent question-answering model, and send the test result to a designated user.

8. An electronic device, characterized in that: The electronic device comprises: at least one processor, and a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the test method of the application scenario described in any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and the computer program is used to enable a processor to implement the test method of the application scenario described in any one of claims 1 to 6 when executed.

10. A computer program product, characterized in that The invention comprises a computer program, which, when executed by a processor, implements the testing method for the application scenario according to any one of claims 1 to 6.

Images