Voice response system testing method, device, electronic device and storage medium

By using test records of interactive processes in IVR system testing to determine the nodes that are not tested and conduct targeted testing, the problem of repeated testing is solved, and the testing efficiency and accuracy are improved.

CN114528203BActive Publication Date: 2024-12-03MASHANG CONSUMER FINANCE CO LTD
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
CN202210015890.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-01-07
Publication Date
2024-12-03
Estimated Expiration
2042-01-07

AI Technical Summary

Technical Problem

The prior art is prone to repeated testing during IVR system testing, resulting in inefficiency in testing and errors.

Method used

By executing the interactive process associated with the received call request, if the interactive process is in a state of waiting for external input, the test record of the interactive process is obtained, and the child node whose current node is not tested is determined based on the test record, and the response input is entered to it Test, get feedback results and update the test records to avoid repeated tests.

Benefits of technology

Improve the efficiency of IVR system testing, ensure the accuracy and efficiency of the test, and avoid repeated testing of nodes that have been tested.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114528203B_ABST
    Figure CN114528203B_ABST
Patent Text Reader

Abstract

The present application discloses a voice response system testing method, which includes: executing an interactive process associated with a received call request; if the interactive process is in a state of waiting for external input, obtaining a test record of the interactive process; determining the untested subnodes of the current node according to the test record, the current node is used to represent the node that has completed the test at the current moment during the execution of the interactive process; inputting a response input corresponding to the untested subnode into the interactive process, testing the untested subnode, and obtaining a feedback result of the interactive process, the response input is used to represent the input of the response interaction with the untested subnode; and updating the test record according to the feedback result. The method can complete the test record after the voice response system executes the interactive process, thereby avoiding repeated testing of the nodes that have completed the test and improving the efficiency of the test.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of voice interaction technology, and more specifically, to a voice response system testing method, device, electronic device and storage medium. Background Art

[0002] Interactive Voice Response (IVR) system is a general term for a telephone-based voice value-added service system. Currently, most commercial institutions (such as banks, e-commerce, and financial consumer companies) use IVR systems to provide automated telephone inquiry services. Customers dial a designated phone number to enter the IVR system of the corresponding institution, and then according to the instructions of the IVR system, enter appropriate options or personal information to obtain pre-stored information, including reading specific information (such as account balances, transaction records, etc.) to customers in voice.

[0003] Since the business volume of IVR systems is usually large, and with the continuous changes in business types and the high complexity of the system itself, in order to ensure that the IVR system can operate stably, it is necessary to conduct product testing before the system goes online, including functional testing and stress testing. However, in the existing technology, repeated testing usually occurs during the testing of IVR systems, resulting in low testing efficiency and prone to testing errors. Summary of the invention

[0004] Embodiments of the present application provide a voice response system testing method, device, electronic device, and storage medium.

[0005] In a first aspect, some embodiments of the present application provide a voice response system testing method, which includes: executing an interactive process associated with a received call request; if the interactive process is in a state of waiting for external input, obtaining a test record of the interactive process; determining an untested sub-node of a current node based on the test record, the current node is used to represent the node that has completed the test at the current moment during the execution of the interactive process; inputting a response input corresponding to the untested sub-node into the interactive process, testing the untested sub-node, and obtaining feedback results of the interactive process, the response input being used to represent the input for response interaction with the untested sub-node; and updating the test record based on the feedback results.

[0006] On the second aspect, some embodiments of the present application also provide a voice response system testing device, which includes: a process execution module, which is used to execute the interactive process associated with the received call request; an information acquisition module, which is used to obtain the test record of the interactive process if the interactive process is in a state of waiting for external input; a node determination module, which is used to determine the untested sub-nodes of the current node according to the test records, and the current node is used to represent the node that has completed the test at the current moment in the execution of the interactive process; a response input module, which is used to input the response input corresponding to the untested sub-node into the interactive process, test the untested sub-node, and obtain the feedback result of the interactive process, and the response input is used to represent the input of the response interaction with the untested sub-node; a record update module, which is used to update the test record according to the feedback result.

[0007] In a third aspect, some embodiments of the present application further provide an electronic device, including a processor and a memory, wherein the memory stores computer program instructions, and when the computer program instructions are called by the processor, the above-mentioned voice response system testing method is executed.

[0008] In a fourth aspect, some embodiments of the present application further provide a computer-readable storage medium storing a program code, wherein when the program code is executed by a processor, the voice response system testing method provided in the first aspect is executed.

[0009] In a fifth aspect, the embodiments of the present application further provide a computer program product or a computer program, wherein the computer program product or the computer program includes computer instructions, and the computer instructions are stored in a storage medium. A processor of a computer device reads the computer instructions from the storage medium, and the processor executes the computer instructions, so that the computer performs the steps in the above-mentioned voice response system testing method.

[0010] It can be seen that in the embodiment of the present application, the interactive process associated with the received call request can be executed. If the interactive process is in a state of waiting for external input, the test record of the interactive process can be obtained, so that it can be determined whether the nodes in the interactive process have completed the test according to the test record, so that only the untested nodes are tested, thereby avoiding repeated testing of the nodes that have completed the test. Further, the untested sub-nodes of the current node are obtained according to the test record. The current node is used to characterize the current path when the test is completed at the current moment during the execution of the interactive process. Then, the response input corresponding to the untested sub-node is input to the interactive process, and the untested sub-node is tested to obtain the feedback result of the interactive process, and then the test record is updated according to the feedback result. Therefore, in the interactive voice response system test scenario, with the help of the update of the test record of the interactive process, the nodes in the interactive process can be tested in a targeted manner, thereby improving the efficiency of the interactive voice response system test. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

[0012] Figure 1 A hardware architecture diagram of a voice response system testing method provided in an embodiment of the present application is shown.

[0013] Figure 2 A flow chart of a voice response system testing method provided in an embodiment of the present application is shown.

[0014] Figure 3 A flow chart of another voice response system testing method provided in an embodiment of the present application is shown.

[0015] Figure 4 A decision tree diagram associated with an interactive process provided in an embodiment of the present application is shown.

[0016] Figure 5 Shows Figure 3 A flowchart of the steps of obtaining feedback results of an interactive process.

[0017] Figure 6 A module block diagram of a voice response system testing device provided in an embodiment of the present application is shown.

[0018] Figure 7 This is a module block diagram of an electronic device provided in an embodiment of the present application.

[0019] Figure 8 It is a module block diagram of a computer-readable storage medium provided in an embodiment of the present application. DETAILED DESCRIPTION

[0020] The embodiments of the present application are described in detail below, and examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the present application, and cannot be understood as limiting the present application.

[0021] In order to enable those skilled in the art to better understand the solutions of the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without making creative work are within the scope of protection of the present application.

[0022] Interactive voice response system can provide powerful telephone automatic service function, which is mainly used in the customer service call center of the enterprise. The system provides a menu navigation function for customers, and guides users to the specific path of consultation through voice menu and key menu. For example, financial institutions use IVR system to realize automatic business promotion and financial product marketing in order to reduce service costs. Therefore, the call volume of call center is very large, and there is a high concurrency. In order to ensure the stable operation of IVR system, especially IVR system under 7×24h service mode, it is necessary to do sufficient testing before the system goes online, including functional testing, stress testing and other different types of testing.

[0023] Currently, when a function of an IVR system changes with the business, the upstream and downstream related parts of the entire business chain need to provide resources to cooperate in completing the test, including providing process data, key menu selection, voice menu selection, etc. This testing process usually requires testers to simulate users to initiate calls for manual testing. However, manual testing solutions usually have the problem of test errors that are prone to occur due to repeated testing.

[0024] In order to solve the above problems, the inventors have proposed a voice response system testing method provided by the embodiment of the present application after long-term research. The method can execute the interactive process associated with the received call request. If the interactive process is in a state of waiting for external input, the test record of the interactive process is obtained, and the untested sub-nodes of the current node are determined according to the test record. Further, the response input corresponding to the untested sub-node is input into the interactive process, the untested sub-node is tested, the feedback result of the interactive process is obtained, and the test record is updated according to the feedback result. Thus, the test record is completed after the interactive process is executed, avoiding the problem of repeated testing of the nodes that have been tested. At the same time, a variety of functional system tests are performed according to different external inputs, which greatly improves the testing efficiency of the IVR system.

[0025] The following is an introduction to the hardware architecture diagram of the voice response system testing method involved in this application.

[0026] like Figure 1As shown, in some embodiments, the voice response system testing method provided in the embodiment of the present application can be applied to Figure 1 In the voice response test system 400 shown, the voice response test system 400 includes a simulation terminal 401, a simulation gateway 402, a media server (FreeSwitch) 403, a load balancer 404, a simulator 405, a manager (Test Manager) 406 and a simulation seat 407.

[0027] The voice response test system 400 can complete the test of the IVR process, wherein the IVR process is the IVR process to be tested, each IVR process can have one or more numbers bound to it, and the simulation terminal 401 can call the bound number to interact with the IVR process corresponding to the bound number. The IVR process may include multiple IVR nodes for testing, and the node types of the IVR nodes may include: playback, playback and button menu, playback and voice menu, interface call, transfer and other types, which are not limited here. A corresponding test path is pre-set in each IVR process, and each test path includes at least one IVR node.

[0028] In the embodiment of the present application, the analog terminal 401 can send a call request (carrying the called number information) similar to the customer's mobile phone. Each analog terminal 401 has a terminal number representing its own unique identification, which can represent the customer's mobile phone number and each terminal number needs to be registered in the analog gateway 402. The analog gateway 402 can simulate the terminal registration server based on the Session Initialization Protocol (Session Initialization Protocol, SIP). The media server 403 can be used to run the IVR process, and can automatically complete the IVR routing (bridge to the IVR process associated with the called number) according to the call request.

[0029] The load balancer 404 can reasonably and evenly allocate different work tasks to the idle media servers 403 according to the resource usage of the media servers 403 and the allocation rules (including but not limited to the minimum connection method and the polling method). If all media servers 403 are in the idle state, the load balancer 404 can allocate according to the random allocation rules.

[0030] Simulator 405 is one of the core components for implementing the entire test solution, and may include a key simulator 405a, a voice simulator 405b, and an interface simulator 405c. The key simulator 405a may generate simulated key characters or key character strings as required based on the node information of the IVR node and the historical test data of the manager 406; the voice simulator 405b may generate simulated voice text content as required based on the node information of the IVR node and the historical test data of the manager 406; and the interface simulator 405c may return interface data as required based on the interface call request initiated by the IVR node and the historical test data of the manager 406.

[0031] Manager 406 is also one of the core components for implementing the entire test solution. Testers need to enter the node information and dialogue rules (i.e., test cases) of all IVR nodes of the IVR process to be tested in advance in manager 406, and record the IVR nodes and test results that have been tested in the IVR process in real time. For example, assume that IVR process α has 3 IVR nodes: IVR node α1, IVR node α2, and IVR node α3; IVR node α1 is a button menu, IVR node α2 is a voice menu, and IVR node α3 is an interface call.

[0032] For example, the key menu of IVR node α1 is recorded as "Press 1 for business processing, press 2 for business consultation, and hang up when finished". The corresponding node information entered includes the key options allowed for input: key characters "1" and "2", key timeout, and incorrect key characters.

[0033] The voice menu of IVR node α2 is recorded as "Our company's telephone channel supports business processing, business consultation, and transfer to manual service. Please tell us the business you need to handle." The corresponding node information entered includes the voice option scripts allowed to be input: business processing, business consultation, transfer to manual service, timeout without answering, and other error option texts.

[0034] The interface call of the IVR node α3 is recorded to query the customer level according to the incoming call number. The corresponding node information entered includes all customer level classifications and the interface return values ​​and abnormal return values ​​corresponding to different customer levels, as follows:

[0035] SVIP:

[0036]

[0037] VIP:

[0038]

[0039]

[0040] General:

[0041]

[0042] Exception return:

[0043]

[0044] The simulated agent 407 has similar functions to the human agent, has attributes such as the skill group, work status, unique identification ID, etc., and can make and receive calls.

[0045] As an implementation method, the analog terminal 401 can initiate a call request, which may include a terminal number (calling number: such as 151****5288) and an IVR process number (called number, such as 95 or 400). The call request is transmitted to the load balancer 404 through the analog gateway 402. After the load balancer 404 obtains the call request, it can query the current resource usage of all media servers 403 in the media server cluster in real time, and then allocate the call request to the relatively most idle media server 403.

[0046] Furthermore, the media server 403 routes the call request to the corresponding IVR process according to the called number carried in the call request, and thus a "dialogue" is formed between the simulation terminal 401 and the IVR process, and the simulation terminal 401 interacts with the IVR process or transfers to the simulation agent 407 with the assistance of the manager 406 until the test of the IVR process is completed. It should be noted that the main executor of the voice response system test method provided in the embodiment of the present application can be the media server 403, and in the process of executing the voice response system test method, it can also be jointly executed with the help of other hardware devices in the above content.

[0047] The various embodiments of the present application will be described in detail below with reference to the accompanying drawings.

[0048] See also Figure 2 , Figure 2 A voice response system testing method provided by an embodiment of the present application is shown, and the voice response system testing method may include the following steps S110 to S150.

[0049] Step S110: executing the interaction process associated with the received call request.

[0050] In the embodiment of the present application, the interaction process is an IVR process, which includes multiple IVR nodes. The corresponding IVR nodes can be executed based on the test cases to execute the interaction process. In order to achieve the effect of automatically completing the IVR system test, a simulation terminal can be used to establish a dialogue relationship with the interaction process, and a simulator can be used to communicate with the interaction process to complete the test of the IVR system.

[0051] The call request refers to a request sent by the simulation terminal to establish a dialogue relationship with the interactive process. The call request may include a terminal number (calling number) and an interactive process number (called number). The terminal number can be understood as, if the simulation terminal simulates a mobile phone, the terminal number is the mobile phone number of the mobile phone. Each interactive process is bound to at least one interactive process number.

[0052] As an implementation method, the media resource server can execute the interactive process when receiving the interactive process associated with the call request. Specifically, the analog terminal can issue a call request and transmit the call request to the load balancer through the analog gateway. The load balancer is responsible for passing the call request to an idle target media server according to the resource usage of each media server in the media server cluster. Further, the target media server obtains the call request, determines the corresponding interactive process according to the interactive process number in the call request, and executes the interactive process.

[0053] Step S120: If the interaction process is in a state of waiting for external input, a test record of the interaction process is obtained.

[0054] Considering that repeated tests may occur during the IVR system testing process, for example, the same IVR node is repeatedly tested, resulting in a waste of computing resources. To this end, in an embodiment of the present application, a corresponding test record can be generated when the test is completed for each IVR node, and then when the interaction process is executed again, the untested IVR node can be obtained by querying the test record, and only the untested IVR node can be tested, thereby avoiding repeated testing. The test record may include a test mark for reflecting the test status of the IVR node, for example, a completed test or an uncompleted test. The identifier of the interaction process refers to the unique identity document (ID) corresponding to the interaction process.

[0055] Among them, external input refers to the different simulated inputs generated by the simulator during the execution of the interactive process, such as key input, voice input and interface call input. It can be understood that external input in the real world is the input for interacting with the IVR system when the customer touches the phone buttons, conducts voice communication and inquires about customer information during the conversation between the customer and the IVR system.

[0056] As an implementation method, during the execution of the interactive process, when the media resource server is in a state of waiting for external input, it can obtain the identification ID of the interactive process (e.g., ID: d4e1b4086f55), and obtain the node information and test records of each IVR node in the interactive process according to the identification ID. Specifically, the media resource server can send a query request to the manager, and the manager can query and feedback the node information and test records of each IVR node.

[0057] Step S130: Determine the untested child nodes of the current node according to the test record.

[0058] In an embodiment of the present application, the current node is used to represent the node that completes the test at the current moment during the execution of the interactive process. The interactive process is associated with a corresponding decision tree, which is composed of multiple IVR nodes. There is a parent-child relationship between the IVR nodes. For example, the IVR node Q contains two IVR child nodes: IVR child node Q1 and IVR child node Q2. It should be noted that the parent-child relationship of the nodes in the interactive process is relative. For example, the IVR node Q can be the parent node of the IVR child node Q1 and the IVR child node Q2, or it can be the child node of other nodes.

[0059] As an implementation method, after obtaining the test record, it can be determined based on the test record whether there is an untested sub-node in the IVR node that has completed the test at the current moment, and the untested sub-node can be obtained. For example, it is determined based on the test record whether the two sub-nodes in the current node IVR node Q, IVR sub-node Q1 and IVR sub-node Q2, have been tested. If IVR sub-node Q1 has been tested and IVR sub-node Q2 has not been tested, then IVR sub-node Q1 is obtained.

[0060] Step S140: inputting a response input corresponding to the untested sub-node into the interactive process, testing the untested sub-node, and obtaining a feedback result of the interactive process.

[0061] The embodiment of the present application uses a simulator to simulate the interaction process between the customer and the interaction process to implement the test of the IVR system. To this end, the corresponding response input can be input into the IVR node in the interaction process to simulate the input for the voice response system. Among them, the response input is the key characters, voice information, interface data, etc. allowed to be input by the IVR node in the interaction process, and the response input can be generated by the simulator. The feedback result refers to the status of whether the IVR node in the interaction process has completed the test.

[0062] As an implementation method, if an IVR subnode that has not been tested in the interaction process is obtained, the corresponding response input can be input to the IVR subnode, and then the IVR node completes the corresponding test case according to the response input. For example, the IVR subnode Q2 in the IVR node Q has not been tested, and the test case of the IVR subnode Q2 is the broadcast voice corresponding to the key "1". When the simulator inputs the key "1" to the IVR subnode Q2, the IVR subnode Q2 executes the broadcast voice, thereby completing the test and returning the completed test status as the feedback result.

[0063] Step S150: Update the test record according to the feedback result.

[0064] In order to avoid repeated testing of IVR nodes when testing the IVR system, the embodiment of the present application updates the test record according to the feedback result after obtaining the feedback result of the interaction process, so that in the process of executing the interaction process, it is possible to determine which IVR nodes are untested nodes based on the test record, and then test the IVR nodes that have not been executed to avoid repeated testing.

[0065] As an implementation method, the manager can update the test record according to the feedback result of each IVR node after each interaction process is executed. Specifically, each interaction process includes multiple IVR nodes, and the manager can complete the test case at each IVR node according to the response input to obtain the corresponding feedback result, and then update the test record based on the feedback result.

[0066] In the embodiment of the present application, the interactive process associated with the received call request is executed. If the interactive process is in a state of waiting for external input, the test record of the interactive process is obtained, and the sub-nodes of the current node that have not been tested are determined according to the test record. Further, the response input corresponding to the sub-node that has not been tested is input into the interactive process, and the sub-node that has not been tested is tested, and the feedback result of the interactive process is obtained, and the test record is updated according to the feedback result. When the interactive process is in a state of waiting for external input, the associated node information and test record are obtained according to the identifier of the interactive process, and the sub-nodes of the current node that have not been executed are obtained according to the test record, and the response input corresponding to the sub-node is input into the interactive process, and the feedback result of the interactive process is obtained, and the test record is updated according to the feedback result. Thus, the test record is completed after the execution of the interactive process, avoiding the problem of repeated testing of the nodes that have been tested, and performing multiple functional system tests according to different external inputs, thereby improving the test efficiency of the IVR system.

[0067] like Figure 3 As shown, Figure 3Another voice response system testing method provided in an embodiment of the present application is schematically illustrated. The voice response system testing method may include the following steps S201 to S210.

[0068] Step S201: when a call request is received, the resource usage status is obtained.

[0069] Step S202: Determine an allocation strategy according to resource usage status.

[0070] Considering that the call center needs to face a huge amount of call traffic, in order to improve the test efficiency of the IVR system and effectively utilize computing resources, when executing the interactive process, you can choose the strategy with the best computing efficiency to execute the interactive process according to the resource status of each media server in the current IVR system. Among them, the resource usage status refers to the current computing resource usage status of all media servers in the media server cluster running the interactive process.

[0071] In some embodiments, if the load balancer receives a call request, it can obtain the resource usage status of the current media server cluster and determine the allocation strategy according to the resource usage status. Specifically, if it is detected that the resource usage status of the media server cluster is in an idle state, a random allocation strategy is determined to execute the interaction process. Otherwise, a balanced allocation strategy is determined to execute the interaction process.

[0072] Step S203: executing the interaction process associated with the received call request according to the allocation strategy.

[0073] As an implementation method, when the load balancer detects that the resource usage status of all media servers is in an idle state, the interaction process can be executed on any idle media server according to the random allocation strategy. Optionally, the load balancer can perform the detection of the resource adaptation status of the media server cluster in a polling manner. For example, the tester can pre-set a fixed cycle duration, and the load balancer can then perform polling detection according to the cycle.

[0074] As another implementation, when the load balancer detects that the resource usage status of some media servers is in an idle state, the interaction process can be executed on the media servers whose resource usage status is in a relatively idle state according to the balanced allocation strategy.

[0075] Step S204: If the interaction process is in a state of waiting for external input, a test record of the interaction process is obtained.

[0076] In this embodiment, the specific implementation of step S204 can refer to the description of step S120 provided in the above embodiment, which will not be repeated here.

[0077] Step S205: Determine all child nodes of the current node according to the decision tree.

[0078] The decision tree refers to a set of test paths that the tester sets in advance for different interaction processes. The decision tree may include multiple IVR nodes, and there may be a situation where an IVR node has multiple IVR sub-nodes. When testing the IVR system, it is necessary to execute the corresponding interaction process according to the decision tree.

[0079] See also Figure 4 , Figure 4 A schematic diagram of a decision tree associated with an interactive process provided in an embodiment of the present application is shown. The decision tree includes seven IVR nodes, namely, a main menu node, node A, node B, and subnodes A1 and A2 of node A, and subnodes B1 and B2 of node B. The test case corresponding to each IVR node can be:

[0080] Main menu node: "Welcome to call XXX, press 1 for key selection, press 2 for voice selection";

[0081] Node A: interface call, query whether the caller is a VIP customer of XXX based on the incoming phone number;

[0082] Node B: "Our telephone channel supports business processing and complaint suggestions. Please tell us what services we can provide you";

[0083] Subnode A1, subnode A2: broadcast a fixed audio segment;

[0084] Subnode B1, subnode B2: transfer to manual operation.

[0085] As an implementation method, the media server can obtain a decision tree associated with the interaction process from the manager, and obtain the child nodes of the current node according to the structural distribution of the decision tree. Specifically, when the analog terminal interacts with the IVR system, the analog terminal sends a call request to the media server, and the media server determines the corresponding interaction process according to the called number of the call request. Further, the decision tree associated with the interaction process can be obtained from the manager, and the child nodes of the current node can be obtained according to the decision tree. For example, after obtaining the above decision tree, the child nodes of IVR node A can be obtained: IVR child node A1 and IVR child node A2.

[0086] Step S206: Acquire the test marks of all child nodes of the current node according to the test record, and determine the untested child nodes of the current node according to the test mark of each child node.

[0087] Among them, the test mark is recorded in the test record, and the test mark is used to indicate whether the sub-node has completed the test in each test path associated with a specific test type. In an embodiment of the present application, when executing to a certain IVR node in the interaction process, the IVR system can initiate a menu request information to the simulator. The single request information includes the interaction process ID and the IVR node ID. The simulator can send the menu request information to the manager. The manager can query the test record of the interaction process according to the interaction process ID, and query the input allowed by the IVR node according to the IVR node ID. Furthermore, the manager instructs the simulator to generate a response input based on the input allowed by the IVR node, and then completes the test based on the response input. The manager completes the test record based on the feedback result of the test.

[0088] Exemplarily, test records of four interaction processes recorded by the manager are given, and the four interaction processes are associated with the decision tree in the above step S205.

[0089] The test path of the interactive process θ is: Start → Main Menu → Node A → Node A1, where the response input generated by the simulator includes: Key 1 (Main Menu), VIP User (Node A calls the interface simulator), and the manager records the test record as follows:

[0090] Main menu: The simulator simulates pressing key "1" to enter node A, but the sub-menus are not tested.

[0091] Node A: The interface returns to VIP; A1 node can be entered, but the lower-level menu has not been tested;

[0092] Node A1: speech broadcast.

[0093] The test path of the interaction process σ is: Start → Main Menu → Node A → Node A2, where the response input generated by the simulator includes: key 1 (main menu), non-VIP user (node ​​A calls the interface simulator), and the manager records the test record as follows:

[0094] Main menu: The simulator simulates pressing key "1" to enter node A, but the sub-menus have not been tested;

[0095] Node A: The interface returns to non-VIP; A2 node can be entered, and the lower-level menu has been tested positively;

[0096] Node A2: Script broadcast.

[0097] The test path of the interactive process δ is: start → main menu → node B → node B1, where the response input generated by the simulator includes: key 2 (main menu), voice "business processing" (node ​​B), and the manager records the test record as follows:

[0098] Main menu: The simulator simulates pressing key "2" to enter node B, but the sub-menus have not been tested;

[0099] Node B: The simulator issues "Business Processing"; can enter the B1 node, but the lower-level menu has not been tested;

[0100] B1 node: transfer to manual operation.

[0101] The test path of the interactive process μ is: Start → Main Menu → Node B → Node B2, where the response input generated by the simulator includes: key 2 (main menu), voice "complaint suggestion" (node ​​B), and the manager records the test record as follows:

[0102] Main menu: The simulator simulates pressing key "2" to enter node B, but the sub-menus have not been tested;

[0103] Node B: The simulator issues a "complaint suggestion"; can enter the B2 node, and the lower-level menu has been tested in the forward direction;

[0104] B2 node: transfer to manual operation.

[0105] Among them, "Sub-menu has not been tested" is one of the test marks of the IVR node, which is used to indicate that the sub-nodes of the node have not been executed. "Sub-menu forward test has been completed" is also one of the test marks of the IVR node, which is used to indicate that all sub-nodes under the node have been executed. It should be noted that the forward test refers to the test performed according to the test path of the interaction process, for example, the test is performed one by one from the root node to the leaf node of the decision tree. After the forward test is completed, a reverse test, that is, an abnormal test, can also be performed, including simulating wrong key presses, simulating wrong voices, timed input, interface timeouts, interface returns wrong data, etc., which are not limited here.

[0106] As an implementation method, the test marks of all child nodes of the current node can be obtained from the test record corresponding to the interaction process, and the untested child nodes of the current node can be determined based on the test mark of each child node. Specifically, the manager can obtain the test record corresponding to the interaction process, and further query the test marks corresponding to all child nodes of the current node from the test record, and then determine the untested child nodes based on the test mark. For example, the manager can obtain the test record corresponding to the interaction process θ based on the interaction process ID of the interaction process θ, and then obtain the test mark "sub-menu untested" of node A from the test record, and obtain the test mark of node A1 of node A as "untested".

[0107] Step S207: Obtain the node identifier corresponding to the untested sub-node, and determine the response input corresponding to the untested sub-node in the node information according to the node identifier.

[0108] In the embodiment of the present application, the node identifier is a unique identification ID of the IVR node, and each IVR node in the interaction process has its own IVR node ID. As an implementation method, the manager can obtain the node information corresponding to the IVR node according to the node identifier, and further obtain the response input corresponding to the IVR node from the node information.

[0109] For example, when executing to the untested IVR subnode α1 in the IVR process α, the IVR system can initiate a menu request message to the simulator, and the menu request message includes the node ID of the IVR subnode α1, that is, the node identification. The simulator can send the menu request message to the manager, and the manager can query the node information corresponding to the IVR subnode α1 according to the node ID of the IVR subnode α1 (such as YWBL). The subnode information includes the key options allowed for input: key characters "1" and "2", key timeout, and wrong key characters. Furthermore, the manager can determine that the response input corresponding to the sub-IVR node α1 can be the key character "1", the key character "2", the wrong key character "X" and the preset waiting time according to the node information.

[0110] Step S208: inputting a response input into the interactive process, and testing the untested sub-nodes in the interactive process according to the response input to obtain a feedback result of the interactive process.

[0111] In some embodiments, after the answer input is determined, the answer input can be executed on the IVR node in the interaction process, so that after the answer input is executed, specifically, refer to Figure 5 , step S208 may include steps S2081 to S2083.

[0112] Step S2081: Determine the corresponding response instruction according to the input mode of the response input.

[0113] Considering that the existing technology has the problem of singleness in the test scheme for IVR system, specifically, during the test process, only a single function can be tested, for example, the test object is only the load capacity of the load balancing component, or the pressure resistance of the media server in high concurrency mode, or only the selection function of the key menu. Instead of solving the test problems of interface call, voice menu selection and key menu selection at the same time.

[0114] To this end, the voice response system testing method provided in the embodiment of the present application can be tested in a targeted manner according to the response input corresponding to each IVR node in the interaction process to be tested, thereby improving the ability of automated testing of the IVR system. Among them, the input mode refers to the way in which the response input is input into the interaction process. According to different input methods of the response input, the input mode may include a key input mode, a voice input mode, and an interface input mode.

[0115] As an implementation method, after obtaining the response input of the untested IVR subnode, the manager can determine the input mode corresponding to the response input, and then generate a response instruction according to the input mode, wherein the response instruction is used to instruct the target simulator to generate a simulated customer interaction method or simulated interface call data. For example, the key simulator simulates the key characters of the key manually triggered by the customer, the voice simulator simulates the voice audio or voice text of the customer, and the interface simulator simulates the interface data corresponding to the customer information, such as VIP interface and non-VIP interface.

[0116] Step S2082: testing the untested sub-node corresponding to the node identifier according to the response instruction to obtain a test result.

[0117] Step S2083: taking the test result of the sub-node that has completed the test in the interactive process as the feedback result of the interactive process.

[0118] As an implementation method, the manager can generate a corresponding simulated customer interaction method or simulated interface call data for the child node corresponding to the node identifier through the simulator according to the response instruction. Further, the media server uses the simulated customer interaction method or simulated interface call data to execute the interaction process, thereby realizing the automatic test of the IVR system, obtaining the test result of the child node test being completed, and using the test result as the feedback result of the child node corresponding to the node identifier in the interaction process.

[0119] For example, the manager determines that the response input of the IVR node is a key input mode based on the node ID of the IVR node, and can generate a response instruction and send it to the key simulator, so that the key simulator generates key characters simulating the customer manually triggering the key after receiving the response instruction. Similarly, a response instruction can be generated and sent to the key simulator, so that the voice simulator generates a simulated customer's voice audio or voice text after receiving the response instruction. A response instruction can also be generated and sent to the key simulator, so that the interface simulator generates interface data corresponding to the simulated customer information after receiving the response instruction, such as VIP interface and non-VIP interface.

[0120] Furthermore, during the execution of the interactive process, when node B plays "Our company's telephone channel supports business processing and complaint suggestions. Please tell us the services we will provide you", the voice simulator generates a simulated customer's voice text "business processing" to complete the test, thereby realizing the automatic interaction between the simulated terminal and the interactive process.

[0121] Step S209: If the interactive process is completed, the feedback results of the nodes in each level of the decision tree are recorded, and according to the feedback results of the nodes in each level, it is determined whether the test marks of all child nodes of the current node are in the completed test state.

[0122] The feedback result refers to the execution status of each IVR node in the interactive process after executing the interactive process, that is, the test results of different sub-nodes. In order to avoid repeated testing, a test record can be generated according to the feedback result of each IVR node. When executing different interactive process tests, only the untested sub-nodes can be tested by querying the test record.

[0123] As an implementation method, when the interactive process is executed, the node selected at each level in the decision tree and the feedback result corresponding to the node can be recorded according to the test path corresponding to the interactive process. For example, the test path of the interactive process σ is: start→main menu→node A→node A2. If the main menu node, node A and node A2 have all been executed, the manager can record the main menu node, node A and node A2 and their corresponding feedback results.

[0124] Step S210a: If the test marks of all child nodes of the current node are in the completed test state, the test mark of the current node corresponding to the specific test type is updated to the completed state.

[0125] Among them, the specific test type refers to the forward test and the reverse test. As an implementation method, the test mark of the forward test of all child nodes of the current node can be obtained, and when all the test marks are in the completed test state, the test mark of the forward test of the current node can be updated to the completed state. The test mark of the reverse test of all child nodes of the current node can be obtained, and when all the test marks are in the completed test state, the test mark of the reverse test of the current node can be updated to the completed state.

[0126] Step S210b: If the test mark of the child node of the current node is in an unfinished test state, the test mark corresponding to the current node and the specific test type is kept in an unfinished state.

[0127] As an implementation method, the test mark of the forward test of all child nodes of the current node can be obtained. If there is a child node whose test mark is in an unfinished test state, the test mark of the forward test of the current node remains in an unfinished state. In addition, the test mark of the reverse test of all child nodes of the current node can also be obtained. If there is a child node whose test mark is in an unfinished test state, the test mark of the reverse test of the current node remains in an unfinished state.

[0128] For example, when executing the interactive process δ, when executing to node B, the test mark of node B is "the sub-menu has not been tested yet". Further, when executing to node B1, the test mark of node B remains as "the sub-menu has not been tested yet". Further, when executing to node B2 of the interactive process μ, the test mark of node B is updated to "the sub-menu has been tested forward".

[0129] In the embodiment of the present application, when a call request is received, the resource usage status is obtained, and then the allocation strategy is determined according to the resource usage status, and the interactive process associated with the received call request is executed according to the allocation strategy, thereby improving the utilization rate of computing resources. When the interactive process is in a state of waiting for external input, the associated node information and test records are obtained according to the identifier of the interactive process, and the decision tree associated with the interactive process is obtained, and the child nodes of the current node are obtained according to the decision tree, and then the test mark of the current node is obtained according to the test record, and the untested child nodes are obtained according to the test mark of the current node, and the node identifier corresponding to the untested child node is obtained, and the node information of the untested child node is determined according to the node identifier. The corresponding response input should be determined, so that the response input is executed in the interactive process, and the feedback result of the untested child node in the interactive process is obtained.

[0130] Furthermore, when the interactive process is completed, the nodes selected at each level in the decision tree and the corresponding feedback results are recorded, and it is determined whether the test marks of all child nodes of the current node are in the completed test state. If the test marks of all child nodes of the current node are in the completed test state, the test mark corresponding to the current node and the specific test type is updated to the completed state. If the test mark of the child node of the current node has an uncompleted test state, the test mark corresponding to the current node and the specific test type is updated to the uncompleted state. Thus, the test mark of the parent node is determined according to the test mark of the child node in the interactive process, so as to update the test record and avoid repeated testing.

[0131] See also Figure 6, which shows a structural block diagram of a voice response system test device 500 provided in an embodiment of the present application. The color picking control device 500 includes: a process execution module 510, which is used to execute the interactive process associated with the received call request; an information acquisition module 520, which is used to obtain the test record of the interactive process if the interactive process is in a state of waiting for external input; a node determination module 530, which is used to determine the untested sub-nodes of the current node according to the test record, and the current node is used to represent the node that has completed the test at the current moment during the execution of the interactive process; a response input module 540, which is used to input the response input corresponding to the untested sub-node to the interactive process, test the untested sub-node, and obtain the feedback result of the interactive process, and the response input is used to represent the input of the response interaction with the untested sub-node; a record update module 550, which is used to update the test record according to the feedback result.

[0132] In some embodiments, the node determination module 530 can be specifically used to: obtain a decision tree associated with the interaction process; determine all child nodes of the current node based on the decision tree; obtain test tags of all child nodes of the current node based on the test record, the test tags are used to indicate whether the child node has completed the test in each test path associated with a specific test type; determine the untested child nodes of the current node based on the test tags of each child node.

[0133] In some embodiments, the record update module 550 can be specifically used to: if the interaction process is completed, record the feedback results of the nodes in each level of the decision tree; based on the feedback results of the nodes in each level, determine whether the test marks of all child nodes of the current node are in the completed test status; if the test marks of all child nodes of the current node are in the completed test status, update the test mark corresponding to the current node and the specific test type to the completed status.

[0134] In some embodiments, the record update module 550 may also be specifically configured to: if the test tag of a child node of the current node is in an unfinished test state, keep the test tag corresponding to the current node and the specific test type in an unfinished state.

[0135] In some embodiments, the input module 540 may include an acquisition unit, a determination unit, an execution unit, and an input unit. The acquisition unit is used to acquire a node identifier corresponding to an untested sub-node; the determination unit is used to determine a response input corresponding to an untested sub-node in the node information according to the node identifier; the input unit is used to input a response input into the interactive process; and the execution unit is used to test the untested sub-node in the interactive process according to the response input to obtain a feedback result of the interactive process.

[0136] In some embodiments, the execution unit can be specifically used to: determine the corresponding response instruction according to the input mode of the response input; test the untested sub-node corresponding to the node identifier according to the response instruction to obtain the test result; and use the test result of the sub-node that has completed the test in the interaction process as the feedback result of the interaction process.

[0137] In some embodiments, the process execution module 510 may be specifically used to: obtain resource usage status when a call request is received; determine an allocation strategy according to the resource usage status; and execute an interactive process associated with the received call request according to the allocation strategy.

[0138] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described devices and modules can refer to the corresponding processes in the aforementioned method embodiments, and will not be repeated here.

[0139] In several embodiments provided in the present application, the coupling between modules may be electrical, mechanical or other forms of coupling.

[0140] In addition, each functional module in each embodiment of the present application can be integrated into a processing module, or each module can exist physically separately, or two or more modules can be integrated into one module. The above integrated modules can be implemented in the form of hardware or software functional modules.

[0141] The scheme provided by the present application executes the interactive process associated with the received call request. If the interactive process is in a state of waiting for external input, the test record of the interactive process is obtained, and the sub-nodes of the current node that have not been tested are determined according to the test record. Further, the response input corresponding to the untested sub-node is input into the interactive process, the untested sub-node is tested, and the feedback result of the interactive process is obtained, and the test record is updated according to the feedback result. When the interactive process is in a state of waiting for external input, the associated node information and test record are obtained according to the identifier of the interactive process, and the sub-nodes of the current node that have not been executed are obtained according to the test record. Further, the response input corresponding to the sub-node is input into the interactive process, and the feedback result of the interactive process is obtained, and the test record is updated according to the feedback result. Thus, the test record is completed after the interactive process is executed, avoiding the problem of repeated testing of the nodes that have been tested, and performing multiple functional system tests according to different external inputs, thereby improving the test efficiency of the IVR system.

[0142] like Figure 7As shown, an embodiment of the present application further provides an electronic device 600, which includes a processor 610 and a memory 620, wherein the memory 620 stores computer program instructions, and when the computer program instructions are called by the processor 610, the above-mentioned voice response system testing method is executed.

[0143] The processor 610 may include one or more processing cores. The processor 610 uses various interfaces and lines to connect various parts of the entire battery management system, and executes various functions and processes data of the battery management system by running or executing instructions, programs, code sets or instruction sets stored in the memory 620, and calling data stored in the memory 620. Optionally, the processor 610 can be implemented in at least one hardware form of digital signal processing (DSP), field programmable gate array (FPGA), and programmable logic array (PLA). The processor 610 can integrate one or more combinations of a central processing unit 610 (CPU), a graphics processing unit 610 (GPU), and a modem. Among them, the CPU mainly processes the operating system, user interface, and application programs; the GPU is responsible for rendering and drawing display content; and the modem is used to process wireless communications. It can be understood that the above-mentioned modem may not be integrated into the processor 610, but may be implemented separately through a communication chip.

[0144] The memory 620 may include a random access memory 620 (Random Access Memory, RAM), and may also include a read-only memory 620 (Read-Only Memory). The memory 620 may be used to store instructions, programs, codes, code sets, or instruction sets. The memory 620 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playback function, an image playback function, etc.), instructions for implementing the various method embodiments described below, etc. The data storage area may also store data created by the electronic device during use (such as a phone book, audio and video data, chat record data), etc.

[0145] like Figure 8As shown, an embodiment of the present application further provides a computer-readable storage medium 700, in which computer program instructions 710 are stored. The computer program instructions 710 can be called by a processor to execute the method described in the above embodiment.

[0146] The computer readable storage medium may be an electronic memory such as a flash memory, an EEPROM (electrically erasable programmable read-only memory), an EPROM, a hard disk, or a ROM. Optionally, the computer readable storage medium includes a non-transitory computer-readable storage medium. The computer readable storage medium 700 has storage space for program codes that execute any of the method steps in the above method. These program codes may be read from or written to one or more computer program products. The program code may be compressed, for example, in an appropriate form.

[0147] According to one aspect of the present application, a computer program product or a computer program is provided, the computer program product or the computer program includes computer instructions, the computer instructions are stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the method provided in various optional implementations provided in the above embodiments.

[0148] The above are only preferred embodiments of the present application, and are not intended to limit the present application in any form. Although the present application has been disclosed as above with preferred embodiments, it is not intended to limit the present application. Any technical personnel in the field can make some changes or modify the technical contents disclosed above into equivalent embodiments without departing from the scope of the technical solution of the present application. However, any brief modifications, equivalent changes and modifications made to the above embodiments based on the technical essence of the present application without departing from the content of the technical solution of the present application are still within the scope of the technical solution of the present application.

Claims

1. A voice response system testing method, characterized in that: The method comprises: executing an interactive process associated with a received call request, wherein the call request is a request sent by a simulation terminal to establish a dialog relationship with the interactive process; If the interaction process is in a state of waiting for external input, the test record of the interaction process fed back by the manager is obtained, wherein the external input refers to different simulation inputs generated by the simulator during the execution of the interaction process, and the manager pre-enters the required information and dialogue rules of all nodes of the IVR to be tested; Determine, according to the test record, a sub-node of the current node that has not been tested, wherein the current node is used to represent a node that has completed the test at the current moment during the execution of the interaction process; Inputting a response input corresponding to the untested sub-node into the interaction process, testing the untested sub-node, and obtaining a feedback result of the interaction process, wherein the response input is used to represent an input for response interaction with the untested sub-node, and the feedback result is an execution state of each IVR node in the interaction process obtained after executing the interaction process; The test record is updated according to the feedback result.

2. The method according to claim 1, characterized in that The step of determining, according to the test record, a sub-node of the current node that has not been tested, comprises: Obtaining a decision tree associated with the interaction process; Determine all child nodes of the current node according to the decision tree; Acquire test marks of all child nodes of the current node according to the test record, wherein the test marks are used to indicate whether the child nodes have completed the test in each test path associated with a specific test type; The untested child nodes of the current node are determined according to the test flag of each child node.

3. The method according to claim 2, characterized in that The test record includes a test mark corresponding to the current node and a test mark corresponding to the child node, and updating the test record according to the feedback result includes: If the interactive process is completed, the feedback results of the nodes in each level of the decision tree are recorded; According to the feedback results of the nodes in each level, determining whether the test marks of all child nodes of the current node are in the completed test state; If the test marks of all the child nodes of the current node are in the completed test state, the test mark of the current node corresponding to the specific test type is updated to the completed state.

4. The method according to claim 3, characterized in that The method further comprises: If the test tag of the child node of the current node is in an unfinished test state, the test tag corresponding to the current node and the specific test type is kept in an unfinished state.

5. The method according to claim 1, characterized in that The step of inputting a response input corresponding to the untested sub-node into the interaction process, testing the untested sub-node, and obtaining a feedback result of the interaction process includes: Obtaining a node identifier corresponding to the untested subnode; Determining, in the node information according to the node identifier, a response input corresponding to the untested subnode; inputting the response input into the interaction process; The untested sub-nodes in the interaction process are tested according to the response input to obtain a feedback result of the interaction process.

6. The method according to claim 5, characterized in that The testing of the untested sub-node according to the response input to obtain a feedback result of the interaction process includes: Determining a corresponding response instruction according to an input mode of the response input; Testing the untested sub-node corresponding to the node identifier according to the response instruction to obtain a test result; The test results of the sub-nodes that have completed the test in the interaction process are used as the feedback results of the interaction process.

7. The method according to claim 1, characterized in that The interactive process associated with executing the received call request includes: When a call request is received, the resource usage status is obtained; Determine an allocation strategy according to the resource usage status; The interaction process associated with the received call request is executed according to the allocation strategy.

8. A voice response system testing device, characterized in that: The device comprises: A process execution module, configured to execute an interactive process associated with a received call request, wherein the call request is a request sent by a simulation terminal to establish a dialog relationship with the interactive process; An information acquisition module, used for acquiring the test record of the interaction process fed back by the manager if the interaction process is in a state of waiting for external input, wherein the external input refers to different simulation inputs generated by the simulator during the execution of the interaction process, and the manager pre-enters the required information and dialogue rules of all nodes of the IVR to be tested; A node determination module, used to determine, according to the test record, a sub-node of a current node that has not been tested, wherein the current node is used to represent a node that has completed testing at the current moment during the execution of the interaction process; A response input module, used for inputting a response input corresponding to the untested sub-node into the interaction process, testing the untested sub-node, and obtaining a feedback result of the interaction process, wherein the response input is used to represent an input for response interaction with the untested sub-node, and the feedback result is an execution state of each IVR node in the interaction process obtained after executing the interaction process; A record updating module is used to update the test record according to the feedback result.

9. An electronic device, characterized in that: include: Memory; One or more processors coupled to the memory; One or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, and the one or more applications are configured to execute the method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores program codes, which can be called by a processor to execute the method according to any one of claims 1 to 7.

Citation Information

Patent Citations

  • Graphical editing and debugging system of automatic answer system

    CN102426567A

  • Stress testing method, system, electronic device and storage medium for call center

    CN108989583A

  • Automated-script-based flow project test method and related equipment

    CN110309057A

  • Process test method and device

    CN110347593A

  • Automatic interface test case execution method and device

    CN112905461A