Object testing method and device, electronic equipment and computer readable medium

Abstract

The invention provides an object testing method and device, electronic equipment and a computer readable medium, the object testing method comprises the following steps: in response to an object testing instruction for a to-be-tested object, displaying a dialogue flow chart associated with the to-be-tested object on a testing interface, the to-be-tested object being used for interacting with a user, the dialogue flow chart is used for describing dialogue logic of the to-be-tested object; identifying an interaction intention of each piece of test interaction data input by the user; determining an interaction process node corresponding to each interaction intention and interaction response data of each interaction process node in the dialogue flow chart, and updating a node state of each interaction process node in the test interface; under the condition that the interaction process of the to-be-tested object reaches an end node of the dialogue flow chart, generating a test path of the dialogue flow chart according to the node state of each interaction process node; and generating test feedback data based on each piece of interactive response data and the test path, the test feedback data being used for debugging the dialogue flow chart.

Description

Technical Field

[0001] The present invention relates to the field of computer technology, and in particular to an object testing method and device, electronic equipment, and computer-readable medium. Background Art

[0002] With the development of science and technology, human-computer interaction functions have been widely used in various technical fields. In current practical applications, dialogue management systems are usually used for human-computer interaction. However, in actual applications, the scenarios of human-computer interaction are relatively complex, and customers have various ways of expressing themselves. Robots used to communicate with customers often find it difficult to provide satisfactory answers to customers and ensure the continuity of the conversation. Therefore, it is crucial to test the robot's conversation process before applying it to communicate with customers. Summary of the invention

[0003] To this end, the present invention provides an object testing method and device, an electronic device, and a computer-readable medium to solve the technical defects existing in the prior art.

[0004] In order to achieve the above object, the present invention provides a first aspect of an object testing method, comprising:

[0005] In response to an object test instruction for an object to be tested, displaying a dialog flow chart associated with the object to be tested on a test interface, wherein the object to be tested is used to interact with a user, and the dialog flow chart is used to describe the dialog logic of the object to be tested;

[0006] Identify the interaction intent of each test interaction data entered by the user;

[0007] Determining the interactive process node corresponding to each of the interactive intentions and the interactive response data of each of the interactive process nodes in the dialog flow chart, and updating the node status of each of the interactive process nodes in the test interface;

[0008] When the interaction process of the object to be tested reaches the end node of the dialog flow chart, generating a test path of the dialog flow chart according to the node state of each of the interaction process nodes;

[0009] Based on each of the interactive response data and the test path, test feedback data is generated, wherein the test feedback data is used to debug the dialog flow chart.

[0010] Optionally, identifying the interaction intent of each test interaction data input by the user includes: for any test interaction data, inputting the test interaction data into an intent recognition model; and obtaining the interaction intent of the test interaction data output by the intent recognition model.

[0011] Optionally, determining the interaction process node corresponding to each interaction intention in the dialogue flow chart includes: obtaining preset intentions of multiple process nodes in the dialogue flow chart; for any interaction intention, determining the intention matching degree between the interaction intention and multiple preset intentions respectively; based on the multiple intention matching degrees, determining the target intention corresponding to the interaction intention from the multiple preset intentions; and determining the process node to which the target intention belongs as the interaction process node corresponding to the interaction intention.

[0012] Optionally, updating the node status of each of the interactive process nodes in the test interface includes: for any interactive process node, updating the node status of the interactive process node to a processed status.

[0013] Optionally, after the test interface updates the node status of each of the interactive process nodes, the method further comprises: for any interactive process node, highlighting a node line connected to the interactive process node.

[0014] Optionally, in response to an object test instruction for the object to be tested, before displaying the dialogue flow chart associated with the object to be tested on the test interface, the method also includes: obtaining preset intention configuration information, preset entity configuration information and preset speech configuration information; adding a start node, multiple blank process nodes and a blank end node in the flowchart canvas; performing node configuration on the multiple blank process nodes according to the preset intention configuration information, the preset entity configuration information and the preset speech configuration information, to obtain multiple process nodes; performing node configuration on the blank end node according to the preset speech configuration information, to obtain an end node; and connecting the start node, the multiple process nodes and the end node in a directionally manner to generate a dialogue flow chart.

[0015] Optionally, after generating test feedback data based on each of the interactive response data and the test path, the method further includes: in response to a delete instruction for content to be deleted in the dialog flow chart, deleting the content to be deleted from the dialog flow chart to obtain a debugged dialog flow chart; or in response to an add instruction for content to be added, adding the content to be added to the dialog flow chart to obtain a debugged dialog flow chart; wherein, the content to be deleted includes nodes to be deleted and / or node connections to be deleted, and the content to be added includes nodes to be added and / or node connections to be added.

[0016] A second aspect of the present invention provides an object testing device, comprising:

[0017] A display module is configured to display a dialogue flow chart associated with the object to be tested on a test interface in response to an object test instruction for the object to be tested, wherein the object to be tested is used to interact with a user, and the dialogue flow chart is used to describe the dialogue logic of the object to be tested;

[0018] an identification module configured to identify the interaction intention of each test interaction data input by the user;

[0019] A determination module is configured to determine the interaction process node corresponding to each interaction intention and the interaction response data of each interaction process node in the dialogue flow chart, and update the node state of each interaction process node in the test interface;

[0020] A first generating module is configured to generate a test path of the dialog flow chart according to the node state of each of the interaction process nodes when the interaction process of the object to be tested reaches the end node of the dialog flow chart;

[0021] The second generating module is configured to generate test feedback data based on each of the interactive response data and the test path, wherein the test feedback data is used to debug the dialog flow chart.

[0022] A third aspect of the present invention provides an electronic device, comprising:

[0023] One or more processors; a memory having one or more programs stored thereon, wherein when the one or more programs are executed by the one or more processors, the one or more processors implement the above-mentioned object testing method; one or more I / O interfaces connected between the processor and the memory and configured to implement information interaction between the processor and the memory.

[0024] A fourth aspect of the present invention provides a computer-readable medium having a computer program stored thereon, wherein the program implements the above-mentioned object testing method when executed by a processor.

[0025] The present invention has the following advantages: in response to the object test instruction of the object to be tested, a dialog flow chart associated with the object to be tested is displayed in the test interface, the interactive intention of each test interactive data input by the user is identified, the interactive process node and the interactive response data of the interactive process node corresponding to each interactive intention are determined in the dialog flow chart, and the node state of each interactive process node is updated in the test interface. In the case that the interactive process of the object to be tested reaches the end node of the dialog flow chart, the test path of the dialog flow chart can be generated according to the node state of each interactive process node, and the test feedback data of the dialog flow chart can be generated based on the interactive response data of each interactive process node and the generated test path. Thus, the dialog flow chart can be debugged according to the test feedback data, and the node state of each interactive process node and the interactive response data given by the object to be tested for each test interactive data can be intuitively viewed in a visual way of the dialog flow chart, and the logic and reaction of the interaction between the object to be tested and the user can be clearly understood, and the reliability and coherence of the interaction between the object to be tested and the customer in practical applications based on the debugged dialog flow chart can be further improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] The accompanying drawings are used to provide further understanding of the present invention and constitute a part of the specification. Together with the following specific embodiments, they are used to explain the present invention, but do not constitute a limitation of the present invention.

[0027] Figure 1 A flowchart of an object testing method provided by an embodiment of the present invention;

[0028] Figure 2 A schematic diagram of displaying a dialog flow chart on a test interface provided by an embodiment of the present invention;

[0029] Figure 3 A schematic diagram of generating a dialogue flow chart provided by an embodiment of the present invention;

[0030] Figure 4 A processing flow chart of an object testing method provided by an embodiment of the present invention;

[0031] Figure 5 A structural block diagram of an object testing device provided by an embodiment of the present invention;

[0032] Figure 6 A structural block diagram of an electronic device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0033] The specific implementation of the present invention is described in detail below in conjunction with the accompanying drawings. It should be understood that the specific implementation described here is only used to illustrate and explain the present invention, and is not used to limit the present invention.

[0034] As used herein, the term "and / or" includes any and all combinations of one or more of the associated listed items.

[0035] The terms used in the present invention are only used to describe specific embodiments and are not intended to limit the present invention. As used in the present invention, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.

[0036] When the terms “comprising” and / or “made of…” are used in the present invention, it specifies the existence of the stated features, integers, steps, operations, elements and / or components, but does not exclude the existence or addition of one or more other features, integers, steps, operations, elements, components and / or groups thereof.

[0037] Unless otherwise defined, all terms (including technical and scientific terms) used in the present invention have the same meaning as those commonly understood by those of ordinary skill in the art. It will also be understood that terms such as those defined in commonly used dictionaries should be interpreted as having a meaning consistent with their meaning in the context of the relevant art and the present invention, and will not be interpreted as having an idealized or overly formal meaning unless the present invention clearly defines it as such.

[0038] In current practical applications, chatbots or dialogue robots are usually used to conduct conversations with customers. To ensure the reliability and coherence of the conversations between the robot and the customer, developers often configure the robot for dialogue before putting it into practical application. For example, by defining the intent and entity for the conversation, and building a script library based on the defined intent and entity, and then using a dialogue management system or machine learning model to manage the conversation data. In the above way, the next sentence of the conversation between the robot and the customer is determined to maintain the coherence of the conversation.

[0039] However, in related technologies, when developers configure robots, it is easy for them to have confusing robot dialogue configurations due to problems such as large amounts of dialogue data in the constructed speech library, inaccurate entity extraction, and unclear relationships between various intents. As a result, when developers are testing robots, they cannot intuitively understand the logic and response of the robot's interaction with customers, thereby reducing the response quality of the robot's dialogue and chat with customers in actual applications and reducing customer experience.

[0040] Based on this, the embodiments of the present invention provide an object testing method, an object testing device, an electronic device, and a computer-readable medium, which are described in detail one by one in the following embodiments.

[0041] In a first aspect, an embodiment of the present invention provides an object testing method. Figure 1 , Figure 1A flowchart of an object testing method provided according to an embodiment of the present invention is shown, which specifically includes the following steps:

[0042] Step 102: In response to an object test instruction for the object to be tested, displaying a dialog flow chart associated with the object to be tested on a test interface.

[0043] Among them, the object to be tested refers to an intelligent entity that needs to be interactively tested, and the object to be tested is used to interact with the user. In practical applications, the object to be tested can specifically be a conversational chat robot, an outbound call robot, a voice assistant, an automatic customer service, etc. that need to be tested for dialogue. The object test instruction refers to an instruction for interactively testing the object to be tested. The object test instruction can be generated by a user who performs an interactive test on the object to be tested, triggering a test operation on the object to be tested. For example, the user can click the "Test the object to be tested" button to generate an object test instruction for the object to be tested; the user can use the voice instruction "Test the object to be tested" to generate an object test instruction for the object to be tested, and so on. The specific method for generating the object test instruction can be determined according to the actual application situation, and the present invention is not limited here.

[0044] The test interface refers to the interface used to perform interactive testing on the test object. Users can intuitively see the process of interactive testing on the test object through the test interface. The dialogue flow chart is used to describe the dialogue logic of the test object. The dialogue flow chart includes a start node, a process node, and an end node. The number of process nodes can be one or more. The process node is specifically a node between the start node and the end node.

[0045] Specifically, the object testing method provided by the embodiment of the present invention can be applied to a terminal device, and the terminal device can specifically be a user device, a mobile device, a user terminal, a terminal, a handheld device, a computing device, a vehicle-mounted device, a wearable device, etc. After receiving an object testing instruction triggered by a user for an object to be tested, the terminal device responds to the object testing instruction and displays a dialog flow chart associated with the object to be tested on a test interface.

[0046] See also Figure 2 , Figure 2 FIG. 1 is a schematic diagram showing a dialog flow chart displayed on a test interface according to an embodiment of the present invention. The test object is a robot as an example. Figure 2 As shown in the figure, the test interface displays an interactive content page for the user to interact with the robot and a display page of the dialogue flow chart associated with the robot. The user enters the dialogue for interactive testing with the robot on the interactive content page, and the robot responds to the dialogue input by the user based on the dialogue flow chart. Specifically, the user enters the test interface by clicking the "Test Robot" button, and the robot responds as follows: Figure 2The content of the dialogue flow chart on the right side of the middle screen interacts with the user. During the interactive test between the user and the robot, the user can intuitively see the dialogue flow chart displayed on the test interface to understand the specific test process of the user's interactive test on the robot.

[0047] The embodiment of the present invention can visualize the interactive testing process between the user and the object to be tested, so that the user can intuitively understand the interactive testing process.

[0048] Before performing interactive testing on the test object based on the dialogue flow chart, you need to pre-configure the dialogue flow chart associated with the test object. The specific implementation method of configuring and generating the dialogue flow chart is as follows:

[0049] In a specific implementation of the present invention, in response to an object test instruction for the object to be tested, before displaying the dialog flow chart associated with the object to be tested on the test interface, the method further includes:

[0050] Obtain preset intent configuration information, preset entity configuration information, and preset speech configuration information;

[0051] Add a start node, multiple blank process nodes, and a blank end node to the flowchart canvas;

[0052] According to the preset intention configuration information, the preset entity configuration information and the preset speech configuration information, respectively configure the multiple blank process nodes to obtain multiple process nodes;

[0053] According to the preset speech configuration information, the blank end node is configured to obtain an end node;

[0054] The start node, the multiple process nodes and the end node are connected in a directionally manner to generate a dialog flow chart.

[0055] Among them, preset intent configuration information refers to pre-configured intent information, including multiple intents. The intent is specifically the purpose of the customer inputting the interaction data, such as consultation, complaint, appointment, etc. Users (specifically developers) can customize the constructed intent to obtain preset intent configuration information. Preset entity configuration information refers to pre-configured entity information, including multiple entities. The entity is specifically a specific information fragment or parameter related to the customer's intent, which is used to provide a specific context for the intent. For example, the entity can be a person, date, place, etc. Users can customize entities to obtain preset entity configuration information.

[0056] For example, a customer enters the dialogue "I want to query the bills from February to May of this year", the intent of the dialogue is "bill query", and "February of this year" and "May" are date entities.

[0057] Preset speech configuration information refers to pre-configured speech information, including multiple response speeches designed for the object to be tested. Specifically, it includes single-round dialogue speeches and multi-round dialogue speeches. The flowchart canvas is the canvas used to generate a dialogue flowchart. The canvas (Grah) is the carrier of the graph. It contains all the elements on the graph (nodes, edges, etc.), and also mounts the relevant operations of the graph (such as interaction detection, element operation, rendering, etc.). A blank process node is a process node that has not been configured, that is, a blank process node. A blank end node is an end node that has not been configured, that is, a blank end node.

[0058] Specifically, the pre-configured preset intention configuration information, preset entity configuration information and preset speech configuration information are obtained, and a start node, a blank process node and a blank end node are added to the flowchart canvas for generating a dialogue flow chart. The number of blank process nodes and blank end nodes can be added according to the actual application situation. The present invention does not limit the number of blank process nodes and blank end nodes added. In practical applications, blank process nodes and blank end nodes can be added to the flowchart canvas by dragging and dropping blank process nodes and blank end nodes. According to the pre-configured preset intention configuration information, the blank process node is configured with intention, according to the preset entity configuration information, the blank process node is configured with entity, and according to the preset speech configuration information, the blank process node is configured with speech. After completing the node configuration of multiple blank process nodes, multiple process nodes can be obtained. Since the end node means the end of the dialogue, there is no need to configure the intention and entity for the blank end node, and the blank end node can be configured with speech according to the preset speech configuration information to obtain the corresponding end node.

[0059] In actual applications, all nodes have connection piles, which are used to connect nodes and support the generation of dynamic connection lines. Connection piles include entry piles and exit piles. Entry piles are the connection piles where the process enters the current node from the previous node, and exit piles are the connection piles where the process leaves the current node. The start node has an exit pile but no entry pile; the process node has an entry pile and an exit pile; the end node has an entry pile but no exit pile.

[0060] In an embodiment of the present invention, the number of outgoing piles of a process node is determined according to the number of configured intentions, and a process node can be configured with one or more intentions, and the number of intentions is the same as the number of outgoing piles of the process node. After the configuration obtains the start node, the process node and the end node, the directed connection between the start node, the process node and the end node is completed through the connection piles of the start node, the process node and the end node, and the outgoing pile of each node is specifically connected to the incoming pile of other nodes, so that the directed connection between the nodes can be completed, a dialogue flow chart is generated, and the orderly flow of the dialogue process is realized.

[0061] Further, see Figure 3 , Figure 3 FIG. 2 shows a schematic diagram of generating a dialog flow chart according to an embodiment of the present invention. Figure 3 As shown, users can drag Figure 3 To add a blank process node, drag the end node to the flowchart canvas ( Figure 3 For any blank node (including blank process node and blank end node) added to the flowchart canvas, click the corresponding blank node to Figure 3 The node configuration area shown on the right performs node configuration on the blank node. The node configuration method is specifically as described above, and the present invention will not repeat it here. After completing the node configuration, click "Save" to display it in the corresponding part of the node.

[0062] It should be noted that in actual applications, other related configurations can be made to the nodes according to actual configuration requirements. Users can customize the style of the flowchart canvas, the alignment of the connection lines, the mouse scrolling method, the node connection form, etc., and can also set node interaction events, such as clicking a node, moving the mouse into a node, removing a node with the mouse, adding a node to refresh the node list, deleting a node to refresh the node list, etc.

[0063] In order to improve the efficiency of generating a dialogue flow chart, the dialogue flow chart can be generated based on AntV X6, vue-flow, GoJS, mxGrah, etc. In the embodiment of the present invention, AntV X6 is preferably used to generate the dialogue flow chart.

[0064] The embodiment of the present invention constructs a dialogue flow chart and displays it on a test interface, so that the user can intuitively see the process of interactive testing with the object to be tested based on the dialogue flow chart. In the process of generating the dialogue flow chart, the user can generate the dialogue flow chart by dragging and connecting nodes, which simplifies the generation method of the dialogue flow chart.

[0065] Step 104: Identify the interaction intention of each test interaction data input by the user.

[0066] After the dialog flow chart associated with the object to be tested is displayed on the test interface, the terminal can receive the test interaction data input by the user, and determine the subsequent nodes by identifying the interaction intention of the test interaction data.

[0067] The test interaction data refers to the interaction data input by the user for interactive testing of the test object, which may be dialogue data, including dialogue text or dialogue voice. The interaction intention is used to characterize the interaction purpose of the user inputting the test interaction data.

[0068] In practical applications, the intent recognition model can be trained and used to identify the interaction intent of test interaction data.

[0069] Based on this, in a specific implementation of the present invention, identifying the interaction intention of each test interaction data input by the user includes:

[0070] For any test interaction data, input the test interaction data into the intent recognition model;

[0071] Obtain the interaction intent of the test interaction data output by the intent recognition model.

[0072] The intent recognition model is used to recognize the interaction intent of the test interaction data. The intent recognition model can be a language processing model, such as a Transformer model, a BERT (Bidirectional Encoder Representations from Transformers) model, a GPT (Generative Pre-trained Transformer) model, a T5 (Text-to-Text Transfer Transformer) model, and the like.

[0073] In the process of configuring the preset intent configuration information, after constructing the intent, sample interaction data for training the intent recognition model can be obtained, and the intent recognition model can be trained based on the sample interaction data to obtain a trained intent recognition model.

[0074] Specifically, after receiving the test interaction data input by the user, the test interaction data is input into the intent recognition model, and the test interaction data is processed by the intent recognition model to identify the interaction intent of the test interaction data.

[0075] The embodiment of the present invention trains an intention recognition model to recognize the interaction intention of test interaction data, thereby improving the accuracy and efficiency of identifying the interaction intention.

[0076] Step 106: Determine the interaction process node corresponding to each interaction intention and the interaction response data of each interaction process node in the dialogue flow chart, and update the node status of each interaction process node in the test interface.

[0077] After identifying the interaction intention of each test interaction data, the interaction process node corresponding to each interaction intention can be determined in the dialogue flow chart according to the interaction intention of each test interaction data, thereby determining the interaction response data that the object to be tested should make for each test interaction data.

[0078] The interactive process node refers to the process node that has a high degree of match with the interactive intent. The interactive response data refers to the response data used to interact with the test interactive data, specifically the words configured in the interactive process node.

[0079] Specifically, according to the interaction intention of each test interaction data, the interaction process node corresponding to each interaction intention is determined in the dialogue flow chart, and the words configured in the interaction process node are determined as the interaction response data for interactive testing with the user, and the interaction response data is output to the interaction content page between the object to be tested and the user. After completing the operation of the interaction process node, the node status of the interaction process node is updated.

[0080] In actual applications, the interaction process node corresponding to the interaction intent can be determined by determining the matching degree between each interaction intent and the intent configured in each process node. The specific implementation method is as follows:

[0081] In a specific implementation of the present invention, determining the interaction process node corresponding to each interaction intention in the dialog flow chart includes:

[0082] Obtaining preset intentions of multiple process nodes in the dialog flow chart;

[0083] For any interaction intention, respectively determine the intention matching degree between the interaction intention and multiple preset intentions;

[0084] According to the multiple intention matching degrees, determining the target intention corresponding to the interaction intention from the multiple preset intentions;

[0085] The process node to which the target intent belongs is determined as the interaction process node corresponding to the interaction intent.

[0086] The preset intent refers to the intent configured for the process node according to the preset intent configuration information. The intent matching degree is used to characterize the matching degree between the interaction intent and the preset intent, and also to characterize the closeness between the interaction intent and the preset intent. The target intent refers to the preset intent with the highest intent matching degree with the interaction intent among multiple preset intents.

[0087] Specifically, after determining the interaction intent of each test interaction data, the preset intents configured in multiple process nodes in the dialog flow chart are obtained. For any interaction intent, the intent matching degree between the interaction intent and multiple preset intents is determined respectively, and the preset intent with the highest intent matching degree is determined as the target intent of the interaction intent, and the process node to which the target intent belongs is determined as the interaction process node corresponding to the interaction intent.

[0088] For example, the preset intentions of multiple process nodes in the dialogue flow chart are obtained, and the preset intentions of process node 1 include intentions s11 and intentions s12, and the preset intentions of process node 2 include intentions s21. For interaction intention a, the intention matching degree p11 between interaction intention a and intention s11, the intention matching degree p12 between interaction intention a and intention s12, and the intention matching degree p21 between interaction intention a and intention s21 are determined respectively, wherein the intention matching degree p11>p21>p12. Therefore, intention s11 can be determined as the target intention of interaction intention a, and process node 1 to which intention s11 belongs is the interaction process node of interaction intention a.

[0089] By determining the intent matching degree between the interaction intent of the test interaction data and the preset intentions of multiple process nodes, the target intent with the highest intent matching degree between the interaction intent is determined, and the process node to which the target intent belongs is further determined as the interaction process node corresponding to the interaction intent in the dialogue flow chart, thereby improving the accuracy of determining the interaction process nodes, thereby further improving the accuracy of determining the interaction response data used to interact with the object to be tested.

[0090] Furthermore, in order to improve the user's understanding of the interactive test process based on the dialogue flowchart, the node status of the interactive process node can be updated after each interactive process node is operated, so that the user can understand the process of the interactive test more intuitively.

[0091] Based on this, in a specific implementation manner provided by the present invention, updating the node status of each of the interactive process nodes in the test interface includes:

[0092] For any interactive process node, the node state of the interactive process node is updated to a processed state.

[0093] In actual applications, the process nodes in the dialogue flow chart should be in an unprocessed state when no interactive test is performed. After determining the interactive response data of the object to be tested at the interactive process node, the determined interactive response data will be output to the interactive content page between the object to be tested and the user. At this time, the interactive process node is operated, and the node state of the interactive process node can be updated to a processed state. Specifically, the node state of the interactive process node can also be displayed to the user through a visual effect, for example, the interactive process node after the operation can be highlighted, or the node color of the interactive process node can be changed.

[0094] Furthermore, in a specific implementation manner provided by the present invention, after the test interface updates the node status of each of the interaction process nodes, the method further includes:

[0095] For any interactive process node, the node line connected to the interactive process node is highlighted.

[0096] In order to enable the user to clearly understand the interactive test process of the test object, the node connection lines connected to the interactive process nodes can also be highlighted.

[0097] The embodiment of the present invention determines the intention matching degree between the interaction intention and multiple preset intentions, determines the interaction process node corresponding to the interaction intention, and determines the words configured in the interaction process node as the interaction response data for replying to the object to be tested, thereby improving the accuracy of determining the interaction response data. By updating the node status of the interaction process node, the user can more intuitively understand the interaction test process for the object to be tested.

[0098] Step 108: When the interaction process of the object to be tested reaches the end node of the dialog flow chart, a test path of the dialog flow chart is generated according to the node state of each of the interaction process nodes.

[0099] When the interaction process of the object to be tested reaches the end node of the dialog flow chart, it means that the interaction test process is over. After the interaction test process is over, the test path of the dialog flow chart can be generated according to the node status of each interaction process node. Through the test path, the user can intuitively see the interaction test process.

[0100] Step 110: Generate test feedback data based on each of the interactive response data and the test path.

[0101] Among them, the test feedback data is used to debug the dialogue flow chart. After obtaining the test path of the dialogue flow chart, the interactive response data and the test path are used as the test feedback data of the dialogue flow chart. The user can debug the words configured in each process node and end node according to the interactive response data, and debug the connection relationship between each node according to the test path, so as to realize the debugging of the dialogue flow chart.

[0102] In actual applications, users can debug the dialogue flow chart by operating the nodes and node connections in the dialogue flow chart. Specifically, the user can move the node to any position in the flowchart canvas by hovering the mouse over the node and dragging it, thereby debugging the node position; by clicking the delete button in the upper right corner of the node, the node can be deleted; by hovering the mouse over the node connection, the corresponding node connection can be displayed in dotted form for easy user identification; by clicking the delete mark on the node connection, the node connection can be deleted, etc. Through the above operations on nodes and node connections, users can intuitively manage and debug the dialogue flow chart, improving the flexibility and ease of management and debugging of the dialogue flow chart.

[0103] Based on this, in a specific implementation manner provided by the present invention, after generating the test feedback data based on each of the interactive response data and the test path, the method further includes:

[0104] In response to a deletion instruction for the content to be deleted in the dialog flow chart, the content to be deleted is deleted from the dialog flow chart to obtain a debugged dialog flow chart; or

[0105] In response to an adding instruction for the content to be added, adding the content to be added to the dialog flow chart to obtain a debugged dialog flow chart;

[0106] The content to be deleted includes nodes to be deleted and / or connections between nodes to be deleted, and the content to be added includes nodes to be added and / or connections between nodes to be added.

[0107] The content to be deleted is the content that needs to be deleted in the dialog flow chart, including the nodes to be deleted or the connections between the nodes to be deleted; the content to be added is the content that needs to be added to the dialog flow chart, including the nodes to be added or the connections between the nodes to be added. The deletion instruction is the instruction generated based on the deletion operation performed by the user on the content to be deleted; the addition instruction is the instruction generated based on the addition operation performed by the user on the content to be added.

[0108] Specifically, after receiving a delete instruction for the content to be deleted, the content to be deleted is deleted from the dialog flow chart in response to the delete instruction to obtain a debugged dialog flow chart; after receiving an add instruction for the content to be added, the content to be added is added to the dialog flow chart in response to the add instruction to obtain a debugged dialog flow chart. The debugged dialog flow chart can be used for the next interactive test on the object to be tested. After determining that the dialog flow chart does not need to be debugged, the dialog flow chart can be applied.

[0109] The embodiment of the present invention generates test feedback data so that the user can debug the dialogue flow chart according to the test feedback data to continuously improve the accuracy of the dialogue flow chart, further improve the accuracy and consistency of interaction with customers based on the dialogue flow chart in actual applications, and improve customer experience.

[0110] The object testing method provided by the present invention comprises: in response to an object testing instruction for an object to be tested, displaying a dialog flow chart associated with the object to be tested on a test interface, wherein the object to be tested is used to interact with a user, and the dialog flow chart is used to describe the dialog logic of the object to be tested; identifying the interaction intention of each test interaction data input by the user; determining the interaction process node corresponding to each interaction intention and the interaction response data of each interaction process node in the dialog flow chart, and updating the node state of each interaction process node on the test interface; when the interaction process of the object to be tested reaches the end node of the dialog flow chart, generating a test path of the dialog flow chart according to the node state of each interaction process node; generating test feedback data based on each interaction response data and the test path, wherein the test feedback data is used to debug the dialog flow chart.

[0111] The embodiment provided by the present invention realizes that, in response to the object test instruction of the object to be tested, a dialog flow chart associated with the object to be tested is displayed in the test interface, the interactive intention of each test interactive data input by the user is identified, the interactive process node corresponding to each interactive intention and the interactive response data of the interactive process node are determined in the dialog flow chart, and the node state of each interactive process node is updated in the test interface. In the case that the interactive process of the object to be tested reaches the end node of the dialog flow chart, the test path of the dialog flow chart can be generated according to the node state of each interactive process node, and the test feedback data of the dialog flow chart is generated based on the interactive response data of each interactive process node and the generated test path. Thus, the dialog flow chart can be debugged according to the test feedback data, and the node state of each interactive process node and the interactive response data given by the object to be tested for each test interactive data can be intuitively viewed in a visual way of the dialog flow chart, and the logic and reaction of the object to be tested interacting with the user can be clearly understood, and the reliability and coherence of the object to be tested interacting with the customer in practical applications based on the debugged dialog flow chart can be further improved.

[0112] The following combination Figure 4 , taking the object to be tested as a conversational robot as an example, the object testing method provided in the embodiment of the present invention is further explained. Figure 4 A processing flow chart of an object testing method provided according to an embodiment of the present invention is shown, which specifically includes the following steps:

[0113] Step 402: Receive a robot test instruction for the conversational robot.

[0114] Step 404: In response to the robot test instruction, display the dialogue flow chart associated with the dialogue robot on the test interface.

[0115] Step 406: Input the test interaction dialogue input by the user into the intention recognition model to obtain the interaction intention of the test interaction dialogue.

[0116] Step 408: Obtain preset intentions of multiple process nodes in the dialog flow chart.

[0117] Step 410: Determine the intention matching degree between the interaction intention and multiple preset intentions respectively.

[0118] Step 412: Determine a target intent corresponding to the interaction intent from among the plurality of preset intents based on the matching degrees of the plurality of intents.

[0119] Step 414: determine the process node to which the target intent belongs as the interactive process node corresponding to the interactive intent, and determine the interactive response dialogue of the interactive process node.

[0120] Step 416: updating the node status of the interactive process node in the test interface, and highlighting the node connection line connected to the interactive process node.

[0121] Step 418: When the interaction process of the conversation robot reaches the end node of the conversation flow chart, a test path of the conversation flow chart is generated according to the node state of each interaction process node.

[0122] Step 420: Generate test feedback data based on the interactive response dialogue of each interactive process node and the test path.

[0123] Specifically, the test feedback data generated by the user can be used to debug the dialogue flow diagram to improve the accuracy and coherence of the dialogue flow diagram.

[0124] Step 422: In response to a deletion instruction for the content to be deleted in the dialog flow chart, the content to be deleted is deleted from the dialog flow chart to obtain a debugged dialog flow chart.

[0125] Step 424: In response to the adding instruction for the content to be added, the content to be added is added to the dialog flow chart to obtain a debugged dialog flow chart.

[0126] Specifically, the debugged dialogue flow chart can be used for the next dialogue interaction test for the dialogue robot. After determining that the dialogue flow chart does not need to be debugged, the dialogue flow chart can be applied.

[0127] The embodiments of the present invention realize debugging of the dialogue flow chart according to the test feedback data, and realize that by visualizing the dialogue flow chart, the user can intuitively view the node status of each interactive process node, as well as the interactive response dialogue given by the dialogue robot for each test interactive dialogue, and clearly understand the logic and response of the dialogue robot's dialogue interaction with the user, and further improve the reliability and consistency of the dialogue robot's dialogue interaction with the customer during the application process based on the debugged dialogue flow chart.

[0128] The step division of the above methods is only for the purpose of clear description. When implemented, they can be combined into one step or some steps can be split and decomposed into multiple steps. As long as they include the same logical relationship, they are all within the scope of protection of this patent; adding insignificant modifications to the algorithm or process or introducing insignificant designs without changing the core design of the algorithm and process are all within the scope of protection of this patent.

[0129] In a second aspect, an embodiment of the present invention provides an object testing device. Figure 5 FIG. 4 shows a structural block diagram of an object testing device provided according to an embodiment of the present invention. Figure 5 As shown, the object test device includes:

[0130] A display module 502 is configured to display a dialog flow chart associated with the object to be tested on a test interface in response to an object test instruction for the object to be tested, wherein the object to be tested is used to interact with a user, and the dialog flow chart is used to describe the dialog logic of the object to be tested;

[0131] An identification module 504 is configured to identify the interaction intention of each test interaction data input by the user;

[0132] The determination module 506 is configured to determine the interaction process node corresponding to each interaction intention and the interaction response data of each interaction process node in the dialogue flow chart, and update the node state of each interaction process node in the test interface;

[0133] A first generating module 508 is configured to generate a test path of the dialog flow chart according to the node state of each of the interaction process nodes when the interaction process of the object to be tested reaches the end node of the dialog flow chart;

[0134] The second generating module 510 is configured to generate test feedback data based on each of the interactive response data and the test path, wherein the test feedback data is used to debug the dialog flow chart.

[0135] Optionally, the identification module 504 is further configured to:

[0136] For any test interaction data, input the test interaction data into the intent recognition model;

[0137] Obtain the interaction intent of the test interaction data output by the intent recognition model.

[0138] Optionally, the determining module 506 is further configured to:

[0139] Obtaining preset intentions of multiple process nodes in the dialog flow chart;

[0140] For any interaction intention, respectively determine the intention matching degree between the interaction intention and multiple preset intentions;

[0141] According to the multiple intention matching degrees, determining the target intention corresponding to the interaction intention from the multiple preset intentions;

[0142] The process node to which the target intent belongs is determined as the interaction process node corresponding to the interaction intent.

[0143] Optionally, the determining module 506 is further configured to:

[0144] For any interactive process node, the node state of the interactive process node is updated to a processed state.

[0145] Optionally, the device further comprises a highlight display module configured to:

[0146] For any interactive process node, the node line connected to the interactive process node is highlighted.

[0147] Optionally, the device further includes a third generating module, configured to:

[0148] Obtain preset intent configuration information, preset entity configuration information, and preset speech configuration information;

[0149] Add a start node, multiple blank process nodes, and a blank end node to the flowchart canvas;

[0150] According to the preset intention configuration information, the preset entity configuration information and the preset speech configuration information, respectively configure the multiple blank process nodes to obtain multiple process nodes;

[0151] According to the preset speech configuration information, the blank end node is configured to obtain an end node;

[0152] The start node, the multiple process nodes and the end node are connected in a directionally manner to generate a dialog flow chart.

[0153] Optionally, the device further includes a debugging module configured to:

[0154] In response to a deletion instruction for the content to be deleted in the dialog flow chart, the content to be deleted is deleted from the dialog flow chart to obtain a debugged dialog flow chart; or

[0155] In response to an adding instruction for the content to be added, adding the content to be added to the dialog flow chart to obtain a debugged dialog flow chart;

[0156] The content to be deleted includes nodes to be deleted and / or connections between nodes to be deleted, and the content to be added includes nodes to be added and / or connections between nodes to be added.

[0157] The object testing device provided by the present invention comprises: a display module, configured to display a dialogue flow chart associated with the object to be tested on a test interface in response to an object testing instruction for the object to be tested, wherein the object to be tested is used to interact with a user, and the dialogue flow chart is used to describe the dialogue logic of the object to be tested; an identification module, configured to identify the interaction intention of each test interaction data input by the user; a determination module, configured to determine the interaction process node corresponding to each interaction intention and the interaction response data of each interaction process node in the dialogue flow chart, and update the node state of each interaction process node on the test interface; a first generation module, configured to generate a test path of the dialogue flow chart according to the node state of each interaction process node when the interaction process of the object to be tested reaches the end node of the dialogue flow chart; a second generation module, configured to generate test feedback data based on each interaction response data and the test path, wherein the test feedback data is used to debug the dialogue flow chart.

[0158] The embodiment provided by the present invention realizes that, in response to the object test instruction of the object to be tested, a dialog flow chart associated with the object to be tested is displayed in the test interface, the interactive intention of each test interactive data input by the user is identified, the interactive process node corresponding to each interactive intention and the interactive response data of the interactive process node are determined in the dialog flow chart, and the node state of each interactive process node is updated in the test interface. In the case that the interactive process of the object to be tested reaches the end node of the dialog flow chart, the test path of the dialog flow chart can be generated according to the node state of each interactive process node, and the test feedback data of the dialog flow chart is generated based on the interactive response data of each interactive process node and the generated test path. Thus, the dialog flow chart can be debugged according to the test feedback data, and the node state of each interactive process node and the interactive response data given by the object to be tested for each test interactive data can be intuitively viewed in a visual way of the dialog flow chart, and the logic and reaction of the object to be tested interacting with the user can be clearly understood, and the reliability and coherence of the object to be tested interacting with the customer in practical applications based on the debugged dialog flow chart can be further improved.

[0159] The functions or modules included in the device provided in the embodiment of the present invention can be used to execute the method described in the first aspect method embodiment above. Its specific implementation and technical effects can refer to the description of the above method embodiment. For the sake of brevity, they will not be repeated here.

[0160] It should be noted that all modules involved in this embodiment are logic modules. In practical applications, a logic unit may be a physical unit, or a part of a physical unit, or may be implemented as a combination of multiple physical units. In addition, in order to highlight the innovative part of the present invention, this embodiment does not introduce units that are not closely related to solving the technical problem proposed by the present invention, but this does not mean that there are no other units in this embodiment.

[0161] Reference Figure 6 , an embodiment of the present invention provides an electronic device, the electronic device 600 comprising:

[0162] One or more processors 601;

[0163] A memory 602 having one or more programs stored thereon, which, when executed by one or more processors, enables the one or more processors to implement the object testing method described above;

[0164] One or more I / O interfaces 603 are connected between the processor and the memory and are configured to implement information exchange between the processor and the memory.

[0165] Among them, the processor 601 is a device with data processing capabilities, including but not limited to a central processing unit (CPU); the memory 602 is a device with data storage capabilities, including but not limited to random access memory (RAM, more specifically SDRAM, DDR, etc.), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory (FLASH); the I / O interface (read-write interface) 603 is connected between the processor 601 and the memory 602, and can realize information interaction between the processor 601 and the memory 602, including but not limited to a data bus (Bus), etc.

[0166] In some embodiments, the processor 601 , the memory 602 , and the I / O interface 603 are connected to each other through a bus, and further connected to other components of the computing device.

[0167] This embodiment further provides a computer-readable medium on which a computer program is stored. When the program is executed by a processor, the object testing method provided by this embodiment is implemented. To avoid repeated description, the specific steps of the object testing method are not repeated here.

[0168] It will be appreciated by those skilled in the art that all or some of the steps, systems, and functional modules / units in the invented method described above may be implemented as software, firmware, hardware, and appropriate combinations thereof. In hardware implementations, the division between the functional modules / units mentioned in the above description does not necessarily correspond to the division of physical components; for example, a physical component may have multiple functions, or a function or step may be performed by several physical components in cooperation. Some physical components or all physical components may be implemented as software executed by a processor, such as a central processing unit, a digital signal processor, or a microprocessor, or implemented as hardware, or implemented as an integrated circuit, such as an application-specific integrated circuit. Such software may be distributed on a computer-readable medium, which may include a computer storage medium (or non-transitory medium) and a communication medium (or temporary medium). As known to those skilled in the art, the term computer storage medium includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storing information (such as computer-readable instructions, data structures, program modules, or other data). Computer storage media include, but are not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tapes, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to store the desired information and can be accessed by a computer. In addition, it is well known to those skilled in the art that communication media typically contain computer-readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transport mechanism, and may include any information delivery media.

[0169] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.

[0170] Those skilled in the art will understand that although some embodiments described herein include certain features included in other embodiments but not other features, the combination of features from different embodiments is meant to be within the scope of the present embodiment and to form different embodiments.

[0171] It is to be understood that the above embodiments are merely exemplary embodiments used to illustrate the principles of the present invention, but the present invention is not limited thereto. For those of ordinary skill in the art, various modifications and improvements can be made without departing from the spirit and essence of the present invention, and these modifications and improvements are also considered to be within the scope of protection of the present invention.

Claims

1. An object testing method, characterized in that: include: In response to an object test instruction for an object to be tested, displaying a dialog flow chart associated with the object to be tested on a test interface, wherein the object to be tested is used to interact with a user, and the dialog flow chart is used to describe the dialog logic of the object to be tested; Identify the interaction intent of each test interaction data entered by the user; Determining the interactive process node corresponding to each of the interactive intentions and the interactive response data of each of the interactive process nodes in the dialog flow chart, and updating the node status of each of the interactive process nodes in the test interface; When the interaction process of the object to be tested reaches the end node of the dialog flow chart, generating a test path of the dialog flow chart according to the node state of each of the interaction process nodes; Based on each of the interactive response data and the test path, test feedback data is generated, wherein the test feedback data is used to debug the dialog flow chart.

2. The method according to claim 1, characterized in that Identify the interaction intent of each test interaction data entered by the user, including: For any test interaction data, input the test interaction data into the intent recognition model; Obtain the interaction intent of the test interaction data output by the intent recognition model.

3. The method according to claim 1, characterized in that Determining the interaction process node corresponding to each interaction intention in the dialogue flow chart includes: Obtaining preset intentions of multiple process nodes in the dialog flow chart; For any interaction intention, respectively determine the intention matching degree between the interaction intention and multiple preset intentions; According to the multiple intention matching degrees, determining the target intention corresponding to the interaction intention from the multiple preset intentions; The process node to which the target intent belongs is determined as the interaction process node corresponding to the interaction intent.

4. The method according to claim 1, characterized in that Updating the node status of each of the interactive process nodes on the test interface includes: For any interactive process node, the node state of the interactive process node is updated to a processed state.

5. The method according to claim 1 or 4, characterized in that After the test interface updates the node status of each of the interaction process nodes, the method further includes: For any interactive process node, the node line connected to the interactive process node is highlighted.

6. The method according to claim 1, characterized in that In response to an object test instruction for the object to be tested, before displaying the dialog flow chart associated with the object to be tested on the test interface, the method further includes: Obtain preset intent configuration information, preset entity configuration information, and preset speech configuration information; Add a start node, multiple blank process nodes, and a blank end node to the flowchart canvas; According to the preset intention configuration information, the preset entity configuration information and the preset speech configuration information, respectively configure the multiple blank process nodes to obtain multiple process nodes; According to the preset speech configuration information, the blank end node is configured to obtain an end node; The start node, the multiple process nodes and the end node are connected in a directionally manner to generate a dialog flow chart.

7. The method according to claim 1, characterized in that After generating test feedback data based on each of the interactive response data and the test path, the method further includes: In response to a deletion instruction for the content to be deleted in the dialog flow chart, the content to be deleted is deleted from the dialog flow chart to obtain a debugged dialog flow chart; or In response to an adding instruction for the content to be added, adding the content to be added to the dialog flow chart to obtain a debugged dialog flow chart; The content to be deleted includes nodes to be deleted and / or connections between nodes to be deleted, and the content to be added includes nodes to be added and / or connections between nodes to be added.

8. An object testing device, characterized in that: include: A display module is configured to display a dialogue flow chart associated with the object to be tested on a test interface in response to an object test instruction for the object to be tested, wherein the object to be tested is used to interact with a user, and the dialogue flow chart is used to describe the dialogue logic of the object to be tested; an identification module configured to identify the interaction intention of each test interaction data input by the user; A determination module is configured to determine the interaction process node corresponding to each interaction intention and the interaction response data of each interaction process node in the dialogue flow chart, and update the node state of each interaction process node in the test interface; A first generating module is configured to generate a test path of the dialog flow chart according to the node state of each of the interaction process nodes when the interaction process of the object to be tested reaches the end node of the dialog flow chart; The second generating module is configured to generate test feedback data based on each of the interactive response data and the test path, wherein the test feedback data is used to debug the dialog flow chart.

9. An electronic device, characterized in that: include: one or more processors; A memory having one or more programs stored thereon, wherein when the one or more programs are executed by the one or more processors, the one or more processors implement the method according to any one of claims 1 to 7; One or more I / O interfaces are connected between the processor and the memory and are configured to implement information interaction between the processor and the memory.

10. A computer-readable medium, characterized in that A computer program is stored thereon, and when the program is executed by a processor, the method according to any one of claims 1 to 7 is implemented.

Images