An interaction test method, device and electronic equipment of a virtual object

Abstract

The present disclosure provides a virtual object interaction test method and device and electronic equipment, relates to the technical field of automatic testing, and particularly relates to the field of smart home. The specific implementation scheme is as follows: a test case for testing a virtual object displayed by a to-be-tested device is acquired, wherein the test case at least contains interaction information for interacting with the virtual object, the interaction information corresponds to an interaction function of the virtual object; the virtual object is controlled to execute a control instruction corresponding to the interaction information, and an execution result is obtained, wherein the execution result is displayed in the form of a video image; a target execution result corresponding to the test case is acquired; the execution result and the target execution result are compared, and a test result for testing the interaction function of the virtual object is obtained. The present disclosure at least solves the problem of low test efficiency in testing the interaction function of the virtual object in the prior art.

Description

Technical Field

[0001] The present disclosure relates to the field of automatic testing technology, and in particular to a method, device, and electronic device for interactive testing of virtual objects. Background Art

[0002] With the development of computer technology and artificial intelligence technology, in addition to robots in traditional industrial industries gradually entering the fields of human medicine, e-commerce and entertainment, as humans have higher requirements for human-computer interaction, more and more smart devices are gradually showing increasingly realistic and smooth multimodal interactions of virtual objects. That is, virtual objects displayed on smart devices can communicate and interact with users through voice, facial expressions, body movements, etc.

[0003] In existing technologies, manual testing is often used to test the interactive functions of virtual objects. Because virtual objects are multimodal, testers must individually test each functional module of the virtual object. This is labor-intensive, error-prone, and requires a high level of professional expertise. Furthermore, manual intervention is required at every test point and stage during the testing process, resulting in a lengthy testing cycle. Summary of the Invention

[0004] The present disclosure provides a method, device, and electronic device for interactive testing of virtual objects.

[0005] According to one aspect of the present disclosure, a method for interactive testing of virtual objects is provided, comprising: obtaining a test case for testing a virtual object displayed by a device under test, wherein the test case includes at least interaction information for interacting with the virtual object, and the interaction information corresponds to the interactive function of the virtual object; controlling the virtual object to execute a control instruction corresponding to the interaction information to obtain an execution result, wherein the execution result is displayed in the form of a video image; obtaining a target execution result corresponding to the test case; and comparing the execution result with the target execution result to obtain a test result for testing the interactive function of the virtual object.

[0006] Furthermore, the interactive testing method for virtual objects also includes: before obtaining a test case for testing the virtual object displayed by the device under test, obtaining audio information and / or video information collected by the information collection device; and generating a test case based on the audio information and / or video information.

[0007] Furthermore, the interactive testing method of virtual objects also includes: before obtaining a test case for testing the virtual object displayed by the device under test, obtaining a pre-stored video image file and / or audio file, wherein the audio file includes at least one of the following: a pre-stored audio file, an audio file converted from a text file; generating a test case based on the video image file and / or audio file.

[0008] Furthermore, the interactive testing method of virtual objects also includes: obtaining an action video image corresponding to the virtual object executing the control instruction from the video image corresponding to the execution result; obtaining a target action video image corresponding to the control instruction from the video image corresponding to the target execution result; comparing the action video image with the target action video image to obtain the action similarity; and determining the test result based on the action similarity.

[0009] Furthermore, the interactive testing method of virtual objects also includes: obtaining the recognition result of the interactive information recognized by the device under test; obtaining the audio feedback result corresponding to the virtual object executing the control instruction from the video image corresponding to the execution result; obtaining the target audio feedback result corresponding to the control instruction from the video image corresponding to the target execution result; comparing the audio similarity between the audio feedback result and the target audio feedback result; and determining the test result based on the recognition result and the audio similarity.

[0010] Furthermore, the virtual object interaction testing method also includes: after comparing the execution result with the target execution result to obtain the test result of testing the interactive function of the virtual object, generating a test report according to the test result; and sending the test report to the terminal device.

[0011] Furthermore, the interactive testing method of virtual objects also includes: when it is detected that the test case execution fails, detecting whether the test case is an abnormal test case; when the test case is an abnormal test case, recording the identification information of the abnormal test case and the execution result corresponding to the execution of the abnormal test case, and executing other test cases.

[0012] Furthermore, the interactive testing method of virtual objects also includes: when the test case is a normal test case, determining the failure condition for the test case to fail to execute; when the failure condition is converted to a success condition, controlling the virtual object to re-execute the test case, wherein the success condition is the condition for the virtual object to successfully execute the test case.

[0013] According to another aspect of the present disclosure, a virtual object interaction testing device is provided, comprising: a first acquisition module, configured to acquire a test case for testing a virtual object displayed by a device under test, wherein the test case at least includes interaction information for interacting with the virtual object, and the interaction information corresponds to the interaction function of the virtual object; a control module, configured to control the virtual object to execute a control instruction corresponding to the interaction information, and obtain an execution result, wherein the execution result is displayed in the form of a video image; a second acquisition module, configured to acquire a target execution result corresponding to the test case; and a comparison module, configured to compare the execution result with the target execution result, and obtain a test result for testing the interaction function of the virtual object.

[0014] According to another aspect of the present disclosure, an electronic device is provided, comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the above-mentioned virtual object interaction testing method.

[0015] According to another aspect of the present disclosure, a non-transitory computer-readable storage medium storing computer instructions is provided, wherein the computer instructions are used to enable a computer to execute the above-mentioned virtual object interaction testing method.

[0016] According to another aspect of the present disclosure, a computer program product is provided, including a computer program, which implements the above-mentioned virtual object interaction testing method when executed by a processor.

[0017] In the present disclosure, a method of functionally testing the interactive function of the virtual object is adopted using a test case corresponding to the interactive function of the virtual object. After obtaining the test case for testing the virtual object displayed by the device to be tested, the virtual object is controlled to execute control instructions for interactive information with the virtual object contained in the test case, and an execution result displayed in the form of a video image is obtained. Then, the target execution result corresponding to the test case is obtained, and the test result of testing the interactive function of the virtual object is determined by comparing the execution result with the target execution result.

[0018] In the above process, the control instructions executed by the virtual object correspond to the interactive information contained in the test case, and the interactive information corresponds to the interactive function of the virtual object. Therefore, after setting up the test case, the test case can be used to test the interactive function of the virtual object. This process does not require human participation, thus avoiding the low test efficiency problem of manual testing of the interactive function of virtual objects in the existing technology, improving test efficiency and test accuracy. In addition, because the interactive function of the virtual object corresponds to the test case, when testing the multimodal function of the virtual object, it is only necessary to call the corresponding test case, without the need for testers to test each test function of the virtual object one by one, thereby reducing testing costs.

[0019] It can be seen that the solution provided by the present disclosure achieves the purpose of automatically testing the multimodal functions of virtual objects, thereby achieving the technical effect of improving the testing efficiency of the interactive functions of virtual objects, and further solving the problem of low testing efficiency in testing the interactive functions of virtual objects in the prior art.

[0020] It should be understood that the contents described in this section are not intended to identify the key or important features of the embodiments of the present disclosure, nor are they intended to limit the scope of the present disclosure. Other features of the present disclosure will become readily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] The accompanying drawings are provided to facilitate a better understanding of the present invention and do not constitute a limitation of the present disclosure.

[0022] Figure 1 is a flowchart of a method for interactive testing of a virtual object according to a first embodiment of the present disclosure;

[0023] Figure 2 is a schematic diagram of a graphical user interface of a device under test according to the first embodiment of the present disclosure;

[0024] Figure 3 is a flowchart of a method for interactive testing of a virtual object according to a first embodiment of the present disclosure;

[0025] Figure 4 is a schematic diagram of a virtual object interaction testing device according to a second embodiment of the present disclosure;

[0026] Figure 5 4 is a block diagram of an electronic device used to implement the interactive testing method of a virtual object according to an embodiment of the present disclosure. DETAILED DESCRIPTION

[0027] The following description of exemplary embodiments of the present disclosure is made in conjunction with the accompanying drawings, including various details of the embodiments of the present disclosure to facilitate understanding. These details should be considered as merely exemplary. Therefore, those skilled in the art will recognize that various changes and modifications may be made to the embodiments described herein without departing from the scope and spirit of the present disclosure. Similarly, for the sake of clarity and conciseness, descriptions of well-known functions and structures are omitted in the following description.

[0028] It should be noted that the acquisition, storage and application of user personal information involved in the technical solution of this disclosure are in compliance with the provisions of relevant laws and regulations and do not violate public order and good morals.

[0029] Example 1

[0030] According to an embodiment of the present disclosure, the present disclosure provides an interactive testing method for a virtual object, wherein a testing device can serve as the execution subject of the method provided by this embodiment, wherein the testing device can be connected to a device under test that displays a virtual object, and the testing device can be connected via a USB (Universal Serial Bus) interface, a serial port, a wireless network, etc.

[0031] Optional, Figure 1is a flow chart of a method for interactive testing of virtual objects according to an embodiment of the present disclosure. Figure 1 As shown, the method includes the following steps:

[0032] Step S102 : obtaining a test case for testing a virtual object displayed by the device under test, wherein the test case at least includes interaction information with the virtual object, and the interaction information corresponds to an interaction function of the virtual object.

[0033] In step S102, the device under test includes at least a processing unit and a display unit, wherein the display unit can display a virtual object. Optionally, the device under test can be a handheld device (e.g., a smart phone, a smart tablet, a smart watch, etc.) or a non-handheld device (e.g., a desktop computer, a laptop computer, and other terminal devices, etc.). In addition, the virtual object can be an object in a graphical user interface presented by a program running on the device under test, for example, Figure 2 In the graphical user interface of the device under test shown, the virtual object is a cartoon image.

[0034] It should be noted that the virtual object can be a cartoon character or other character, such as a human or animal. Furthermore, when the program is run on the device under test, the virtual object can interact with the user. For example, if the program is a game, the user speaks the word "dance," and the virtual object dances in the graphical user interface. For another example, if the program is a consulting program, the user raises their hand in a handshake gesture, and the virtual object extends their hand, indicating a desire to shake hands. If the user speaks the word "weather query," the virtual object broadcasts the weather conditions.

[0035] In addition, it should be noted that in step S102, the test case is used to test the interactive function of the virtual object. Optionally, one interactive function of the virtual object corresponds to a test case. For example, test case 1 is used to test the weather query function of the virtual object, test case 2 is used to test the voice recognition function of the virtual object, and test case 3 is used to test the expression display function of the virtual object.

[0036] It is easy to notice that, since one interactive function corresponds to one test case, when testing the interactive function of a multimodal virtual object, it is sufficient to test the function of the virtual object using the test case corresponding to the interactive function, without the need for manual comparison testing one by one, thereby reducing testing costs. In addition, if a test case for a certain interactive function encounters an exception and cannot be executed, the test cases of other interactive functions can continue to be used to test other interactive functions without interrupting the test. This avoids the problem of low testing efficiency in the prior art, where one test case fails during the batch execution of multiple test cases and the other test cases cannot be executed, thereby improving the testing efficiency of the interactive functions of virtual objects.

[0037] In addition, in step S102, the interactive information with the virtual object included in the test case is the interactive information sent to the virtual object. For example, the "dancing" voice, "weather query" voice, and handshake gesture of the user sent by the above-mentioned user are all the above-mentioned interactive information.

[0038] In an optional embodiment, the testing device can automatically record the tester's actions, voice, etc., and generate test cases based on the recorded actions, voice, etc. The testing device can also retrieve existing test cases from a preset storage area and import the existing test cases to test the virtual object.

[0039] Step S104: Control the virtual object to execute the control instruction corresponding to the interaction information to obtain an execution result, wherein the execution result is displayed in the form of a video image.

[0040] In step S104, when testing the interactive function of the virtual object in the device under test, the test device displays the interactive information contained in the test case. After receiving the above-mentioned interactive information, the virtual object in the device under test identifies the interactive information and obtains the control instruction corresponding to the interactive information. Then, the virtual object in the device under test executes the control instruction. During the process of the virtual object executing the control instruction, the device under test displays the process of the virtual object executing the control instruction and displays the execution process in the form of a video image. At the same time, the test device records the screen of the device under test to obtain the execution result. That is, in this embodiment, the execution result of the virtual object executing the control instruction is displayed in the form of a video image, and then the test device determines whether there is any abnormality in the interactive function of the virtual object by video comparison.

[0041] Step S106: Obtain the target execution result corresponding to the test case.

[0042] In step S106, the target execution result corresponding to the test case is a standard execution result, wherein the target execution result can also be displayed on the test device in the form of a video image. Optionally, the target execution result at least includes one of the following: a target execution action of the virtual object, a target recognition result, and a target audio feedback result of the virtual object. The target execution action is an action that the virtual object should perform according to the interaction information, the target audio feedback result is an audio that the virtual object should feedback according to the interaction information, and the target recognition result is a correct control instruction that the to-be-tested device should recognize according to the interaction information.

[0043] Optionally, the target execution result corresponding to the test case can be pre-stored in a preset storage area of the test device, can also be stored in a storage area of another terminal device, or can be stored in a network cloud disk. In addition, the target execution result corresponding to the test case is generated at the same time as the test case.

[0044] In an optional embodiment, after detecting that the virtual object has executed the control instruction, the test device acquires the target execution result corresponding to the test case from the preset storage area or the network cloud disk.

[0045] In another optional embodiment, after acquiring the test case, the test device acquires the target execution result corresponding to the test case from the preset storage area or the network cloud disk, and stores the target execution result in the local memory of the test device, so as to facilitate quick acquisition of the target execution result when the result comparison is performed.

[0046] In step S108, the execution result and the target execution result are compared, and a test result of testing the interaction function of the virtual object is obtained.

[0047] In step S108, after acquiring the execution result of the virtual object executing the control instruction and the target execution result corresponding to the test case, the test device can compare the execution result and the target execution result through video comparison, so as to obtain a test result representing whether the interaction function of the virtual object is normal.

[0048] Optionally, in the process of comparing the execution result and the target execution result through video comparison, the test device can compare each frame image of a first video corresponding to the execution result with each frame image of a second video corresponding to the target execution result. When the similarity between each frame image of the first video and each frame image of the second video reaches a preset similarity, it is determined that the interaction function of the virtual object is normal, and the test is successful. If there is a frame image in the first video that has a similarity less than the preset similarity with a frame image in the second video, it is determined that the interaction function of the virtual object is abnormal, and the test fails.

[0049] It should be noted that before comparing each frame image of the first video with each frame image of the second video, the testing device also needs to determine the starting frame image in the first video, which corresponds to the first frame image of the second video, thereby avoiding the problem of inaccurate comparison results caused by the different starting playback time of the first video and the starting playback time of the second video, thereby improving the accuracy of the interactive function test of the virtual object.

[0050] Based on the scheme defined by the above steps S102 to S108, it can be known that in the present disclosure, a method of functionally testing the interactive function of the virtual object is adopted using a test case corresponding to the interactive function of the virtual object. After obtaining the test case for testing the virtual object displayed by the device to be tested, the virtual object is controlled to execute the control instructions of the interactive information contained in the test case for interacting with the virtual object, and the execution result displayed in the form of a video image is obtained. Then, the target execution result corresponding to the test case is obtained, and the test result of testing the interactive function of the virtual object is determined by comparing the execution result with the target execution result.

[0051] It is easy to notice that in the above process, the control instructions executed by the virtual object correspond to the interactive information contained in the test case, and the interactive information corresponds to the interactive function of the virtual object. Therefore, after setting up the test case, the test case can be used to test the interactive function of the virtual object. This process does not require human participation, thereby avoiding the low test efficiency problem of manual testing of the interactive function of virtual objects in the existing technology, improving test efficiency and test accuracy. In addition, because the interactive function of the virtual object corresponds to the test case, when testing the multimodal function of the virtual object, it is only necessary to call the corresponding test case, without the need for testers to test each test function of the virtual object one by one, thereby reducing testing costs.

[0052] It can be seen that the solution provided by the present disclosure achieves the purpose of automatically testing the multimodal functions of virtual objects, thereby achieving the technical effect of improving the testing efficiency of the interactive functions of virtual objects, and further solving the problem of low testing efficiency in testing the interactive functions of virtual objects in the prior art.

[0053] In an optional embodiment, before obtaining a test case for testing a virtual object displayed by the device under test, the testing device needs to generate a test case. The testing device may generate the test case in any one of the following two ways.

[0054] Method 1: Generate test cases by recording test cases. Specifically, the test device first obtains audio information and / or video information collected by the information collection device, and generates test cases based on the audio information and / or video information.

[0055] In this scenario, the information acquisition unit in the test device includes at least an audio acquisition unit and an image acquisition unit, wherein the audio acquisition unit may be but is not limited to a recorder, and the image acquisition unit may be but is not limited to a camera or a video camera.

[0056] Optionally, the tester can operate the test case acquisition control in the test device. After detecting that the tester operates the test case acquisition control, the test device determines that the tester needs to obtain the test case. At this time, a selection interface for obtaining the test case acquisition method pops up in the graphical user interface of the test device. At least two acquisition methods are displayed in the selection interface, wherein method one is to record the test case and method two is to import an existing test case. After the tester selects method one and asks for the consent of the person being tested, the test device starts the audio acquisition unit and / or the image acquisition unit. The audio acquisition unit collects the voice information of the person being tested, and the image acquisition unit collects the image information (for example, face information) and action information (for example, body movement information, facial expression information) of the person being tested. After collecting the voice information and / or image information of the person being tested, the test device generates a test case based on the voice information and / or image information.

[0057] It should be noted that, in the process of the audio acquisition unit collecting the voice information of the person being tested, and / or the image acquisition unit collecting the image information and action information of the person being tested, the person being tested can make corresponding voices or perform the same actions according to the requirements of the tester. For example, if the tester requires the person being tested to make a voice of "check the weather", the person being tested will make a voice of "check the weather". The person being tested can also make corresponding voices or perform corresponding actions according to the prompt information displayed by the test device. For example, the test device sets the voice that the person being tested needs to make and / or the action that the person being tested needs to perform according to the interactive function of the virtual object currently to be tested, and displays the corresponding instructions on the display unit of the test device, so that the person being tested can make corresponding voices and / or perform corresponding actions according to the instructions.

[0058] Furthermore, it should be noted that if the tester detects that the voice information and / or image information used to generate the test case does not meet the requirements, the tester can delete the unqualified voice information and / or image information by operating the delete control in the test device. Furthermore, the tester can also modify the voice information and / or image information by operating the modify control in the test device. For example, the tester can manually change the speech speed, brightness, or contrast of the video image, etc.

[0059] In addition, in the above scenario, since the audio information and / or video information is collected by the information collection device, the test cases generated based on the audio information and / or video information can better match the interactive function of the virtual object to be tested. Using test cases with a higher degree of match with the interactive function to test the interactive function can effectively improve the testing efficiency of the interactive function of the virtual object.

[0060] Method 2: Generate test cases from existing test cases. Specifically, the testing device first obtains pre-stored video and / or audio files and generates test cases based on the video and / or audio files. The audio files include at least one of the following: pre-stored audio files and audio files converted from text files.

[0061] Optionally, in Method 2, the test device can generate test cases corresponding to facial information by importing images or videos to increase the comprehensiveness of the test cases. The images or videos can be pre-stored in the local memory of the test device, in the memory of another device, or in a cloud server.

[0062] In addition, the above-mentioned audio files can be pre-stored audio files, for example, audio files pre-stored in the local memory of the test device, audio files pre-stored in the memory of other devices, audio files pre-stored in the cloud server, etc., wherein the format of the above-mentioned pre-stored audio files can be but not limited to common video formats such as mp3, pcm, wav, etc.

[0063] The above-mentioned audio file can also be an audio file converted from a text file, wherein the tester can configure the above-mentioned text file in the test device. After the configuration is completed, the test device can automatically convert the text in the above-mentioned text file into speech according to the test case and test timing, thereby obtaining the above-mentioned audio file and playing the audio file.

[0064] It should be noted that in method 2, the existing video image files and / or audio files are directly called to generate test cases, and there is no need to record video images and / or audio every time the interactive function of the virtual object is tested, thereby reducing the testing steps of the interactive function of the virtual object and reducing the operating cost of testing the interactive function of the virtual object.

[0065] Furthermore, after generating the test case through the above-mentioned method 1 or method 2, the testing device can import the test case and test the interactive function of the virtual object based on the test case to obtain the execution result.

[0066] Optionally, the tester can click a start control in the test device to initiate the test process. The test device can test the interactive functions of the virtual object based on the test case recorded in Method 1 or the test case obtained by importing an existing test case in Method 2, while automatically recording the video image of the virtual object executing the control instructions corresponding to the test case.

[0067] It should be noted that during the process of testing the interactive function of the virtual object, the test device also automatically monitors the log and the performance of the test device, and displays the above content in real time in a designated area of ​​the display device corresponding to the test device. The above log records at least the test information of the interactive function of the virtual object, such as the function type tested, the test time, the test duration, the time when the abnormality occurred during the test, the duration of the abnormality, the cause of the abnormality, etc., so that the tester can know the relevant information of the test in a timely manner and take effective measures when an abnormality occurs during the test.

[0068] Furthermore, after determining the test case, the testing device also imports the target execution result corresponding to the test case for testing the interactive function of the virtual object, and compares the execution result with the target execution result to obtain the test result for testing the interactive function of the virtual object.

[0069] In an optional embodiment, the testing device tests the accuracy of the action execution of the virtual object by comparing the video image corresponding to the execution result with the video image corresponding to the target execution result.

[0070] Specifically, the testing device first obtains the action video image corresponding to the virtual object executing the control instruction from the video image corresponding to the execution result, and obtains the target action video image corresponding to the control instruction from the video image corresponding to the target execution result. Then, the action video image is compared with the target action video image to obtain the action similarity. Finally, the test result is determined based on the action similarity.

[0071] Optionally, the testing device can determine whether the action of the virtual object is accurately executed by comparing the similarity between each frame image in the action video image and each frame image in the target action video image. For example, the testing device can first determine whether the execution action of the virtual object in the first frame image corresponding to the first moment in the action video image is the same as the target execution action of the virtual object in the first frame image corresponding to the first moment in the target action video image, and obtain a first similarity. If they are the same, then continue to compare the action details of the execution action to see whether they are the same as the action details of the target execution action, and obtain a second similarity, for example, comparing the execution speed, delay, etc. of a certain action performed by the virtual object. Finally, the testing device calculates the weighted average of the first similarity and the second similarity to obtain the action similarity. Among them, the higher the numerical value of the action similarity, the higher the matching degree between the action video image and the target action video image, that is, the more accurate the action execution of the virtual object is.

[0072] It should be noted that automatic testing of the accuracy and details of the action execution of virtual objects through video image comparison can effectively avoid the problems of low testing efficiency and low testing accuracy in the existing technology of manual comparison of virtual object actions, as well as the subjectivity and error-proneness of manual comparison, thereby improving the test accuracy of the action execution accuracy of virtual objects.

[0073] In another optional embodiment, the testing device may also test the accuracy of the audio feedback of the virtual object by comparing the audio feedback result corresponding to the execution result with the target audio feedback result corresponding to the target execution result.

[0074] Specifically, the testing device first obtains the recognition result of the interactive information by the device under test, and obtains the audio feedback result corresponding to the virtual object executing the control instruction from the video image corresponding to the execution result. Then, it obtains the target audio feedback result corresponding to the control instruction from the video image corresponding to the target execution result, and compares the audio similarity between the audio feedback result and the target audio feedback result. Finally, the test result is determined based on the recognition result and the audio similarity.

[0075] Optionally, the audio in the test case is "querying the weather", and the testing device first detects whether the to-be-tested device can accurately recognize the audio, to obtain the recognition result. If the to-be-tested device cannot accurately recognize the audio, it is determined that the test fails; if the to-be-tested device can accurately recognize the audio, the testing device further tests the audio feedback result of the virtual object, that is, the testing device compares the audio feedback result of the virtual object with the target audio feedback result, to obtain the audio similarity between the two, and then determines whether the test is successful according to the audio similarity. Wherein, when the audio similarity is less than a preset similarity, it is determined that the test fails; when the audio similarity is greater than or equal to the preset similarity, it is determined that the test succeeds.

[0076] It should be noted that the testing device can automatically assert the recognition result of the to-be-tested device and the audio feedback result of the virtual object to determine whether the test is successful, which improves the accurate testing efficiency and testing accuracy of the audio feedback result of the virtual object compared with the prior art.

[0077] Further, after comparing the execution result with the target execution result to obtain the test result of the interactive function of the virtual object, the testing device can further generate a test report according to the test result and send the test report to the terminal device.

[0078] It should be noted that in the present disclosure, the tester can also configure the tester mailbox information through the testing device, which is used to notify the tester of the test information, test report, etc. It is easy to note that since the testing device can automatically generate the test report without manual filling, the workload of the tester is reduced, the operation steps of the tester are simplified, and the testing experience of the tester is improved.

[0079] In an optional embodiment, in the case where it is detected that the test case execution fails, the testing device detects whether the test case is an abnormal test case, and when the test case is an abnormal test case, records the identification information of the abnormal test case and the execution result corresponding to the execution of the abnormal test case, and executes other test cases.

[0080] It should be noted that the identification information of the abnormal test case is used to uniquely identify the test case, and the identification information can include but is not limited to one or more combinations of the number, name, etc. of the test case. In addition, the abnormal test case represents that the test case itself has an error.

[0081] In addition, it should be noted that when an error is detected in the test case itself, the test device continues to execute other test cases, which can avoid the problem in related technologies that the test device waits for the abnormal test case to return to normal before continuing to test the interactive function of the virtual object, resulting in increased test time and reduced test efficiency, thereby improving the test efficiency of the interactive function of the virtual object.

[0082] In addition, when the test case is a normal test case, the testing device determines the failure condition for the test case to fail to execute, and when the failure condition is converted to a success condition, controls the virtual object to re-execute the test case, wherein the success condition is the condition for the virtual object to successfully execute the test case.

[0083] It should be noted that the above failure conditions can include, but are not limited to, power outages or network disconnections. In this scenario, the test case itself is not faulty; it's simply that external conditions prevent the test device from testing the interactive functionality of the virtual object. In this case, the test device simply pauses the test and, after resolving the issue preventing the test device from executing the test step, resumes testing the interactive functionality of the virtual object using the current test case.

[0084] In addition, it should be noted that when the external environment causes the test device to be unable to perform the test process normally, the execution of the current test case is suspended. After the fault in the external environment that causes the test device to be unable to perform the test process is resolved, the current test case is continued to be executed. This avoids the problem in the prior art that after the fault in the external environment that causes the test device to be unable to perform the test process is resolved, all test cases are restarted, resulting in repeated test steps and an increase in the workload of testers.

[0085] In an optional embodiment, Figure 3 A flowchart of an optional virtual object interaction testing method is shown. Figure 3It can be seen that after the device under test displaying the virtual object is connected to the test device, the tester can configure the mailbox through the test device to obtain test results, test reports and other information. Then, the test device generates a test case by recording a video image, or obtains the test case by importing an existing test case, and at the same time obtains the target execution result corresponding to the user-input or existing virtual object executing the test case. After receiving the tester's control instruction to start the test, the test device starts the test program, obtains the execution result of the virtual object executing the test case, and compares the execution result with the target execution result by video comparison to obtain the test result. In addition, during the process of testing the interactive function of the virtual object, the test device also detects whether the test case is an abnormal test case. If it is an abnormal test case, other test cases are executed; if it is not an abnormal test case, a test report is automatically generated after the test is completed, and the test report is sent to the above-mentioned mailbox via email to notify the tester of the relevant information of the test.

[0086] As can be seen from the above, this disclosure provides an automated testing solution for multimodal visual voice interactive virtual objects, which effectively improves testing efficiency and saves manpower. Furthermore, this disclosure also applies video comparison technology to the automatic assertion stage of test results. Simultaneously, virtual object recognition results and voice feedback results can be automatically asserted and verified, reducing the subjectivity and error-proneness caused by manual intervention.

[0087] Example 2

[0088] According to an embodiment of the present disclosure, the present disclosure also provides an interactive testing device for a virtual object, wherein: Figure 4 is a schematic diagram of a virtual object interaction testing device provided according to an embodiment of the present disclosure, such as Figure 4 As shown, the device includes: a first acquisition module 401 , a control module 403 , a second acquisition module 405 and a comparison module 407 .

[0089] Among them, the first acquisition module 401 is used to obtain a test case for testing the virtual object displayed by the device under test, wherein the test case at least includes interaction information for interacting with the virtual object, and the interaction information corresponds to the interaction function of the virtual object; the control module 403 is used to control the virtual object to execute the control instruction corresponding to the interaction information, and obtain the execution result, wherein the execution result is displayed in the form of a video image; the second acquisition module 405 is used to obtain the target execution result corresponding to the test case; the comparison module 407 is used to compare the execution result with the target execution result to obtain the test result of testing the interactive function of the virtual object.

[0090] It should be noted that the above-mentioned first acquisition module 401, control module 403, second acquisition module 405 and comparison module 407 correspond to steps S102 to S108 in the above-mentioned embodiment. The examples and application scenarios implemented by the four modules and the corresponding steps are the same, but are not limited to the contents disclosed in the above-mentioned embodiment 1.

[0091] Optionally, the virtual object interaction testing device further includes: a third acquisition module and a first generation module. The third acquisition module is configured to acquire audio information and / or video information collected by the information acquisition device before acquiring a test case for testing the virtual object displayed by the device under test; and the first generation module is configured to generate a test case based on the audio information and / or video information.

[0092] Optionally, the interactive testing apparatus for virtual objects further includes: a fourth acquisition module and a second generation module. The fourth acquisition module is configured to acquire a pre-stored video image file and / or audio file before acquiring a test case for testing the virtual object displayed by the device under test, wherein the audio file includes at least one of the following: a pre-stored audio file and an audio file converted from a text file; and the second generation module is configured to generate a test case based on the video image file and / or audio file.

[0093] Optionally, the comparison module includes: a fifth acquisition module, a sixth acquisition module, a first comparison module, and a first determination module. The fifth acquisition module is configured to acquire an action video image corresponding to the virtual object executing the control instruction from the video image corresponding to the execution result; the sixth acquisition module is configured to acquire a target action video image corresponding to the control instruction from the video image corresponding to the target execution result; the first comparison module is configured to compare the action video image with the target action video image to obtain action similarity; and the first determination module is configured to determine the test result based on the action similarity.

[0094] Optionally, the comparison module includes: a seventh acquisition module, an eighth acquisition module, a ninth acquisition module, a second comparison module, and a second determination module. The seventh acquisition module is used to obtain the recognition result of the interactive information by the device under test; the eighth acquisition module is used to obtain the audio feedback result corresponding to the virtual object executing the control instruction from the video image corresponding to the execution result; the ninth acquisition module is used to obtain the target audio feedback result corresponding to the control instruction from the video image corresponding to the target execution result; the second comparison module is used to compare the audio similarity between the audio feedback result and the target audio feedback result; and the second determination module is used to determine the test result based on the recognition result and the audio similarity.

[0095] Optionally, the virtual object interaction testing device further includes: a third generation module and a transmission module. The third generation module is configured to generate a test report based on the test results obtained after comparing the execution result with the target execution result to test the interactive function of the virtual object; and the transmission module is configured to transmit the test report to the terminal device.

[0096] Optionally, the interactive testing device for virtual objects further includes: a detection module and a recording module. The detection module is configured to detect whether a test case is an abnormal test case upon detecting that the test case has failed to execute; and the recording module is configured to record identification information of the abnormal test case and the execution result corresponding to the abnormal test case if the test case is an abnormal test case, and then execute other test cases.

[0097] Optionally, the interactive testing device for a virtual object further includes: a third determination module and a first control module. The third determination module is configured to determine a failure condition for the test case to fail when the test case is a normal test case; and the first control module is configured to control the virtual object to re-execute the test case when the failure condition is converted to a success condition, wherein the success condition is a condition for the virtual object to successfully execute the test case.

[0098] Example 3

[0099] According to an embodiment of the present disclosure, the present disclosure also provides an electronic device, a computer-readable storage medium, and a computer program product.

[0100] Figure 5 A schematic block diagram of an example electronic device 800 that can be used to implement embodiments of the present disclosure is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital assistants, cellular phones, smartphones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are provided as examples only and are not intended to limit the implementation of the present disclosure described and / or claimed herein.

[0101] like Figure 5As shown, electronic device 800 includes a computing unit 801, which can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 802 or a computer program loaded from a storage unit 808 into a random access memory (RAM) 803. Various programs and data required for the operation of device 800 can also be stored in RAM 803. Computing unit 801, ROM 802, and RAM 803 are connected to each other via a bus 804. An input / output (I / O) interface 805 is also connected to bus 804.

[0102] Various components in device 800 are connected to I / O interface 805, including an input unit 806, such as a keyboard, mouse, etc.; an output unit 807, such as various types of displays, speakers, etc.; a storage unit 808, such as a magnetic disk, optical disk, etc.; and a communication unit 809, such as a network card, modem, wireless communication transceiver, etc. The communication unit 809 allows device 800 to exchange information / data with other devices via a computer network such as the Internet and / or various telecommunication networks.

[0103] The computing unit 801 can be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the computing unit 801 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various computing units that run machine learning model algorithms, digital signal processors (DSPs), and any appropriate processors, controllers, microcontrollers, etc. The computing unit 801 performs the various methods and processes described above, such as the interactive testing method of virtual objects. For example, in some embodiments, the interactive testing method of virtual objects can be implemented as a computer software program that is tangibly contained in a machine-readable medium, such as a storage unit 808. In some embodiments, part or all of the computer program can be loaded and / or installed on the device 800 via the ROM 802 and / or the communication unit 809. When the computer program is loaded into the RAM 803 and executed by the computing unit 801, one or more steps of the interactive testing method of virtual objects described above can be performed. Alternatively, in other embodiments, the computing unit 801 can be configured to perform the interactive testing method of virtual objects by any other appropriate means (e.g., by means of firmware).

[0104] The various embodiments of the systems and techniques described above can be implemented in digital electronic circuitry, integrated circuitry, a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system on a chip (SOC), a load programmable logic device (CPLD), computer hardware, firmware, software, and / or combinations thereof. These various embodiments can include implementation in one or more computer programs that are executable and / or interpretable on a programmable system including at least one programmable processor, which can be special or general purpose, coupled to receive data and instructions from, and to transmit data and instructions to, a storage system, at least one input device, and at least one output device.

[0105] Program code for carrying out methods of the present disclosure can be written in any combination of one or more programming languages. The program code can be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the program code, when executed by the processor or controller, produces the functions / operations specified in the flowcharts and / or the block diagrams. The program code can be executed entirely on a machine, partially on a machine, partially on a machine as a stand-alone software package, or entirely on a remote machine or server.

[0106] In the context of the present disclosure, a machine-readable medium can be a tangible medium that contains or stores a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include but is not limited to an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of the machine-readable storage medium will include one or more lines of electrical conductors, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0107] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0108] The systems and techniques described herein can be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network (LAN), a wide area network (WAN), and the Internet.

[0109] A computer system may include a client and a server. The client and server are generally remote from each other and typically interact through a communication network. The client-server relationship arises through computer programs running on the respective computers and having a client-server relationship with each other. The server may be a cloud server, a server in a distributed system, or a server integrated with a blockchain.

[0110] It should be understood that the various forms of the processes shown above can be used to reorder, add, or delete steps. For example, the steps described in this disclosure can be performed in parallel, sequentially, or in a different order, as long as the desired results of the technical solutions disclosed in this disclosure can be achieved. This is not a limitation herein.

[0111] The above specific embodiments do not constitute a limitation on the scope of protection of this disclosure. Those skilled in the art will appreciate that various modifications, combinations, sub-combinations, and substitutions may be made based on design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this disclosure shall be included within the scope of protection of this disclosure.

Claims

1. A method for interactive testing of a virtual object, comprising: Acquire a test case for testing a virtual object displayed by the device under test, wherein the test case at least includes interaction information with the virtual object, and the interaction information corresponds to an interactive function of the virtual object; controlling the virtual object to execute a control instruction corresponding to the interaction information to obtain an execution result, wherein the execution result is displayed in the form of a video image; Obtaining the target execution result corresponding to the test case; Obtaining a recognition result of the interaction information by the device under test; obtaining an audio feedback result corresponding to the execution of the control instruction by the virtual object from the video image corresponding to the execution result; obtaining a target audio feedback result corresponding to the control instruction from the video image corresponding to the target execution result; comparing the audio similarity between the audio feedback result and the target audio feedback result; and determining a test result based on the recognition result and the audio similarity; The method further comprises: In response to the audio similarity being less than a preset similarity, the test result is determined to be a test failure; in response to the audio similarity being greater than or equal to the preset similarity, the test result is determined to be a test success.

2. The method according to claim 1, before obtaining a test case for testing a virtual object displayed by the device under test, the method further comprises: Acquiring audio information and / or video information collected by the information collection device; The test case is generated according to the audio information and / or the video information.

3. The method according to claim 1, before obtaining a test case for testing a virtual object displayed by the device under test, the method further comprises: Acquire a pre-stored video image file and / or audio file, wherein the audio file includes at least one of the following: a pre-stored audio file, an audio file converted from a text file; The test case is generated based on the video image file and / or the audio file.

4. The method according to claim 1, wherein comparing the execution result with the target execution result to obtain a test result of testing the interactive function of the virtual object comprises: Obtaining, from the video image corresponding to the execution result, an action video image corresponding to the execution of the control instruction by the virtual object; Acquiring a target action video image corresponding to the control instruction from the video image corresponding to the target execution result; Comparing the action video image with the target action video image to obtain action similarity; The test result is determined according to the action similarity.

5. The method according to any one of claims 1 or 4, after comparing the execution result with the target execution result to obtain a test result of testing the interactive function of the virtual object, the method further comprises: generating a test report according to the test results; Send the test report to the terminal device.

6. The method according to claim 1, further comprising: In the case of detecting that the test case fails to execute, detecting whether the test case is an abnormal test case; When the test case is the abnormal test case, the identification information of the abnormal test case and the execution result corresponding to the execution of the abnormal test case are recorded, and other test cases are executed.

7. The method according to claim 6, further comprising: When the test case is a normal test case, determining a failure condition for failure in execution of the test case; When the failure condition is converted into a success condition, the virtual object is controlled to re-execute the test case, wherein the success condition is a condition for the virtual object to successfully execute the test case.

8. An interactive testing device for a virtual object, comprising: A first acquisition module is configured to acquire a test case for testing a virtual object displayed by the device under test, wherein the test case at least includes interaction information with the virtual object, and the interaction information corresponds to an interactive function of the virtual object; a control module, configured to control the virtual object to execute a control instruction corresponding to the interaction information, and obtain an execution result, wherein the execution result is displayed in the form of a video image; A second acquisition module is used to obtain the target execution result corresponding to the test case; a comparison module, configured to obtain a recognition result of the interaction information recognized by the device under test; obtain an audio feedback result corresponding to the execution of the control instruction by the virtual object from the video image corresponding to the execution result; obtain a target audio feedback result corresponding to the control instruction from the video image corresponding to the target execution result; compare the audio similarity between the audio feedback result and the target audio feedback result; and determine a test result based on the recognition result and the audio similarity; Wherein, the device further includes: The determination module is configured to: determine that the test result is a test failure in response to the audio similarity being less than a preset similarity; and determine that the test result is a test success in response to the audio similarity being greater than or equal to the preset similarity.

9. An electronic device comprising: at least one processor; as well as a memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the virtual object interaction testing method according to any one of claims 1 to 7.

10. A non-transitory computer-readable storage medium storing computer instructions, wherein: The computer instructions are used to enable a computer to execute the virtual object interactive testing method according to any one of claims 1 to 7. 11 . A computer program product, comprising a computer program, wherein when the computer program is executed by a processor, the computer program implements the method for interactive testing of a virtual object according to claim 1 .

Images