Test method and device, electronic equipment and intelligent voice terminal

Abstract

The invention provides a testing method and device, electronic equipment and an intelligent voice terminal, and relates to the technical field of computers, in particular to the technical field of application program development, application program testing, voice data processing, video data processing, audio and video data processing and the like. According to the specific implementation scheme, a test data packet corresponding to a target test scene is generated; sending the test data packet to the terminal equipment; wherein the terminal equipment is used for running a target application program based on the test data packet so as to obtain test result representation data of the target application program; sending the test result characterization data to the service equipment; receiving test result characterization data; and obtaining a test result of the target application program based on the test result representation data.

Description

Technical Field

[0001] The present disclosure relates to the field of computer technology, and in particular to technical fields such as application development, application testing, voice data processing, video data processing, audio and video data processing, and specifically to a testing method, device, electronic device, and intelligent voice terminal. Background Art

[0002] In recent years, with the rapid advancement of computer technology, various applications have emerged in an endless stream, among which intelligent voice applications have occupied an important position. In order to ensure the stability and reliability of these intelligent voice applications, these intelligent voice applications need to be tested in both the early development stage and the later operation and maintenance stage to verify whether these intelligent voice applications can run smoothly. Summary of the invention

[0003] The present disclosure provides a testing method, a device, an electronic device and an intelligent voice terminal.

[0004] According to a first aspect of the present disclosure, a testing method is provided, which is applied to a service device; the method comprises:

[0005] Generate test data packets corresponding to target test scenarios;

[0006] Sending a test data packet to a terminal device; wherein the terminal device is used to run a target application based on the test data packet to obtain test result representation data of the target application; and sending the test result representation data to a service device;

[0007] receiving test result characterization data;

[0008] Based on the test result characterization data, a test result of the target application is obtained.

[0009] According to a second aspect of the present disclosure, a testing method is provided, which is applied to a terminal device; the method comprises:

[0010] receiving a test data packet corresponding to a target test scenario;

[0011] Based on the test data packet, running the target application to obtain test result representation data of the target application;

[0012] The test result characterization data is sent to a service device; wherein the service device is used to receive the test result characterization data; and based on the test result characterization data, a test result of a target application is obtained.

[0013] According to a third aspect of the present disclosure, a testing device is provided, which is applied to a service device; the device comprises:

[0014] A data generation unit, used to generate a test data packet corresponding to a target test scenario;

[0015] A first data sending unit, configured to send a test data packet to a terminal device; wherein the terminal device is configured to run a target application based on the test data packet to obtain test result representation data of the target application; and send the test result representation data to a service device;

[0016] A first data receiving unit, used for receiving test result representation data;

[0017] The test result acquisition unit is used to obtain the test result of the target application based on the test result characterization data.

[0018] According to a fourth aspect of the present disclosure, a testing device is provided, which is applied to a terminal device; the device includes:

[0019] A second data receiving unit, configured to receive a test data packet corresponding to a target test scenario;

[0020] A data processing unit, configured to run a target application based on the test data packet to obtain test result representation data of the target application;

[0021] The second data sending unit is used to send the test result characterization data to the service device; wherein the service device is used to receive the test result characterization data; and obtain the test result of the target application based on the test result characterization data.

[0022] According to a fifth aspect of the present disclosure, there is provided an electronic device, including:

[0023] at least one processor;

[0024] a memory communicatively coupled to the at least one processor;

[0025] The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to execute the method provided by the embodiment of the present disclosure.

[0026] According to a sixth aspect of the present disclosure, there is provided an intelligent voice terminal, including an electronic device; wherein the electronic device includes:

[0027] at least one processor;

[0028] a memory communicatively coupled to the at least one processor;

[0029] The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to execute the method provided by the embodiment of the present disclosure.

[0030] According to a seventh aspect of the present disclosure, a non-transitory computer-readable storage medium storing computer instructions is provided, wherein the computer instructions are used to enable the computer to execute the method provided according to an embodiment of the present disclosure.

[0031] According to an eighth aspect of the present disclosure, a computer program product is provided, including a computer program, which implements the method provided according to the embodiment of the present disclosure when executed by a processor.

[0032] The present disclosure can improve the reliability of the test results of the target application without affecting the stability of the target application.

[0033] It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] The accompanying drawings are used to better understand the present solution and do not constitute a limitation of the present disclosure.

[0035] Figure 1 A flow chart of a testing method (applied to service equipment) provided in an embodiment of the present disclosure;

[0036] Figure 2 A schematic diagram of a process for establishing a heartbeat detection mechanism between a service device and a terminal device provided in an embodiment of the present disclosure;

[0037] Figure 3 A flow chart of a testing method (applied to a terminal device) provided in an embodiment of the present disclosure;

[0038] Figure 4 A schematic structural block diagram of a test system provided in an embodiment of the present disclosure;

[0039] Figure 5 A schematic diagram of a scenario of a testing method provided in an embodiment of the present disclosure;

[0040] Figure 6 A schematic structural block diagram of a test device (applied to service equipment) provided in an embodiment of the present disclosure;

[0041] Figure 7 A schematic structural block diagram of a test device (applied to a terminal device) provided in an embodiment of the present disclosure;

[0042] Figure 8 A schematic structural block diagram of an electronic device provided in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0043] The following is a description of exemplary embodiments of the present disclosure in conjunction with the accompanying drawings, including various details of the embodiments of the present disclosure to facilitate understanding, which should be considered as merely exemplary. Therefore, it should be recognized by those of ordinary skill in the art that various changes and modifications may be made to the embodiments described herein without departing from the scope of the present disclosure. Similarly, for the sake of clarity and conciseness, the description of well-known functions and structures is omitted in the following description.

[0044] As described in the background technology, in recent years, with the rapid progress of computer technology, various applications have emerged in an endless stream, among which intelligent voice applications have occupied an important position. In order to ensure the stability and reliability of these intelligent voice applications, both in the early development completion stage and in the later operation and maintenance stage, these intelligent voice applications need to be tested to verify whether these intelligent voice applications can run smoothly.

[0045] At present, the intelligent voice application is usually enabled to collect real-time scene data and process the real-time scene data by adding test code to the code file of the intelligent voice application, so as to obtain test result representation data of the intelligent voice application in the process of collecting real-time scene data and processing the real-time scene data by the intelligent voice application, so that the test result representation data can be used to obtain the test result of the intelligent voice application in the future.

[0046] However, the inventors have found that, through the above method, on the one hand, since the test code will be added to the code file of the intelligent voice application, this will not only destroy the internal structure of the intelligent voice application, thereby affecting the stability of the intelligent voice application, but also obtain abnormal test result characterization data when the test code crashes, thereby reducing the reliability of the test results of the intelligent voice application. On the other hand, the actual application scenarios of intelligent voice applications are often complex and diverse. However, through the above method, the test results of the intelligent voice application can only be obtained based on the real-time scene data collected by the intelligent voice application, and the collected real-time scene data often comes from a single test scenario, and it is impossible to take into account different test scenarios to ensure the complexity and diversity of the test scenarios. Therefore, the reliability of the test results of the intelligent voice application will also be reduced.

[0047] In view of the above problems, the present disclosure provides a testing method, which can be applied to electronic devices. The electronic device can be a service device. Figure 1 The flowchart diagram shown illustrates a test method provided by an embodiment of the present disclosure. It should be noted that although a logical sequence is shown in the flowchart diagram, in some cases, the steps shown or described may also be performed in other sequences.

[0048] Step S101, generating a test data packet corresponding to a target test scenario.

[0049] The target test scenario can be an actual application scenario that the target application may face, and the target application can be an application (Application, APP) that can be applied to the terminal device. Here, the target application can specifically be an intelligent voice application, and correspondingly, the terminal device can be an intelligent voice terminal, such as a car machine, or a human-computer interaction device set up in hospitals, banks, hotels, entertainment venues, etc. to provide self-service.

[0050] In addition, in an embodiment of the present disclosure, a test data packet may include a first test instruction. The first test instruction may be used to instruct the terminal device to obtain test result characterization data of the target application in the process of running the target application to collect real-time scene data using the target application, and processing the real-time scene data. In an embodiment of the present disclosure, the test data may also include a second test instruction and special scene data. The second test instruction may be used to instruct the terminal device to obtain test result characterization data of the target application in the process of processing special scene data using the target application when running the target application; the special scene data may be scene description information of the target test scene. Here, the special scene data may be pre-collected or generated by computer simulation, and the embodiment of the present disclosure does not limit this.

[0051] Step S102: Send the test data packet to the terminal device.

[0052] The terminal device is used to run the target application based on the test data packet to obtain test result representation data of the target application; and send the test result representation data to the service device.

[0053] As mentioned above, in the embodiment of the present disclosure, when the test data packet includes the first test instruction, the terminal device can run the target application under the instruction of the first test instruction, and then obtain the test result characterization data of the target application in the process of collecting real-time scene data using the target application and processing the real-time scene data; and send the test result characterization data to the service device. When the test data packet includes the second test instruction and special scene data, the terminal device can run the target application under the instruction of the second test instruction, and then obtain the test result characterization data of the target application in the process of processing the special scene data using the target application; and send the test result characterization data to the service device.

[0054] Step S103, receiving test result characterization data.

[0055] Step S104: obtaining the test result of the target application based on the test result characterization data.

[0056] Among them, the test results can be used to characterize whether the target application can run smoothly.

[0057] By adopting the test method provided by the embodiment of the present disclosure, on the one hand, there is no need to add test code to the code file of the target application, but the service device generates a test data packet corresponding to the target test scenario, and sends the test data packet to the terminal device, so that the terminal device runs the target application based on the test data packet to obtain the test result characterization data of the target application, and sends the test result characterization data to the service device, and then the service device receives the test result characterization data, and obtains the test result of the target application based on the test result characterization data. In this way, it can be avoided that the internal structure of the target application is destroyed by the test code, thereby affecting the stability of the target application, and at the same time, there will be no test code crash, which will cause the test result characterization data to be abnormal, so that the reliability of the test result of the target application can be improved. On the other hand, in the embodiment of the present disclosure, the test data packet corresponding to the target test scenario is generated by the service device, so when the target test scenario changes, the test data packet will also change accordingly to maintain the corresponding relationship with the target test scenario. In this way, through the test method provided by the embodiment of the present disclosure, different test scenarios can be taken into account to ensure the complexity and diversity of the test scenarios, thereby improving the reliability of the test results of the target application.

[0058] In summary, the testing method provided by the embodiments of the present disclosure can improve the reliability of the test results of the target application without affecting the stability of the target application.

[0059] In addition, in the embodiment of the present disclosure, the test result characterization data may include at least one of the interface test data, the stress test data, and the performance test data. Based on this, it can be understood that in the embodiment of the present disclosure, based on the test result characterization data, the test result of the target application obtained may include a first test result obtained based on the interface test data, may also include a second test result obtained based on the stress test data, and may also include a third test result obtained based on the performance test data, thereby ensuring the comprehensiveness of the test result of the target application.

[0060] Furthermore, in the embodiments of the present disclosure, the target test scenario may be determined in the following manner:

[0061] Identify multiple candidate test scenarios;

[0062] Determine the order of testing multiple candidate test scenarios;

[0063] According to the test order, a target test scenario is selected from multiple candidate test scenarios.

[0064] Among them, multiple candidate test scenarios can be determined based on the target application. For example, if the target application is an intelligent voice application applied to a car computer, then multiple candidate test scenarios can be used to reflect different in-car driving scenarios; for another example, if the target application is an intelligent voice application applied to a human-computer interaction device, and the human-computer interaction device is set up in a hospital, then multiple candidate test scenarios can include application scenarios for interacting with medical staff, and can also include application scenarios for interacting with patients; for another example, if the target application is an intelligent voice application applied to a human-computer interaction device, and the human-computer interaction device is set up in a bank, then multiple candidate test scenarios can include application scenarios for interacting with bank employees, and can also include application scenarios for interacting with bank customers.

[0065] In addition, in an embodiment of the present disclosure, the test order of multiple candidate test scenarios can be pre-set, and the setting principle can be: ensure that each candidate test scenario in the multiple candidate test scenarios can be traversed according to the test order, so that each candidate test scenario in the multiple candidate test scenarios can be used as a target test scenario.

[0066] In the above manner, in the embodiment of the present disclosure, multiple candidate test scenarios can be determined, and the test order of the multiple candidate test scenarios can be determined, and the target test scenario can be selected from the multiple candidate test scenarios according to the test order. In this way, it can be further ensured that the test method provided by the embodiment of the present disclosure can take into account different test scenarios to ensure the complexity and diversity of the test scenarios, thereby improving the reliability of the test results of the target application.

[0067] In some optional implementations, step S101, i.e., “generating a test data packet corresponding to a target test scenario” may include:

[0068] When the target test scenario belongs to a conventional application scenario, a test data packet including a first test instruction is generated.

[0069] The conventional application scenario may be an application scenario that is easy to simulate by real people during the development completion stage of the target application, or a relatively common application scenario during the operation and maintenance stage of the target application. In one example, the target test scenario may have a predefined first attribute tag to characterize whether the target test scenario belongs to a conventional application scenario.

[0070] In addition, as mentioned above, in the embodiment of the present disclosure, the first test instruction can be used to instruct the terminal device to obtain test result representation data of the target application while running the target application to collect real-time scene data using the target application and process the real-time scene data.

[0071] In some optional implementations, step S101, i.e., “generating a test data packet corresponding to a target test scenario” may also include:

[0072] When the target test scenario belongs to a special application scenario, a test data packet including a second test instruction and special scenario data is generated.

[0073] The special application scenario may be an application scenario that is difficult to simulate by real people during the development completion stage of the target application, or a relatively rare application scenario during the operation and maintenance stage of the target application. In one example, the target test scenario may have a predefined second attribute tag to characterize whether the target test scenario belongs to a special application scenario.

[0074] In addition, as mentioned above, in the embodiment of the present disclosure, the second test instruction can be used to instruct the terminal device to obtain test result representation data of the target application during the process of running the target application to process special scenario data using the target application.

[0075] In the above manner, in the embodiment of the present disclosure, no matter whether the target test scenario belongs to a conventional application scenario or a special application, a test data packet corresponding to the target test scenario can be smoothly generated, which helps to smoothly complete the test process of the target application. In this way, it can be further ensured that the test method provided by the embodiment of the present disclosure can take into account different test scenarios to ensure the complexity and diversity of the test scenarios, thereby improving the reliability of the test results of the target application.

[0076] In some optional implementations, “generating a test data packet including a second test instruction and special scenario data” may include:

[0077] Acquire interactive simulation data and external environment audio simulation data;

[0078] The interactive simulation data and the external environment audio simulation data are integrated to obtain special scene data;

[0079] A test data packet including a second test instruction and special scenario data is generated.

[0080] Among them, the interactive simulation data may include voice data (represented by voice simulation data) used to represent the interaction between a user and a terminal device (specifically, a target application installed inside the terminal device), and / or video data (represented by video simulation data) used to represent the interaction between a user and a terminal device (specifically, a target application installed inside the terminal device); the external environment audio simulation data can be used to represent the external environment sound when the user interacts with the terminal device.

[0081] In the above manner, in the embodiment of the present disclosure, after the interactive simulation data and the external environment audio simulation data are obtained, the interactive simulation data and the external environment audio simulation data can be merged to obtain special scene data, and a test data packet including the second test instruction and the special scene data is generated. That is to say, in the embodiment of the present disclosure, the special scene data can include not only the interactive simulation data, but also the external environment audio simulation data, so as to fit the actual application scenario to the greatest extent, thereby improving the reliability of the test results of the target application.

[0082] Further, in one example, “obtaining interactive simulation data and external environment audio simulation data” may include:

[0083] Based on the basic functions of the target application and the scenario characteristics of the target test scenario, interactive simulation data is obtained.

[0084] Among them, the basic functions of the target application may include voice acquisition and processing functions but not video acquisition and processing functions, or may include both voice acquisition and processing functions and video acquisition and processing functions; the scenario characteristics of the target test scenario may include at least one of the user characteristics of the terminal device (for example, user identity, user gender, user age, etc.) and usage environment characteristics.

[0085] In the above manner, in the disclosed embodiment, the interactive simulation data can be obtained based on the basic functions of the target application and the scenario characteristics of the target test scenario. In this way, it can be ensured that the interactive simulation data has a strong correlation with the target application and the target test scenario, and the strong correlation between the interactive simulation data and the target application and the target test scenario can improve the reliability of the test results of the target application.

[0086] In a specific example, the interactive simulation data can be obtained based on the basic functions of the target application and the scenario characteristics of the target test scenario in the following manner:

[0087] In the case where the basic functions of the target application include voice acquisition and processing functions, voice simulation data is acquired based on the scenario characteristics of the target test scenario, and the voice simulation data is used as interactive simulation data; in the case where the basic functions of the target application include voice acquisition and processing functions, as well as video acquisition and processing functions, voice simulation data is acquired based on the scenario characteristics of the target test scenario, and video simulation data is acquired based on the scenario characteristics of the target test scenario, and interactive simulation data is obtained based on the voice simulation data and the video simulation data.

[0088] Exemplarily, after the voice simulation data and the video simulation data are acquired, the voice simulation data and the video simulation data may be fused to obtain interactive simulation data.

[0089] In addition, in the embodiments of the present disclosure, the speech simulation data can be obtained based on the scene characteristics of the target test scene in the following manner:

[0090] Based on the scene characteristics of the target test scene, initial speech data is obtained;

[0091] Selecting at least one target dimension from a plurality of sound attribute dimensions; wherein the plurality of sound attribute dimensions include at least one of timbre, volume, audio frequency and phase;

[0092] The initial speech data is adjusted from at least one target dimension to obtain speech simulation data.

[0093] Exemplarily, the scenario characteristics of the target test scenario include user characteristics of the terminal device. Based on this, in the embodiment of the present disclosure, initial voice data that matches the user characteristics of the terminal device can be selected from a preset voice database, or initial voice data that matches the user characteristics of the terminal device can be generated by computer simulation. After obtaining the initial voice data, the initial voice data can be adjusted from at least one target dimension to obtain voice simulation data to increase the complexity and diversity of the voice simulation data.

[0094] For example, if at least one target dimension includes timbre, the initial voice data may be adjusted by adding noise (e.g., white noise, pink noise, etc.), adding distortion effects, etc., or by changing the spectral distribution of the initial voice data; for another example, if at least one target dimension includes volume, the initial voice data may be adjusted by compressing the volume dynamic range of the initial voice data, or by randomly adjusting the volume of the initial voice data; for another example, if at least one target dimension includes audio, the initial voice data may be adjusted by adding reverberation and echo effects to the initial voice data, or by editing and splicing the initial voice data; for another example, if at least one target dimension includes phase, the initial voice data may be adjusted by randomizing the phase of the initial voice data, or by introducing phase offsets in different parts of the initial voice data.

[0095] In addition, in the embodiments of the present disclosure, at least one target dimension may be selected from multiple sound attribute dimensions according to a preset selection rule, or may be randomly selected from multiple sound attribute dimensions, and the embodiments of the present disclosure do not impose any restrictions on this.

[0096] In the above manner, in the embodiment of the present disclosure, initial voice data can be obtained based on the scene characteristics of the target test scene, and at least one target dimension can be selected from multiple sound attribute dimensions, and the initial voice data can be adjusted from the at least one target dimension to obtain voice simulation data. In this way, the complexity and diversity of the voice simulation data can be improved to fit the actual application scenario to the greatest extent, thereby improving the reliability of the test results of the target application.

[0097] In the embodiment of the present disclosure, the video simulation data can also be obtained based on the scene characteristics of the target test scene in the following manner:

[0098] Based on the scene features of the target test scene, select a person video from the foreground video library;

[0099] Based on the scene features of the target test scene, a background video is selected from the background database;

[0100] The character video and the background video are fused to obtain video simulation data.

[0101] Exemplarily, the scene features of the target test scene include user features and usage environment features of the terminal device. Based on this, in the disclosed embodiment, a character video that matches the user features of the terminal device can be selected from a preset foreground video library, and a background video that matches the usage environment features of the terminal device can be selected from a preset background video library. Thereafter, the character video and the background video can be fused to obtain video simulation data.

[0102] In the above manner, in the disclosed embodiment, based on the scene features of the target test scene, a person video can be selected from the foreground video library, and based on the scene features of the target test scene, a background video can be selected from the background database, and the person video and the background video can be fused to obtain video simulation data. In this way, it can be ensured that the video simulation data has a strong correlation with the target test scene, and the strong correlation between the video simulation data and the target test scene can improve the reliability of the test results of the target application.

[0103] In another example, “obtaining interactivity simulation data and external environment audio simulation data” may also include:

[0104] Based on the scene characteristics of the target test scene, external environment audio simulation data is obtained.

[0105] Among them, the scenario characteristics of the target test scenario may include usage environment characteristics.

[0106] In the above manner, in the disclosed embodiment, external environment audio simulation data can be obtained based on the scene characteristics of the target test scene. In this way, it can be ensured that there is a strong correlation between the external environment audio simulation data and the target test scene, and the strong correlation between the external environment audio simulation data and the target test scene can improve the reliability of the test results of the target application.

[0107] In a specific example, external environment audio simulation data may be obtained based on the scene characteristics of the target test scene in the following manner:

[0108] Based on the scene characteristics of the target test scene, determining a target number of audio databases corresponding to the target test scene;

[0109] Selecting audios to be fused from a target number of audio simulation databases respectively;

[0110] The audios to be fused are selected from a target number of audio simulation databases to obtain external environment audio simulation data.

[0111] Exemplarily, the scenario characteristics of the target test scenario include the usage environment characteristics of the terminal device. In this case, it is assumed that the usage environment characteristics of the terminal device are used to characterize that the terminal device is set in a bank, that is, the usage environment of the terminal device is a bank.

[0112] Based on this, in the embodiment of the present disclosure, three (that is, the target number is 3) audio databases corresponding to the target test scenario can be determined based on the use environment characteristics of the terminal device - the first audio database, the second audio database and the third audio database. Among them, the first audio database is used to store multiple candidate in-bank broadcast voices; the second audio database is used to store multiple external environment voice noises (for example, the voices of bank employees, the voices of bank customers, the communication sounds of bank employees and bank customers, etc.); the third audio database is used to store multiple external environment non-language noises (for example, traffic sounds, vehicle horns, and street hawking sounds, etc.). Thereafter, at least one audio to be fused can be randomly selected from the first audio database, at least one audio to be fused can be randomly selected from the second audio database, and at least one audio to be fused can be randomly selected from the third audio database, and all the selected audio to be fused can be fused to obtain external environment audio simulation data.

[0113] Through the above method, in the embodiment of the present disclosure, based on the scene characteristics of the target test scene, a target number of audio databases corresponding to the target test scene can be determined, and audio to be fused can be selected from the target number of audio simulation databases respectively to obtain a target number of audio to be fused, and then the target number of audio to be fused can be fused to obtain external environment audio simulation data. In this way, the complexity and diversity of the external environment audio simulation data can be improved to fit the actual application scene to the greatest extent, thereby improving the reliability of the test results of the target application.

[0114] In some optional implementations, step S102, that is, "sending the test data packet to the terminal device" may include:

[0115] When it is detected through the heartbeat detection mechanism that normal communication is maintained between the service device and the terminal device, a test data packet is sent to the terminal device.

[0116] Please combine Figure 2 In the embodiment of the present disclosure, the process of establishing a heartbeat detection mechanism between the service device and the terminal device may include:

[0117] (1) The terminal device starts a target application (with a first communication module including a first heartbeat control unit added therein) to wait for the service device to initiate a communication connection request to the terminal device;

[0118] (2) The service device starts the second communication module (including the second heartbeat control unit) and obtains the Internet Protocol Address (IP address) of the terminal device, so as to initiate a communication connection request to the terminal device based on the IP address of the terminal device;

[0119] (3) After receiving the communication connection request, the terminal device establishes a communication connection with the service device and sends a random heartbeat value to the service device through the heartbeat module;

[0120] (4) The service device establishes a communication connection with the terminal device, and after receiving the heartbeat value for the first time, performs a “+1” operation on the heartbeat value and sends it to the terminal device;

[0121] (5) After receiving the heartbeat value for the first time, the terminal device confirms whether the heartbeat value is executed with a "+1" operation, and if it is confirmed that the heartbeat value is executed with a "+1" operation, it executes a "+1" operation on the heartbeat value again and sends it to the service device; or, if it is confirmed that the heartbeat value is not executed with a "+1" operation, it sends a communication abnormality indication to the service device;

[0122] …

[0123] (N) After receiving the heartbeat value for the Mth time (M≥2, and is a positive integer), the service device confirms whether the heartbeat value has been subjected to the "+1" operation, and if it is confirmed that the heartbeat value is "+1", it performs the "+1" operation on the heartbeat value again and sends it to the terminal device; or if it is confirmed that the heartbeat value has not been subjected to the "+1" operation, it disconnects the communication connection with the terminal device; in addition, if a communication abnormality indication is received from the terminal device, it also disconnects the communication connection with the terminal device.

[0124] Based on the above process, it is possible to accurately detect whether the service device and the terminal device maintain normal communication, and when it is detected that the service device and the terminal device maintain normal communication, a test data packet is sent to the terminal device.

[0125] In the above manner, in the embodiment of the present disclosure, the test data packet can be sent to the terminal device only when the heartbeat detection mechanism detects that the service device and the terminal device maintain normal communication. In this way, not only can the number of invalid communications be reduced to avoid the waste of communication resources, but also when a communication failure occurs between the service device and the terminal device, timely response measures (such as reconnection, alarm or failover) can be taken, thereby ensuring that the test process of the target application can be successfully completed.

[0126] Furthermore, in one example, the test data packet may be sent to the terminal device in the following manner:

[0127] Identify multiple devices to be tested;

[0128] Each of the multiple devices under test is used as a terminal device, and a test data packet is sent to the terminal device.

[0129] Among them, the multiple devices to be tested may be from different brands, different manufacturers, or have different operating systems. In this case, after each of the multiple devices to be tested is used as a terminal device and the test data packet is sent to the terminal device, multiple test results corresponding to the multiple devices to be tested can be obtained. Based on these test results, the compatibility test of the target application for different devices to be tested can be completed, thereby improving the functionality of the test method provided by the embodiment of the present disclosure.

[0130] The present disclosure also provides a test method that can be applied to electronic devices. The electronic device can be a terminal device. Here, the terminal device can be an intelligent voice terminal (e.g., a car computer, a human-computer interaction device), a workbench, a large computer, a conventional computer (e.g., a desktop computer, a laptop computer, a car computer, etc.), a personal digital processing unit or other similar computing devices. Figure 3 The flowchart diagram shown illustrates a test method provided by an embodiment of the present disclosure. It should be noted that although a logical sequence is shown in the flowchart diagram, in some cases, the steps shown or described may also be performed in other sequences.

[0131] Step S301, receiving a test data packet corresponding to a target test scenario.

[0132] The target test scenario can be an actual application scenario that the target application may face, and the target application can be an application (Application, APP) that can be applied to the terminal device. Here, the target application can specifically be an intelligent voice application, and correspondingly, the terminal device can be an intelligent voice terminal, such as a car machine, or a human-computer interaction device set up in hospitals, banks, hotels, entertainment venues, etc. to provide self-service.

[0133] In addition, in an embodiment of the present disclosure, a test data packet may include a first test instruction. The first test instruction may be used to instruct the terminal device to obtain test result characterization data of the target application in the process of running the target application to collect real-time scene data using the target application and processing the real-time scene data. In an embodiment of the present disclosure, the test data may also include a second test instruction and special scene data. The second test instruction may be used to instruct the terminal device to obtain test result characterization data of the target application in the process of running the target application to process special scene data using the target application; the special scene data may be scene description information of the target test scene. Here, the special scene data may be pre-collected or generated by computer simulation, and the embodiment of the present disclosure does not limit this.

[0134] Step S302: running the target application based on the test data packet to obtain test result representation data of the target application.

[0135] As mentioned above, in the embodiment of the present disclosure, when the test data packet includes a first test instruction, the terminal device can run the target application under the instruction of the first test instruction, and then obtain the test result characterization data of the target application in the process of collecting real-time scene data using the target application and processing the real-time scene data. When the test data packet includes a second test instruction and special scene data, the terminal device can run the target application under the instruction of the second test instruction, and then obtain the test result characterization data of the target application in the process of processing the special scene data using the target application.

[0136] Step S303: Send the test result characterization data to the service device.

[0137] The service device is used to receive the test result characterization data, and obtain the test result of the target application based on the test result characterization data. Here, the test result can be used to characterize whether the target application can run smoothly.

[0138] By adopting the test method provided by the embodiment of the present disclosure, on the one hand, there is no need to add test code to the code file of the target application, but the service device generates a test data packet corresponding to the target test scenario, and sends the test data packet to the terminal device, so that the terminal device runs the target application based on the test data packet to obtain the test result characterization data of the target application, and sends the test result characterization data to the service device, and then the service device receives the test result characterization data, and obtains the test result of the target application based on the test result characterization data. In this way, it can be avoided that the internal structure of the target application is destroyed by the test code, thereby affecting the stability of the target application, and at the same time, there will be no test code crash, which will cause the test result characterization data to be abnormal, so that the reliability of the test result of the target application can be improved. On the other hand, in the embodiment of the present disclosure, the test data packet corresponding to the target test scenario is generated by the service device, so when the target test scenario changes, the test data packet will also change accordingly to maintain the corresponding relationship with the target test scenario. In this way, through the test method provided by the embodiment of the present disclosure, different test scenarios can be taken into account to ensure the complexity and diversity of the test scenarios, thereby improving the reliability of the test results of the target application.

[0139] In summary, the testing method provided by the embodiments of the present disclosure can improve the reliability of the test results of the target application without affecting the stability of the target application.

[0140] In addition, in the embodiment of the present disclosure, the test result characterization data may include at least one of the interface test data, the stress test data, and the performance test data. Based on this, it can be understood that in the embodiment of the present disclosure, based on the test result characterization data, the test result of the target application obtained may include a first test result obtained based on the interface test data, may also include a second test result obtained based on the stress test data, and may also include a third test result obtained based on the performance test data, thereby ensuring the comprehensiveness of the test result of the target application.

[0141] In some optional implementations, the target test scenario belongs to a conventional application scenario, and the test data packet includes a first test instruction. The conventional application scenario may be an application scenario that is easy to simulate by real people at the development completion stage of the target application, or may be a relatively common application scenario at the operation and maintenance stage of the target application. In one example, the target test scenario may have a predefined first attribute tag to characterize whether the target test scenario belongs to a conventional application scenario.

[0142] Based on this, in the embodiment of the present disclosure, step S301, that is, "running the target application based on the test data packet to obtain test result representation data of the target application" may include:

[0143] According to the first test instruction, the target application is run to obtain test result representation data of the target application in the process of collecting real-time scene data by using the target application and processing the real-time scene data.

[0144] As mentioned above, in the embodiment of the present disclosure, the test result representation data may include at least one of interface test data, pressure test data and performance test data.

[0145] In one example, the first test instruction may include an interface test instruction. Based on this, in the embodiment of the present disclosure, when using the target application to collect real-time scene data, according to the interface test instruction, the target application's voice collection and processing function (for example, voice noise reduction function, etc.), the target application's video collection and processing function (for example, face positioning function, video noise reduction function, etc.), and the target application's audio and video processing function (for example, voice recognition function, person tracking function, audio and video fusion function, etc.) are turned on or off to obtain the target application's interface test data.

[0146] Among them, the interface test data is used to characterize whether the voice acquisition and processing function of the target application can be successfully turned on or off, whether the video acquisition and processing function of the target application can be successfully turned on or off, and whether the audio and video processing function of the target application can be successfully turned on or off. When these functions can be successfully turned on or off, a first test result characterizing that the interface function of the target application is available can be obtained based on the interface test data; otherwise, a first test result characterizing that the interface function of the target application is unavailable will be obtained based on the interface test data.

[0147] In another example, the first test instruction may include a stress test instruction. Based on this, in the embodiment of the present disclosure, in the process of using the target application to process real-time scene data (for example, voice acquisition and processing, video acquisition and processing, and audio and video processing, etc.), according to the stress test instruction, the stress test data of the terminal device can be obtained to characterize the degree of stress impact brought to the terminal device by running the target application.

[0148] In a specific example, when the stress test data of the terminal device is greater than or equal to the preset stress threshold, a second test result can be obtained to characterize that the stress impact on the terminal device caused by running the target application is large, resulting in the target application being unable to run smoothly; otherwise, a second test result can be obtained to characterize that the stress impact on the terminal device caused by running the target application is small, thus ensuring the smooth operation of the target application. The preset stress threshold can be set according to actual application requirements, and the embodiments of the present disclosure do not limit this.

[0149] In another example, the first test instruction may include a performance test instruction. Based on this, in the embodiment of the present disclosure, in the process of processing real-time scene data (e.g., voice acquisition and processing, video acquisition and processing, and audio and video processing, etc.) using the target application, the performance test data of the terminal device can be obtained according to the performance test instruction to characterize the degree of performance impact on the terminal device caused by running the target application. Among them, the performance test data may include multiple performance test sub-data, such as the central processing unit (CPU) occupancy rate, memory occupancy rate, device temperature, communication traffic consumption, etc.

[0150] In a specific example, when each performance test sub-data in a plurality of performance test sub-data is less than the corresponding preset data threshold, a second test result can be obtained to characterize that the performance impact of running the target application on the terminal device is small, and therefore, the target application can be ensured to run smoothly; otherwise, a third test result will be obtained to characterize that the performance impact of running the target application on the terminal device is large, and the target application cannot run smoothly. The preset data threshold can be set according to actual application requirements, and the embodiments of the present disclosure do not limit this.

[0151] In the above manner, in the embodiment of the present disclosure, when the target test scenario belongs to a conventional application scenario, a test data packet corresponding to the target test scenario can be smoothly generated, which helps to smoothly complete the test process of the target application. In this way, it can be further ensured that the test method provided by the embodiment of the present disclosure can take into account different test scenarios to ensure the complexity and diversity of the test scenarios, thereby improving the reliability of the test results of the target application.

[0152] In some optional implementations, the target test scenario belongs to a special application scenario, and the test data packet includes a second test instruction and special scenario data. The special application scenario may be an application scenario that is difficult to simulate by real people at the development completion stage of the target application, or a relatively rare application scenario at the operation and maintenance stage of the target application. In one example, the target test scenario may have a predefined second attribute tag to characterize whether the target test scenario belongs to a special application scenario.

[0153] Based on this, in the embodiment of the present disclosure, step S301, that is, "running the target application based on the test data packet to obtain test result representation data of the target application" may include:

[0154] According to the second test instruction, the target application is run to obtain test result representation data of the target application in the process of processing the special scenario data using the target application.

[0155] As mentioned above, in the embodiment of the present disclosure, the test result representation data may include at least one of stress test data and performance test data.

[0156] In one example, the second test instruction may include a stress test instruction. Based on this, in the embodiment of the present disclosure, in the process of processing special scene data (e.g., voice acquisition and processing, video acquisition and processing, and audio and video processing, etc.) using the target application, according to the stress test instruction, the stress test data of the terminal device can be obtained to characterize the degree of stress impact brought to the terminal device by running the target application.

[0157] In a specific example, when the stress test data of the terminal device is greater than or equal to the preset stress threshold, a second test result can be obtained to characterize that the stress impact on the terminal device caused by running the target application is large, resulting in the target application being unable to run smoothly; otherwise, a second test result can be obtained to characterize that the stress impact on the terminal device caused by running the target application is small, thus ensuring the smooth operation of the target application. The preset stress threshold can be set according to actual application requirements, and the embodiments of the present disclosure do not limit this.

[0158] In another example, the second test instruction may include a performance test instruction. Based on this, in the embodiment of the present disclosure, in the process of processing special scene data (e.g., voice acquisition and processing, video acquisition and processing, and audio and video processing, etc.) using the target application, the performance test data of the terminal device can be obtained according to the performance test instruction to characterize the degree of performance impact on the terminal device caused by running the target application. Among them, the performance test data may include CPU occupancy, memory occupancy, device temperature, communication traffic consumption, etc.

[0159] In a specific example, when each performance test sub-data in a plurality of performance test sub-data is less than the corresponding preset data threshold, a second test result can be obtained to characterize that the performance impact of running the target application on the terminal device is small, and therefore, the target application can be ensured to run smoothly; otherwise, a third test result will be obtained to characterize that the performance impact of running the target application on the terminal device is large, and the target application cannot run smoothly. The preset data threshold can be set according to actual application requirements, and the embodiments of the present disclosure do not limit this.

[0160] In the above manner, in the embodiment of the present disclosure, when the target test scenario belongs to a special application scenario, a test data packet corresponding to the target test scenario can be smoothly generated, which helps to smoothly complete the test process of the target application. In this way, it can be further ensured that the test method provided by the embodiment of the present disclosure can take into account different test scenarios to ensure the complexity and diversity of the test scenarios, thereby improving the reliability of the test results of the target application.

[0161] The following is divided into two parts, which provide a supplementary introduction to the testing method provided in the embodiment of the present disclosure.

[0162] In the first part, the test system including terminal equipment and service equipment is introduced.

[0163] Please combine Figure 4 In the disclosed embodiment, the test system includes a terminal device and a service device.

[0164] Among them, a target application is installed inside the terminal device, and the target application can be an APP that can be applied to the terminal device. Here, the target application can specifically be an intelligent voice application, and correspondingly, the terminal device can be an intelligent voice terminal, such as a car machine, or a human-computer interaction device set up in hospitals, banks, hotels, entertainment venues, etc. to provide self-service. In addition, it should be noted that in the embodiment of the present disclosure, there is only its own code file inside the target application, and there is no test code for implementing the test method provided by the embodiment of the present disclosure, that is, all test codes are stored in the service device.

[0165] The following introduces the functions and internal structures of the terminal device and the service device respectively.

[0166] Terminal device: A first communication module (including a first heartbeat control unit) can be added to the target application, which can also be called a client service end, which can communicate with a second communication module (including a second heartbeat control unit) in the service device through a communication protocol (for example, Socket / Websocket protocol), and send the processing results (audio content, text content or video content) of the audio and video processing module integrated in the target application to the data receiving module integrated in the service device. In addition, it should be noted that in the embodiment of the present disclosure, the service device can also perform a visual synchronous display of the processing results of the audio and video processing module.

[0167] That is, the target application internally integrates:

[0168] (1) A first communication module (including a first heartbeat control unit): used to detect whether normal communication is maintained between the service device and the terminal device.

[0169] (2) Voice acquisition and processing module: used to acquire and process audio data.

[0170] (3) Video acquisition and processing module: used to acquire and process video data.

[0171] (4) Audio and video processing module: used to further process the audio data collected and processed by the voice collection and processing module, and the video data collected and processed by the video collection and processing module.

[0172] Service device: used to establish a communication connection with the terminal device and send a test data packet to the terminal device so that the terminal device runs the target application based on the test data packet to obtain test result characterization data of the target application; the test result characterization data is sent to the service device, after which the service device receives the test result characterization data and obtains the test result of the target application based on the test result characterization data.

[0173] Specifically, the service equipment integrates:

[0174] (1) The second communication module (including the second heartbeat control unit): used to detect whether normal communication is maintained between the service device and the terminal device.

[0175] (2) Data receiving module: used to receive the processing results (audio content, text content or video content) of the audio and video processing module integrated in the target application.

[0176] (3) Central processing module: used to generate test data packets to control the test process of the target application through the test data packets.

[0177] In addition, in the embodiment of the present disclosure, the test system may further include a cloud. Based on this, in the embodiment of the present disclosure, after the service device sends a test data packet to the terminal device so that the terminal device runs the target application based on the test data packet to obtain test result characterization data of the target application, the terminal device may send at least part of the test result characterization data to the cloud and perform a visual synchronous display on the cloud. At the same time, after obtaining the test result of the target application based on the test result characterization data, the terminal device may send the test result of the target application to the cloud and perform a visual synchronous display on the cloud.

[0178] The second part is the partial workflow after the terminal device receives the test data packet.

[0179] In the embodiment of the present disclosure, after the terminal device receives the test data packet sent by the service device, the data detection module can be synchronously started. The data detection module may include a data uploading unit, an operation status detection unit, an abnormal alarm unit, a data monitoring unit and an offline data processing unit.

[0180] (1) Data upload unit: After the service device sends a test data packet to the terminal device so that the terminal device runs the target application based on the test data packet to obtain test result representation data of the target application, the terminal device can use the data upload unit to send at least part of the test result representation data to the cloud and perform a visual synchronous display on the cloud. At the same time, after the terminal device obtains the test result of the target application based on the test result representation data, it can use the data upload unit to send the test result of the target application to the cloud and perform a visual synchronous display on the cloud.

[0181] (2) Operation status detection unit: detects whether the target application is running normally and whether there is any crash.

[0182] (3) Abnormal alarm unit: When an abnormality is detected in the target application, an alarm signal is generated and the target object is notified through communication software, email, etc.

[0183] (4) Data monitoring unit: collects log information, CPU usage, memory usage, device temperature, communication traffic consumption, etc. of the target application in real time (i.e., data representing some test results).

[0184] (5) Offline data processing unit: After the service device sends the test data packet to the terminal for identification, in the event of a communication failure between the service device and the terminal device, the terminal device can run the target application based on the test data packet to obtain test result characterization data of the target application, and keep the test result characterization data locally. After the communication between the service device and the terminal device is restored, the test result characterization data is sent to the service device.

[0185] See also Figure 5 , which is a scenario diagram of a testing method provided in an embodiment of the present disclosure.

[0186] As mentioned above, the test method provided by the embodiment of the present disclosure is applied to electronic devices. Among them, the electronic device can be a service device or a terminal device. Here, the terminal device can be an intelligent voice terminal (for example, a car computer, a human-computer interaction device), a workbench, a mainframe computer, a conventional computer (for example, a desktop computer, a laptop computer, a car computer, etc.), a personal digital processing or other similar computing device.

[0187] In the case where the electronic device is a service device, it is used to:

[0188] Generate test data packets corresponding to target test scenarios;

[0189] Sending a test data packet to a terminal device; wherein the terminal device is used to run a target application based on the test data packet to obtain test result representation data of the target application; and sending the test result representation data to a service device;

[0190] receiving test result characterization data;

[0191] Based on the test result characterization data, a test result of the target application is obtained.

[0192] When the electronic device is a terminal device, it is used to:

[0193] receiving a test data packet corresponding to a target test scenario;

[0194] Running the target application based on the test data packet to obtain test result representation data of the target application;

[0195] The test result characterization data is sent to a service device; wherein the service device is used to receive the test result characterization data; and based on the test result characterization data, a test result of a target application is obtained.

[0196] It should be noted that in the embodiments of the present disclosure, Figure 5 The scene diagram shown is only illustrative and not restrictive. Those skilled in the art can Figure 5 Various obvious changes and / or substitutions are made to the examples, and the obtained technical solutions still fall within the scope of the disclosure of the embodiments of the present disclosure.

[0197] In order to better implement the testing method applied to the service device, the embodiment of the present disclosure further provides a testing device 600, which can be integrated in an electronic device. The electronic device can be a service device. Figure 6 The schematic structural block diagram shown is used to illustrate a testing device 600 provided in the disclosed embodiment.

[0198] The testing device 600 comprises:

[0199] The data generating unit 601 is used to generate a test data packet corresponding to a target test scenario;

[0200] The first data sending unit 602 is used to send a test data packet to a terminal device; wherein the terminal device is used to run a target application based on the test data packet to obtain test result representation data of the target application; and send the test result representation data to a service device;

[0201] A first data receiving unit 603, used to receive test result representation data;

[0202] The test result acquisition unit 604 is used to obtain the test result of the target application based on the test result characterization data.

[0203] In some optional implementations, the data generating unit 601 is used to:

[0204] In the case where the target test scenario belongs to a conventional application scenario, a test data packet including a first test instruction is generated; wherein the first test instruction is used to instruct the terminal device to obtain test result representation data of the target application during the process of running the target application to collect real-time scenario data using the target application and processing the real-time scenario data;

[0205] Alternatively, when the target test scenario belongs to a special application scenario, a test data packet including a second test instruction and special scenario data is generated; wherein the second test instruction is used to instruct the terminal device to obtain test result characterization data of the target application when running the target application to process the special scenario data using the target application.

[0206] In some optional implementations, the data generating unit 601 is used to:

[0207] Acquire interactive simulation data and external environment audio simulation data;

[0208] The interactive simulation data and the external environment audio simulation data are integrated to obtain special scene data;

[0209] A test data packet including a second test instruction and special scenario data is generated.

[0210] In some optional implementations, the data generating unit 601 is used to:

[0211] Acquire interactive simulation data based on the basic functions of the target application and the scenario characteristics of the target test scenario;

[0212] And / or, based on the scene characteristics of the target test scene, obtain external environment audio simulation data.

[0213] In some optional implementations, the data generating unit 601 is used to:

[0214] In the case where the basic functions of the target application include voice acquisition and processing functions, based on the scenario characteristics of the target test scenario, voice simulation data is acquired and the voice simulation data is used as interactive simulation data;

[0215] Alternatively, when the basic functions of the target application include voice acquisition and processing functions, and video acquisition and processing functions, voice simulation data is obtained based on the scene characteristics of the target test scene, and video simulation data is obtained based on the scene characteristics of the target test scene, and interactive simulation data is obtained based on the voice simulation data and the video simulation data.

[0216] In some optional implementations, the data generating unit 601 is used to:

[0217] Based on the scene characteristics of the target test scene, initial speech data is obtained;

[0218] Selecting at least one target dimension from a plurality of sound attribute dimensions; wherein the plurality of sound attribute dimensions include at least one of timbre, volume, audio frequency and phase;

[0219] The initial speech data is adjusted from at least one target dimension to obtain speech simulation data.

[0220] In some optional implementations, the data generating unit 601 is used to:

[0221] Based on the scene features of the target test scene, select a person video from the foreground video library;

[0222] Based on the scene features of the target test scene, a background video is selected from the background database;

[0223] The character video and the background video are fused to obtain video simulation data.

[0224] In some optional implementations, the data generating unit 601 is used to:

[0225] Based on the scene characteristics of the target test scene, determining a target number of audio databases corresponding to the target test scene;

[0226] Selecting audios to be fused from a target number of audio simulation databases respectively;

[0227] The audios to be fused are selected from a target number of audio simulation databases to obtain external environment audio simulation data.

[0228] In some optional implementations, the test result characterization data includes at least one of interface test data, pressure test data, and performance test data.

[0229] In some optional implementation manners, the first data sending unit 602 is configured to:

[0230] When it is detected through the heartbeat detection mechanism that normal communication is maintained between the service device and the terminal device, a test data packet is sent to the terminal device.

[0231] In some optional implementation manners, the first data sending unit 602 is configured to:

[0232] Identify multiple devices to be tested;

[0233] Each of the multiple devices under test is used as a terminal device, and a test data packet is sent to the terminal device.

[0234] In some optional implementations, the testing device 600 further includes a test scenario selection unit, which is used to:

[0235] Identify multiple candidate test scenarios;

[0236] Obtaining a test order for multiple candidate test scenarios;

[0237] According to the test order, a target test scenario is selected from multiple candidate test scenarios.

[0238] For the description of the specific functions and examples of each unit of the test device 600 of the embodiment of the present disclosure, reference can be made to the relevant description of the corresponding steps in the aforementioned embodiment of the test method applied to the service device, and will not be repeated here.

[0239] In order to better implement the test method applied to the terminal device, the embodiment of the present disclosure also provides a test device, which can be integrated in an electronic device. Among them, the electronic device can be a terminal device. Here, the terminal device can be an intelligent voice terminal (for example, a car computer, a human-computer interaction device), a workbench, a mainframe computer, a conventional computer (for example, a desktop computer, a laptop computer, a car computer, etc.), a personal digital processing or other similar computing device. In the following, the test method of the terminal device is combined with the test method of the terminal device. Figure 7 The schematic structural block diagram shown is used to illustrate a testing device 700 provided in the disclosed embodiment.

[0240] The testing device 700 comprises:

[0241] The second data receiving unit 701 is used to receive a test data packet corresponding to a target test scenario;

[0242] The data processing unit 702 is used to run the target application based on the test data packet to obtain test result representation data of the target application;

[0243] The second data sending unit 703 is used to send the test result characterization data to the service device; wherein the service device is used to receive the test result characterization data; and obtain the test result of the target application based on the test result characterization data.

[0244] In some optional implementations, the target test scenario belongs to a conventional application scenario, and the test data packet includes a first test instruction; the data processing unit 702 is used to:

[0245] According to the first test instruction, the target application is run to obtain test result representation data of the target application in the process of collecting real-time scene data by using the target application and processing the real-time scene data.

[0246] In some optional implementations, the target test scenario belongs to a special application scenario, and the test data packet includes a second test instruction and special scenario data; the data processing unit 702 is used to:

[0247] According to the second test instruction, the target application is run to obtain test result representation data of the target application in the process of processing the special scenario data using the target application.

[0248] In some optional implementations, the test result characterization data includes at least one of interface test data, pressure test data, and performance test data.

[0249] For the description of the specific functions and examples of each unit of the test device 700 of the embodiment of the present disclosure, reference can be made to the relevant description of the corresponding steps in the aforementioned embodiment of the test method applied to the terminal device, and will not be repeated here.

[0250] In the technical solution disclosed herein, the acquisition, storage and application of user personal information involved are in compliance with the provisions of relevant laws and regulations and do not violate public order and good morals.

[0251] According to an embodiment of the present disclosure, the present disclosure also provides an electronic device, an intelligent voice terminal, a readable storage medium and a computer program product.

[0252] Figure 8 A schematic block diagram of an example electronic device 800 that can be used to implement an embodiment of the present disclosure is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital assistants, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present disclosure described and / or required herein.

[0253] like Figure 8 As shown, the device 800 includes a computing unit 801, which can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 802 or a computer program loaded from a storage unit 808 to a random access memory (RAM) 803. In RAM 803, various programs and data required for the operation of the device 800 can also be stored. The computing unit 801, ROM 802 and RAM 803 are connected to each other via a bus 804. An input / output (I / O) interface 805 is also connected to the bus 804.

[0254] A number of components in the device 800 are connected to the I / O interface 805, including: an input unit 806, such as a keyboard, a mouse, etc.; an output unit 807, such as various types of displays, speakers, etc.; a storage unit 808, such as a disk, an optical disk, etc.; and a communication unit 809, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 809 allows the device 800 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0255] The computing unit 801 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the computing unit 801 include, but are not limited to, a CPU, a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, digital signal processors (DSP), and any appropriate processors, controllers, microcontrollers, etc. The computing unit 801 performs the various methods and processes described above, such as the test method. For example, in some embodiments, the test method may be implemented as a computer software program, which is tangibly contained in a machine-readable medium, such as a storage unit 808. In some embodiments, part or all of the computer program may be loaded and / or installed on the device 800 via the ROM 802 and / or the communication unit 809. When the computer program is loaded into the RAM 803 and executed by the computing unit 801, one or more steps in the test method described above may be performed. Alternatively, in other embodiments, the computing unit 801 may be configured as a test method in any other appropriate manner (e.g., by means of firmware).

[0256] Various embodiments of the systems and techniques described above herein may be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which may be a dedicated or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0257] The program code for implementing the method of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that the program code, when executed by the processor or controller, enables the functions / operations specified in the flow chart and / or block diagram to be implemented. The program code may be executed entirely on the machine, partially on the machine, partially on the machine as a stand-alone software package and partially on a remote machine, or entirely on a remote machine or server.

[0258] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a RAM, a ROM, an erasable programmable read-only memory (EPROM) or a flash memory, an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0259] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a cathode ray tube (CRT) display or a liquid crystal display (LCD)) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the computer. Other types of devices are also used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0260] The systems and techniques described herein can be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: Local Area Network (LAN), Wide Area Network (WAN), and the Internet.

[0261] A computer system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The relationship of client and server is generated by computer programs running on respective computers and having a client-server relationship to each other. The server may be a cloud server, a server of a distributed system, or a server combined with a blockchain.

[0262] The embodiment of the present disclosure also provides an intelligent voice terminal, which may include an electronic device. The electronic device includes:

[0263] at least one processor;

[0264] a memory communicatively coupled to the at least one processor;

[0265] The memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform a testing method.

[0266] The embodiment of the present disclosure also provides a non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are used to enable the computer to execute a testing method.

[0267] The embodiment of the present disclosure also provides a computer program product, including a computer program, which implements the testing method when executed by a processor.

[0268] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps recorded in the present disclosure can be executed in parallel, sequentially or in a different order, as long as the desired results of the technical solutions disclosed in the present disclosure can be achieved, and this document is not limited here. In addition, in the present disclosure, relational terms such as "first", "second", "third", etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply the existence of any such actual relationship or order between these entities or operations. In addition, "multiple" in the present disclosure can be understood as at least two.

[0269] The above specific implementations do not constitute a limitation on the protection scope of the present disclosure. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the principles of the present disclosure shall be included in the protection scope of the present disclosure.

Claims

1. A testing method, applied to a service device; the method comprising: Generate test data packets corresponding to target test scenarios; Sending the test data packet to a terminal device; wherein the terminal device is used to run a target application based on the test data packet to obtain test result representation data of the target application; and sending the test result representation data to the service device; Receiving the test result characterization data; Based on the test result characterization data, a test result of the target application is obtained.

2. The method according to claim 1, wherein: The generating of a test data packet corresponding to a target test scenario includes: In the case where the target test scenario belongs to a conventional application scenario, a test data packet including a first test instruction is generated; wherein the first test instruction is used to instruct the terminal device to obtain test result representation data of the target application during the process of running the target application to collect real-time scenario data using the target application and processing the real-time scenario data; Alternatively, when the target test scenario belongs to a special application scenario, a test data packet including a second test instruction and special scenario data is generated; wherein the second test instruction is used to instruct the terminal device to obtain test result characterization data of the target application when running the target application to process the special scenario data using the target application.

3. The method according to claim 2, wherein: The generating of the test data packet including the second test instruction and the special scenario data includes: Acquire interactive simulation data and external environment audio simulation data; Fusing the interactive simulation data and the external environment audio simulation data to obtain the special scene data; Generate a test data packet including the second test instruction and the special scenario data.

4. The method according to claim 3, wherein: The obtaining of the interactive simulation data and the external environment audio simulation data includes: Based on the basic functions of the target application and the scenario characteristics of the target test scenario, acquiring the interactivity simulation data; And / or, based on the scene characteristics of the target test scene, the external environment audio simulation data is obtained.

5. The method according to claim 4, wherein: The acquiring of the interactive simulation data based on the basic functions of the target application and the scenario characteristics of the target test scenario includes: In the case where the basic functions of the target application include voice collection and processing functions, based on the scenario characteristics of the target test scenario, voice simulation data is acquired, and the voice simulation data is used as the interactive simulation data; Alternatively, when the basic functions of the target application include voice acquisition and processing functions, and video acquisition and processing functions, voice simulation data is acquired based on the scene characteristics of the target test scene, and video simulation data is acquired based on the scene characteristics of the target test scene, and the interactive simulation data is obtained based on the voice simulation data and the video simulation data.

6. The method according to claim 5, wherein: The acquiring of speech simulation data based on the scene features of the target test scene includes: Based on the scene characteristics of the target test scene, obtaining initial speech data; Selecting at least one target dimension from a plurality of sound attribute dimensions; wherein the plurality of sound attribute dimensions include at least one of timbre, volume, audio frequency and phase; The initial speech data is adjusted based on the at least one target dimension to obtain the speech simulation data.

7. The method according to claim 5, wherein: The acquiring of video simulation data based on the scene features of the target test scene includes: Based on the scene features of the target test scene, selecting a person video from a foreground video library; Based on the scene features of the target test scene, selecting a background video from a background database; The character video and the background video are fused to obtain the video simulation data.

8. The method according to claim 4, wherein: The step of acquiring external environment audio simulation data based on the scene features of the target test scene includes: Based on the scene characteristics of the target test scene, determining a target number of audio databases corresponding to the target test scene; Selecting audios to be fused from the target number of audio simulation databases respectively; The audio to be fused selected from the target number of audio simulation databases is fused to obtain the external environment audio simulation data.

9. The method according to any one of claims 1 to 8, wherein: The test result characterization data includes at least one of interface test data, pressure test data and performance test data.

10. The method according to claim 1, wherein: The sending the test data packet to the terminal device includes: When it is detected through the heartbeat detection mechanism that the service device and the terminal device maintain normal communication, the test data packet is sent to the terminal device.

11. The method according to claim 1 or 10, wherein: The sending the test data packet to the terminal device includes: Identify multiple devices to be tested; Each of the multiple devices under test is used as the terminal device, and the test data packet is sent to the terminal device.

12. The method according to claim 1, further comprising: Identify multiple candidate test scenarios; determining a test order for the plurality of candidate test scenarios; According to the test order, the target test scenario is selected from the multiple candidate test scenarios.

13. A testing method, applied to a terminal device; the method comprising: receiving a test data packet corresponding to a target test scenario; Based on the test data packet, running the target application to obtain test result representation data of the target application; Sending the test result characterization data to a service device; wherein the service device is used to receive the test result characterization data; Based on the test result characterization data, a test result of the target application is obtained.

14. The method according to claim 13, wherein: The target test scenario belongs to a conventional application scenario, and the test data packet includes a first test instruction; and running the target application based on the test data packet to obtain test result characterization data of the target application includes: According to the first test instruction, the target application is run to obtain test result representation data of the target application in the process of collecting real-time scene data by using the target application and processing the real-time scene data.

15. The method according to claim 13, wherein: The target test scenario belongs to a special application scenario, and the test data packet includes a second test instruction and special scenario data; The step of running the target application based on the test data packet to obtain test result representation data of the target application includes: The target application is run according to the second test instruction to obtain test result representation data of the target application in the process of using the target application to process the special scenario data.

16. The method according to any one of claims 13 to 15, wherein: The test result characterization data includes at least one of interface test data, pressure test data and performance test data.

17. A testing device, applied to a service device; the device comprising: A data generation unit, used to generate a test data packet corresponding to a target test scenario; A first data sending unit, configured to send the test data packet to a terminal device; wherein the terminal device is configured to run a target application based on the test data packet to obtain test result representation data of the target application; and send the test result representation data to the service device; A first data receiving unit, configured to receive the test result representation data; A test result acquisition unit is used to obtain the test result of the target application based on the test result characterization data.

18. The device according to claim 17, wherein: The data generating unit is used for: In the case where the target test scenario belongs to a conventional application scenario, a test data packet including a first test instruction is generated; wherein the first test instruction is used to instruct the terminal device to obtain test result representation data of the target application during the process of running the target application to collect real-time scenario data using the target application and processing the real-time scenario data; Alternatively, when the target test scenario belongs to a special application scenario, a test data packet including a second test instruction and special scenario data is generated; wherein the second test instruction is used to instruct the terminal device to obtain test result characterization data of the target application when running the target application to process the special scenario data using the target application.

19. The device according to claim 18, wherein: The data generating unit is used for: Acquire interactive simulation data and external environment audio simulation data; Fusing the interactive simulation data and the external environment audio simulation data to obtain the special scene data; Generate a test data packet including the second test instruction and the special scenario data.

20. The device according to claim 19, wherein The data generating unit is used for: Based on the basic functions of the target application and the scenario characteristics of the target test scenario, acquiring the interactive simulation data; And / or, based on the scene characteristics of the target test scene, the external environment audio simulation data is obtained.

21. The device according to claim 20, wherein: The data generating unit is used for: In the case where the basic functions of the target application include voice collection and processing functions, based on the scenario characteristics of the target test scenario, voice simulation data is acquired, and the voice simulation data is used as the interactive simulation data; Alternatively, when the basic functions of the target application include voice acquisition and processing functions, and video acquisition and processing functions, voice simulation data is acquired based on the scene characteristics of the target test scene, and video simulation data is acquired based on the scene characteristics of the target test scene, and the interactive simulation data is obtained based on the voice simulation data and the video simulation data.

22. The device according to claim 21, wherein The data generating unit is used for: Based on the scene characteristics of the target test scene, obtaining initial speech data; Selecting at least one target dimension from a plurality of sound attribute dimensions; wherein the plurality of sound attribute dimensions include at least one of timbre, volume, audio frequency and phase; The initial speech data is adjusted based on the at least one target dimension to obtain the speech simulation data.

23. The device according to claim 21, wherein The data generating unit is used for: Based on the scene features of the target test scene, selecting a person video from a foreground video library; Based on the scene features of the target test scene, selecting a background video from a background database; The character video and the background video are fused to obtain the video simulation data.

24. The device according to claim 20, wherein: The data generating unit is used for: Based on the scene characteristics of the target test scene, determining a target number of audio databases corresponding to the target test scene; Selecting audios to be fused from the target number of audio simulation databases respectively; The audio to be fused selected from the target number of audio simulation databases is fused to obtain the external environment audio simulation data.

25. The device according to any one of claims 17 to 24, wherein: The test result characterization data includes at least one of interface test data, pressure test data and performance test data.

26. The device according to claim 17, wherein: The first data sending unit is used for: When it is detected through the heartbeat detection mechanism that the service device and the terminal device maintain normal communication, the test data packet is sent to the terminal device.

27. The device according to claim 17 or 26, wherein: The first data sending unit is used for: Identify multiple devices to be tested; Each of the multiple devices under test is used as the terminal device, and the test data packet is sent to the terminal device.

28. The apparatus according to claim 17, further comprising a test scene selection unit, configured to: Identify multiple candidate test scenarios; Obtaining a test order for the plurality of candidate test scenarios; According to the test order, the target test scenario is selected from the multiple candidate test scenarios.

29. A testing device, applied to a terminal device; the device comprises: A second data receiving unit, configured to receive a test data packet corresponding to a target test scenario; A data processing unit, configured to run a target application based on the test data packet to obtain test result representation data on the target application; A second data sending unit, configured to send the test result characterization data to a service device; wherein the service device is configured to receive the test result characterization data; Based on the test result characterization data, a test result of the target application is obtained.

30. The device according to claim 29, wherein: The target test scenario belongs to a conventional application scenario, and the test data packet includes a first test instruction; and the data processing unit is used for: According to the first test instruction, the target application is run to collect real-time scene data using the target application, and in the process of processing the real-time scene data, test result representation data of the target application is obtained.

31. The device according to claim 29, wherein: The target test scenario belongs to a special application scenario, and the test data packet includes a second test instruction and special scenario data; and the data processing unit is used for: The target application is run according to the second test instruction to obtain test result representation data of the target application in the process of using the target application to process the special scenario data.

32. The device according to any one of claims 29 to 31, wherein: The test result characterization data includes at least one of interface test data, pressure test data and performance test data.

33. An electronic device comprising: at least one processor; a memory communicatively coupled to the at least one processor; The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can perform the method according to any one of claims 1 to 16.

34. An intelligent voice terminal, comprising an electronic device; wherein: The electronic device comprises: at least one processor; a memory communicatively coupled to the at least one processor; The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method according to any one of claims 13 to 16.

35. A non-transitory computer-readable storage medium storing computer instructions, wherein: The computer instructions are used to cause the computer to execute the method according to any one of claims 1 to 16.

36. A computer program product, comprising a computer program, which, when executed by a processor, implements the method according to any one of claims 1 to 16.

Images