Method, apparatus, storage medium, and electronic device for determining test results

Abstract

The present application discloses a method, apparatus, storage medium, and electronic device for determining a test result, relating to the technical field of smart homes. The method for determining the test result includes: determining a to-be-tested environment of a voice test device; obtaining one or more target noise types corresponding to the to-be-tested environment, and determining playback attributes of target noise data of the one or more target noise types, where the playback attributes at least include: a playback time interval corresponding to each target noise data; playing the target noise data of the one or more target noise types in the to-be-tested environment according to the playback attributes, and determining a test result of the voice test device in the to-be-tested environment. By adopting the above technical solution, the problem of how to accurately determine the test result of noise audio data in a test environment is solved.

Description

Technical Field

[0001] The present application relates to the technical field of smart homes, and in particular, to a method, device, storage medium, and electronic device for determining test results. Background Art

[0002] At present, with the rapid development of technology, our lives are filled with various intelligent devices all the time, such as mobile phones, computers, TVs, in-vehicle devices, etc. To make it more convenient for users, these devices basically come with intelligent voice functions. For example, in-vehicle devices can use voice to locate destinations, answer and hang up calls, and perform a series of operations while driving. Correspondingly, these devices will conduct system voice function tests before release, such as manual wake-up or wake-up recognition tests using a single automated script. However, this test scheme has a relatively single test environment, especially for complex usage scenarios such as vegetable markets, stations, and shopping malls, which cannot cover the complex usage environments that users often encounter, and there are also problems with inaccurate test results.

[0003] Therefore, in the related art, there is a technical problem of how to accurately determine the test results of noisy audio data in a test environment.

[0004] In view of the problems in the related art of how to accurately determine the test results of noisy audio data in a test environment, no effective solution has been proposed yet. Summary of the Invention

[0005] Embodiments of the present application provide a method, device, storage medium, and electronic device for determining test results, so as to at least solve the problem in the related art of how to accurately determine the test results of noisy audio data in a test environment.

[0006] According to an embodiment of the embodiments of the present application, a method for determining test results is provided, including: determining a test environment to be tested for a voice test device; obtaining one or more target noise types corresponding to the test environment to be tested, and determining playback attributes of target noise data of the one or more target noise types, where the playback attributes at least include: a playback time interval corresponding to each target noise data; playing the target noise data of the one or more target noise types in the test environment to be tested according to the playback attributes, and determining a test result of the voice test device in the test environment to be tested.

[0007] In an exemplary embodiment, before obtaining one or more target noise types corresponding to the environment to be tested, the method further includes: determining noise data corresponding to a plurality of environments to be tested respectively, where the attributes of the noise data include noise types, and the plurality of environments to be tested include the environment to be tested; when the target noise data of a plurality of target noise types are included in each environment to be tested, respectively determining the playback time intervals corresponding to the target noise data of the plurality of target noise types included in each environment to be tested; establishing a correspondence relationship among the plurality of environments to be tested, the target noise data of the plurality of target noise types, and the playback time intervals.

[0008] In an exemplary embodiment, when the target noise data of a plurality of target noise types are included in each environment to be tested, respectively determining the playback time intervals corresponding to the target noise data of the plurality of target noise types included in each environment to be tested includes: respectively determining the number of playback times corresponding to each target noise type according to the target noise types of the noise data in each environment to be tested; the target noise types include at least one of the following: a first type of noise type for identifying the environmental location of the environment to be tested, a second type of noise type for representing the noise object of the environment to be tested, and a third type of noise type for representing the irregular noise of the environment to be tested; determining the playback time interval corresponding to each target noise type according to the quotient of the test duration of each environment to be tested and the number of playback times corresponding to each target noise type.

[0009] In an exemplary embodiment, the method further includes: for each environment to be tested, when the target noise data of a plurality of target noise types are included in each environment to be tested, determining the playback priority corresponding to the target noise data of each target noise type according to the playback time interval of each target noise type in the plurality of target noise types, where the playback priority represents the playback order of the target noise data.

[0010] In an exemplary embodiment, playing the target noise data of the one or more target noise types in the environment to be tested according to the playback attribute includes: when the playback attribute includes a playback duration and a playback time interval, sorting the playback time intervals of the target noise data of the one or more target noise types to obtain a first sorting result; setting the playback duration of the target noise data of the one or more target noise types according to the first sorting result and a first correspondence relationship; where the first correspondence relationship represents the correspondence relationship between the sorting result of the preset playback time interval and the playback duration; playing the target noise data of the one or more target noise types in the environment to be tested according to the playback duration.

[0011] In an exemplary embodiment, playing the target noise data of one or more target noise types in the to-be-tested environment according to the playing attribute includes: when the playing attribute includes a playing volume and a playing time interval, sorting the playing time intervals of the target noise data of one or more target noise types to obtain a second sorting result; setting the playing volume of the target noise data of one or more target noise types according to the second sorting result and a second corresponding relationship; wherein, the second corresponding relationship represents the corresponding relationship between the sorting result of the preset playing time interval and the playing volume; playing the noise data of one or more target noise types in the to-be-tested environment according to the playing volume.

[0012] In an exemplary embodiment, playing the target noise data of one or more target noise types in the to-be-tested environment according to the playing attribute includes: when the playing attribute includes a playing angle and a playing time interval, sorting the playing time intervals of the target noise data of one or more target noise types to obtain a third sorting result; setting the playing angle of the target noise data of one or more target noise types according to the third sorting result and a third corresponding relationship; wherein, the third corresponding relationship represents the corresponding relationship between the sorting result of the preset playing time interval and the playing angle; playing the target noise data of one or more target noise types in the to-be-tested environment according to the playing angle.

[0013] According to another embodiment of the embodiments of the present application, there is also provided a device for determining a test result, including: a determining module, configured to determine a to-be-tested environment of a voice test device; a setting module, configured to obtain one or more target noise types corresponding to the to-be-tested environment, and determine a playing attribute of the target noise data of the one or more target noise types, wherein the playing attribute at least includes: a playing time interval corresponding to each target noise data; a playing module, configured to play the target noise data of the one or more target noise types in the to-be-tested environment according to the playing attribute, and determine a test result of the voice test device in the to-be-tested environment.

[0014] According to another aspect of the embodiments of the present application, there is also provided a computer-readable storage medium, in which a computer program is stored, wherein the computer program is configured to execute the above-mentioned method for determining a test result when running.

[0015] According to another aspect of the embodiments of the present application, there is also provided an electronic device, including a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein the above-mentioned processor executes the above-mentioned method for determining a test result through the computer program.

[0016] In an embodiment of the present application, a to-be-tested environment of a voice test device is determined; one or more noise types corresponding to the to-be-tested environment are obtained, and a playback attribute including at least a playback time interval corresponding to noise data of the one or more noise types is determined; the noise data of the one or more noise types is played in the to-be-tested environment according to the playback attribute, and a test result of the voice test device in the to-be-tested environment is determined; by adopting the above technical solution, the problem of how to accurately determine the test result of noise audio data in a test environment is solved, and thus the accuracy of the test result is improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] The accompanying drawings herein are incorporated into the specification and form a part of the specification, showing embodiments consistent with the present application, and are used together with the specification to explain the principles of the present application.

[0018] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the accompanying drawings required for use in the description of the embodiments or the prior art. Obviously, for those of ordinary skill in the art, other drawings can also be obtained based on these drawings without creative efforts.

[0019] Figure 1 is a schematic diagram of the hardware environment of a method for determining a test result according to an embodiment of the present application;

[0020] Figure 2 is a flowchart of a method for determining a test result according to an embodiment of the present application;

[0021] Figure 3 is a schematic diagram of the process of a method for determining a test result according to an embodiment of the present application;

[0022] Figure 4 is a schematic diagram of an implementation scenario of a method for determining a test result according to an embodiment of the present application;

[0023] Figure 5 is a structural block diagram of a device for determining a test result according to an embodiment of the present application. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0024] In order to enable those skilled in the art to better understand the solutions of the present application, the following will clearly and completely describe the technical solutions in the embodiments of the present application with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all of the embodiments. Based on the embodiments of the present application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present application.

[0025] It should be noted that the terms "first", "second", etc. in the description, claims and the above-mentioned drawings of the present application are used to distinguish similar objects, and do not necessarily describe a specific order or sequence. It should be understood that the data used in this way can be interchanged under appropriate circumstances, so that the embodiments of the present application described here can be implemented in an order other than those illustrated or described here. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product or device that includes a series of steps or units does not necessarily have to be limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or are inherent to these processes, methods, products or devices.

[0026] According to one aspect of the embodiments of the present application, a method for determining test results is provided. The method for determining test results is widely applied to whole-house intelligent digital control application scenarios such as Smart Home, smart home, smart home appliance ecosystem, IntelligenceHouse ecosystem, etc. Optionally, in this embodiment, the above-mentioned method for determining test results can be applied to, for example Figure 1 the hardware environment composed of the terminal device 102 and the server 104 as shown. As Figure 1 shown, the server 104 is connected to the terminal device 102 through a network, and can be used to provide services (such as application services, etc.) for the terminal or the client installed on the terminal. A database can be set up on the server or independently of the server to provide data storage services for the server 104. Cloud computing and / or edge computing services can be configured on the server or independently of the server to provide data operation services for the server 104.

[0027] The above-mentioned network can include, but is not limited to, at least one of the following: wired network, wireless network. The above-mentioned wired network can include, but is not limited to, at least one of the following: wide area network, metropolitan area network, local area network. The above-mentioned wireless network can include, but is not limited to, at least one of the following: WIFI (Wireless Fidelity), Bluetooth. The terminal device 102 is not necessarily limited to a PC, mobile phone, tablet computer, smart air conditioner, smart range hood, smart refrigerator, smart oven, smart stove, smart washing machine, smart water heater, smart washing equipment, smart dishwasher, smart projection device, smart TV, smart drying rack, smart curtain, smart audio and video, smart socket, smart speaker, smart sound box, smart fresh air device, smart kitchen and bathroom equipment, smart bathroom equipment, smart floor sweeping robot, smart window cleaning robot, smart mopping robot, smart air purification device, smart steam box, smart microwave oven, smart kitchen treasure, smart purifier, smart water dispenser, smart door lock, etc.

[0028] In this embodiment, a method for determining a test result is provided, which is applied to the above computer terminal. Figure 2 FIG. Figure 2 is a flowchart of a method for determining a test result according to an embodiment of the present application. The process includes the following steps:

[0029] Step S202: Determine the environment to be tested of the voice test device.

[0030] Step S204: Obtain one or more target noise types corresponding to the environment to be tested, and determine the playback attributes of the target noise data of the one or more target noise types. Wherein, the playback attributes at least include: the playback time interval corresponding to each target noise data.

[0031] Step S206: Play the target noise data of the one or more target noise types in the environment to be tested according to the playback attributes, and determine the test result of the voice test device in the environment to be tested.

[0032] Through the above steps, determine the environment to be tested of the voice test device; obtain one or more target noise types corresponding to the environment to be tested, and determine the playback attributes of the target noise data of the one or more target noise types. Wherein, the playback attributes at least include: the playback time interval corresponding to each target noise data; play the target noise data of the one or more target noise types in the environment to be tested according to the playback attributes, and determine the test result of the voice test device in the environment to be tested, which solves the problem of how to accurately determine the test result of the noise audio data in the test environment in the related art, and further improves the accuracy of the test result.

[0033] In an exemplary embodiment, before obtaining one or more noise types corresponding to the environment to be tested, a technical solution is also proposed. The specific steps include: determining the noise data corresponding to multiple environments to be tested respectively. Wherein, the attributes of the noise data include noise types, and the multiple environments to be tested include the environment to be tested; when each environment to be tested includes the target noise data of multiple target noise types, respectively determine the playback time intervals corresponding to the target noise data of the multiple target noise types included in each environment to be tested; establish a corresponding relationship among the multiple environments to be tested, the target noise data of the multiple target noise types, and the playback time intervals.

[0034] Among them, in the process of establishing the correspondence relationship among the multiple to-be-tested environments, the target noise data of the multiple target noise types, and the playback time intervals, the obtained noise data can be classified according to the data source to obtain an audio data table, and a test data table corresponding to different test environments can be generated according to the audio data table. The process of classifying the obtained noise data according to the data source to obtain an audio data table may include: classifying the obtained noise data according to the data source to obtain audio data of different environment types; processing the audio data of each environment type in the audio data of different environment types to obtain sub-audio data of different playback durations; generating the audio data table based on the sub-audio data of different playback durations and the environment types corresponding to the sub-audio data of different playback durations. In the case where the environmental audio data corresponding to the test scenario type is not obtained from the test data table, the environment type recreated by the technician for this test scenario type is obtained, and the corresponding environmental audio data is obtained.

[0035] In an exemplary embodiment, in order to better understand the specific process of separately determining the playback time intervals corresponding to the target noise data of the multiple target noise types included in each to-be-tested environment when there are multiple target noise types of target noise data in each to-be-tested environment, the following implementation steps are also proposed: according to the target noise types of the noise data in each to-be-tested environment, separately determine the playback times corresponding to each target noise type; the target noise types at least include one of the following: the first type of noise type for identifying the environmental location of the to-be-tested environment, the second type of noise type for representing the noise object of the to-be-tested environment, and the third type of noise type for representing the irregular noise of the to-be-tested environment; determine the playback time interval corresponding to each target noise type according to the quotient of the test duration of each to-be-tested environment and the playback times corresponding to each target noise type.

[0036] Among them, the playback times corresponding to the target noise types at least include one of the following: the first playback times corresponding to the first type of noise type, the second playback times corresponding to the second type of noise type, and the third playback times corresponding to the third type of noise type; the first playback times are less than the second playback times, and the second playback times are less than the third playback times.

[0037] It should be noted that, among them, the first type of noise type for identifying the environmental location of the to-be-tested environment can be set as the main noise, for example, the second type of noise type for representing the noise object of the to-be-tested environment can be set as the secondary noise, and the third type of noise type for representing the irregular noise of the to-be-tested environment can be set as the auxiliary noise, for example.

[0038] In an exemplary embodiment, further, in the process of playing the noise data of one or more noise types according to the playback attributes in the environment to be tested and determining the test result of the voice test device in the environment to be tested, for each environment to be tested, when there is target noise data of multiple target noise types in each environment to be tested, the playback priority corresponding to the target noise data of each target noise type may be determined according to the playback time interval of each target noise type in the multiple target noise types, where the playback priority represents the playback order of the target noise data.

[0039] In an exemplary embodiment, to better understand how to implement the process of playing the target noise data of one or more target noise types according to the playback attributes in the environment to be tested in step S206 above, the following technical solution is also proposed. The specific steps include: when the playback attributes include playback duration and playback time interval, sorting the playback time intervals of the target noise data of the one or more target noise types to obtain a first sorting result; setting the playback duration of the target noise data of the one or more target noise types according to the first sorting result and a first correspondence; where the first correspondence represents the correspondence between the sorting result of the preset playback time interval and the playback duration; playing the target noise data of the one or more target noise types in the environment to be tested according to the playback duration.

[0040] Among them, the playback duration of the noise data of the target noise type with the largest playback time interval may be set to the largest, and this application does not limit this.

[0041] In an exemplary embodiment, further, another technical solution for implementing playing the target noise data of one or more target noise types according to the playback attributes in the environment to be tested is also proposed, which specifically includes: when the playback attributes include playback volume and playback time interval, sorting the playback time intervals of the noise data of the one or more noise types to obtain a second sorting result; setting the playback volume of the noise data of the one or more noise types according to the second sorting result and a second correspondence; where the second correspondence represents the correspondence between the sorting result of the preset playback time interval and the playback volume; playing the target noise data of the one or more noise types in the environment to be tested according to the playback volume.

[0042] In an exemplary embodiment, to further illustrate the technical solution of playing the target noise data of one or more target noise types in the to-be-tested environment according to the playing attributes, the following implementation steps are proposed: When the playing attributes include a playing angle and a playing time interval, sort the playing time intervals of the target noise data of one or more target noise types to obtain a third sorting result; Set the playing angles of the target noise data of one or more target noise types according to the third sorting result and a third corresponding relationship; where the third corresponding relationship represents the corresponding relationship between the sorting result of the preset playing time interval and the playing angle; Play the target noise data of one or more target noise types in the to-be-tested environment according to the playing angle.

[0043] Through the above steps, the process of how to play the noise data of different noise types is realized through multiple solutions, which can simulate different complex usage scenarios, generate different environmental noises, and automate the performance data such as recognition rate and wake-up rate in the real usage scenario as much as possible, making the voice function inspection more real and effective, effectively evaluating the wake-up model and recognition model, reproducing the problems in the user usage scenario, and effectively improving the user usage effect.

[0044] To better understand the process of the above method for determining the test result, the following further describes the implementation method flow of the determination of the above test result in combination with optional embodiments, but it is not used to limit the technical solutions of the embodiments of the present application.

[0045] In this embodiment, a method for determining a test result is provided. Figure 3 It is a schematic diagram of the method for determining the test result according to the embodiment of the present application, as Figure 3 shown, and the specific steps are as follows:

[0046] Step S301: Collect environmental noises in life, classify the noises, and obtain a noise type table.

[0047] Specifically, step S301 further includes the following steps:

[0048] Step 1: Prepare environmental noises in life, classify them according to traffic noise, commercial activity noise, collective activity noise, decoration and renovation noise, entertainment venue noise, mechanical equipment noise, and ordinary home life noise, and process the noise into short-duration noise, medium-duration noise, and long-duration noise within 5 minutes, from 5 minutes to half an hour, and more than half an hour according to each type.

[0049] Step 2: Create a noise type table based on the classified noises above, including information such as noise duration and noise type, and upload and store the collected data according to the type.

[0050] Step S302: Obtain the noise type table according to the noise type table;

[0051] Specifically, step S302 further includes the following steps:

[0052] Step 1: According to the environment in which the intelligent device is used, set the main noise (equivalent to the above-mentioned first type of noise), secondary noise (equivalent to the above-mentioned second type of noise), auxiliary noise (equivalent to the above-mentioned third type of noise), etc. included in the environment, create a test environment table, and add the data to the database; for example, for a quiet living room next to a shopping mall and a quiet living room in the suburbs, the same quiet living room scenario can be distinguished by the main noise. The main noise of the quiet living room next to the shopping mall is commercial activity noise, and the secondary noise is traffic noise; while the main noise of the quiet living room in the suburbs is the sound of nature, and the secondary noise is the sound of TV entertainment.

[0053] Step 2: According to each test environment, set the noise types that need to exist (i.e., the above-mentioned target noise types), the interval duration of noise playback, and the interval times of each noise playback.

[0054] For example, in a shopping mall environment, the main noise is the noise of commercial activities and needs to be played continuously. The noise duration of the main noise can be set to a long duration, while the secondary noise during human conversation can be set to a medium duration, such as setting it to play for a period of time at an interval of 5 minutes. If there are also auxiliary noises such as traffic noise, the duration of the auxiliary noise can be set to a short duration, and the playback interval can be set to a long interval, playing once every 10 minutes.

[0055] Step S303: Start the test and determine the test environment: Run the test system program and select the usage scenario of the intelligent product to be simulated for testing. If the test environment exists, execute step S304; otherwise, if the test environment does not exist, execute step S305.

[0056] Step S304: When the scenario exists, the scenario can be directly selected by distinguishing the main noise, secondary noise, and auxiliary noise according to the actual scenario.

[0057] Step S305: Create a new test environment scenario when the scenario does not exist.

[0058] Step S306: Determine whether the noise data corresponding to the test environment (i.e., the above-mentioned target noise data) exists; if so, execute step S310; if not, execute step S307;

[0059] Step S307: Determine whether the noise data corresponding to the test environment exists; if so, execute step S310; if not, execute step S308;

[0060] Step S308: Create the type of noise data corresponding to the test environment; after creating a new test environment scenario, select the required noise type for the test environment.

[0061] In one embodiment, a new test environment name can be created and the data added to the corresponding database table. Continue to add the noise types included in the test environment. When the noise type exists, directly select and add it; when the noise type does not exist, a new noise type can be created.

[0062] Step S309: Back up the newly created data; after creating a new noise type, upload the corresponding noise data.

[0063] Specifically: create a new noise type name, add the data to the corresponding database table, and click to upload the audio data; after the audio data is successfully uploaded, save the settings and associate the data with the test environment corresponding to step 3.

[0064] Step S310: Save the noise data of the test environment to the database.

[0065] Step S311: Use the Adobe Audition software on the computer to select the noise playback channel.

[0066] Figure 4 It is a schematic diagram of the implementation scenario of the test result determination method according to the embodiment of the present application; in one embodiment, as Figure 4 shown, after selecting the angle at which the environmental noise in the test environment is played, install the Adobe Audition playback software on the computer, purchase a multi-channel sound card device, connect the computer to the sound card device, connect the sound card device to multiple audio output lines, and connect to a high-fidelity speaker. When performing an angle test, select the specific output audio line of the sound source according to the position of the high-fidelity speaker, and deploy the positions of different Genelec speakers; if no angle test is performed, the noise is played in the default order.

[0067] Step S312: Perform the voice test function: deploy the voice product to be tested, and start the test by running the automated test script or perform the voice function test manually.

[0068] Through the above steps, various noises in the natural environment are processed according to the scenarios in which the intelligent device is used by an automated script, and various noise types and noise durations in the scenarios in which the intelligent device is used are generated in the data table. Multiple scenarios in which the intelligent device is used can be generated according to the main noise, secondary noise, auxiliary noise, etc. of the usage environment. Test scenarios to be used can be added independently, or those already set in the database can be selected. According to the corresponding test scenarios, the main and secondary noise types of the test environment, the playback angles of different noise types, and the interval times at which the main and secondary noises are played can be set to form a variety of test environments. Through the above solution, performance tests such as intelligent recognition and voice recognition and voice wake-up in multiple scenarios can be covered, the wake-up model and recognition model can be effectively evaluated, problems in the user usage scenario can be reproduced, and the user usage effect can be effectively improved.

[0069] Through the description of the above embodiments, those skilled in the art can clearly understand that the method according to the above embodiments can be implemented by means of software plus a necessary general hardware platform. Of course, it can also be implemented by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, in essence, or the part that makes a contribution to the prior art, can be embodied in the form of a software product. The computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disc), and includes several instructions for causing a terminal device (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods of the various embodiments of the present application.

[0070] Figure 5 is a structural block diagram of a device for determining a test result according to an embodiment of the present application; as Figure 5 shown, it includes:

[0071] A determination module 52, configured to determine a test environment to be tested for a voice test device;

[0072] A setting module 54, configured to obtain one or more target noise types corresponding to the test environment to be tested, and determine playback attributes of target noise data of the one or more target noise types, where the playback attributes at least include: the playback time interval corresponding to each target noise data;

[0073] A playback module 56, configured to play the target noise data of the one or more target noise types in the test environment to be tested according to the playback attributes, and determine a test result of the voice test device in the test environment to be tested.

[0074] Through the above device, determine the environment to be tested of the voice test device; obtain one or more target noise types corresponding to the environment to be tested, and determine the playback attributes of the target noise data of the one or more target noise types, where the playback attributes at least include: the playback time intervals corresponding to the respective target noise data; play the target noise data of the one or more target noise types in the environment to be tested according to the playback attributes, and determine the test result of the voice test device in the environment to be tested, solving the problem in the related art of how to accurately determine the test result of the noise audio data in the test environment, thereby improving the accuracy of the test result.

[0075] In an exemplary embodiment, the above determination module 52 is further configured to determine the noise data corresponding to multiple environments to be tested respectively, where the attributes of the noise data include noise types, and the multiple environments to be tested include the environment to be tested; when there are target noise data of multiple target noise types in each environment to be tested, respectively determine the playback time intervals corresponding to the target noise data of the multiple target noise types included in each environment to be tested; establish a correspondence relationship among the multiple environments to be tested, the target noise data of the multiple target noise types, and the playback time intervals.

[0076] Among them, in the process of establishing the correspondence relationship among the multiple environments to be tested, the target noise data of the multiple target noise types, and the playback time intervals, the obtained noise data can be classified according to the data source to obtain an audio data table, and a test data table corresponding to different test environments can be generated according to the audio data table. The process of classifying the obtained noise data according to the data source to obtain an audio data table may include: classifying the obtained noise data according to the data source to obtain audio data of different environment types; processing the audio data of each environment type in the audio data of different environment types to obtain sub-audio data of different playback durations; generating the audio data table based on the sub-audio data of different playback durations and the environment types corresponding to the sub-audio data of different playback durations. In the case where the environmental audio data corresponding to the test scenario type is not obtained from the test data table, obtain the environment type re-created by the technician for this test scenario type, and obtain the corresponding environmental audio data.

[0077] In an exemplary embodiment, the determining module 52 is further configured to respectively determine the number of playbacks corresponding to each target noise type according to the target noise type of the noise data in each environment to be tested; the target noise type includes at least one of the following: a first type of noise type for identifying the environmental location of the environment to be tested, a second type of noise type for representing the noise object of the environment to be tested, and a third type of noise type for representing the irregular noise of the environment to be tested; and determine the playback time interval corresponding to each target noise type according to the quotient of the test duration of each environment to be tested and the number of playbacks corresponding to each target noise type.

[0078] It should be noted that, among them, the first type of noise type for identifying the environmental location of the environment to be tested may be set as the main noise, for example, the second type of noise type for representing the noise object of the environment to be tested may be set as the secondary noise, and the third type of noise type for representing the irregular noise of the environment to be tested may be set as the auxiliary noise, for example.

[0079] In an exemplary embodiment, for each environment to be tested, when the target noise data in the environment to be tested includes multiple target noise types, the determining module 52 is further configured to determine the playback priority corresponding to the target noise data of each target noise type according to the playback time interval of each target noise type in the multiple target noise types, where the playback priority represents the playback order of the target noise data.

[0080] In an exemplary embodiment, when the playback attribute includes a playback duration and a playback time interval, the playback module 56 is further configured to sort the playback time intervals of the target noise data of the one or more target noise types to obtain a first sorting result; set the playback durations of the target noise data of the one or more target noise types according to the first sorting result and a first corresponding relationship; where the first corresponding relationship represents the corresponding relationship between the sorting result of the preset playback time interval and the playback duration; and play the target noise data of the one or more target noise types in the environment to be tested according to the playback duration.

[0081] Among them, the playback duration of the noise data of the target noise type with the largest playback time interval may be set as the largest, and the present application does not limit this.

[0082] In an exemplary embodiment, the above-mentioned playback module 56 is further configured to, when the playback attributes include playback volume and playback time interval, sort the playback time intervals of the noise data of the one or more noise types to obtain a second sorting result; set the playback volume of the noise data of the one or more noise types according to the second sorting result and the second corresponding relationship; wherein, the second corresponding relationship represents the corresponding relationship between the sorting result of the preset playback time interval and the playback volume; play the target noise data of the one or more noise types in the to-be-tested environment according to the playback volume.

[0083] In an exemplary embodiment, the above-mentioned playback module 56 is further configured to, when the playback attributes include playback angle and playback time interval, sort the playback time intervals of the target noise data of the one or more target noise types to obtain a third sorting result; set the playback angle of the target noise data of the one or more target noise types according to the third sorting result and the third corresponding relationship; wherein, the third corresponding relationship represents the corresponding relationship between the sorting result of the preset playback time interval and the playback angle; play the target noise data of the one or more target noise types in the to-be-tested environment according to the playback angle.

[0084] Through the above device, the process of how to play the noise data of different noise types is realized through multiple solutions, different complex usage scenarios can be simulated, different environmental noises can be generated, and performance data such as recognition rate and wake-up rate in the real usage scenario can be realized as automated as possible, so that the voice function check can be more real and effective, the wake-up model and recognition model can be effectively evaluated, the problems in the user usage scenario can be reproduced, and the user usage effect can be effectively improved.

[0085] An embodiment of the present application further provides a storage medium, which includes a stored program, wherein the above program executes the method of any one of the above when running.

[0086] Optionally, in this embodiment, the above storage medium may be set to store program codes for executing the following steps:

[0087] S1, determine the to-be-tested environment of the voice test device;

[0088] S2, obtain one or more target noise types corresponding to the to-be-tested environment, and determine the playback attributes of the target noise data of the one or more target noise types, wherein the playback attributes at least include: the playback time interval corresponding to each target noise data;

[0089] S3. Play the target noise data of the one or more target noise types in the to-be-tested environment according to the playback attribute, and determine the test result of the voice test device in the to-be-tested environment.

[0090] An embodiment of the present application further provides an electronic device, including a memory and a processor. A computer program is stored in the memory, and the processor is configured to run the computer program to execute the steps in any one of the above method embodiments.

[0091] Optionally, the above electronic device may further include a transmission device and an input / output device. Among them, the transmission device is connected to the above processor, and the input / output device is connected to the above processor.

[0092] Optionally, in this embodiment, the above processor may be configured to execute the following steps through a computer program:

[0093] S1. Determine the to-be-tested environment of the voice test device;

[0094] S2. Obtain one or more target noise types corresponding to the to-be-tested environment, and determine the playback attribute of the target noise data of the one or more target noise types, where the playback attribute at least includes: the playback time interval corresponding to each target noise data;

[0095] S3. Play the target noise data of the one or more target noise types in the to-be-tested environment according to the playback attribute, and determine the test result of the voice test device in the to-be-tested environment.

[0096] Optionally, in this embodiment, the above storage medium may include, but is not limited to: various media such as a USB flash drive, a read-only memory (ROM), a random access memory (RAM), a mobile hard disk, a magnetic disk, or an optical disc that can store program codes.

[0097] Optionally, the specific examples in this embodiment may refer to the examples described in the above embodiments and optional implementation manners, and will not be elaborated herein.

[0098] Obviously, those skilled in the art should understand that the above-mentioned modules or steps of the present application can be implemented by a general-purpose computing device. They can be concentrated on a single computing device or distributed on a network composed of multiple computing devices. Optionally, they can be implemented by program codes executable by the computing device. Thus, they can be stored in a storage device and executed by the computing device. And in some cases, the steps shown or described can be executed in a sequence different from that here, or they can be separately fabricated into individual integrated circuit modules, or multiple modules or steps among them can be fabricated into a single integrated circuit module for implementation. In this way, the present application is not limited to any specific combination of hardware and software.

[0099] The above are only the preferred embodiments of the present application. It should be noted that for those of ordinary skill in the art, without departing from the principle of the present application, several improvements and modifications can still be made, and these improvements and modifications should also be regarded as the protection scope of the present application.

Claims

1. A method for determining test results, characterized in that, Including: Determine the environment to be tested of the voice test device; Obtain one or more target noise types corresponding to the environment to be tested, and determine the playback attributes of the target noise data of the one or more target noise types, wherein the playback attributes at least include: the playback time intervals corresponding to the respective target noise data; Play the target noise data of the one or more target noise types in the environment to be tested according to the playback attributes, and determine the test result of the voice test device in the environment to be tested; before obtaining the one or more target noise types corresponding to the environment to be tested, the method further includes: Determine the noise data corresponding to multiple environments to be tested respectively, wherein the attributes of the noise data include noise types, and the multiple environments to be tested include the environment to be tested; When the target noise data of multiple target noise types are included in each environment to be tested, respectively determine the playback time intervals corresponding to the target noise data of the multiple target noise types included in each environment to be tested; Establish the corresponding relationship among the multiple environments to be tested, the target noise data of the multiple target noise types, and the playback time intervals; The method further includes: classifying the obtained noise data according to the data source to obtain a noise data table, and generating a test data table corresponding to different test environments according to the noise data table. When the environmental noise data corresponding to the test scenario type is not obtained from the test data table, obtain the re-created environment type for the test scenario type and obtain the corresponding environmental noise data.

2. The method for determining the test result according to claim 1, wherein When the target noise data of multiple target noise types are included in each environment to be tested, respectively determine the playback time intervals corresponding to the target noise data of the multiple target noise types included in each environment to be tested, including: According to the target noise types of the noise data in each environment to be tested, respectively determine the playback times corresponding to each target noise type; the target noise types at least include one of the following: the first type of noise type for identifying the environmental location of the environment to be tested, the second type of noise type for representing the noise object of the environment to be tested, and the third type of noise type for representing the irregular noise of the environment to be tested; Determine the playback time interval corresponding to each target noise type according to the quotient of the test duration of each environment to be tested and the playback times corresponding to each target noise type.

3. The method for determining the test result according to claim 1, characterized in that The method further includes: for each environment to be tested, when the target noise data of multiple target noise types are included in the each environment to be tested, determine the playback priority corresponding to the target noise data of each target noise type according to the playback time interval of each target noise type in the multiple target noise types, wherein the playback priority represents the playback order of the target noise data.

4. The method for determining the test result according to any one of claims 1 to 3, characterized in that, Playing the target noise data of the one or more target noise types in the environment to be tested according to the playback attributes includes: When the playback attributes include the playback duration and the playback time interval, sort the playback time intervals of the target noise data of the one or more target noise types to obtain a first sorting result; set the playback durations of the target noise data of the one or more target noise types according to the first sorting result and a first correspondence relationship; wherein, the first correspondence relationship represents the correspondence relationship between the sorting result of the preset playback time interval and the playback duration. Play the target noise data of the one or more target noise types in the to-be-tested environment according to the playback duration.

5. The method for determining the test result according to any one of claims 1 to 3, characterized in that Playing the target noise data of the one or more target noise types in the to-be-tested environment according to the playback attributes includes: When the playback attributes include the playback volume and the playback time interval, sort the playback time intervals of the target noise data of the one or more target noise types to obtain a second sorting result; set the playback volumes of the target noise data of the one or more target noise types according to the second sorting result and a second correspondence relationship; wherein, the second correspondence relationship represents the correspondence relationship between the sorting result of the preset playback time interval and the playback volume. Play the target noise data of the one or more target noise types in the to-be-tested environment according to the playback volume.

6. The method for determining the test result according to any one of claims 1 to 3, characterized in that, Playing the target noise data of the one or more target noise types in the to-be-tested environment according to the playback attributes includes: When the playback attributes include the playback angle and the playback time interval, sort the playback time intervals of the target noise data of the one or more target noise types to obtain a third sorting result; set the playback angles of the target noise data of the one or more target noise types according to the third sorting result and a third correspondence relationship; wherein, the third correspondence relationship represents the correspondence relationship between the sorting result of the preset playback time interval and the playback angle. Play the target noise data of the one or more target noise types in the to-be-tested environment according to the playback angle.

7. An apparatus for determining a test result, characterized in that including: a determination module, configured to determine the to-be-tested environment of the voice test device; a setting module, configured to obtain one or more target noise types corresponding to the to-be-tested environment, and determine the playback attributes of the target noise data of the one or more target noise types, wherein the playback attributes at least include: the playback time interval corresponding to each target noise data; a playback module, configured to play the target noise data of the one or more target noise types in the to-be-tested environment according to the playback attributes, and determine the test result of the voice test device in the to-be-tested environment; The determination module is further configured to determine the noise data corresponding to multiple to-be-tested environments respectively, wherein the attributes of the noise data include the noise type, and the multiple to-be-tested environments include the to-be-tested environment. In the case where the target noise data of multiple target noise types are included in each environment to be tested, respectively determine the playback time intervals corresponding to the target noise data of the multiple target noise types included in each environment to be tested; establish a correspondence relationship among the multiple environments to be tested, the target noise data of the multiple target noise types, and the playback time intervals; and classify the obtained noise data according to the data source to obtain a noise data table, and generate a test data table corresponding to different test environments. In the case where the environmental noise data corresponding to the test scenario type is not obtained from the test data table, obtain the environmental type recreated for the test scenario type and obtain the corresponding environmental noise data.

8. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes a stored program, wherein the program, when running, executes the method described in any one of claims 1 to 6 above.

9. An electronic device, comprising a memory and a processor, characterized in that, A computer program is stored in the memory, and the processor is configured to execute the method described in any one of claims 1 to 6 through the computer program.

Images