Vehicle machine test method and device, electronic equipment and storage medium
By receiving test instructions in vehicle-machine testing and controlling the vehicle playback equipment to output matching audio information, and determining the recognition ability in combination with vehicle-machine feedback information, the problem of large differences between the test process and the actual application scenarios of users in the prior art is solved, and more reliable test results support is achieved.
Patent Information
- Application Number
- CN202510094760.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-01-21
- Publication Date
- 2025-04-29
AI Technical Summary
The process of voice interaction testing of CHJ in the prior art is quite different from the actual application scenarios of users, resulting in the inability to effectively support the actual experience of users.
By receiving the test command, the playback device of the vehicle controls outputs audio information matching the target test scene, including manual simulated voice commands and pre-recorded manual voice commands, and determines whether it can recognize the audio information based on the feedback information of the vehicle machine.
Through the test process corresponding to the target test scenario, the difference between the test process and the user's actual application scenario is reduced, so that the test results can more reliably support the user's actual experience.
Smart Images

Figure CN119905109A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of vehicle technology, and in particular to a vehicle computer testing method, device, electronic equipment and storage medium. Background Art
[0002] With the rapid development of the vehicle industry, voice interaction between vehicle computers and passengers has become an important part of vehicle design, and is constantly developing in a more intelligent, convenient and personalized direction. The voice interaction technology between vehicle computers and passengers covers multiple aspects such as speech recognition, semantic understanding, speech synthesis, multimodal interaction and intelligent voice assistants. Therefore, voice interaction testing is particularly important. Through reliable testing, the accuracy, stability and security of the voice interaction system can be ensured, thereby avoiding problems such as misrecognition, slow response or safety hazards during actual use.
[0003] At present, the test of voice interaction mainly uses simulated voice signals to input into the vehicle computer through the interface and test the voice interaction function of the vehicle computer. Directly inputting simulated voice signals into the vehicle computer through the interface is quite different from the actual application scenario of users, and the test results obtained cannot provide reliable support for the user's experience in actual application. Summary of the invention
[0004] The present application provides a vehicle computer testing method, device, electronic device and storage medium to at least solve the technical problem that the testing process in the related art is quite different from the actual application scenario of the user and cannot provide reliable support for the actual experience of the user. The technical solution of the present application is as follows:
[0005] According to a first aspect of the present application, a vehicle computer testing method is provided, comprising:
[0006] Receive a test instruction, the test instruction is used to test the voice command function of the vehicle computer in a target test scenario. In response to the test instruction, control the vehicle's playback device to output audio information matching the target test scenario. The audio information includes artificial simulated voice instructions and / or pre-recorded artificial voice instructions. Based on the feedback information of the vehicle computer, determine whether the vehicle computer can recognize the audio information.
[0007] According to the above technical means, the present application can determine the test process of the vehicle computer according to the target test scenario, and determine whether the vehicle computer can recognize audio information according to the feedback information of the vehicle computer. The test process corresponding to the target test scenario reduces the difference between the test process and the actual application scenario of the user, and the test results can provide reliable support for the actual user experience.
[0008] In a possible implementation, the target test scenario includes at least one of the following: a multi-zone voice command issuance scenario. The multi-zones are multiple different areas inside the vehicle where the vehicle computer is located. Voice commands include valid commands and / or invalid commands. Among them, valid commands are commands that can trigger the vehicle computer to perform operations, and invalid commands are commands that cannot trigger the vehicle computer to perform operations. A single-zone continuous voice command issuance scenario. A voice command and noise output scenario. The voice command and noise come from different sound zones respectively. A multi-zone noise output scenario. A single-zone mixed voice command issuance scenario. Mixed commands include valid commands and invalid commands.
[0009] According to the above technical means, the present application can perform different tests on the vehicle computer that conform to the preset target test scenario through the preset target test scenario, thereby obtaining test data for each target test scenario, making the test data more reliable and the test process more diversified.
[0010] In a possible implementation, the vehicle's playback device includes multiple playback devices, and the multiple playback devices are arranged in different sound zones of the vehicle. The target test scenario issues instructions for the abnormal sound zone, and controls the vehicle's playback device to output audio information matching the target test scenario, including: controlling the first playback device to output audio information for waking up the vehicle computer. The first playback device is any one of the multiple playback devices. After waking up the vehicle computer, control at least one playback device among the multiple playback devices except the first playback device to output audio information containing valid instructions.
[0011] Based on the above technical means, the present application can provide a complete test process for the scenario of issuing instructions in the abnormal sound zone, enrich the vehicle computer test method, and make the vehicle computer test method more targeted.
[0012] In a possible implementation, the target test scenario is to issue multiple rounds of commands in the same voice zone, and control the vehicle's playback device to output audio information matching the target test scenario, including: controlling the first playback device to output audio information for waking up the vehicle computer. After waking up the vehicle computer, controlling the first playback device to output audio information containing multiple valid commands.
[0013] Based on the above technical means, the present application can provide a complete testing process for the scenario of issuing multiple rounds of instructions in the same pronunciation zone, enrich the vehicle computer testing method, and make the vehicle computer testing method more targeted.
[0014] In a possible implementation, the target test scenario is a voice command and noise output scenario, and controlling the vehicle's playback device to output audio information matching the target test scenario includes: controlling the first playback device to output audio information for waking up the vehicle computer. After waking up the vehicle computer, controlling one or more playback devices to output audio information containing invalid commands.
[0015] Based on the above technical means, the present application can provide a complete testing process for voice command and noise output scenarios, enrich the vehicle computer testing method, and make the vehicle computer testing method more targeted.
[0016] In one possible implementation, the target test scenario is a multi-zone noise output scenario, and the vehicle's playback device is controlled to output audio information matching the target test scenario, including: controlling one or more playback devices to output audio information containing invalid instructions.
[0017] Based on the above technical means, the present application can provide a complete testing process for multi-zone noise output scenarios, enrich the vehicle computer testing method, and make the vehicle computer testing method more targeted.
[0018] In a possible implementation, the target test scenario is a scenario where a mixed voice command is issued in a single tone zone, and the playback device of the vehicle is controlled to output audio information matching the target test scenario, including: controlling the first playback device to output audio information for waking up the vehicle computer. After waking up the vehicle computer, controlling the first playback device to output audio information containing at least one valid command and at least one invalid command.
[0019] Based on the above technical means, the present application can provide a complete test process for the scenario of issuing mixed voice commands in a single tone zone, enrich the vehicle computer test method, and make the vehicle computer test method more targeted.
[0020] In a possible implementation, the feedback information of the vehicle computer is compared with the preset feedback information to obtain a comparison result; and according to the comparison result, it is determined whether the vehicle computer can recognize the audio information.
[0021] According to the above technical means, the present application can determine whether the vehicle computer can recognize the audio information according to the comparison between the feedback information and the preset information. Based on multiple target test scenarios, a specific unified test process is provided.
[0022] In a possible implementation, the feedback information includes at least one of the following: text information generated by the vehicle computer in response to a voice command; TTS broadcast information output by the vehicle computer in response to a voice command; image information displayed by the vehicle computer in response to a voice command.
[0023] According to the above technical means, the present application can provide multiple feedback information, and the multiple feedback information increases the test scope of the vehicle computer testing method, making the vehicle computer testing method more comprehensive.
[0024] According to a second aspect provided by the present application, a vehicle computer testing device is provided, including an acquisition unit and a determination unit.
[0025] An acquisition unit, used for receiving a test instruction, where the test instruction is used for testing the voice command function of the vehicle computer in a target test scenario;
[0026] A determination unit, configured to control a playback device of the vehicle to output audio information matching a target test scenario in response to a test instruction; the audio information includes an artificial simulated voice instruction and / or a pre-recorded artificial voice instruction;
[0027] The determination unit is further used to determine whether the vehicle computer can recognize the audio information based on the feedback information of the vehicle computer.
[0028] In a possible implementation, the target test scenario includes at least one of the following: a multi-zone voice command issuance scenario. The multi-zones are multiple different areas inside the vehicle where the vehicle computer is located. Voice commands include valid commands and / or invalid commands. Among them, valid commands are commands that can trigger the vehicle computer to perform operations, and invalid commands are commands that cannot trigger the vehicle computer to perform operations. A single-zone continuous voice command issuance scenario. A voice command and noise output scenario. The voice command and noise come from different sound zones respectively. A multi-zone noise output scenario. A single-zone mixed voice command issuance scenario. Mixed commands include valid commands and invalid commands.
[0029] In one possible implementation, the vehicle's playback device includes multiple playback devices, and the multiple playback devices are arranged in different sound zones of the vehicle. The target test scenario is to issue instructions in the abnormal sound zone. The determination unit is specifically used to control the first playback device to output audio information for waking up the vehicle computer. The first playback device is any one of the multiple playback devices. After waking up the vehicle computer, the determination unit is also used to control at least one playback device among the multiple playback devices except the first playback device to output audio information containing valid instructions.
[0030] In a possible implementation, the target test scenario is to issue multiple rounds of instructions in the same voice zone, and the determination unit is also used to control the vehicle's playback device to output audio information matching the target test scenario, including: the determination unit is also used to control the first playback device to output audio information for waking up the vehicle computer. After waking up the vehicle computer, the determination unit is also used to control the first playback device to output audio information containing multiple valid instructions.
[0031] In a possible implementation, the target test scenario is a voice command and noise output scenario, and the determination unit is further used to control the vehicle's playback device to output audio information matching the target test scenario, including: the determination unit is further used to control the first playback device to output audio information for waking up the vehicle computer. After waking up the vehicle computer, the determination unit is further used to control one or more playback devices to output audio information containing invalid commands.
[0032] In a possible implementation, the target test scenario is a multi-zone noise output scenario, and the determination unit is specifically used to control one or more playback devices to output audio information containing invalid instructions.
[0033] In a possible implementation, the target test scenario is a scenario where a mixed voice command is issued in a single tone zone, and the determination unit is further used to control the playback device of the vehicle to output audio information matching the target test scenario, including: the determination unit is further used to control the first playback device to output audio information for waking up the vehicle computer. After waking up the vehicle computer, the determination unit is further used to control the first playback device to output audio information containing at least one valid command and at least one invalid command.
[0034] In a possible implementation, the feedback information of the vehicle computer is compared with the preset feedback information to obtain a comparison result; and according to the comparison result, it is determined whether the vehicle computer can recognize the audio information.
[0035] In a possible implementation, the feedback information includes at least one of the following: text information generated by the vehicle computer in response to a voice command; TTS broadcast information output by the vehicle computer in response to a voice command; image information displayed by the vehicle computer in response to a voice command.
[0036] According to the third aspect provided by the present application, an electronic device is provided, comprising: a processor; a memory for storing processor executable instructions; wherein the processor is configured to execute instructions to implement the method of the above-mentioned first aspect and any possible implementation manner thereof.
[0037] According to the fourth aspect provided by the present application, a computer-readable storage medium is provided. When the instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the method in the above-mentioned first aspect and any possible implementation method thereof.
[0038] According to the fifth aspect provided by the present application, a computer program product is provided, the computer program product comprising computer instructions, and when the computer instructions are executed on an electronic device, the electronic device executes the method of the above-mentioned first aspect and any possible implementation manner thereof.
[0039] It should be noted that the technical effects brought about by any implementation method in the second to fifth aspects can refer to the technical effects brought about by the corresponding implementation method in the first aspect, and will not be repeated here.
[0040] It should be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present application. BRIEF DESCRIPTION OF THE DRAWINGS
[0041] The drawings herein are incorporated into the specification and constitute a part of the specification, illustrate embodiments consistent with the present application, and together with the specification are used to explain the principles of the present application, and do not constitute an improper limitation on the present application.
[0042] Figure 1 is a structural schematic diagram of a vehicle computer test system according to an exemplary embodiment;
[0043] Figure 2 is a structural schematic diagram of another vehicle computer test system according to an exemplary embodiment;
[0044] Figure 3 is a flow chart of a vehicle computer testing method according to an exemplary embodiment;
[0045] Figure 4 is a flow chart of another vehicle computer testing method according to an exemplary embodiment;
[0046] Figure 5 is a block diagram of a vehicle computer testing device according to an exemplary embodiment;
[0047] Figure 6 It is a block diagram of an electronic device according to an exemplary embodiment. DETAILED DESCRIPTION
[0048] In order to enable ordinary persons in the art to better understand the technical solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the accompanying drawings.
[0049] It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. On the contrary, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the attached claims.
[0050] At present, the test of voice interaction mainly uses simulated voice signals to input into the vehicle computer through the interface and test the voice interaction function of the vehicle computer. Directly inputting simulated voice signals into the vehicle computer through the interface is quite different from the actual application scenario of users, and the test results obtained cannot provide reliable support for the user's experience in actual application.
[0051] In view of this, an embodiment of the present application provides a vehicle computer testing method to at least solve the technical problem that the testing process in the related technology is quite different from the user's actual application scenario and cannot provide reliable support for the user's actual experience.
[0052] In one example, Figure 1 As shown, a vehicle computer test system provided by the present application is provided. The vehicle computer test system may include a vehicle computer, multiple artificial mouths, multiple microphones, a host computer, and a pickup. The vehicle computer, multiple artificial mouths, multiple microphones, a host computer, and a pickup are communicatively connected.
[0053] Among them, multiple artificial mouths correspond to multiple microphones one by one, and multiple different sound zones can be set by the positions of multiple artificial mouths in the vehicle, for example, the main driver's sound zone, the co-driver's sound zone, and the rear sound zone. There are distance restrictions between multiple sound zones, so as to fully eliminate the interference of noise and sound sources in different sound zones. It should be noted that the number of artificial mouths, microphones, and sound zones is not limited and can be set according to the needs of the target test scenario. The following is an introduction using three sound zones as an example.
[0054] The vehicle computer can be used to respond to the audio information output by the artificial mouth and display the text information of the recognized audio information on the screen. It can also be used to execute the operation corresponding to the valid instruction contained in the audio information. It can also be used to generate and play the TTS broadcast according to the execution status of the operation. It can also be used to display the execution result of the instruction corresponding to the audio information on the screen.
[0055] An artificial mouth that can be used to output audio information.
[0056] A microphone can be used to receive audio information output by the artificial mouth.
[0057] The host computer can be used to generate artificial simulated voice commands based on pre-recorded artificial voice commands. It can also be used to run automated test software to perform automated tests on the vehicle computer. It can also be used to perform semantic recognition on the TTS broadcast of the vehicle computer, and compare the semantics of the TTS broadcast with the semantics of the preset TTS broadcast corresponding to the audio information to obtain the TTS broadcast test results. It can also be used to provide audio information to the artificial mouth.
[0058] In one possible implementation, the host computer may be deployed with one or more artificial intelligence models, through which the semantic recognition of TTS broadcasts and the generation of artificially simulated voice commands can be realized.
[0059] The microphone can be used to record the TTS broadcast of the car computer.
[0060] In another example, Figure 2As shown, a vehicle computer test system provided by an embodiment of the present application is provided. The vehicle computer test system is deployed inside the vehicle, including a vehicle computer, a host computer, and automated test software deployed in the host computer, a pickup, an artificial mouth, and an in-vehicle power supply. The artificial mouth is deployed on the main driver's seat, which is a deployment method of a vehicle computer test system with a single tone zone.
[0061] Among them, the car computer, artificial mouth, automated test software, and microphone have the same functions as the above equipment. The power supply in the car is used to power the artificial mouth and the host computer.
[0062] It should be noted that the actions, terms, etc. involved in the various embodiments of the present application can refer to each other without limitation. The message name or parameter name in the message exchanged between the various devices in the embodiments of the present application is only an example, and other names can also be used in the specific implementation without limitation.
[0063] The domain name processing method provided in the embodiment of the present application is described below in conjunction with the accompanying drawings. Among them, the actions, terms, etc. involved in the various embodiments of the present application can refer to each other without limitation. The message name or parameter name in the message exchanged between the various devices in the embodiment of the present application is only an example, and other names can also be used in the specific implementation without limitation. The actions involved in the various embodiments of the present application are only an example, and other names can also be used in the specific implementation, such as: "included in" in the embodiment of the present application can also be replaced by "carried on" or "carried in", etc.
[0064] For ease of understanding, the vehicle computer testing method provided in this application is specifically introduced below with reference to the accompanying drawings.
[0065] Figure 3 is a flow chart of a vehicle computer testing method according to an exemplary embodiment. Figure 3 As shown, the vehicle computer testing method includes: S301 to S303.
[0066] S301, receiving a test instruction.
[0067] Among them, the test command is used to test the voice command function of the vehicle computer in the target test scenario. The target test scenarios include multi-tone zone voice command issuance scenarios, single-tone zone continuous voice command issuance scenarios, voice command and noise output scenarios, multi-tone zone noise output scenarios, and single-tone zone mixed voice command issuance scenarios. Please refer to the descriptions of scenarios 1 to 5 for details. Multi-tone zones are multiple different areas inside the vehicle where the vehicle computer is located. Voice commands include valid commands and / or invalid commands. Valid commands are commands that can trigger the vehicle computer to perform operations, and invalid commands are commands that cannot trigger the vehicle computer to perform operations. Valid commands include control commands and interactive commands.
[0068] Scenario 1: Multi-zone voice command issuance scenario.
[0069] Among them, the multi-zone voice command issuance scenario may refer to: the artificial mouth in one zone outputs the command to wake up the vehicle computer, and the artificial mouth in another zone outputs audio information including effective commands.
[0070] Scenario 2: Continuous voice commands are issued in a single tone area.
[0071] Among them, the scenario of issuing continuous voice commands in a single tone zone may refer to: an artificial mouth in one tone zone outputs a command to wake up the vehicle computer, and after waking up the vehicle computer, continuously outputs multiple audio information including multiple valid commands.
[0072] Scenario 3: Voice command and noise output scenario.
[0073] Among them, the voice command and noise output scenario may refer to: an artificial mouth in one sound zone outputs a command to wake up the vehicle computer, and after waking up the vehicle computer, the artificial mouths in other one or more sound zones output audio information including invalid commands.
[0074] Scenario 4: Multi-zone noise output scenario.
[0075] The multi-zone noise output scenario may refer to: an artificial mouth in multiple zones outputs audio information containing invalid instructions.
[0076] Scenario 5: Scenario where mixed voice commands are issued in a single tone area.
[0077] Among them, the scenario of issuing mixed voice commands in a single tone zone may refer to: an artificial mouth in one tone zone outputs audio information containing valid commands and invalid commands.
[0078] S302: In response to the test instruction, control the playback device of the vehicle to output audio information matching the target test scenario.
[0079] The vehicle's playback device includes multiple playback devices, which are arranged in different sound zones of the vehicle. The playback device may be a device such as a speaker or an artificial mouth for playing audio information. The artificial mouth is used as an example for explanation below. The audio information includes artificial simulated voice instructions and / or pre-recorded artificial voice instructions. The artificial simulated voice instructions may be generated by an artificial intelligence model based on pre-recorded artificial voice instructions.
[0080] In one example, the host computer controls one or more artificial mouths to send out one or more audio information. The vehicle computer can obtain the audio information through the microphone corresponding to the artificial mouth, and perform voice recognition, command execution, and TTS broadcast based on the instructions contained in the content of the audio information.
[0081] The audio information can be obtained from the corpus list. The corpus list is used to store multiple audio information, as well as preset text information, preset TTS broadcast, and preset instruction execution images corresponding to the audio information.
[0082] In one application scenario, the audio message is "Turn on the air conditioner". The preset text message is "Turn on the air conditioner", the preset TTS broadcast is "The air conditioner is turned on", "OK", etc., which are used to answer the audio message, and the preset instruction execution image is an image of the air conditioner switch state being turned on.
[0083] In another example, the host computer determines that one or more artificial mouths among the plurality of artificial mouths output audio information matching the target test scene according to the target test scene, and performs the test of the target test scene. For details, refer to the description of the second embodiment, which will not be repeated here.
[0084] S303: Based on the feedback information from the vehicle computer, determine whether the vehicle computer can recognize the audio information.
[0085] Among them, the feedback information includes text information, TTS broadcast information, and image information. Whether the car computer can recognize audio information indicates whether the car computer can make a satisfactory response for different target test scenarios. A satisfactory response indicates whether the car computer can correctly respond to the audio information, whether the car computer can correctly execute the effective instructions of the audio information, and whether the car computer can generate a TTS broadcast in response to the audio information.
[0086] In one example, the host computer compares the feedback information of the vehicle computer with the preset information to determine whether the vehicle computer can recognize the audio information. The preset information includes preset text information, preset TTS broadcast information, and preset image information. The host computer determines whether the vehicle computer is correctly awakened and whether the instructions contained in the audio information are successfully executed by obtaining the image information of the vehicle computer screen. The host computer determines whether the vehicle computer correctly recognizes the content of the audio information by comparing the obtained text information with the preset text information. The host computer determines whether the vehicle computer generates a correct TTS broadcast by comparing the obtained TTS broadcast information with the preset TTS broadcast.
[0087] Among them, the preset information can be saved in the corpus list. The corpus list includes audio information and preset information corresponding to the audio information. The image of the car screen can be obtained through the ADB screen projection tool. The ADB screen projection tool can obtain the screen image of the car and can also perform click operations. For details, refer to the existing technology. The TTS broadcast can be obtained through an audio recording device. The audio recording device can be a microphone, a recorder, or other device that can record audio.
[0088] In an application scenario, such as Figure 4As shown, the automated test software deployed on the host computer sends the audio information of "turn on the air conditioner" to the artificial mouth. The host computer controls the artificial mouth to output the audio information used to wake up the car computer, obtains the image displayed on the car computer screen through the ADB screen projection tool, and identifies whether the image contains content used to indicate that the car computer has been awakened. For example, there is a pop-up window of the car computer wizard on the car computer screen. If the car computer has been awakened, the car computer wake-up test result is a successful awakening. The host computer controls the artificial mouth to output the audio information of "turn on the air conditioner". The host computer obtains the text information converted from the audio information displayed in the image of the car computer screen through the ADB screen projection tool. The text information is "turn on the air conditioner", which is the same as the preset text information, so the speech recognition test result is correct recognition. The host computer records the audio of the TTS broadcast through the microphone. The audio content is "the air conditioner is turned on", which is the same as the preset TTS broadcast semantics, so the TTS broadcast test result is semantically correct.
[0089] Furthermore, the host computer obtains the image used to display the status of the air-conditioning switch on the vehicle screen through the ADB screen projection tool. The air-conditioning switch in the image is in the on state, which is the same as the preset image, so the command execution test result is successful execution.
[0090] According to the above technical means, the present application can determine the test process of the vehicle computer according to the target test scenario, and determine whether the vehicle computer can recognize audio information according to the feedback information of the vehicle computer. The test process corresponding to the target test scenario narrows the difference between the test process and the actual application scenario of the user, so that the data of the test results can provide data support for the user experience.
[0091] In another embodiment (embodiment 2), a vehicle computer testing method is provided for the embodiment of the present application, which is used to control one or more artificial mouths to output one or more audio information according to the target test scenario, so as to simulate the target test scenario in the test process. According to different target test scenarios, the method includes cases 1 to 5.
[0092] Case 1: The target test scenario is a multi-zone voice command issuance scenario.
[0093] In one example, the host computer controls the first playback device to output audio information for waking up the vehicle computer. The first playback device is any one of a plurality of playback devices. After waking up the vehicle computer, the host computer controls at least one playback device among the plurality of playback devices except the first playback device to output audio information containing valid instructions.
[0094] In one application scenario, the host computer controls the artificial mouth of the main driver's voice zone to output audio information for waking up the vehicle computer. After waking up the vehicle computer, the host computer controls the artificial mouth of the co-driver's voice zone and / or the rear voice zone to output audio information containing valid instructions, for example, the output audio information is "Open the sunroof." This simulates a scenario where multiple people give instructions.
[0095] Case 2: The target test scenario is a scenario where continuous voice commands are issued in a single tone area.
[0096] In one example, the host computer controls the first playback device to output audio information for waking up the vehicle computer. After waking up the vehicle computer, the host computer controls the first playback device to output audio information containing multiple valid instructions.
[0097] In one application scenario, the host computer controls the artificial mouth in the main driving audio zone to output audio information for waking up the vehicle computer. After waking up the vehicle computer, the host computer controls the artificial mouth in the main driving audio zone to output audio information containing multiple valid commands, for example, the output audio information is "turn on the air conditioner, play music, lock the car door, close the car window." This simulates the scenario of issuing commands continuously.
[0098] Case 3: The target test scenario is the voice command and noise output scenario.
[0099] In one example, the host computer controls the first playback device to output audio information for waking up the vehicle computer. After waking up the vehicle computer, the host computer controls one or more playback devices to output audio information containing invalid instructions.
[0100] In one application scenario, the host computer controls the artificial mouth of the main driving audio zone to output audio information for waking up the car computer. After waking up the car computer, the host computer controls the artificial mouths of the main driving audio zone, the co-pilot audio zone, and the rear audio zone to output audio information containing invalid instructions. For example, the output audio information is "Where are we going to eat today?" "Let's have hot pot." "Okay." This simulates a scene of multiple people talking.
[0101] Case 4: The target test scenario is a multi-zone noise output scenario.
[0102] In one example, the host computer controls one or more playback devices to output audio information containing invalid instructions.
[0103] In one application scenario, the host computer controls the artificial mouths of the main driver's audio zone and the co-driver's audio zone to output audio information containing invalid commands. For example, the output audio information is "Where are we going to eat today?" "Let's eat hot pot." This simulates a scenario of non-interactive intention dialogue.
[0104] Case 5: The target test scenario is a scenario where mixed voice commands are issued in a single tone area.
[0105] In one example, the host computer controls the first playback device to output audio information for waking up the vehicle computer. After waking up the vehicle computer, the host computer controls the first playback device to output audio information including at least one valid instruction and at least one invalid instruction.
[0106] In one application scenario, the host computer controls the artificial mouth of the main driving audio zone to output audio information for waking up the vehicle computer. After waking up the vehicle computer, the host computer controls the artificial mouth of the main driving audio zone to output audio information containing at least one valid command and at least one invalid command, for example, "The weather is good today, open the sunroof.", thereby realizing a mixed interaction scenario. Among them, "The weather is good today." is an invalid command, and "Open the sunroof." is a valid command.
[0107] Based on the above-mentioned technical means, the present application can specify the test to multiple target test scenarios, enrich the scenarios covered by the vehicle computer test method, and make the test process more targeted.
[0108] In another embodiment (Embodiment 3), a vehicle computer test method is provided for the embodiment of the present application, which is used to obtain feedback information from the vehicle computer and determine whether the vehicle computer can recognize audio information according to the feedback information. According to different target test scenarios, the method includes Case 1 to Case 5.
[0109] Case 1: The target test scenario is one of the multi-tone zone voice command issuing scenarios and the single-tone zone continuous voice command issuing scenarios.
[0110] In one example, the host computer obtains the image displayed on the car computer screen through the ADB screen projection tool, compares it with the preset image, and obtains the car computer wake-up test result. When it is determined that the car computer is successfully awakened and the artificial mouth outputs audio information containing valid instructions, the host computer obtains the text information converted from the audio information displayed in the image displayed on the car computer screen through the ADB screen projection tool, and compares it with the preset text information to obtain the speech recognition test result. When the car computer outputs a TTS broadcast, the host computer records the TTS broadcast through a microphone, analyzes the semantics of the TTS broadcast and compares it with the semantics of the preset TTS broadcast to obtain the TTS broadcast test result. After obtaining the TTS broadcast test result, the host computer obtains the image used to display the switch status of the in-vehicle equipment on the car computer screen through the ADB screen projection tool, compares it with the preset image, and obtains the instruction execution test result.
[0111] Among them, the vehicle computer wake-up test results, voice recognition test results, TTS broadcast test results, and command execution test results in this scenario can indicate whether the vehicle computer can be correctly woken up, whether the vehicle computer can correctly recognize audio information, whether the vehicle computer can correctly execute multiple valid commands, and whether the vehicle computer can correctly respond to or not respond to commands in audio zones other than the audio zone that wakes up the vehicle computer.
[0112] It should be noted that, when the target test scenario is a multi-zone voice command issuance scenario, it can be determined according to demand whether the vehicle computer needs to respond to audio information of a sound zone other than the sound zone for waking up the vehicle computer.
[0113] Case 2: The target test scenario is the voice command and noise output scenario.
[0114] In one example, the host computer obtains the image displayed on the vehicle screen through the ADB projection tool, compares it with the preset image, and obtains the vehicle wake-up test result. The host computer obtains the text information converted from the audio information displayed in the image displayed on the vehicle screen through the ADB projection tool, and compares it with the preset text information to obtain the speech recognition test result. The speech recognition test result in this scenario can characterize the vehicle's ability to reject recognition.
[0115] Among them, the rejection capability refers to the ability of the vehicle computer to identify and filter invalid commands. When the user interacts with the vehicle computer, the vehicle computer needs to accurately judge the intention of the person in the vehicle and distinguish between valid and invalid commands among multiple commands from the person in the vehicle.
[0116] Case 3: The target test scenario is a multi-zone noise output scenario.
[0117] In one example, the host computer obtains the image displayed on the car computer screen through the ADB screen projection tool, determines whether the car computer is successfully awakened, and obtains the car computer wake-up test result. The speech recognition test result in this scenario can represent the anti-recognition ability of the car computer.
[0118] Case 4: The target test scenario is a scenario where mixed voice commands are issued in a single tone area.
[0119] In one example, the host computer obtains the image displayed on the car computer screen through the ADB screen projection tool, determines whether the car computer is successfully awakened, and obtains the car computer wake-up test result. When it is determined that the car computer is successfully awakened and the artificial mouth outputs audio information containing valid instructions, the host computer obtains the text information converted from the audio information displayed in the image displayed on the car computer screen through the ADB screen projection tool, determines whether the audio information is correctly recognized, and obtains the speech recognition test result. When the car computer outputs TTS broadcast, the host computer records the TTS broadcast through the microphone, determines whether the semantics of the TTS broadcast is correct, and obtains the TTS broadcast test result. After obtaining the TTS broadcast test result, the host computer obtains the image used to display the switch status of the in-vehicle equipment on the car computer screen through the ADB screen projection tool, determines whether the instruction is successfully executed, and obtains the instruction execution test result. The speech recognition test results, TTS broadcast test results, and instruction execution test results in this scenario can indicate whether the car computer can correctly recognize the valid instructions in the audio information and exclude invalid instructions.
[0120] Furthermore, the host computer may count multiple vehicle computer wake-up test results in multiple scenarios, and determine the wake-up rate according to the multiple vehicle computer wake-up test results.
[0121] According to the above technical means, the present application can formulate different test processes for multiple target test scenarios, and through multiple test results, it can be determined whether the performance of the vehicle computer in multiple target test scenarios meets the expected standards. Formulating different test processes for multiple scenarios can make the test results provide a higher reference value for the user's actual car experience.
[0122] The above mainly introduces the solution provided by the embodiment of the present application from the perspective of the method. In order to realize the above functions, the vehicle-mounted test device or electronic device includes hardware structures and / or software modules corresponding to the execution of each function. Those skilled in the art should easily realize that, in combination with the units and algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of this application.
[0123] The embodiments of the present application can exemplarily divide the functional modules of the vehicle test device or the electronic device according to the above method. For example, the vehicle test device or the electronic device can include various functional modules corresponding to the various functional divisions, or two or more functions can be integrated into one processing module. The above integrated modules can be implemented in the form of hardware or in the form of software functional modules. It should be noted that the division of modules in the embodiments of the present application is schematic and is only a logical functional division. There may be other division methods in actual implementation.
[0124] Figure 5 is a block diagram of a vehicle machine testing device according to an exemplary embodiment. Figure 5 The vehicle computer testing device 50 includes: an acquisition unit 501 and a determination unit 502 .
[0125] The acquisition unit 501 is used to receive a test instruction, where the test instruction is used to test the voice command function of the vehicle computer in a target test scenario.
[0126] The determination unit 502 is used to control the playback device of the vehicle to output audio information matching the target test scenario in response to the test instruction. The audio information includes artificial simulated voice instructions and / or pre-recorded artificial voice instructions.
[0127] The determination unit 502 is further configured to determine whether the vehicle computer can recognize the audio information based on the feedback information of the vehicle computer.
[0128] In a possible implementation, the target test scenario includes at least one of the following: a multi-zone voice command issuance scenario. The multi-zones are multiple different areas inside the vehicle where the vehicle computer is located. Voice commands include valid commands and / or invalid commands. Among them, valid commands are commands that can trigger the vehicle computer to perform operations, and invalid commands are commands that cannot trigger the vehicle computer to perform operations. A single-zone continuous voice command issuance scenario. A voice command and noise output scenario. The voice command and noise come from different sound zones respectively. A multi-zone noise output scenario. A single-zone mixed voice command issuance scenario. Mixed commands include valid commands and invalid commands.
[0129] In one possible implementation, the vehicle's playback device includes multiple playback devices, and the multiple playback devices are arranged in different sound zones of the vehicle. The target test scenario is to issue instructions in the abnormal sound zone, and the determination unit 502 is also used to control the vehicle's playback device to output audio information matching the target test scenario, including: the determination unit 502 is also used to control the first playback device to output audio information for waking up the vehicle computer. The first playback device is any one of the multiple playback devices. After waking up the vehicle computer, the determination unit 502 is also used to control at least one playback device among the multiple playback devices except the first playback device to output audio information containing valid instructions.
[0130] In a possible implementation, the target test scenario is multiple rounds of instructions in the same voice zone, and the determination unit 502 is also used to control the playback device of the vehicle to output audio information matching the target test scenario, including: the determination unit 502 is also used to control the first playback device to output audio information for waking up the vehicle computer. After waking up the vehicle computer, the determination unit 502 is also used to control the first playback device to output audio information containing multiple valid instructions.
[0131] In a possible implementation, the target test scenario is a voice command and noise output scenario, and the determination unit 502 is further used to control the playback device of the vehicle to output audio information matching the target test scenario, including: the determination unit 502 is further used to control the first playback device to output audio information for waking up the vehicle computer. After waking up the vehicle computer, the determination unit 502 is further used to control one or more playback devices to output audio information containing invalid commands.
[0132] In one possible implementation, the target test scenario is a multi-zone noise output scenario, and the determination unit 502 is also used to control the vehicle's playback device to output audio information matching the target test scenario, including: the determination unit 502 is also used to control one or more playback devices to output audio information containing invalid instructions.
[0133] In a possible implementation, the target test scenario is a scenario where a mixed voice command is issued in a single tone zone, and the determination unit 502 is further used to control the playback device of the vehicle to output audio information matching the target test scenario, including: the determination unit 502 is further used to control the first playback device to output audio information for waking up the vehicle computer. After waking up the vehicle computer, the determination unit 502 is further used to control the first playback device to output audio information containing at least one valid command and at least one invalid command.
[0134] In a possible implementation, the determination unit 502 is further configured to compare the feedback information of the vehicle computer with the preset feedback information to obtain a comparison result, and determine whether the vehicle computer can recognize the audio information according to the comparison result.
[0135] In a possible implementation, the feedback information includes at least one of the following: text information generated by the vehicle computer in response to the voice command. TTS broadcast information output by the vehicle computer in response to the voice command. Image information displayed by the vehicle computer in response to the voice command.
[0136] Regarding the device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.
[0137] Figure 6 FIG. 1 is a block diagram of an electronic device according to an exemplary embodiment. Figure 6 As shown, the electronic device 60 includes but is not limited to: a processor 601 and a memory 602 .
[0138] The memory 602 is used to store executable instructions of the processor 601. It can be understood that the processor 601 is configured to execute instructions to implement the vehicle computer testing method in the above embodiment.
[0139] It should be noted that those skilled in the art can understand that Figure 6 The electronic device structure shown in the figure does not constitute a limitation on the electronic device, and the electronic device may include Figure 6 More or fewer components may be shown, or certain components may be combined, or the components may be arranged differently.
[0140] The processor 601 is the control center of the electronic device. It uses various interfaces and lines to connect various parts of the entire electronic device. By running or executing software programs and / or modules stored in the memory 602, and calling data stored in the memory 602, it performs various functions of the electronic device and processes data, thereby monitoring the electronic device as a whole. The processor 601 may include one or more processing units. Optionally, the processor 601 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor 601.
[0141] The memory 602 may be used to store software programs and various data. The memory 602 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required by at least one functional module (such as a determination unit, etc.), etc. In addition, the memory 602 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices.
[0142] In an exemplary embodiment, a computer-readable storage medium including instructions is also provided, such as a memory 602 including instructions. The above instructions can be executed by a processor 601 of an electronic device 600 to implement the vehicle computer testing method in the above embodiment.
[0143] In actual implementation, Figure 5 The functions of the acquisition unit 501 and the determination unit 502 in Figure 6 The processor 601 in the embodiment calls the computer program stored in the memory 602. The specific execution process can refer to the description of the method part in the above embodiment, which will not be repeated here.
[0144] Optionally, the computer-readable storage medium may be a non-temporary computer-readable storage medium, for example, the non-temporary computer-readable storage medium may be a read-only memory (ROM), a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.
[0145] In an exemplary embodiment, the present application also provides a computer program product including one or more instructions, and the one or more instructions can be executed by the processor 601 of the electronic device to complete the vehicle computer testing method in the above embodiment.
[0146] It should be noted that when the instructions in the above-mentioned computer-readable storage medium or one or more instructions in the computer program product are executed by the processor of the electronic device, the various processes of the above-mentioned method embodiment are implemented, and the same technical effect as the above-mentioned method can be achieved. To avoid repetition, they will not be repeated here.
[0147] Through the description of the above implementation methods, technical personnel in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.
[0148] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of modules or units is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
[0149] The units described as separate components may or may not be physically separated, and the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed in multiple different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.
[0150] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.
[0151] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or the full classification part or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium, including a number of instructions to enable a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to execute the full classification part or part of the steps of each embodiment method of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, ROM, RAM, disk or CD and other media that can store program code.
[0152] The above are only specific implementations of the present application, but the protection scope of the present application is not limited thereto, and any changes or substitutions within the technical scope disclosed in the present application should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.
Claims
1. A vehicle computer testing method, characterized in that: include: Receiving a test instruction, wherein the test instruction is used to test the voice command function of the vehicle computer in a target test scenario; In response to the test instruction, controlling a playback device of the vehicle to output audio information matching the target test scenario; the audio information includes artificial simulated voice instructions and / or pre-recorded artificial voice instructions; Based on the feedback information of the vehicle computer, it is determined whether the vehicle computer can recognize the audio information.
2. The method according to claim 1, characterized in that The target test scenario includes at least one of the following: A scenario in which a multi-zone voice command is issued; the multi-zone is a plurality of different areas inside the vehicle where the vehicle computer is located; the voice command includes a valid command and / or an invalid command; wherein the valid command is a command that can trigger the vehicle computer to perform an operation, and the invalid command is a command that cannot trigger the vehicle computer to perform an operation; Scenarios for issuing continuous voice commands in a single tone area; Voice command and noise output scenario; the voice command and the noise come from different sound zones respectively; Multi-zone noise output scenario; A scenario in which a single-tone zone mixed voice instruction is issued; the mixed voice instruction includes the valid instruction and the invalid instruction.
3. The method according to claim 2, characterized in that The playback device of the vehicle includes a plurality of playback devices, and the plurality of playback devices are arranged in different sound zones of the vehicle; the target test scenario is a multi-sound zone voice instruction issuance scenario, and the playback device of the vehicle is controlled to output audio information matching the target test scenario, including: Controlling a first playback device to output the audio information for waking up the vehicle computer; the first playback device is any one of the multiple playback devices; After waking up the vehicle computer, at least one of the multiple playback devices except the first playback device is controlled to output audio information containing valid instructions.
4. The method according to claim 2, characterized in that: The target test scenario is a scenario where a continuous voice command is issued in a single tone zone, and the playback device of the vehicle is controlled to output audio information matching the target test scenario, including: Controlling the first playback device to output the audio information for waking up the vehicle computer; After waking up the vehicle computer, the first playback device is controlled to output audio information containing a plurality of valid instructions.
5. The method according to claim 2, characterized in that: The target test scenario is a voice command and noise output scenario, and the playback device of the vehicle is controlled to output audio information matching the target test scenario, including: Controlling the first playback device to output the audio information for waking up the vehicle computer; After waking up the vehicle computer, one or more of the playback devices are controlled to output audio information containing invalid instructions.
6. The method according to claim 2, characterized in that The target test scenario is a multi-zone noise output scenario, and the controlling the playback device of the vehicle to output audio information matching the target test scenario includes: Control one or more of the playback devices to output audio information containing invalid instructions.
7. The method according to claim 2, characterized in that The target test scenario is a scenario where a mixed voice command is issued in a single tone zone, and the playback device of the vehicle is controlled to output audio information matching the target test scenario, including: Controlling the first playback device to output the audio information for waking up the vehicle computer; After waking up the vehicle computer, the first playback device is controlled to output audio information including at least one valid instruction and at least one invalid instruction.
8. The method according to any one of claims 1 to 7, characterized in that The determining, based on the feedback information from the vehicle computer, whether the vehicle computer can recognize the audio information includes: Comparing the feedback information of the vehicle computer with the preset feedback information to obtain a comparison result; According to the comparison result, it is determined whether the vehicle computer can recognize the audio information.
9. The method according to claim 8, characterized in that The feedback information includes at least one of the following: The text information generated by the vehicle computer in response to the voice command; The vehicle computer outputs TTS broadcast information in response to the voice command; The vehicle computer displays image information in response to the voice command.
10. A vehicle computer testing device, characterized in that: The vehicle computer testing device comprises: An acquisition unit, used for receiving a test instruction, wherein the test instruction is used for testing the voice command function of the vehicle computer in a target test scenario; A determination unit, configured to control a playback device of the vehicle to output audio information matching the target test scenario in response to the test instruction; the audio information includes an artificial simulated voice instruction and / or a pre-recorded artificial voice instruction; The determination unit is further configured to determine whether the vehicle computer can recognize the audio information based on feedback information from the vehicle computer.
11. An electronic device, characterized in that: include: processor; a memory for storing instructions executable by the processor; The processor is configured to execute the instructions to implement the method according to any one of claims 1 to 9.
12. A computer-readable storage medium, characterized in that: When the computer-executable instructions stored in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device is capable of performing the method as claimed in any one of claims 1 to 9.
Citation Information
Patent Citations
Method for testing voice recognition rate of automobile-mounted control screen, electronic equipment and system
CN109473094A
Vehicle-mounted control screen voice recognition process testing method, electronic equipment and system
CN109616106A
Voice test method, device and electronic equipment
CN111145737A
Vehicle-mounted multi-mode voice performance test method, device and equipment and storage medium
CN115331655A
Voice test method and device, electronic equipment and computer readable storage medium
CN116303018A