A test method, device, equipment, medium and product

Abstract

The present invention discloses a test method, device, equipment, medium and product. The method comprises: in response to a recording start instruction, controlling a playback device arranged in a vehicle to play an audio instruction file, and controlling a camera arranged in the vehicle to record a video of a vehicle-side device providing an interactive interface under test, and obtaining video information; parsing the video information, and determining the interaction time information corresponding to the audio instruction in the audio instruction file; according to the interaction time information, determining the response time of the device in response to the audio instruction, and obtaining a test result. The vehicle-side is automatically tested by controlling the playback device and the camera device, and the test end automatically recognizes the audio and response picture in the vehicle-side video information and determines the response time. The automation of the test is realized. The influence of human factors is reduced, and the test efficiency and the accuracy of the results are improved.

Description

Technical Field

[0001] The present invention relates to the field of testing technology, and in particular to a testing method, device, equipment, medium and product. Background Art

[0002] With the development of intelligent connected vehicle technology, in-vehicle voice interaction systems have become a key component to improve driving safety and convenience.

[0003] The response time test of traditional in-vehicle voice interaction systems mostly relies on manual operation, which requires manual recording of the interaction screen and counting the frames of the recorded screen and audio, so as to determine the response time of the interaction system by counting the number of frames.

[0004] This manual method is extremely time-consuming and difficult to conduct in large-scale parallel testing with fewer people, which limits the number and diversity of test cases and affects the comprehensiveness and efficiency of the test. In addition, manual testing is greatly affected by subjective factors. The operating habits and environmental perception differences of different testers will lead to large variability in the response time test results, which cannot accurately reflect the performance of in-vehicle voice. Summary of the invention

[0005] The present invention provides a testing method, device, equipment, medium and product to realize automatic testing of vehicle-computer interaction and automatic determination of response time results.

[0006] According to a first aspect of the present invention, there is provided a testing method, comprising:

[0007] In response to the recording start instruction, the playback device arranged in the vehicle is controlled to play the audio instruction file, and the camera device arranged in the vehicle is controlled to record the video of the vehicle-side device providing the interactive interface under test to obtain video information;

[0008] Parsing the video information to determine interaction time information corresponding to the audio instruction in the audio instruction file, wherein the interaction time information includes audio time sub-information and picture time sub-information;

[0009] According to the interaction time information, the response time of the vehicle-side device in response to the audio command is determined to obtain a test result.

[0010] According to a second aspect of the present invention, there is provided a testing device, characterized in that it comprises:

[0011] The video recording module is used to control the playback device provided in the vehicle to play the audio instruction file in response to the recording start instruction, and control the camera device provided in the vehicle to record the video of the vehicle-side device providing the interactive interface under test to obtain video information;

[0012] An information determination module is used to parse the video information and determine the interaction time information corresponding to the audio instruction in the audio instruction file, wherein the interaction time information includes audio time sub-information and picture time sub-information;

[0013] The result determination module is used to determine the response time of the vehicle-side device in response to the audio instruction according to the interaction time information to obtain a test result.

[0014] According to a third aspect of the present invention, there is provided an electronic device, the electronic device comprising:

[0015] at least one processor; and

[0016] a memory communicatively connected to the at least one processor; wherein,

[0017] The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the testing method described in any embodiment of the present invention.

[0018] According to a fourth aspect of the present invention, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the test method described in any embodiment of the present invention when executed.

[0019] According to a fifth aspect of the present invention, an embodiment of the present invention further provides a computer program product, the computer program product comprising a computer program, and the computer program implements the test method of any embodiment of the present invention when executed by a processor.

[0020] The technical solution of the embodiment of the present invention controls the playback device provided in the vehicle to play the audio instruction file in response to the recording start instruction, and controls the camera device provided in the vehicle to record the video of the vehicle-side device under test that provides an interactive interface, so as to obtain video information; parses the video information to determine the interaction time information corresponding to the audio instruction in the audio instruction file, wherein the interaction time information includes audio time sub-information and picture time sub-information; determines the response time of the device in response to the audio instruction according to the interaction time information, and obtains the test result. The vehicle-side is automatically tested by controlling the playback device and the camera device, and the test end automatically recognizes the audio and response picture in the vehicle-side video information and determines the response time. The automation of the test is achieved. The influence of human factors is reduced, and the test efficiency and the accuracy of the results are improved.

[0021] It should be understood that the contents described in this section are not intended to identify the key or important features of the embodiments of the present invention, nor are they intended to limit the scope of the present invention. Other features of the present invention will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0023] Figure 1 is a flow chart of a testing method provided according to Embodiment 1 of the present invention;

[0024] Figure 2 This is an example diagram of an operation interface in a test method provided in Embodiment 1 of the present invention;

[0025] Figure 3 is a flow chart of a testing method provided according to Embodiment 2 of the present invention;

[0026] Figure 4 is a schematic diagram of the structure of a testing device provided according to Embodiment 3 of the present invention;

[0027] Figure 5 It is a schematic diagram of the structure of an electronic device implementing an embodiment of the present invention. DETAILED DESCRIPTION

[0028] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0029] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0030] Embodiment 1

[0031] Figure 1 A flow chart of a test method is provided for the first embodiment of the present invention. This embodiment is applicable to the case of automatically testing the vehicle interaction time. The method can be executed by a test device, which can be implemented in the form of hardware and / or software, and can be configured in an electronic device. Figure 1 As shown, the method includes:

[0032] S110. In response to a recording start instruction, control a playback device in the vehicle to play an audio instruction file, and control a camera in the vehicle to record a video of the vehicle-side device providing an interactive interface under test to obtain video information.

[0033] In this embodiment, the recording start instruction can be understood as an instruction for indicating the start of the test. The playback device can be understood as a device for audio playback, such as audio and speaker devices. The audio instruction file can be understood as a file for storing audio instructions issued by the test, which may include multiple audio instructions. The camera device can be understood as a device for audio and video recording, such as a programmable high-definition camera. The vehicle-side device providing an interactive interface under test can be understood as a vehicle-side device providing an interactive interface under test in a vehicle, and the device may include display interaction and audio interaction, such as a display screen in a vehicle. Video information can be understood as a recorded video of the vehicle-side device providing an interactive interface under test responding to an audio instruction.

[0034] A recording start button can be provided in the form of a control or the like through a visual interface provided by the processor corresponding to the server. The tester can pre-generate the audio instructions used for the test, and package the audio instructions to form an audio instruction file and upload it. The tester can automatically generate a recording start instruction by clicking the recording start button. The processor can receive the recording start instruction, and in response to the recording start instruction, control the playback device set in the car to play the audio instructions in the order corresponding to the audio instruction file. Among them, the playback device can be set at the position to be tested, such as the main driver's seat, the co-driver's seat or the rear seat, and is set according to the actual test requirements. The processor can control the camera device set in the car to record the video of the vehicle-side device providing the interactive interface under test according to the maximum duration corresponding to each audio instruction, wherein the camera device is set at a position where the overall display of the vehicle-side device providing the interactive interface under test can be clearly captured, and the video clip corresponding to each audio instruction in the audio instruction file is obtained, and the video information corresponding to the overall audio instruction file is obtained and stored for subsequent processing.

[0035] S120: parse the video information to determine the interaction time information corresponding to the audio instruction in the audio instruction file, where the interaction time information includes audio time sub-information and picture time sub-information.

[0036] In this embodiment, the audio instruction can be understood as an audio instruction for the tested vehicle-side device providing an interactive interface to perform a test function, such as a pre-recorded functional statement, such as play the next song, return to the desktop, navigate home, play FM and today's weather, etc. Since the audio instruction file includes not only audio instructions for testing, but also other instructions, the interaction time information can be understood as the time when the instruction is issued and the time when the tested vehicle-side device providing an interactive interface responds to the audio instruction. The audio time sub-information can be understood as the time information related to audio, such as the time when the audio instruction is issued and the time when the tested vehicle-side device providing an interactive interface responds through audio. The picture time sub-information can be understood as the time information related to the picture response, such as the response time corresponding to the change in the interface of the tested vehicle-side device providing an interactive interface.

[0037] After the video information is formed, the tester can be fed back through the visual interface that the recording is complete, and the tester can trigger the start analysis button provided by the visual interface to start parsing the video information, so as to determine the test results through the video information, or automatically trigger the parsing of the video information after the video information is formed. And because different audio instructions have different corresponding interaction methods, they can be divided into voice feedback and display feedback, such as voice broadcasting of feedback content or display through screen switching, etc., so the two feedback forms can be parsed separately.

[0038] Specifically, the processor can parse the video information, first distinguish the picture information and audio information corresponding to each audio instruction, parse the audio information through voice recognition technology, determine the time when the audio instruction is issued and the time when the tested vehicle-side device providing an interactive interface responds to the audio instruction, and obtain the audio time sub-information. The picture information is recognized through a computer vision algorithm, and the picture change time in response to the audio instruction is determined to obtain the picture time sub-information.

[0039] S130. Determine the time it takes for the vehicle-side device to respond to the audio command based on the interaction time information, and obtain a test result.

[0040] In this embodiment, the response time can be understood as the delay time corresponding to the response instruction of the vehicle-side device providing the interactive interface under test. The test results can be understood to include the time when different audio instructions are issued and the response time corresponding to different response modes.

[0041] Specifically, the processor can distinguish the end time of the instruction in the audio instruction, the audio start time corresponding to the audio mode response of the tested vehicle-side device providing an interactive interface to the instruction, and the screen start time corresponding to the screen mode response of the tested vehicle-side device providing an interactive interface to the instruction according to the interaction time information. By subtracting the two times, the response time from the issuance of the instruction by the test-side playback device to the response of the tested vehicle-side device providing an interactive interface can be determined.

[0042] The technical solution of the embodiment of the present invention controls the playback device provided in the vehicle to play the audio instruction file in response to the recording start instruction, and controls the camera device provided in the vehicle to record the video of the vehicle-side device under test that provides an interactive interface, so as to obtain video information; parses the video information to determine the interaction time information corresponding to the audio instruction in the audio instruction file, wherein the interaction time information includes audio time sub-information and picture time sub-information; determines the response time of the device in response to the audio instruction according to the interaction time information, and obtains the test result. The vehicle-side is automatically tested by controlling the playback device and the camera device, and the test end automatically recognizes the audio and response picture in the vehicle-side video information and determines the response time. The automation of the test is achieved. The influence of human factors is reduced, and the test efficiency and the accuracy of the results are improved.

[0043] As a first optional embodiment of the first embodiment, before controlling the playback device set in the vehicle to play the audio instruction file, the method further includes:

[0044] In response to the acquired audio instruction path, an operation interface is generated and displayed.

[0045] In this embodiment, the audio instruction path can be understood as the path information for storing the audio instruction file. The operation interface can be understood as a visual interface for providing operation selection to the tester.

[0046] Specifically, when the tester opens the test tool, the processor can provide a selection interface for the test vehicle type and path, and the tester can input or select the audio command path in the selection interface. The processor responds to the acquired audio command path, generates an operation interface containing the audio command path and controls for triggering the test operation, and generates a visual operation interface for display to the tester, so as to guide the tester to determine whether the selected audio command file is correct, and guide the tester to control the start or end of the test, as well as the start and end of the analysis.

[0047] For example, an operation interface is used to display: Figure 2 This is an example diagram of an operation interface in a test method provided in Embodiment 1 of the present invention, such as Figure 2As shown, the operation interface may include a path window to provide the tester with the selected audio instruction path, a start recording button and a start analysis button, and trigger the start and end of the test and the start and end of the test result analysis by the tester.

[0048] Embodiment 2

[0049] Figure 3 This is a flow chart of a testing method provided in Embodiment 2 of the present invention. This embodiment is a further refinement of the above embodiment. Figure 3 As shown, the method includes:

[0050] S201. In response to a recording start instruction, control a playback device in the vehicle to play an audio instruction file, and perform video recording of the vehicle-side device providing an interactive interface under test according to the maximum response duration corresponding to each audio instruction in the audio instruction file to obtain a video clip of the interactive video response to the audio instruction to be tested.

[0051] Among them, the audio instruction file also includes restoring the environment audio, which is played before playing the audio instruction and is used for the vehicle-side device to restore the default interactive interface.

[0052] In this embodiment, the maximum response time can be understood as the maximum waiting time corresponding to the response audio instruction, so as to ensure that the video clip corresponding to each audio instruction can be fully recorded. The video clip can be understood as the video corresponding to the response to each audio instruction.

[0053] The recovery environment audio can be understood as the audio used to restore the default interaction interface. The default interaction interface can be understood as the interface of the tested vehicle-side device providing the interaction interface when no interaction is triggered.

[0054] Specifically, in response to the recording start instruction, the processor can control the playback device set in the car to play the audio instruction file, and use the maximum response time corresponding to each audio instruction in the audio instruction file as the duration of each video recording. The processor can play and start recording the audio instructions in the audio instruction file in turn, and end recording after waiting for the maximum response time, as a video clip corresponding to the audio instruction played this time. The processor can automatically connect to the next audio instruction in the audio instruction file to play and start recording, and end recording after waiting for the maximum response time, and so on, until all audio instructions in the audio instruction file are played. Among them, after the recording of each video clip is completed and before the next audio instruction is played, the processor can control the playback device to play the recovery environment audio, so that the vehicle-side device that provides the interactive interface under test is restored to the default interactive interface.

[0055] Through such a setting, the consistency of conditions and repeatability of results of each test are ensured, fairness to each audio command is guaranteed, and consistency of the interface of the tested vehicle-side device providing an interactive interface is guaranteed before each audio command is issued, so as to eliminate errors caused by different response times due to different interfaces of the tested vehicle-side device providing an interactive interface.

[0056] Among them, when the tester pauses recording, the processor responds to the pause recording instruction. For the last video clip corresponding to the pause, the processor can compare the video clip with its corresponding maximum response time to determine whether the video clip is recorded. If the maximum response time is not reached, the video clip will be discarded, and subsequent video information will be generated through other video clips. If the maximum response time is reached, the video clip will be retained to generate video information.

[0057] S202: Name the video clip according to the name of the audio instruction to obtain video information.

[0058] Specifically, the processor can name the video clips according to the name corresponding to each audio instruction to ensure efficient indexing and traceability of subsequent processing to obtain video information.

[0059] Through such a setting, compared with the traditional method of obtaining video by recording the screen on the vehicle-side device, the obtained video information is manually transmitted to the test end for subsequent analysis of the video information. This application sets this method on the test end, and records the video of the vehicle-side device by controlling the camera device connected to the test end. The video information can be directly obtained at the test end, thereby improving the efficiency of the test.

[0060] S203: extract the audio track from the video information to obtain audio information.

[0061] In this embodiment, the audio track can be understood as the part of the video that stores the audio content. The audio information can be understood as the information in the video that only includes the audio part.

[0062] Specifically, the processor first separates the audio track in the video information to obtain the audio information.

[0063] S204: Process the audio information to obtain audio time sub-information corresponding to the audio instruction in the audio instruction file.

[0064] Specifically, the processor can first filter the audio information, identify the human voice in the filtered audio information through speech recognition technology, and determine the time node when the command is issued in the human voice and the time node corresponding to the response of the vehicle-side device providing an interactive interface to obtain the audio moment sub-information.

[0065] Further, based on the above embodiment, the step of processing the audio information to obtain the audio moment sub-information corresponding to the audio instruction in the audio instruction file can be refined as follows:

[0066] The audio information is filtered through an adaptive filter algorithm to obtain the audio information; the human voice in the audio information is recognized through a deep learning model to determine the interaction sentences of each interaction object in the audio information and the corresponding sentence start and end times, the interaction sentences include wake-up sentences, greeting sentences and command sentences; according to the interaction sentences and sentence start and end times, the audio moment sub-information is obtained.

[0067] In this embodiment, the adaptive filter algorithm can be understood as a digital filter algorithm that automatically adjusts the filtering performance, and the filter parameters can be adjusted according to the characteristics of the input signal. Audio information can be understood as audio after filtering out ambient sound. Interactive objects can include objects that issue audio instructions and objects that respond to instructions. Interactive sentences can include audio instruction sentences issued and sentences that respond to audio instructions. The start and end times of sentences can be understood as the start time corresponding to the first word of the sentence and the end time corresponding to the last word. The wake-up sentence can be understood as a specific sentence corresponding to the wake-up interactive image, for example, by calling the name of the interactive image, xx hello, to wake up, then the wake-up sentence corresponds to xx hello. The greeting sentence can be understood as a sentence issued after the interactive image is awakened, such as the sentence "I am here" issued by the interactive image. The instruction sentence can be understood as a sentence related to the proposed interactive instruction, which can include an audio instruction sentence issued and a response sentence. For example, the instruction sentence corresponding to the audio instruction is today's weather, and the corresponding response sentence is the weather conditions replied. Speech recognition technology can be understood as a technology for recognizing sentences in audio.

[0068] Specifically, the processor can filter the audio signal in the audio information through an adaptive filter algorithm, filter out the background noise in the audio signal, and especially eliminate the interference of non-human voice elements during the recording process, so as to accurately lock the key human voice audio, lay a pure data foundation for subsequent analysis, and obtain the filtered audio information. The processor can use speech recognition technology (such as input into a pre-trained deep learning model) to identify the human voice in the audio information, and determine the interactive sentences of each interactive object in the audio information and the corresponding sentence start and end times. Among them, the interactive sentences include wake-up sentences, greeting sentences and instruction sentences. The processor can obtain audio moment sub-information based on the interactive sentences and the sentence start and end times. For example, the interactive objects and interactive sentences can be distinguished through labels, etc., so that the sentence start and end times correspond to the interactive sentences and interactive objects, and the audio moment sub-information is obtained.

[0069] S205: Perform picture processing on the video information to determine the picture time sub-information corresponding to the picture that responds to the audio command.

[0070] Specifically, the processor may perform picture processing on the video information, for example, identify the picture through template matching technology, determine the picture frame that responds to the audio instruction and the corresponding response time, and obtain the picture time sub-information.

[0071] Further, based on the above embodiment, the steps of performing picture processing on the video information and determining the picture moment sub-information corresponding to the picture responding to the audio instruction can be refined as follows:

[0072] The key frames in the video information are captured through computer vision algorithms to determine the key frame images and corresponding trigger types, which include voice image trigger types, voice command trigger types and user interface change trigger types. Based on the trigger type and the timestamp of the key frame images, the image moment sub-information corresponding to the image that responds to the audio command is determined.

[0073] In this embodiment, the computer vision algorithm can be understood as an algorithm for video processing. The key frame can be understood as an important change moment or content summary frame of the video. The key frame picture can be understood as the picture of the key frame when responding to the audio instruction. The timestamp can be understood as the time point used to indicate the key frame picture. The trigger type can be understood as the type of triggering the picture change, which can be summarized into three types, namely the voice image trigger type (i.e., triggering the display or disappearance of the voice image, the voice image can be understood as the object that emits the sound in a figurative representation), the voice command trigger type can be understood as the visual feedback type triggered by the voice command (i.e., the display content change caused by responding to the voice command, such as the newly added display picture, etc.) and the user interface change trigger type can be understood as the change of the display interface caused by the response instruction (such as the change of the user interface caused by opening or closing the APP), wherein the user interface refers to the way people interact with digital products or services, including all visual elements, interaction processes and user experience feelings.

[0074] Specifically, the processor can capture and classify the key frames in the video information through a computer vision algorithm, determine the key frame images in the video information and the trigger type corresponding to the key frame images. Among them, the trigger type includes a voice image trigger type, a voice command trigger type, and a user interface change trigger type. The processor can determine the picture time sub-information corresponding to the picture that responds to the audio command based on the trigger type and the timestamp of the key frame image.

[0075] Exemplarily, the response template image can be predetermined as a response condition through the template matching technology in the computer vision algorithm, and the similarity between each frame of video in the video information and the response template image can be determined through the template matching technology to identify key frame images similar to the response template image, and then the picture moment sub-information can be determined according to the predetermined trigger type and trigger instruction corresponding to the response template image.

[0076] S206: Use the audio moment sub-information and the picture moment sub-information as the interaction moment information corresponding to the audio instruction.

[0077] Specifically, the processor may save the audio moment sub-information and the picture moment sub-information according to the name corresponding to the audio instruction, and obtain the interaction moment information corresponding to the audio instruction.

[0078] S207. Determine the audio response time of the vehicle-side device in response to the audio command according to the start and end times of the sentences of different interactive objects in the audio time sub-information.

[0079] In this embodiment, the audio response time can be understood as the delay time corresponding to the voice response instruction.

[0080] Specifically, since the interactive object includes an object that issues a command and an object that responds to the command, the processor can determine the start and end times of the sentence of the interactive object that issues the command in the audio time sub-information, and determine the end time corresponding to the interactive sentence. The processor can determine the start and end times of the sentence corresponding to the interactive object that responds to the command based on the interactive sentence, and determine the start time of the interactive sentence. Subtract the end time of the issuance from the start time of the response, and you can get the audio response time of the tested vehicle-side device that provides an interactive interface in response to the audio command.

[0081] S208. Determine the time taken for the vehicle-side device to respond to the audio command based on the sentence start and end times and the picture time sub-information.

[0082] In this embodiment, the screen response time consumption can be understood as the delay time length corresponding to the screen response instruction.

[0083] Specifically, the processor can identify the screen time corresponding to the key frame screen that responds to the instruction based on the termination time of the instruction corresponding to the start and end time of the statement, and through the trigger type in the screen time sub-information, and then subtract the screen time from the termination time to determine the screen response time of the tested vehicle-side device providing an interactive interface in response to the audio command.

[0084] S209: Use the audio response time and the picture response time as the test results of the vehicle-side device.

[0085] Specifically, the processor can summarize the audio moment sub-information, picture moment sub-information, audio response time and picture response time in a set form (such as list form or chart form), and obtain the test results of the tested vehicle-side device providing an interactive interface. The test results can be displayed through a visual interface, and the folder that saves the video information can be displayed in the form of a path link.

[0086] For example, the test results are shown in a specific example. The audio command file includes five function commands, corresponding to the next song, return to the desktop, navigate home, play FM and today's weather. The test results can be summarized in a table to obtain the following table:

[0087] Table 1: Test results

[0088]

[0089] The first column in the above table corresponds to the name of the function to be completed corresponding to the audio instruction, the second column is the end time of the last word corresponding to the instruction (such as Hello XX, the time corresponding to the word in the next song), the third column is the start time of the greeting (that is, the start time when the voice image sends the first word of the greeting sentence), the fourth column is the voice image appearance time (corresponding to the screen time of the key frame screen of the voice image trigger type), the fifth column is the end time of the last word of the instruction (that is, the end time of the audio corresponding to the response instruction), the sixth column is the execution user interface appearance time (that is, the screen time of the key frame screen of the user interface change trigger type), the seventh column is the wake-up response time (that is, the response time in audio form), the eighth column is the user interface response time (that is, the response time corresponding to the user interface change), and the ninth column is the instruction response time. The test results are displayed in a tabular form to make the results more intuitive.

[0090] The technical solution of the embodiment of the present invention automatically plays the audio instruction file by responding to the recording start instruction, and sequentially records and names the audio instructions therein as video clips, and limits the duration of the video clip by responding to the maximum duration, so as to realize the automatic connection of multiple recording tasks, and each test case automatically triggers the video recording process without manual intervention, thereby improving the test efficiency. The audio information is recognized by voice recognition technology, and the audio moment sub-information is determined, so as to replace the manual test to reduce the test time, avoid the errors caused by manual recognition and human subjective factors, realize the accurate capture and instant recognition of voice instructions in the vehicle environment, and provide support for the accuracy and efficiency of subsequent test results. The response interface changes in the video information are instantly recognized by the computer vision algorithm, and the picture moment sub-information is obtained. Through the algorithm-driven deep analysis, the response time of the vehicle-side device providing the interactive interface can be measured in a refined manner, which reduces the error of manual recognition and ensures the objectivity and reproducibility of the test results. The audio response time and the picture response time are determined by the audio moment sub-information and the picture moment sub-information, and the test results are obtained. The automatic determination of the response time is realized. It can flexibly cover a variety of user command types, ensuring a comprehensive evaluation of the tested vehicle-side device providing an interactive interface, and providing guidance for the subsequent optimization of the tested vehicle-side device providing an interactive interface.

[0091] Embodiment 3

[0092] Figure 4 This is a schematic diagram of the structure of a test device provided in Embodiment 3 of the present invention. Figure 4 As shown, the device includes: a video recording module 31, an information determination module 32 and a result determination module 33.

[0093] in,

[0094] The video recording module 31 is used to control the playback device set in the vehicle to play the audio instruction file in response to the recording start instruction, and control the camera device set in the vehicle to record the video of the vehicle-side device providing the interactive interface under test to obtain video information;

[0095] An information determination module 32 is used to parse the video information and determine the interaction time information corresponding to the audio instruction in the audio instruction file, wherein the interaction time information includes audio time sub-information and picture time sub-information;

[0096] The result determination module 33 is used to determine the response time of the vehicle-side device in response to the audio instruction according to the interaction time information to obtain the test result.

[0097] The technical solution of the embodiment of the present invention controls the playback device provided in the vehicle to play the audio instruction file in response to the recording start instruction, and controls the camera device provided in the vehicle to record the video of the vehicle-side device under test that provides an interactive interface, so as to obtain video information; parses the video information to determine the interaction time information corresponding to the audio instruction in the audio instruction file, wherein the interaction time information includes audio time sub-information and picture time sub-information; determines the response time of the device in response to the audio instruction according to the interaction time information, and obtains the test result. The vehicle-side is automatically tested by controlling the playback device and the camera device, and the test end automatically recognizes the audio and response picture in the vehicle-side video information and determines the response time. The automation of the test is achieved. The influence of human factors is reduced, and the test efficiency and the accuracy of the results are improved.

[0098] Furthermore, the information determination module 32 includes:

[0099] An information extraction unit, used to extract the audio track from the video information to obtain audio information;

[0100] A first processing unit, configured to process the audio information to obtain audio time sub-information corresponding to the audio instruction in the audio instruction file;

[0101] A second processing unit is used to perform picture processing on the video information to determine the picture time sub-information corresponding to the picture responding to the audio instruction;

[0102] The information determination unit is used to use the audio moment sub-information and the picture moment sub-information as the interaction moment information corresponding to the audio instruction.

[0103] Wherein, the first processing unit is specifically used for:

[0104] Filtering the audio information by an adaptive filter algorithm to obtain audio information;

[0105] Recognize the human voice in the audio information by using speech recognition technology, and determine the interactive sentences of each interactive object in the audio information and the corresponding sentence start and end times, wherein the interactive sentences include wake-up sentences, greeting sentences and instruction sentences;

[0106] The audio time sub-information is obtained according to the interactive sentence and the start and end time of the sentence.

[0107] Wherein, the second processing unit is specifically used for:

[0108] Capturing key frames in the video information through a computer vision algorithm, determining key frame images and corresponding trigger types, wherein the trigger types include voice image trigger types, voice command trigger types, and user interface change trigger types;

[0109] The picture moment sub-information corresponding to the picture responding to the audio instruction is determined according to the trigger type and the timestamp of the key frame picture.

[0110] Furthermore, the video recording module 31 is specifically used for:

[0111] According to the maximum response time corresponding to each audio instruction in the audio instruction file, a video of the vehicle-side device providing the interactive interface under test is recorded to obtain a video clip of the interactive video to be tested responding to the audio instruction;

[0112] The video clip is named according to the name of the audio instruction to obtain video information.

[0113] Among them, the audio instruction file also includes restoring the environment audio, and the restoring environment audio is played before playing the audio instruction, and is used for the vehicle-side device to restore the default interactive interface.

[0114] Furthermore, the result determination module 33 is specifically used for:

[0115] Determining the audio response time of the vehicle-side device in response to the audio command according to the start and end times of the sentences of different interactive objects in the audio time sub-information;

[0116] Determining the time taken for the vehicle-side device to respond to the audio command based on the start and end times of the sentence and the screen time sub-information;

[0117] The audio response time and the picture response time are used as the test results of the vehicle-side device.

[0118] Optionally, the device further comprises:

[0119] The interface display module is used to generate and display an operation interface in response to the acquired audio instruction path before controlling the playback device set in the car to play the audio instruction file.

[0120] The testing device provided in the embodiment of the present invention can execute the testing method provided in any embodiment of the present invention, and has the functional modules and beneficial effects corresponding to the execution method.

[0121] Embodiment 4

[0122] Figure 5A schematic diagram of the structure of an electronic device 40 that can be used to implement an embodiment of the present invention is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices (such as helmets, glasses, watches, etc.) and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present invention described and / or required herein.

[0123] like Figure 5 As shown, the electronic device 40 includes at least one processor 41, and a memory connected to the at least one processor 41, such as a read-only memory (ROM) 42, a random access memory (RAM) 43, etc., wherein the memory stores a computer program that can be executed by at least one processor, and the processor 41 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 42 or the computer program loaded from the storage unit 48 to the random access memory (RAM) 43. In the RAM 43, various programs and data required for the operation of the electronic device 40 can also be stored. The processor 41, the ROM 42, and the RAM 43 are connected to each other through a bus 44. An input / output (I / O) interface 45 is also connected to the bus 44.

[0124] A number of components in the electronic device 40 are connected to the I / O interface 45, including: an input unit 46, such as a keyboard, a mouse, etc.; an output unit 47, such as various types of displays, speakers, etc.; a storage unit 48, such as a disk, an optical disk, etc.; and a communication unit 49, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 49 allows the electronic device 40 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0125] The processor 41 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the processor 41 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc. The processor 41 executes the various methods and processes described above, such as the test method.

[0126] In some embodiments, the test method may be implemented as a computer program, which is tangibly contained in a computer-readable storage medium, such as a storage unit 48. In some embodiments, part or all of the computer program may be loaded and / or installed on the electronic device 40 via the ROM 42 and / or the communication unit 49. When the computer program is loaded into the RAM 43 and executed by the processor 41, one or more steps of the test method described above may be performed. Alternatively, in other embodiments, the processor 41 may be configured to execute the test method in any other appropriate manner (e.g., by means of firmware).

[0127] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0128] Computer programs for implementing the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that when the computer program is executed by the processor, the functions / operations specified in the flow chart and / or block diagram are implemented. The computer program may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0129] In the context of the present invention, a computer-readable storage medium may be a tangible medium that may contain or store a computer program for use by or in combination with an instruction execution system, device or equipment. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or equipment, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0130] To provide interaction with a user, the systems and techniques described herein may be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and a pointing device (e.g., a mouse or trackball) through which the user can provide input to the electronic device. Other types of devices may also be used to provide interaction with the user; for example, the feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form (including acoustic input, voice input, or tactile input).

[0131] The systems and techniques described herein may be implemented in a computing system that includes backend components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes frontend components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such backend components, middleware components, or frontend components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0132] A computing system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The client and server relationship is generated by computer programs running on the corresponding computers and having a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system to solve the defects of difficult management and weak business scalability in traditional physical hosts and VPS services.

[0133] In one embodiment, the embodiment of the present invention further includes a computer program product, the computer program product includes a computer program, and the computer program implements the testing method of any embodiment of the present invention when executed by a processor.

[0134] In the process of implementation, the computer program product can be written in one or more programming languages ​​or a combination thereof to perform the computer program code of the present invention, including object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer can be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computer (for example, using an Internet service provider to connect through the Internet).

[0135] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps described in the present invention can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solution of the present invention can be achieved, and this document does not limit this.

[0136] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. A testing method, characterized in that: include: In response to the recording start instruction, the playback device arranged in the vehicle is controlled to play the audio instruction file, and the camera device arranged in the vehicle is controlled to record the video of the vehicle-side device providing the interactive interface under test to obtain video information; Parsing the video information to determine interaction time information corresponding to the audio instruction in the audio instruction file, wherein the interaction time information includes audio time sub-information and picture time sub-information; According to the interaction time information, the response time of the vehicle-side device in response to the audio command is determined to obtain a test result.

2. The method according to claim 1, characterized in that The parsing of the video information to determine the interaction time information corresponding to the audio instruction in the audio instruction file includes: Extracting the audio track from the video information to obtain audio information; Processing the audio information to obtain audio time sub-information corresponding to the audio instruction in the audio instruction file; Performing picture processing on the video information to determine picture time sub-information corresponding to the picture responding to the audio instruction; The audio moment sub-information and the picture moment sub-information are used as the interaction moment information corresponding to the audio instruction.

3. The method according to claim 2, characterized in that The processing of the audio information to obtain the audio time sub-information corresponding to the audio instruction in the audio instruction file includes: Filtering the audio information by an adaptive filter algorithm to obtain audio information; Recognize the human voice in the audio information by using speech recognition technology, and determine the interactive sentences of each interactive object in the audio information and the corresponding sentence start and end times, wherein the interactive sentences include wake-up sentences, greeting sentences and instruction sentences; The audio time sub-information is obtained according to the interactive sentence and the start and end time of the sentence.

4. The method according to claim 2, characterized in that: The performing picture processing on the video information to determine the picture time sub-information corresponding to the picture responding to the audio instruction includes: Capturing key frames in the video information through a computer vision algorithm, determining key frame images and corresponding trigger types, wherein the trigger types include voice image trigger types, voice command trigger types, and user interface change trigger types; The picture moment sub-information corresponding to the picture responding to the audio instruction is determined according to the trigger type and the timestamp of the key frame picture.

5. The method according to claim 1, characterized in that The video information obtained by recording the video of the vehicle-side device providing the interactive interface under test includes: According to the maximum response time corresponding to each audio instruction in the audio instruction file, a video of the vehicle-side device providing the interactive interface under test is recorded to obtain a video clip of the interactive video to be tested responding to the audio instruction; The video clip is named according to the name of the audio instruction to obtain video information.

6. The method according to claim 1, characterized in that The step of determining the response time of the vehicle-side device in response to the audio instruction according to the interaction time information and obtaining the test result includes: Determining the audio response time of the vehicle-side device in response to the audio command according to the start and end times of the sentences of different interactive objects in the audio time sub-information; Determining the time taken for the vehicle-side device to respond to the audio command based on the start and end times of the sentence and the screen time sub-information; The audio response time and the picture response time are used as the test results of the vehicle-side device.

7. The method according to claim 1, characterized in that Before controlling the playback device set in the car to play the audio command file, it also includes: In response to the acquired audio instruction path, an operation interface is generated and displayed.

8. The method according to claim 1, characterized in that The audio instruction file also includes restoring environment audio, which is played before playing the audio instruction and is used for the vehicle-side device to restore the default interaction interface.

9. A testing device, characterized in that: include: The video recording module is used to control the playback device provided in the vehicle to play the audio instruction file in response to the recording start instruction, and control the camera device provided in the vehicle to record the video of the vehicle-side device providing the interactive interface under test to obtain video information; An information determination module is used to parse the video information and determine the interaction time information corresponding to the audio instruction in the audio instruction file, wherein the interaction time information includes audio time sub-information and picture time sub-information; The result determination module is used to determine the response time of the vehicle-side device in response to the audio instruction according to the interaction time information to obtain a test result.

10. An electronic device, characterized in that: The electronic device comprises: at least one processor; and a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can perform the testing method according to any one of claims 1 to 8.

11. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the testing method according to any one of claims 1 to 8 when executed.

12. A computer program product, characterized in that The computer program product comprises a computer program, which, when executed by a processor, implements the testing method according to any one of claims 1 to 8.

Images