Intelligent cabin testing method, intelligent cabin testing equipment, intelligent cabin and medium
Through the testing equipment automatically obtains and recognizes the human-computer interactive interface data of the smart cockpit, the problem that existing testing methods require a lot of manpower and resources is solved, and automated testing is realized, reducing costs and improving efficiency and security.
Patent Information
- Application Number
- CN202410005383.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-01-02
- Publication Date
- 2025-07-04
AI Technical Summary
The existing smart cockpit testing methods require a lot of manpower or additional resources, and are difficult to effectively identify and reproduce occasional failures.
Through the test equipment, the human-computer interaction interface data of the smart cockpit is automatically obtained, the user's operations are simulated, the operation instructions are generated, the faults are identified, the test data is saved, and the automated testing is realized.
It realizes automated testing of various applications in the smart cockpit, reduces development costs, improves testing efficiency, and covers necessary, frequent and occasional failures, improving safety.
Smart Images
Figure CN120255463A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the technical field of vehicle testing, and particularly to an intelligent cockpit testing method, testing equipment, intelligent cockpit and medium. Background Art
[0002] Intelligent cockpit products have realized functions such as wireless communication, navigation, 360° panoramic monitoring, driver safety monitoring, information entertainment, OTA upgrade, etc., providing diversified interaction experiences for drivers and passengers through intelligent and networked technologies. With the continuous enhancement of the integration and processing capabilities of in-vehicle chips, transplanting mobile applications to intelligent cockpits has become a development trend. During the development process of intelligent cockpit products, the software versions of mobile applications will go through multiple iterations, and a large number of tests are required to avoid faults such as application crashes, black screens, control disabling, and abnormal pop-ups in intelligent cockpit products.
[0003] Currently, the commonly used testing method is that testers manually click on the interaction interface of the intelligent cockpit to test the application, or a robotic arm can be used to simulate the tester's click on the application to complete the test. These testing methods require a large amount of manpower, or additional costs and resources. Therefore, there is an urgent need for an automatic and low-cost intelligent cockpit testing method. Summary of the Invention
[0004] The present application provides an intelligent cockpit testing method, testing equipment, intelligent cockpit and medium, aiming to effectively solve the above technical problems.
[0005] The present application provides an intelligent cockpit testing method, which is applied to testing equipment and includes:
[0006] A first data acquisition step of acquiring the human-machine interaction interface data sent by the intelligent cockpit, where the human-machine interaction interface data includes at least one application program;
[0007] A simulated operation step of performing simulated user operations on at least one application program on the human-machine interaction interface according to the human-machine interaction interface data, generating an operation instruction and sending it to the intelligent cockpit;
[0008] A second data acquisition step of acquiring the post-response interface data sent by the intelligent cockpit and performing fault identification based on the post-response interface data, where the post-response interface data is generated after the intelligent cockpit controls the target application in response to the operation instruction sent by the testing equipment;
[0009] A data saving instruction step of sending a test data saving instruction to the intelligent cockpit when the fault identification result indicates the existence of a fault and the fault types are different.
[0010] Through one or more of the above embodiments in the present application, at least the following technical effects can be achieved: The test device first obtains the human-machine interaction interface mapped from the intelligent cockpit, then simulates user operations on the mapped human-machine interaction interface, and performs fault identification on the response interface of the intelligent cockpit after responding to the simulated user operations, and saves the test data according to the fault identification results. It not only realizes the automated testing of various application programs in the intelligent cockpit, but also does not require additional hardware, greatly reducing the development cost. In addition, it can automatically identify faults and improve the testing efficiency. Moreover, by performing multiple loop tests, it is ensured that the test scope can cover inevitable faults, frequent faults, and occasional faults to improve the safety of the intelligent cockpit. BRIEF DESCRIPTION OF THE DRAWINGS
[0011] The following will clearly show the technical solutions and other beneficial effects of the present application by describing the specific embodiments of the present application in detail with reference to the drawings.
[0012] Figure 1 The following shows the structural schematic diagram of the hardware device provided by the embodiment of the present application;
[0013] Figure 2 The following shows the flow schematic diagram of the intelligent cockpit testing method applied to the test device provided by the embodiment of the present application;
[0014] Figure 3 The following shows one of the schematic diagrams of fault identification of character types provided by the embodiment of the present application;
[0015] Figure 4 The following shows another schematic diagram of fault identification of character types provided by the embodiment of the present application;
[0016] Figure 5 The following shows one of the schematic diagrams of fault identification of image types provided by the embodiment of the present application;
[0017] Figure 6 The following shows another schematic diagram of fault identification of image types provided by the embodiment of the present application;
[0018] Figure 7 The following shows the flow schematic diagram of the intelligent cockpit testing method applied to the intelligent cockpit provided by the embodiment of the present application;
[0019] Figure 8 The following shows the overall flow schematic diagram of the intelligent cockpit testing method provided by the embodiment of the present application. DETAILED DESCRIPTION OF THE EMBODIMENTS
[0020] Next, the technical solutions in the embodiments of the present application will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative efforts belong to the scope of protection of the present application.
[0021] In the description of the present application, it should be noted that unless otherwise clearly specified and limited, the term "and / or" in this article is only a description of the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B may represent: A exists alone, A and B exist simultaneously, and B exists alone. In addition, the character " / " in this article generally represents an "or" relationship between the associated objects before and after without special explanation.
[0022] Before describing the intelligent cockpit test method provided by the present invention, the hardware involved in the intelligent cockpit test method will be described first, as Figure 1 shown, specifically including an intelligent cockpit, a DC power supply, and a test device.
[0023] Among them, the test device is respectively communicatively connected to the intelligent cockpit and the DC power supply (i.e., DC Power Supply), and the DC power supply is electrically connected to the intelligent cockpit (Head Unit).
[0024] The test device can be an electronic device such as a smart screen, a tablet computer, a notebook computer, a super mobile personal computer, a netbook, a personal digital assistant, etc., and this is not limited.
[0025] The test device and the DC power supply can be communicatively connected through various methods such as Ethernet, RS232, USB, etc. The DC power supply supports the SCPI protocol, and SCPI is composed of ASCII characters. Specifically, the test device can send SCPI instructions to the DC power supply by calling the PyVISA software library to achieve remote power-on, power-off, restart and other power controls for the DC power supply.
[0026] The test device also includes software such as screen projection software, software for automatically controlling the mouse and keyboard, character recognition software, image processing software, etc., which are respectively used to implement interface projection of the intelligent cockpit, simulate user operations, character recognition, and image comparison, etc.
[0027] The test device and the intelligent cockpit can be communicatively connected through various methods such as USB, LAN, Wifi, and WAN, and this is not limited.
[0028] The intelligent cockpit provides a human-machine interaction interface for users, and the DC power supply supplies power to the intelligent cockpit.
[0029] The following introduces an intelligent cockpit testing method, testing device, intelligent cockpit, and medium provided by this application in conjunction with the accompanying drawings.
[0030] Figure 2 The following shows a schematic flowchart of the intelligent cockpit testing method applied to a testing device provided by an embodiment of this application. As Figure 2 shown, the intelligent cockpit testing method applied to a testing device includes the following steps:
[0031] The first data acquisition step S201: Acquire the human-machine interaction interface data sent by the intelligent cockpit, where the human-machine interaction interface data includes at least one application program.
[0032] In this step, the testing device acquires the human-machine interaction interface mapped by the intelligent cockpit, and on this human-machine interaction interface, there are at least one application program as the test object.
[0033] The simulation operation step S202: Perform simulated user operations on at least one application program on the human-machine interaction interface according to the human-machine interaction interface data, generate operation instructions, and send them to the intelligent cockpit.
[0034] In this step, the testing device automatically performs simulated user operations on each application program on the human-machine interaction interface through a preset test script, generates corresponding operation instructions, and then sends the operation instructions to the intelligent cockpit.
[0035] Among them, the preset test script is generated for the relevant application programs in the intelligent cockpit, such as the test scripts related to functions such as single-shot, continuous shooting, and video recording of the driving recorder. And the test sequences included in the test script can cover the controls of each application program in the intelligent cockpit.
[0036] The simulated user operation refers to operations such as simulating mouse clicks, movements, drags, and keyboard inputs.
[0037] The operation instructions include the operation type (such as single-click, double-click, move of the mouse, keyboard input, etc.), the object of the operation (i.e., the target application), the position information of the operation, etc.
[0038] After the intelligent cockpit obtains the operation instructions, it performs corresponding operations on the target application on the human-machine interaction interface according to the operation type, the object of the operation, the position information of the operation, etc.
[0039] The second data acquisition step S203: Acquire the post-response interface data sent by the intelligent cockpit, and perform fault identification based on the post-response interface data. The post-response interface data is generated after the intelligent cockpit controls the target application in response to the operation instructions sent by the testing device.
[0040] In this step, after the intelligent cockpit controls the target application according to the operation instruction and generates the post-response interface data, the post-response interface will be displayed on the test device, and fault identification will be performed based on the post-response interface to determine whether the target application has a fault and information about the fault type.
[0041] The data saving instruction step S204 sends a test data saving instruction to the intelligent cockpit when the fault identification result is that there is a fault and the fault types are different.
[0042] In this step, if it is determined that a fault has occurred and the fault type has not appeared before, the test device will send a test data saving instruction to the intelligent cockpit to save the running data on the intelligent cockpit as test data. At the same time, the log file on the test device and the post-response interface of the fault will be saved, and the test device will generate a test report based on the test data, log file, post-response interface of the fault, fault type, etc. on the intelligent cockpit.
[0043] If the fault identification result is that there is no fault, or there is a fault but the fault type has appeared before, no test data saving instruction will be sent to the intelligent cockpit, and new simulated user operations will be performed according to the predetermined test sequence for a new round of testing.
[0044] The test repetition step S205 repeats the simulation operation step S202 to the test repetition step S205 until the preset test end conditions are met when the fault identification result is that there is no fault or the fault types are the same. The test end conditions include the number of cycles and the test time.
[0045] In this step, if the fault identification result is that there is no fault or the fault type is repeated with the previously collected test data, the post-response interface of this time will be skipped, and S202 to S205 will be repeated until the preset number of cycles or test time is reached, or the test person actively interrupts the test operation.
[0046] By continuously repeating S202 to S205, comprehensive testing of the inevitable faults, frequent faults, and occasional faults (classified according to the frequency of fault occurrence during the test) in the intelligent cockpit can be achieved, such as application crashes, black screens, control disabling, abnormal pop-ups, etc. Fault reproduction is an important means to analyze the cause of the fault and verify the solution. The higher the frequency of fault occurrence, the easier it is to identify a clear fault reproduction path, and the problem can be solved quickly. The lower the frequency of fault occurrence, the greater the difficulty of analysis and solution.
[0047] In the prior art, for occasional faults, a large number of repeated tests are required to reproduce them, and a large amount of test resources are needed. Relying solely on testers to complete the tests manually or with robotic arms requires a large amount of labor costs and time costs. Moreover, for complex operation sequences, it is difficult to ensure operation consistency through manual operations.
[0048] The intelligent cockpit test method provided by the embodiments of the present invention enables the test device to first obtain the human-machine interaction interface mapped from the intelligent cockpit, then perform simulated user operations on the mapped human-machine interaction interface, and identify faults in the response interface after the intelligent cockpit responds to the simulated user operations, and save the test data according to the fault identification results. This not only realizes the automated testing of various application programs in the intelligent cockpit, but also does not require additional hardware, greatly reducing the development cost. In addition, it can automatically identify faults, improving the test efficiency. Moreover, through multiple loop tests, it is ensured that the test scope can cover inevitable faults, frequent faults, and occasional faults, so as to improve the safety of the intelligent cockpit.
[0049] In some embodiments of the present invention, the step of identifying faults based on the data of the response interface after includes:
[0050] Take screenshots of the response interface after in the data of the response interface after to obtain at least one target area, where the target area includes images and characters showing the running status of the application program. Schematically, the running status of the driving recorder can be whether the video recording control is in use (when in use, the video recording control is indicated by a highlighted state, and when not in use, it is not highlighted). The calendar shows its running status through the text of year, month, and day.
[0051] For the target area including images, compare the target area with a preset fault picture library to obtain an image comparison result.
[0052] For the target area including characters, perform character recognition on the target area to obtain a character recognition result.
[0053] Compare the character recognition result with preset fault characters to obtain a character comparison result.
[0054] In this embodiment, the fault identification method is divided into character fault identification and image fault identification. Schematically, Figure 3 and Figure 4 are character fault identifications, Figure 5 and Figure 6 are image fault identifications.
[0055] Figure 3 is the fault identification of the communication status of the radio application program, such as Figure 3As shown in the figure, first determine the area where the radio application is located on the entire post-response interface, and take a screenshot of the area that displays the running status of the radio application in the area where the radio application is located to obtain the target area, so as to reduce the calculation amount and improve the fault recognition efficiency.
[0056] Subsequently, the text in the target area is recognized through an optical character recognition algorithm, and the character recognition result is "87.0", while the fault character of the radio communication status is "00.0". Since the two do not match, it is determined that the communication status of the radio is normal. If the obtained character recognition result is "00.0", which matches the fault character, it is determined that the communication status of the radio has a fault.
[0057] Figure 4 It is the fault recognition of the synchronization status of the calendar application. As Figure 4 shown, a screenshot of the target area where the year and month are located on the calendar interface is taken, and then the text in the target area is recognized by using an optical character recognition algorithm. The character recognition result "December 2023" does not match the fault character "July 2020" of the calendar synchronization status, so it is determined that the synchronization function of the calendar is normal. If the character recognition result matches the fault character, it is determined that the synchronization function of the calendar is abnormal.
[0058] Figure 5 It is the video preview function of the dash cam application. For the Figure 5 video preview in it, a partial screenshot of the video preview area on the dash cam interface is taken to form the target area. The target area is compared with a preset video preview fault image (which can be a black screen, snowflakes, etc.). If the comparison is successful, it is determined that the video preview of the dash cam application has a fault. If the comparison fails, it is determined that the video preview function of the dash cam application is normal.
[0059] Figure 6 It is the function of the take photo button of the dash cam application. The area where the take photo button control is located on the dash cam interface is intercepted as the target area, and the target area is compared with a preset fault image of the take photo button (the icons in the used state and the unused state of the take photo button are different). If the comparison is successful, it is determined that the take photo button of the dash cam has a fault. If the comparison fails, it is determined that the take photo button of the dash cam is normal.
[0060] It should be noted that the preset fault characters and the fault picture library are updated in real time, and each fault character and fault picture has a corresponding fault name. After the comparison is successful, the corresponding fault name is also output to facilitate the generation of the test report.
[0061] In some embodiments of the present invention, the step of performing fault recognition based on the post-response interface data includes:
[0062] When the character comparison result is a successful comparison or the image comparison result is a successful comparison, determine that the fault identification result is that a fault exists, and send the fault identification result to the intelligent cockpit. The fault identification result includes whether a fault has occurred and the type of fault.
[0063] In this embodiment, the test device sends the fault identification result to the intelligent cockpit so that the intelligent cockpit can present the fault identification result to the tester.
[0064] When the character comparison fails or the image comparison fails, the test device performs a new simulated user operation and starts a new round of testing.
[0065] In some embodiments of the present invention, before the first data acquisition step, the method further includes:
[0066] Send a power-on command to the DC power supply, where the DC power supply is used to supply power to the intelligent cockpit.
[0067] After the test repetition step, the method further includes:
[0068] After reaching the preset test end condition, send a power-off command to the DC power supply.
[0069] In this embodiment, the test device also powers on and off the intelligent cockpit through remote control. Specifically, the test device first sends a power-on command to the DC power supply, and the DC power supply powers on the intelligent cockpit in response to the power-on command. After the intelligent cockpit is powered on, it maps the human-computer interaction interface to the test device.
[0070] After the test is completed or when the intelligent cockpit needs to be powered off for other reasons, the test device sends a power-off command to the DC power supply, and the DC power supply powers off the intelligent cockpit in response to the power-off command.
[0071] The test device can also send a restart command to the DC power supply to restart the intelligent cockpit.
[0072] Through the remote control of the DC power supply by the test device, the power control of the intelligent cockpit is realized, eliminating the need for testers to be on duty in the intelligent cockpit and reducing labor costs.
[0073] Figure 7 The following shows a schematic flowchart of the intelligent cockpit test method applied to an intelligent cockpit provided by an embodiment of the present application, as Figure 7 shown, the intelligent cockpit test method applied to an intelligent cockpit includes the following steps:
[0074] S701, send the human-computer interaction interface data to the test device; wherein, the human-computer interaction interface data includes at least one application program.
[0075] In this step, after the intelligent cockpit is powered on, the intelligent cockpit maps the human-machine interaction interface to the test device, and the human-machine interaction interface includes at least one application program.
[0076] S702, control the target application in response to the operation instruction sent by the test device, and send the interface data after response to the test device.
[0077] Among them, the operation instruction is generated by the test device simulating user operations on at least one application program on the human-machine interaction interface.
[0078] In this step, the intelligent cockpit performs corresponding operations on the target application on the human-machine interaction interface according to the target application, the position information of the target application, and the operation type (such as mouse click, movement, keyboard input, etc.) in the operation instruction, and maps the interface after response after the operation to the test device.
[0079] S703, in response to the test data saving instruction sent by the test device, save the running data corresponding to the interface data after response that is recognized as a fault as test data. Schematically, if the photo-taking button of the driving recorder fails, the data during the control process of the photo-taking button of the driving recorder is saved.
[0080] In addition, the intelligent cockpit also obtains the fault recognition result including the fault type sent by the test device, and issues a warning based on the fault type. Obtain the fault recognition result including the fault type sent by the test device, and issue a warning based on the fault type, for example, enable the tester to immediately understand the fault type through voice broadcast, display on the display screen, etc.
[0081] For the intelligent cockpit test method provided by the embodiments of the present invention, the intelligent cockpit first maps the human-machine interaction interface to the test device, performs simulated user operations through the test device, and controls the target application in response to the simulated operations, and then the test device performs fault recognition based on the interface after response. No additional hardware is required during the entire test process, which not only realizes automation but also greatly reduces costs. In addition, it can automatically identify different types of faults, improving the test efficiency. In addition, through multiple loop tests, it is ensured that the test scope can cover inevitable faults, frequent faults, and occasional faults to improve the safety of the intelligent cockpit.
[0082] Another embodiment of the present application also provides an intelligent cockpit test method, as Figure 8 shown, this intelligent cockpit test method includes the following steps:
[0083] S801, the test device sends a power-on instruction to the DC power supply.
[0084] In this step, the test device can be a PC, which can not only send a power-on command to the DC power supply, but also send a power-off command and a restart command.
[0085] In this embodiment, the test device uses a Python test script to call the PyVISA software library to send SCPI commands to the DC power supply to achieve remote power control.
[0086] S802, the DC power supply responds to the power-on command to supply power to the intelligent cockpit, and the intelligent cockpit starts up successfully.
[0087] S803, the intelligent cockpit mirrors the interactive interface to the test device.
[0088] In this embodiment, the SCRCPY software on the test device maps the human-computer interaction interface to the PC side through the ADB (Android Debug Bridge) interface.
[0089] S804, the test device uses a preset script and software that automatically controls the mouse and keyboard to simulate user input, generates operation commands and sends them to the intelligent cockpit.
[0090] In this embodiment, the SCRCPY software on the test device also pushes the simulated input of the mouse and keyboard to the Android system of the intelligent cockpit in real time.
[0091] S805, the intelligent cockpit responds to the operation command to control the target application and mirrors the responded interface to the test device.
[0092] S806, the test device takes screenshots on the responded interface to obtain multiple target areas.
[0093] It should be noted that the target area here is the area that changes after the target application responds to the simulated operation, and within this area, there are characters or images showing the running state of the target application.
[0094] S807, perform character recognition and comparison, or image comparison on the target area to obtain a character comparison result or an image comparison result. The comparison result includes information such as whether there is a match and the fault name after the match.
[0095] S808, verify the character comparison result or the image comparison result, and determine whether the fault is reproduced according to the fault name.
[0096] S809, when the fault is reproduced, enter S810; when the fault appears for the first time, enter S811.
[0097] S810, determine whether the preset test sequence in the test script has been completed. If not, proceed to S804; if completed, proceed to S812.
[0098] S811, abort the test, save the data on-site of the intelligent cockpit, save the information of the logs, target area, and failure results on the test equipment, generate relevant test reports, and then enter the end state.
[0099] S812, determine whether the preset test end condition is met. If not, proceed to S801 and restart the test through the power-off command, power-on command, or restart command of the test equipment; if met, enter the end state. The test end conditions here include the preset number of loops, preset test time, or an abort command manually issued by the tester.
[0100] Based on any of the above embodiments, another embodiment of the present application further provides a test device, which includes the following:
[0101] The first data acquisition module is used to acquire the human-machine interaction interface data sent by the intelligent cockpit, and the human-machine interaction interface data includes at least one application program.
[0102] The simulation operation module is used to perform simulated user operations on at least one application program on the human-machine interaction interface according to the human-machine interaction interface data, generate operation instructions and send them to the intelligent cockpit.
[0103] The second data acquisition module is used to acquire the post-response interface data sent by the intelligent cockpit and perform fault identification based on the post-response interface data. The post-response interface data is generated after the intelligent cockpit controls the target application in response to the operation instructions sent by the test device.
[0104] The data saving instruction module is used to send a test data saving instruction to the intelligent cockpit when the fault identification result is that there is a fault and the fault types are different.
[0105] The test device corresponds to the intelligent cockpit test method applied to the test device described above and will not be elaborated here.
[0106] Based on any of the above embodiments, another embodiment of the present application further provides an intelligent cockpit, which includes the following:
[0107] The first data sending module is used to send the interaction interface data of the intelligent cockpit to the test device; wherein, the human-machine interaction interface data includes at least one application program.
[0108] The second data sending module is used to control the target application in response to the operation instruction sent by the test device, and send the interface data after response to the test device, where the operation instruction is generated by the test device simulating user operations on at least one application program on the human-computer interaction interface.
[0109] The data saving module is used to save the running data corresponding to the interface data after response identified as a fault as test data in response to the test data saving instruction sent by the test device.
[0110] The intelligent cockpit corresponds to the above-mentioned intelligent cockpit test method applied to the intelligent cockpit, and will not be elaborated here.
[0111] Based on any of the above embodiments, another embodiment of the present application further provides an electronic device, which may include: a processor (Processor), a communication interface (Communications Interface), a memory (Memory), and a communication bus. Among them, the processor, the communication interface, and the memory complete mutual communication through the communication bus. The processor can call the logical instructions in the memory to execute the above-mentioned intelligent cockpit test method.
[0112] In addition, when the logical instructions in the above-mentioned memory are implemented in the form of software functional units and sold or used as an independent product, they can be stored in a computer-readable storage medium. Based on such an understanding, the technical solution of the present application essentially or the part that contributes to the prior art or a part of this technical solution can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to enable a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in various embodiments of the present application. The foregoing storage medium includes: USB flash drives, mobile hard disks, read-only memories (ROM, Read-Only Memory), random access memories (RAM, Random Access Memory), magnetic disks, or optical disks and other various media that can store program codes.
[0113] In addition, when the logical instructions in the above-mentioned memory are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on such an understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or a part of this technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in various embodiments of this application. The foregoing storage medium includes: various media such as USB flash drives, mobile hard disks, read-only memories (ROMs), random access memories (RAMs), magnetic disks, or optical discs that can store program codes.
[0114] On the other hand, an embodiment of this application also provides a storage medium, on which multiple instructions are stored, and the instructions are suitable for being loaded by a processor to execute the intelligent cockpit test method provided in the above-mentioned various embodiments.
[0115] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed to multiple network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment. A person of ordinary skill in the art can understand and implement it without creative efforts.
[0116] Through the description of the above embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus a necessary general hardware platform, and of course, it can also be implemented by hardware. Based on such an understanding, the technical solution, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, magnetic disk, optical disc, etc., and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the methods described in various embodiments or some parts of the embodiments.
[0117] In summary, although this application has been disclosed above with preferred embodiments, the above-mentioned preferred embodiments are not intended to limit this application. Those of ordinary skill in the art can make various changes and modifications without departing from the spirit and scope of this application. Therefore, the protection scope of this application is subject to the scope defined by the claims.
Claims
1. An intelligent cockpit testing method, applied to a testing device, characterized in that, Including: A first data acquisition step of acquiring human-machine interaction interface data sent by an intelligent cockpit, where the human-machine interaction interface data includes at least one application program; A simulation operation step of performing simulated user operations on at least one application program on the human-machine interaction interface according to the human-machine interaction interface data, generating an operation instruction and sending it to the intelligent cockpit; A second data acquisition step of acquiring post-response interface data sent by the intelligent cockpit and performing fault identification based on the post-response interface data, where the post-response interface data is generated after the intelligent cockpit controls a target application in response to the operation instruction sent by the test device; A data saving instruction step of sending a test data saving instruction to the intelligent cockpit when the fault identification result indicates that there is a fault and the fault types are different.
2. The intelligent cockpit testing method according to claim 1, wherein, The step of performing fault identification based on the post-response interface data includes: Taking a screenshot of the post-response interface in the post-response interface data to obtain at least one target area, where the target area includes an image showing the running state of the application program; Comparing the target area with a preset fault picture library to obtain an image comparison result.
3. The intelligent cockpit testing method according to claim 2, wherein, The target area further includes characters showing the running state of the application program. The step of performing fault identification based on the post-response interface data includes: Performing character recognition on the target area to obtain a character recognition result; Comparing the character recognition result with preset fault characters to obtain a character comparison result.
4. The intelligent cockpit testing method according to claim 3, wherein, The step of performing fault identification based on the post-response interface data includes: When the character comparison result is a successful comparison or the image comparison result is a successful comparison, determining that the fault identification result is that there is a fault, and sending the fault identification result to the intelligent cockpit.
5. The intelligent cockpit testing method according to claim 1, wherein After the data saving step, the method further includes: A test repetition step of repeating the simulation operation step to the test repetition step until a preset test end condition is reached when the fault identification result indicates that there is no fault or the fault types are the same, where the test end condition includes the number of loops and the test time.
6. The intelligent cockpit test method according to claim 1, wherein The first data acquisition step includes: Displaying the human-machine interaction interface mapped by the intelligent cockpit, where the human-machine interaction interface includes at least one application program.
7. The intelligent cockpit test method according to claim 5, wherein, Before the first data acquisition step, the method further includes: Sending a power-on instruction to a DC power supply, where the DC power supply is used to supply power to the intelligent cockpit; After the test repetition step, the method further includes: After reaching the preset test end condition, sending a power-off instruction to the DC power supply.
8. An intelligent cockpit testing method, applied to an intelligent cockpit, characterized in that, Including: Sending the human-machine interaction interface data to a test device; where the human-machine interaction interface data includes at least one application program; Controlling a target application in response to the operation instruction sent by the test device and sending the post-response interface data to the test device, where the operation instruction is generated by the test device performing simulated user operations on at least one application program on the human-machine interaction interface; In response to the test data saving instruction sent by the test device, the operation data corresponding to the post-response interface data identified as a fault is saved as test data.
9. The intelligent cockpit test method according to claim 8, wherein After the step of responding to the test data saving instruction sent by the test device, the method further includes: Obtaining a fault identification result including a fault type sent by the test device, and giving an early warning based on the fault type.
10. A test device, characterized in that, It includes: A first data acquisition module, configured to acquire human-machine interaction interface data sent by the intelligent cockpit, where the human-machine interaction interface data includes at least one application program; A simulation operation module, configured to perform simulated user operations on at least one application program on the human-machine interaction interface according to the human-machine interaction interface data, generate an operation instruction and send it to the intelligent cockpit; A second data acquisition module, configured to acquire post-response interface data sent by the intelligent cockpit, and perform fault identification based on the post-response interface data, where the post-response interface data is generated after the intelligent cockpit controls a target application in response to the operation instruction sent by the test device; A data saving instruction module, configured to send a test data saving instruction to the intelligent cockpit when the fault identification result indicates a fault and the fault types are different.
11. An intelligent cockpit, characterized in that, It includes: A first data sending module, configured to send the interaction interface data of the intelligent cockpit to the test device; where the human-machine interaction interface data includes at least one application program; A second data sending module, configured to control a target application in response to the operation instruction sent by the test device, and send the post-response interface data to the test device, where the operation instruction is generated by the test device performing simulated user operations on at least one application program on the human-machine interaction interface; A data saving module, configured to save the operation data corresponding to the post-response interface data identified as a fault as test data in response to the test data saving instruction sent by the test device.
12. A storage medium, characterized in that, Multiple instructions are stored in the storage medium, and the instructions are suitable for being loaded by a processor to execute the steps of the intelligent cockpit test method according to any one of claims 1 to 9.