Test method and system of vehicle interaction system, storage medium and equipment

Abstract

The invention discloses a test method and system of a vehicle interaction system, a storage medium and equipment, and relates to the field of vehicle testing, and the method comprises the steps: recording a click position of a function icon currently clicked by a mechanical arm and a UI interface to which the function icon jumps after clicking through image collection equipment, the UI interface to which the function icon jumps is a sub-UI interface of the UI interface where the currently clicked function icon is located; creating a function branch node corresponding to the sub UI interface; connecting the function branch node corresponding to the parent UI interface with the function branch node corresponding to the child UI interface; determining a tree diagram according to the created functional branch nodes and the connection relationship between the functional branch nodes; according to the tree diagram, creating a test case corresponding to the vehicle interaction system; and testing the vehicle interaction systems of other vehicles through the test case to obtain a test result. Through the method provided by the invention, the maintenance time of the test case is shortened, and meanwhile, the test efficiency of the vehicle interaction system is improved.

Description

Technical Field

[0001] The present invention relates to the field of vehicle testing technology, and in particular to a testing method, system, storage medium and equipment for a vehicle interaction system. Background Art

[0002] In recent years, the main driving force for the rapid development of the automotive industry has gradually shifted from product and technology driven by the supply side to the driving force of increasing customer demand. Consumers' perception of cars has also gradually changed from "single means of transportation" to "third space", and the vehicle interaction system is the core carrier for realizing space shaping. Human-computer interaction, automotive chips and operating system technologies will promote the future development of the interaction system and even trigger changes. At this point, the UI & UE testing of the vehicle interaction system has become particularly important. For large-scale iterative projects, the vehicle interaction system, as a terminal directly facing consumers, changes most frequently during the iteration process. Minor changes in the interaction system will directly cause the previous automated test cases to fail to run correctly.

[0003] In the prior art, the automated testing execution speed of the UI&UE of the vehicle interaction system is slow. Changes in the iterative process result in a particularly long manual maintenance time for the automated cases. Each iteration and even each requirement requires manual regression testing, which ultimately leads to a long maintenance time for the test cases, affecting the testing efficiency of the vehicle interaction system. Summary of the invention

[0004] In view of this, the present invention provides a vehicle interaction system testing method, system, storage medium and device, aiming to shorten the maintenance time of test cases and improve the testing efficiency of the vehicle interaction system.

[0005] In order to achieve the above-mentioned object, a first aspect of an embodiment of the present application provides a method for testing a vehicle interaction system, the method comprising: Control the robotic arm to click on the function icons in the UI interface of the vehicle interaction system; The image acquisition device is used to record the click position of the function icon currently clicked by the robot arm and the UI interface jumped to after the click, and it is determined that the UI interface where the function icon currently clicked is located is the parent UI interface of the UI interface jumped to, and the UI interface jumped to is the child UI interface of the UI interface where the function icon currently clicked is located; Creating a function branch node corresponding to the sub-UI interface, and based on the sub-UI interface and the click position of the UI interface where the currently clicked function icon is located, recording key verification information and the click position of the currently clicked function icon in the function branch node; Connecting the function branch node corresponding to the parent UI interface with the function branch node corresponding to the child UI interface; Determine a tree diagram according to the created functional branch nodes and the connection relationship between the functional branch nodes; According to the tree diagram, create a test case corresponding to the vehicle interaction system; The vehicle interaction systems of other vehicles are tested through the test cases to obtain test results.

[0006] Optionally, based on the sub-UI interface and the click position of the UI interface where the currently clicked function icon is located, recording the key verification information of the currently clicked function icon and the click position in the function branch node includes: Determine key verification information of the currently clicked function icon according to the color jump of the sub-UI interface to which the currently clicked function icon jumps after being clicked and / or the change of interface information; The key verification information and the click position are recorded in the function branch node corresponding to the sub-UI interface.

[0007] Optionally, the method further comprises: Based on the user's adjustment of the function icon in the UI interface of the vehicle interaction system, the click position of the adjusted function icon and the UI interface jumped to after the click are re-recorded through an image acquisition device; Based on the re-recorded click position of the adjusted function icon and the UI interface to which the click jumps, the click position and key verification information recorded in the function branch node corresponding to the adjusted function icon are updated to obtain a new tree diagram; Creating a new test case corresponding to the vehicle interaction system according to the new tree diagram; The vehicle interaction systems of other vehicles are tested using the new test case to obtain test results.

[0008] Optionally, before recording, by the image acquisition device, the click position of the function icon currently clicked by the robotic arm and the UI interface to which the robot arm jumps after the click, the method further includes: Determine whether the UI interface jumped to by clicking the function icon is a negative response interface or an interface that pops up conditional error response information; In the case where the UI interface jumped to is a negative response interface or an interface with a pop-up conditional error response message, determining whether the UI interface jumped to is consistent with a preset result; When the consistency is determined, the following steps are executed: recording the click position of the function icon currently clicked by the robotic arm and the UI interface jumped to after the click through the image acquisition device, and determining that the UI interface where the function icon currently clicked is located is the parent UI interface of the UI interface jumped to, and the UI interface jumped to is the child UI interface of the UI interface where the function icon currently clicked is located; When an inconsistency is determined, an alert is sent to the development side so that the development side can repair the vehicle interaction system.

[0009] Optionally, testing the vehicle interaction systems of other vehicles by using the test case to obtain test results includes: Control the robotic arm to click on a function icon in a target UI interface of a vehicle interaction system of another vehicle; Use an image acquisition device to record the target click position of the function icon currently clicked by the robot arm and the UI interface jumped to after clicking; According to the UI interface you jump to, determine the corresponding key verification information to be verified; Determining, according to the target click position and the test case, predicted key verification information corresponding to the target click position recorded in the test case; Comparing the key verification information to be verified with the predicted key verification information to obtain a comparison result; Determining a test sub-result of the function icon according to the comparison result; The test result of the vehicle interaction system of the other vehicle is determined according to the test sub-result of each function icon in the vehicle interaction system of the other vehicle.

[0010] Optionally, determining, according to the target click position and the test case, prediction key verification information corresponding to the target click position recorded in the test case includes: According to the target UI interface where the function icon at the target click position is located, determining the target function branch node corresponding to the target UI interface from the test case; Determine, according to the target function branch node and the test case, a function branch child node of the target function branch node in the test case; The key verification information recorded in the function branch subnode having the same recorded click position as the target click position is determined as the predicted key verification information.

[0011] Optionally, determining the test result of the vehicle interaction system of the other vehicle according to the test sub-result of each function icon in the vehicle interaction system of the other vehicle includes: When the test sub-results of each function icon in the vehicle interaction system of the other vehicle are that the key verification information to be verified is consistent with the corresponding predicted key verification information, it is determined that the test of the vehicle interaction system of the other vehicle is passed; When the key verification information to be verified is inconsistent with the corresponding predicted key verification information in the test sub-results of each function icon in the vehicle interaction system of other vehicles, the function icon corresponding to the inconsistent test sub-result is determined as the function icon to be modified; Re-record the click position of the to-be-modified function icon and the UI interface jumped to after the click through an image acquisition device; Based on the re-recorded click position of the function icon to be modified and the UI interface that jumps to after clicking, the click position and key verification information recorded in the function branch node corresponding to the function icon to be modified are updated to obtain a new tree diagram for creating a new test case.

[0012] A second aspect of an embodiment of the present application provides a testing system for a vehicle interaction system, the system comprising: A click control module is used to control the robot arm to click on the function icons in the UI interface of the vehicle interaction system; An image recording module is used to record the click position of the function icon currently clicked by the robot arm and the UI interface jumped to after the click through an image acquisition device, and determine that the UI interface where the currently clicked function icon is located is the parent UI interface of the UI interface jumped to, and the UI interface jumped to is the child UI interface of the UI interface where the currently clicked function icon is located; a data recording module, configured to create a function branch node corresponding to the sub-UI interface, and based on the sub-UI interface and the click position of the UI interface where the function icon currently clicked is located, record the key verification information of the function icon currently clicked and the click position in the function branch node; A node connection module, used to connect the function branch node corresponding to the parent UI interface with the function branch node corresponding to the child UI interface; A tree diagram determination module, used to determine a tree diagram according to the created functional branch nodes and the connection relationship between the functional branch nodes; A test case determination module, used for creating a test case corresponding to the vehicle interaction system according to the tree diagram; The test result determination module is used to test the vehicle interaction system of other vehicles through the test case to obtain the test result.

[0013] A third aspect of an embodiment of the present application provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the steps in the vehicle interaction system testing method as described in any one of the first aspects of the present application are implemented.

[0014] A fourth aspect of an embodiment of the present application provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the steps of the vehicle interaction system testing method as described in any one of the first aspects of the present application are implemented.

[0015] A vehicle interaction system testing method provided by the present application is adopted, and the method includes: controlling a robotic arm to click on a function icon in a UI interface of the vehicle interaction system; recording the click position of the function icon currently clicked by the robotic arm and the UI interface jumped to after the click through an image acquisition device, and determining that the UI interface where the currently clicked function icon is located is the parent UI interface of the UI interface jumped to, and the UI interface jumped to is the child UI interface of the UI interface where the currently clicked function icon is located; creating a function branch node corresponding to the child UI interface, and based on the child UI interface and the click position of the UI interface where the currently clicked function icon is located, recording key verification information and the click position of the currently clicked function icon in the function branch node; connecting the function branch node corresponding to the parent UI interface with the function branch node corresponding to the child UI interface; determining a tree diagram based on the connection relationship between each created function branch node and the function branch node; creating a test case corresponding to the vehicle interaction system based on the tree diagram; testing the vehicle interaction systems of other vehicles through the test case to obtain test results.

[0016] By clicking on the function icon on the UI interface, and recording the changes of the UI interface after the function icon is clicked through the image acquisition device, the click position of the function diagram in the UI interface is obtained and the UI sub-interface to which the UI interface jumps after being clicked is determined. Then create a function branch node corresponding to the sub-UI interface, which records the click position and key verification information of the function icon corresponding to the UI interface. Then connect the corresponding function branch nodes of the parent UI interface and the sub-UI interface, and then obtain a tree diagram, and automatically generate test cases through the tree diagram. The test case obtained by this method records the click position and key verification information corresponding to each function icon. Therefore, when using the test case to test the vehicle interaction system of other vehicles, if the function icon of the vehicle interaction system of other vehicles is modified, the present application can accurately determine the modified function icon through the function branch node in the test case, and accurately modify the click position of the function icon or the UI interface to which it jumps after clicking, avoiding the search for the function icon that needs to be modified by a large number of manual queries, saving the maintenance time of the test case, and thus improving the test efficiency of the vehicle interaction system of other vehicles. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1 is a flow chart of a vehicle interaction system testing method proposed in one embodiment of the present application; Figure 2 It is a tree diagram corresponding to the connection relationship between functional branch nodes provided by an embodiment of the present application; Figure 3is a schematic diagram of a test system for a vehicle interaction system proposed in an embodiment of the present application. DETAILED DESCRIPTION

[0018] The following will describe the embodiments of the present invention with reference to the accompanying drawings and preferred embodiments. Those skilled in the art can easily understand other advantages and effects of the present invention from the contents disclosed in this specification. The present invention can also be implemented or applied through other different specific embodiments, and the details in this specification can also be modified or changed in various ways based on different viewpoints and applications without departing from the spirit of the present invention. It should be understood that the preferred embodiments are only for illustrating the present invention, not for limiting the scope of protection of the present invention.

[0019] refer to Figure 1 , Figure 1 It is a flow chart of a vehicle interaction system testing method proposed in one embodiment of the present application. Figure 2 is a tree diagram corresponding to the connection relationship between functional branch nodes provided by an embodiment of the present application, such as Figure 1 and Figure 2 As shown, the method comprises the following steps: S11: Control the robotic arm to click on a function icon in the UI interface of the vehicle interaction system.

[0020] In this embodiment, the vehicle interaction system is used to receive instructions or information given by the user, so as to realize the control and management of the vehicle. The vehicle interaction system includes a UI interface, i.e., a user interface, which is used to feedback the user's instructions. For example, when the user clicks a function icon in the UI interface, the UI interface will jump to the interface corresponding to the function icon. After the vehicle interaction system is developed, in order to detect whether the click position corresponding to each function icon in the UI interface of the vehicle interaction system and the UI interface jumped to after clicking are correct, this embodiment tests the vehicle interaction system. Specifically, the upper computer software controls the mechanical arm to click the function icon in the UI interface of the vehicle interaction system so that the UI interface jumps, and the UI interface that jumps out is the interface generated corresponding to the function icon being clicked. Among them, the mechanical arm can preferably be a three-axis mechanical arm.

[0021] S12: Record the click position of the function icon currently clicked by the robotic arm and the UI interface jumped to after clicking through the image acquisition device, and determine that the UI interface where the currently clicked function icon is located is the parent UI interface of the UI interface jumped to, and the UI interface jumped to is the child UI interface of the UI interface where the currently clicked function icon is located.

[0022] In order to match the click position of the function icon in the UI interface with the UI interface to which it jumps, this embodiment adopts a method of recording the UI interface through an image acquisition device. Specifically, when the control arm clicks the function icon on the UI interface, the image acquisition device records the click position of the function icon currently clicked by the robot on the UI interface, and records the new UI interface that jumps out after the click. At this time, the UI interface where the function icon currently clicked is located is determined as the parent UI interface of the new UI interface that jumps out, and the corresponding new UI interface that jumps out is the child UI interface of the UI interface where the function icon currently clicked is located. If there is also a function icon in the child UI interface, the control arm clicks the function icon in the child UI interface, and the child UI interface will also respond and jump. At this time, the child UI interface becomes the parent UI interface of the newly jumped UI interface, and the newly jumped UI interface becomes the new child UI interface. Correspondingly, what the image acquisition device records is the click position of the function icon in the parent UI interface and the child UI interface. Preferably, the image acquisition device can be a high-definition camera.

[0023] For example, there is a function icon a in the existing A interface. Clicking function icon a will cause an interface jump to the B interface. At this time, the A interface is the parent UI interface of the B interface, and the B interface is the child UI interface of the A interface. If there are function icons b1 and b2 in the B interface, clicking function icon b1 in the B interface will cause an interface jump to the C interface. At this time, the B interface is the parent UI interface of the C interface, and the C interface is the child UI interface of the B interface. Clicking function icon b2 in the B interface will cause an interface jump to the D interface. At this time, the B interface is the parent UI interface of the D interface, and the D interface is the child UI interface of the B interface.

[0024] In addition, in order to ensure that the image recorded by the image acquisition device is not blurred due to the shaking of the vehicle during the test, this embodiment uses a fixing device for the unit under test to fix the vehicle interaction system. At the same time, in order to enable the image acquisition device to clearly record the changes in the UI interface, the image acquisition device is set directly above the vehicle interaction system.

[0025] S13: Create a function branch node corresponding to the sub-UI interface, and based on the sub-UI interface and the click position of the UI interface where the currently clicked function icon is located, record the key verification information and the click position of the currently clicked function icon in the function branch node.

[0026] Specifically, after determining the sub-UI interface corresponding to the currently clicked function icon, based on the click position of the currently clicked function icon in the parent UI interface recorded by the image acquisition device and the jumped sub-UI interface, the host computer software extracts information from the sub-UI interface to obtain key verification information in the sub-UI interface. The key verification information reflects the interface color change or interface graphic information change in the sub-UI interface. The host computer software then constructs the function branch node corresponding to the sub-UI interface, such as Figure 2 As shown, the key verification information and click position of the currently clicked function icon are recorded through the function branch node. The click position is the click point of the function icon in the parent UI interface, which can be expressed by coordinates, and the key verification information is the information extraction situation in the corresponding child UI interface jumped after clicking the function icon.

[0027] S14: Connecting the function branch node corresponding to the parent UI interface with the function branch node corresponding to the child UI interface.

[0028] In this embodiment, there may be multiple function icons in a UI interface, so a corresponding parent UI interface will correspond to multiple child UI interfaces, and because the parent UI interface and the child UI interface are two adjacent interfaces in a corresponding relationship, in the corresponding relationship between the parent UI interface and the adjacent previous interface, the parent UI interface is used as the child UI interface of the previous interface. Therefore, in order to reflect the corresponding relationship between the parent UI interface and the child UI interface, so as to accurately locate the two interfaces corresponding to the function icons, the function branch node corresponding to the parent UI interface and the function branch node corresponding to the child UI interface are connected. Among them, the parent UI interface and the child UI interface are two adjacent interfaces with a corresponding relationship, and a parent UI interface can have multiple child UI interfaces. Correspondingly, a function branch node of a parent UI interface can connect to the function branch nodes of multiple child UI interfaces.

[0029] Using the above example, connect the A1 function branch node corresponding to the A interface with the B1 function branch node corresponding to the B interface, and connect the B1 function branch node corresponding to the B interface with the C1 function branch node corresponding to the C interface. Since there is also a function icon b2 in the B interface, the B1 function branch node corresponding to the B interface is also connected to the D1 function branch node corresponding to the D interface corresponding to the function icon b2. If the A interface is the starting interface and the C interface is the ending interface, the connection from the A1 function branch node to the B1 function branch node and then to the C1 function branch node is a complete link connection relationship.

[0030] S15: Determine a tree diagram according to the created functional branch nodes and the connection relationships between the functional branch nodes.

[0031] S16: Creating a test case corresponding to the vehicle interaction system according to the tree diagram.

[0032] S17: Testing the vehicle interaction systems of other vehicles using the test case to obtain test results.

[0033] Specifically, based on the connection relationship between each functional branch node and the functional branch node, a tree diagram corresponding to the connection relationship is drawn, such as Figure 2 As shown. Through the click positions and key verification information corresponding to the function icons recorded by each function branch node in the tree diagram, the test case corresponding to the vehicle interaction system is automatically generated. The test case records the click position of each function icon in the parent UI interface and the information of the child UI interface. The vehicle interaction system of other vehicles is tested using the test case as the predicted result of other vehicles in the test, so as to determine whether the click position in the UI interface where each function icon in the vehicle interaction system of other vehicles is located and the jumped UI interface when it is clicked are consistent with those recorded in the predicted case, and obtain the final test result.

[0034] The testing method provided in the present application enables a one-to-one accurate comparison when testing the vehicle interaction system of other vehicles, that is, comparing the UI interface jumped out of the interaction system of other vehicles with the UI interface in the test case to quickly determine whether there is a difference. If there is a difference, accurate positioning and modification can be performed to automatically obtain the updated test case, thereby realizing automated maintenance of the test case and improving the testing efficiency of the vehicle interaction system.

[0035] In combination with the above embodiments, in one implementation, an embodiment of the present invention further provides a method for testing a vehicle interaction system. In the method for testing a vehicle interaction system, step S13 includes steps S21 to S22: S21: Determine key verification information of the currently clicked function icon according to the color jump condition and / or interface information change condition of the sub-UI interface to which the currently clicked function icon jumps after being clicked.

[0036] S22: Recording the key verification information and the click position in the function branch node corresponding to the sub-UI interface.

[0037] The image acquisition device is used to record the jump of the UI interface after the currently clicked function icon is clicked. Specifically, the upper computer software extracts the color jump of the sub-UI interface to which the current function icon jumps after being clicked, such as the background or icon color change, or extracts the interface information change in the sub-UI interface, such as the text information change, etc., based on the recording of the image acquisition device. The key verification information corresponding to the currently clicked function icon is determined based on the changes extracted from the sub-UI interface. The key verification information is used to verify whether the jumped UI interface is the interface generated by clicking the function icon. After obtaining the click position and key verification information of the currently clicked function icon, the click position and key verification information of the function icon are recorded in the function branch node corresponding to the sub-UI interface corresponding to the function icon.

[0038] In combination with the above embodiments, in one implementation, an embodiment of the present invention further provides a method for testing a vehicle interaction system. In the method for testing a vehicle interaction system, the method further includes steps S31 to S34: S31: Based on the user's adjustment of the function icon in the UI interface of the vehicle interaction system, re-record the click position of the adjusted function icon and the UI interface jumped to after the click through the image acquisition device.

[0039] S32: Based on the re-recorded click position of the adjusted function icon and the UI interface jumped to after clicking, the click position and key verification information recorded in the function branch node corresponding to the adjusted function icon are updated to obtain a new tree diagram.

[0040] S33: Creating a new test case corresponding to the vehicle interaction system according to the new tree diagram.

[0041] S34: Testing the vehicle interaction systems of other vehicles using the new test case to obtain test results.

[0042] In this embodiment, the UI interface in the vehicle interaction system is adjusted to improve the user experience, and the adjustment method may be to adjust the click position of the function icon in the UI interface or to adjust the interface information of the sub-UI interface corresponding to the function icon, etc. At this time, the test cases generated by the vehicle interaction system are updated and adjusted accordingly according to the adjustment of the function icon.

[0043] Specifically, determine which function icons in the UI interface of the vehicle interaction system have been adjusted by the user, and then re-record the click position of the adjusted function icon and the UI interface to which it jumps after clicking through the image acquisition device. Then, based on the re-recorded click position and the UI interface to which it jumps after clicking, re-acquire the click position and key verification information corresponding to the adjusted function icon, and then update the function branch node that originally records the click position and key verification information of the adjusted function icon. For example, if the click position of the adjusted function icon has changed, the click position is replaced in the corresponding function branch node. If the sub-UI interface of the adjusted function icon has changed, the key verification information recorded in the corresponding function branch node is replaced.

[0044] After updating the function branch nodes corresponding to all the adjusted function icons, a new tree diagram is obtained based on the connection relationship of the function branch nodes, and then the test cases are updated and adjusted according to the new tree diagram to create new test cases. If the user has adjusted the UI interface of the vehicle interaction system, that is, a disruptive adjustment has occurred, the function icons of the entire vehicle interaction system are re-recorded to obtain a new test case. Based on the new test case obtained, the vehicle interaction system of other vehicles is tested and the corresponding test results are obtained.

[0045] In combination with the above embodiments, in one implementation, an embodiment of the present invention further provides a vehicle interaction system testing method. Before step S12 in the vehicle interaction system testing method, the method further includes steps S41 to S44: S41: Determine whether the UI interface jumped to by clicking the function icon is a negative response interface or an interface that pops up conditional error response information.

[0046] S42: When the UI interface jumped to is a negative response interface or an interface that pops up conditional error response information, determine whether the UI interface jumped to is consistent with a preset result.

[0047] S43: When the consistency is determined, execute the following steps: record the click position of the function icon currently clicked by the robotic arm and the UI interface jumped to after the click through the image acquisition device, and determine that the UI interface where the currently clicked function icon is located is the parent UI interface of the UI interface jumped to, and the UI interface jumped to is the child UI interface of the UI interface where the currently clicked function icon is located.

[0048] S44: When an inconsistency is determined, a warning is issued to the development end so that the development end can repair the vehicle interaction system.

[0049] In this embodiment, if the click condition of a function icon in the UI interface is not met, clicking the function icon will jump to the UI interface with a negative response interface or a pop-up interface with a conditional error response message. For example, if a function icon is Bluetooth music, if the vehicle's Bluetooth has not established a connection relationship with other devices, clicking the Bluetooth music function icon at this time will cause the UI interface to jump to a negative response interface such as "Bluetooth not connected" to remind the user that the click condition is not met, or a pop-up interface with an error response message.

[0050] After clicking the function icon, when the UI interface jumped to is a negative response interface or an interface that pops up a conditional error response information, the staff determines whether the current UI interface jumped to is consistent with the preset result. The preset result is determined by the development end. If the development end itself is set to click the function icon, it will jump to a negative response interface or an interface that pops up a conditional error response information, then the jumped UI interface is judged to be consistent with the preset result; if the development end is set to click the function icon to jump to a normal interface, which is inconsistent with the negative response interface or the interface that pops up the conditional error response information when clicking the function icon during the actual test, then the jumped UI interface is judged to be inconsistent with the preset result.

[0051] When it is determined that the UI interface to be jumped to is consistent with the preset result, the click position of the function icon currently clicked by the robotic arm and the UI interface to be jumped to after clicking are recorded normally through the image acquisition device, and the UI interface where the function icon currently clicked is located is the parent UI interface of the UI interface to be jumped to, and the UI interface to be jumped to is a negative response interface or a conditional error response information interface, and the UI interface to be jumped to is also a child UI interface of the UI interface where the function icon currently clicked is located, and a normal test case is generated according to the steps in the above embodiment, and the test case generated in this way will cover the reverse test process, so that the test result reliability is higher. For example, click "Bluetooth Music" and jump to the negative response interface of "Bluetooth Not Connected", and correspondingly, it can be reversely determined that the "Bluetooth Connection" in the UI interface has not been clicked for testing.

[0052] If the UI interface jumped to is inconsistent with the preset result, it can be determined that there may be a fault in the vehicle interaction system. At this time, an alarm is sent to the development end to feedback the fault condition, and the development end then repairs the vehicle interaction system based on the alarm.

[0053] In combination with the above embodiments, in one implementation, an embodiment of the present invention further provides a method for testing a vehicle interaction system. In the method for testing a vehicle interaction system, step S17 includes steps S51 to S57: S51: Control the robotic arm to click on a function icon in a target UI interface of a vehicle interaction system of another vehicle.

[0054] S52: Recording, through an image acquisition device, the target click position of the function icon currently clicked by the robotic arm and the UI interface jumped to after the click.

[0055] S53: According to the UI interface jumped to, the corresponding key verification information to be verified is determined.

[0056] S54: Determine, according to the target click position and the test case, the predicted key verification information corresponding to the target click position recorded in the test case.

[0057] S55: Compare the key verification information to be verified with the predicted key verification information to obtain a comparison result.

[0058] S56: Determine the test sub-result of the function icon according to the comparison result.

[0059] S57: Determine the test result of the vehicle interaction system of the other vehicle according to the test sub-result of each function icon in the vehicle interaction system of the other vehicle.

[0060] Specifically, when testing the vehicle interaction system of other vehicles, the upper computer software controls the mechanical arm to click on the function icon in the target UI interface of the vehicle interaction system of other vehicles. The target UI interface refers to the UI interface to be tested. Preferably, the starting interface to the ending interface can be determined as the target UI interface in sequence, that is, the connection relationship between the functional branch nodes corresponding to the UI interface is tested in sequence. Then, the target click position of the currently clicked function icon in the target UI interface is recorded by an image acquisition device, and the UI interface that jumps to after the click is recorded. Then, information is extracted from the UI interface that jumps to after the click, and the key verification information of the UI interface that jumps to is determined, and the key verification information is determined as the key verification information to be verified.

[0061] Taking the target click position in the target UI interface as a reference, according to the click position and key verification information of the function icon recorded in the test case, the key verification information corresponding to the UI interface jumped out by clicking the target click position in the target UI interface is determined from the test case, and the key verification information is determined as the predicted key verification information. Then the key verification information to be verified in the vehicle interaction system of other vehicles is compared with the predicted key verification information in the test case to obtain the corresponding comparison result. According to the comparison result, the test sub-result of the currently clicked function icon can be determined. Specifically, if the comparison result is that the key verification information to be verified is consistent with the predicted key verification information, the test sub-result of the currently clicked function icon is determined to be the test passed of the function icon. If the comparison result is that the key verification information to be verified is inconsistent with the predicted key verification information, the test sub-result of the currently clicked function icon is determined to be the test failed of the function icon. After testing each function icon in the vehicle interaction system of other vehicles, the test sub-result corresponding to each function icon is obtained, and the test result of the vehicle interaction system of other vehicles is determined based on the test sub-result.

[0062] In combination with the above embodiments, in one implementation, an embodiment of the present invention further provides a method for testing a vehicle interaction system. In the method for testing a vehicle interaction system, step S54 includes steps S61 to S63: S61: According to the target UI interface where the function icon at the target click position is located, determine the target function branch node corresponding to the target UI interface from the test case.

[0063] S62: Determine, according to the target function branch node and the test case, a function branch child node of the target function branch node in the test case.

[0064] S63: Determine the key verification information recorded in the function branch subnode having the same recorded click position as the target click position as the predicted key verification information.

[0065] Specifically, through the target UI interface where the function icon corresponding to the target click position is located, the target function branch node corresponding to the target UI interface is determined from the test case. After the function icon in the target UI interface is clicked, it will jump to another UI interface, and the UI interface jumped to also has a corresponding function branch node. Through the test case, it can be determined that the function branch node has a connection relationship with the target function branch node, and the UI interface corresponding to the function branch node is a sub-UI interface of the UI interface corresponding to the target function branch node, and the function branch node is determined as the function branch sub-node of the target function branch node.

[0066] Since there may be multiple function icons in the target UI interface, the target UI interface may have multiple sub-UI interfaces, and the target function branch node corresponding to the target UI interface will have multiple function branch sub-nodes. At this time, based on the target click position of the function icon currently clicked in the vehicle interaction system of other vehicles, the function branch sub-node that is the same as the target click position is determined from the multiple function branch sub-nodes that record the click position, and then the key verification information recorded in the function branch sub-node is determined as the predicted key verification information.

[0067] In combination with the above embodiments, in one implementation, an embodiment of the present invention further provides a method for testing a vehicle interaction system. In the method for testing a vehicle interaction system, step S57 includes steps S71 to S74: S71: When the test sub-results of each function icon in the vehicle interaction system of the other vehicle are that the key verification information to be verified is consistent with the corresponding predicted key verification information, it is determined that the test of the vehicle interaction system of the other vehicle is passed.

[0068] S72: When there is inconsistency between the key verification information to be verified and the corresponding predicted key verification information in the test sub-results of each function icon in the vehicle interaction system of other vehicles, the function icon corresponding to the inconsistency in the test sub-result is determined as the function icon to be modified.

[0069] S73: re-recording the click position of the to-be-modified function icon and the UI interface jumped to after the click through the image acquisition device.

[0070] S74: Based on the re-recorded click position of the function icon to be modified and the UI interface jumped to after clicking, the click position and key verification information recorded in the function branch node corresponding to the function icon to be modified are updated to obtain a new tree diagram to create a new test case.

[0071] Specifically, if the test sub-results of each function icon in the vehicle interaction system of other vehicles are all that the key verification information to be verified is consistent with the corresponding predicted key verification information, it can be determined that the vehicle interaction system of the tested other vehicles has passed the test, and then the vehicle interaction system of other vehicles that have not been tested is tested based on the test case. If there is a key verification information to be verified and the corresponding predicted key verification information is inconsistent in the test sub-results of each function icon in the vehicle interaction system of other vehicles, this embodiment determines the function icon corresponding to the inconsistent test sub-result as the function icon to be modified, so as to re-record the function icon to be modified. Specifically, the click position of the function icon to be modified and the UI interface to be jumped to after clicking are re-recorded by the image acquisition device, and the corresponding function branch node recording the click position and key verification information of the function icon to be modified is updated through the newly obtained click position and the UI interface to be jumped to after clicking, so as to obtain a new tree diagram, and automatically update the test case based on the new tree diagram. And based on the obtained new test case, the vehicle interaction system of other vehicles that has not been tested is tested.

[0072] Based on the same inventive concept, an embodiment of the present application provides a test system for a vehicle interaction system, referring to Figure 3 , Figure 3 is a schematic diagram of a test system for a vehicle interaction system proposed in an embodiment of the present application, the system comprising: A click control module is used to control the robot arm to click on the function icons in the UI interface of the vehicle interaction system; An image recording module is used to record the click position of the function icon currently clicked by the robot arm and the UI interface jumped to after the click through an image acquisition device, and determine that the UI interface where the currently clicked function icon is located is the parent UI interface of the UI interface jumped to, and the UI interface jumped to is the child UI interface of the UI interface where the currently clicked function icon is located; a data recording module, configured to create a function branch node corresponding to the sub-UI interface, and based on the sub-UI interface and the click position of the UI interface where the function icon currently clicked is located, record the key verification information of the function icon currently clicked and the click position in the function branch node; A node connection module, used to connect the function branch node corresponding to the parent UI interface with the function branch node corresponding to the child UI interface; A tree diagram determination module, used to determine a tree diagram according to the created functional branch nodes and the connection relationship between the functional branch nodes; A test case determination module, used for creating a test case corresponding to the vehicle interaction system according to the tree diagram; The test result determination module is used to test the vehicle interaction system of other vehicles through the test case to obtain the test result.

[0073] Based on the same inventive concept, another embodiment of the present application provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the steps in the vehicle interaction system testing method described in any of the above embodiments are implemented.

[0074] Based on the same inventive concept, another embodiment of the present application provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the steps of the vehicle interaction system testing method as described in any of the above embodiments are implemented.

[0075] The present application records the click position of the currently clicked function icon and the UI interface to which it jumps through an image acquisition device, determines the click position and key verification information corresponding to the function icon, and then constructs a function branch node corresponding to each UI interface, where the function branch node is used to record the click position and key verification information of the function icon, and then connects the corresponding function branch nodes to obtain a tree diagram and generate a test case. When the vehicle interaction system of other vehicles is tested through the test case, the click position and key verification information recorded by the function branch node in the test case can be used to determine whether the UI interface to which the vehicle interaction system of other vehicles jumps is consistent with the test case record, so as to obtain the final test result. Through the test method of the present application, if there is an inconsistency, the inconsistent function icon can be accurately modified and the test case can be automatically updated, which shortens the maintenance time of the test case and improves the testing efficiency of the vehicle interaction system.

[0076] Those skilled in the art will appreciate that embodiments of the present invention may provide methods, devices, electronic devices, storage media, or computer program products. Therefore, embodiments of the present invention may take the form of complete hardware embodiments, complete software embodiments, or embodiments combining software and hardware. Moreover, embodiments of the present invention may take the form of computer program products implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.

[0077] Although the preferred embodiments of the present application have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the embodiments of the present application.

[0078] Finally, it should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or terminal device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or terminal device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or terminal device including the elements.

[0079] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "illustrative embodiments", "examples", "specific examples", or "some examples" means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner.

[0080] In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the previously and subsequently associated objects are in an "or" relationship.

[0081] The testing method, system, storage medium and device of a vehicle interaction system provided by the present application are introduced in detail above. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea. At the same time, for general technical personnel in this field, according to the idea of ​​the present application, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. A vehicle interaction system testing method, characterized in that: The method comprises: Control the robotic arm to click on the function icons in the UI interface of the vehicle interaction system; The image acquisition device is used to record the click position of the function icon currently clicked by the robot arm and the UI interface jumped to after the click, and it is determined that the UI interface where the function icon currently clicked is located is the parent UI interface of the UI interface jumped to, and the UI interface jumped to is the child UI interface of the UI interface where the function icon currently clicked is located; Creating a function branch node corresponding to the sub-UI interface, and based on the sub-UI interface and the click position of the UI interface where the currently clicked function icon is located, recording key verification information and the click position of the currently clicked function icon in the function branch node; Connecting the function branch node corresponding to the parent UI interface with the function branch node corresponding to the child UI interface; Determine a tree diagram according to the created functional branch nodes and the connection relationship between the functional branch nodes; According to the tree diagram, create a test case corresponding to the vehicle interaction system; The vehicle interaction systems of other vehicles are tested through the test cases to obtain test results.

2. The vehicle interaction system testing method according to claim 1, characterized in that: Based on the sub-UI interface and the click position of the UI interface where the currently clicked function icon is located, recording key verification information of the currently clicked function icon and the click position in the function branch node, including: Determine key verification information of the currently clicked function icon according to the color jump of the sub-UI interface to which the currently clicked function icon jumps after being clicked and / or the change of interface information; The key verification information and the click position are recorded in the function branch node corresponding to the sub-UI interface.

3. The vehicle interaction system testing method according to claim 1, characterized in that: The method further comprises: Based on the user's adjustment of the function icon in the UI interface of the vehicle interaction system, the click position of the adjusted function icon and the UI interface jumped to after the click are re-recorded through an image acquisition device; Based on the re-recorded click position of the adjusted function icon and the UI interface to which the click jumps, the click position and key verification information recorded in the function branch node corresponding to the adjusted function icon are updated to obtain a new tree diagram; Creating a new test case corresponding to the vehicle interaction system according to the new tree diagram; The vehicle interaction systems of other vehicles are tested using the new test case to obtain test results.

4. The vehicle interaction system testing method according to claim 1, characterized in that: Before recording, by means of an image acquisition device, the click position of the function icon currently clicked by the robot arm and the UI interface to which the robot arm jumps after the click, the method further includes: Determine whether the UI interface jumped to by clicking the function icon is a negative response interface or an interface that pops up conditional error response information; In the case where the UI interface jumped to is a negative response interface or an interface with a pop-up conditional error response message, determining whether the UI interface jumped to is consistent with a preset result; When the consistency is determined, the following steps are executed: recording the click position of the function icon currently clicked by the robotic arm and the UI interface jumped to after the click through the image acquisition device, and determining that the UI interface where the function icon currently clicked is located is the parent UI interface of the UI interface jumped to, and the UI interface jumped to is the child UI interface of the UI interface where the function icon currently clicked is located; When an inconsistency is determined, an alert is sent to the development side so that the development side can repair the vehicle interaction system.

5. The vehicle interaction system testing method according to claim 1, characterized in that: The vehicle interaction systems of other vehicles are tested through the test cases to obtain test results, including: Control the robotic arm to click on a function icon in a target UI interface of a vehicle interaction system of another vehicle; Use an image acquisition device to record the target click position of the function icon currently clicked by the robot arm and the UI interface jumped to after clicking; According to the UI interface you jump to, determine the corresponding key verification information to be verified; Determining, according to the target click position and the test case, predicted key verification information corresponding to the target click position recorded in the test case; Comparing the key verification information to be verified with the predicted key verification information to obtain a comparison result; Determining a test sub-result of the function icon according to the comparison result; The test result of the vehicle interaction system of the other vehicle is determined according to the test sub-result of each function icon in the vehicle interaction system of the other vehicle.

6. The vehicle interaction system testing method according to claim 5, characterized in that: Determining, according to the target click position and the test case, prediction key verification information corresponding to the target click position recorded in the test case, including: According to the target UI interface where the function icon at the target click position is located, determining the target function branch node corresponding to the target UI interface from the test case; Determine, according to the target function branch node and the test case, a function branch child node of the target function branch node in the test case; The key verification information recorded in the function branch subnode having the same recorded click position as the target click position is determined as the predicted key verification information.

7. The vehicle interaction system testing method according to claim 5, characterized in that: Determining the test result of the vehicle interaction system of the other vehicle according to the test sub-result of each function icon in the vehicle interaction system of the other vehicle includes: When the test sub-results of each function icon in the vehicle interaction system of the other vehicle are that the key verification information to be verified is consistent with the corresponding predicted key verification information, it is determined that the test of the vehicle interaction system of the other vehicle is passed; When the key verification information to be verified is inconsistent with the corresponding predicted key verification information in the test sub-results of each function icon in the vehicle interaction system of other vehicles, the function icon corresponding to the inconsistent test sub-result is determined as the function icon to be modified; Re-record the click position of the to-be-modified function icon and the UI interface jumped to after the click through an image acquisition device; Based on the re-recorded click position of the function icon to be modified and the UI interface that jumps to after clicking, the click position and key verification information recorded in the function branch node corresponding to the function icon to be modified are updated to obtain a new tree diagram for creating a new test case.

8. A vehicle interaction system testing system, characterized in that: The system comprises: A click control module is used to control the robot arm to click on the function icons in the UI interface of the vehicle interaction system; An image recording module is used to record the click position of the function icon currently clicked by the robot arm and the UI interface jumped to after the click through an image acquisition device, and determine that the UI interface where the currently clicked function icon is located is the parent UI interface of the UI interface jumped to, and the UI interface jumped to is the child UI interface of the UI interface where the currently clicked function icon is located; a data recording module, configured to create a function branch node corresponding to the sub-UI interface, and based on the sub-UI interface and the click position of the UI interface where the function icon currently clicked is located, record the key verification information of the function icon currently clicked and the click position in the function branch node; A node connection module, used to connect the function branch node corresponding to the parent UI interface with the function branch node corresponding to the child UI interface; A tree diagram determination module, used to determine a tree diagram according to the created functional branch nodes and the connection relationship between the functional branch nodes; A test case determination module, used for creating a test case corresponding to the vehicle interaction system according to the tree diagram; The test result determination module is used to test the vehicle interaction system of other vehicles through the test case to obtain the test result.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps in the vehicle interaction system testing method as claimed in any one of claims 1 to 7 are implemented.

10. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the steps of the vehicle interaction system testing method according to any one of claims 1 to 7 are implemented.

Images