A testing method and related device for an in-vehicle display device

Abstract

This application relates to the technical field of vehicle equipment testing, and in particular, to a testing method for in-vehicle display devices and related equipment. The testing method is applied to a testing device, and the method includes: when the testing device is fixed at a first position in the vehicle interior space, constructing a three-dimensional model of the vehicle interior space according to the first position; determining a second position of the in-vehicle display device for displaying a target icon in the vehicle interior space according to the three-dimensional model; sending a synchronization test signal to the in-vehicle display device to cause the in-vehicle display device to display the target icon; controlling a robotic arm to carry a video acquisition component to move according to the first position, the second position, and the synchronization test signal, and acquiring a first video of the target icon in the in-vehicle display device; determining a test result of the target icon according to the first video and the attribute information of the target icon; This application can solve the technical problem that the existing testing solutions for in-vehicle display devices have inaccurate test results due to human errors.

Description

Technical Field

[0001] This application relates to the technical field of vehicle equipment testing, and particularly to a testing method for in-vehicle display devices and related equipment. Background Art

[0002] In the prior art, in-vehicle display devices can display various icons according to user instructions. However, in actual operation, display problems such as icon display delay and icon flickering may occur during the display of icons; as the vehicle's service life increases, the above-mentioned icon display problems usually become more serious.

[0003] Regarding the above display problems, the icon display problems of in-vehicle display devices can be tested, and subsequent corresponding repair plans can be determined according to the test results; in actual applications, since there may be various reasons for the above display problems, during the testing and repair process for icon display problems, it may be necessary to repeatedly test the icon display problems.

[0004] In the prior art, usually experienced repair technicians conduct manual tests on the display status of icons, resulting in test results that cannot accurately reflect the icon display problems; in addition, due to individual differences among different repair technicians, test results may have errors, further leading to the inability to determine the correct repair plan based on the test results, and even possibly affecting the use of other devices in the vehicle due to incorrect repair plans, ultimately causing immeasurable economic risks and safety risks. Summary of the Invention

[0005] In view of this, the purpose of this application is to provide a testing method for in-vehicle display devices and related equipment to solve the technical problem that the existing testing solutions for in-vehicle display devices are inaccurate due to manual errors.

[0006] In a first aspect, this application provides a testing method for in-vehicle display devices, which is applied to a testing device. The testing device includes: a device body, a robotic arm, a fixing component, and a video acquisition component. The robotic arm and the fixing component are arranged on the device body, and the video acquisition component is arranged on the robotic arm; the fixing component is used to fix the testing device in the interior space of the vehicle; the testing device is communicatively connected to the in-vehicle display device of the vehicle; the method includes:

[0007] When the testing device is fixed at a first position in the interior space, a three-dimensional model of the interior space is constructed according to the first position;

[0008] According to the three-dimensional model, a second position of the in-vehicle display device for displaying the target icon in the interior space is determined;

[0009] Send a synchronization test signal to the in-vehicle display device to make the in-vehicle display device display the target icon;

[0010] According to the first position, the second position, and the synchronization test signal, control the robotic arm to carry the video acquisition component to move, and acquire the first video of the target icon in the in-vehicle display device;

[0011] Determine the test result of the target icon according to the first video and the attribute information of the target icon.

[0012] In a second aspect, the present application provides a test device for an in-vehicle display device. The test device includes: a device body, a robotic arm, a fixing component, and a video acquisition component. The robotic arm and the fixing component are arranged on the device body, and the video acquisition component is arranged on the robotic arm; the fixing component is used to fix the test device in the interior space of the vehicle; the test device is communicatively connected to the in-vehicle display device of the vehicle; the device further includes: a model construction module, a position determination module, a signal determination module, a control module, and a test module;

[0013] The model construction module is used to construct a three-dimensional model of the interior space of the vehicle according to the first position when the test device is fixed at a first position in the interior space;

[0014] The position determination module is used to determine a second position of the in-vehicle display device that displays the target icon in the interior space of the vehicle according to the three-dimensional model;

[0015] The signal determination module is used to send a synchronization test signal to the in-vehicle display device to make the in-vehicle display device display the target icon;

[0016] The control module is used to control the robotic arm to carry the video acquisition component to move according to the first position, the second position, and the synchronization test signal, and acquire the first video of the target icon in the in-vehicle display device;

[0017] The test module is used to determine the test result of the target icon according to the first video and the attribute information of the target icon.

[0018] In a third aspect, the present application provides a computer-readable storage medium, which is used to store program codes executed by a processor, and the program codes are used to implement the above-mentioned test method for an in-vehicle display device.

[0019] Fourthly, the present application provides a computer program product, which includes computer instructions. When the computer instructions run on an electronic device, the electronic device implements the above-mentioned test method for an in-vehicle display device.

[0020] Beneficial effects:

[0021] The present application provides a test method for an in-vehicle display device, which is applied to a test device. The test device includes: a device body, a robotic arm, a fixing component, and a video acquisition component. The robotic arm and the fixing component are arranged on the device body, and the video acquisition component is arranged on the robotic arm; the fixing component is used to fix the test device in the interior space of a vehicle; the test device is communicatively connected to the in-vehicle display device of the vehicle.

[0022] The method includes: when the test device is fixed at a first position in the interior space, constructing a three-dimensional model of the interior space according to the first position; determining a second position of the in-vehicle display device displaying a target icon in the interior space according to the three-dimensional model; sending a synchronization test signal to the in-vehicle display device to make the in-vehicle display device display the target icon; controlling the robotic arm to carry the video acquisition component to move according to the first position, the second position, and the synchronization test signal, and acquiring a first video of the target icon in the in-vehicle display device; determining a test result of the target icon according to the first video and the attribute information of the target icon.

[0023] In summary, the present application provides a test device and a test method applied to the test device to implement automated testing of an in-vehicle display device; during the whole process, only the staff needs to fix the test device in the interior space of the vehicle, and the test device can automatically determine the interior space and interact with the in-vehicle display device to implement automated testing of the in-vehicle display device; the determination of the test result is based on the first video, so the error of manual measurement can be avoided; in addition, since the automatic test device in the present application can be moved, it also has the advantage of strong practicability. Description of the drawings

[0024] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following will briefly introduce the drawings required to be used in the embodiments of the present application. The following drawings only show some embodiments of the present application, so they should not be regarded as limiting the scope. For those of ordinary skill in the art, without creative efforts, other related drawings can also be obtained based on these drawings.

[0025] Figure 1 It is a schematic structural diagram of a test device for an in-vehicle display device provided by an embodiment of the present application;

[0026] Figure 2Schematic diagram of communication of the test device for in-vehicle display devices provided in the embodiments of the present application;

[0027] Figure 3 Schematic flow diagram of the test method for in-vehicle display devices provided in the embodiments of the present application;

[0028] Figure 4 Schematic structural diagram of the control component in the test device for in-vehicle display devices provided in the embodiments of the present application. Detailed implementation manners

[0029] In the prior art, problems such as icon display delay and icon flickering may occur during the display of icons in in-vehicle display devices; among them, there may be various reasons for the above-mentioned icon display problems. For example, unstable voltage output by the in-vehicle power supply, loose connection lines of the in-vehicle display screen, errors in in-vehicle software, and / or aging of the in-vehicle display screen may all cause icon display delay and / or icon flickering. Therefore, during the repair process for the above display problems, it may be necessary to repeatedly test the icon display problems.

[0030] In actual operation, usually, the repairman repeatedly tests the icon display problems. In the above process, if only relying on the repairman for manual testing, it is not only time-consuming and laborious, but also prone to measurement errors, ultimately affecting the repair efficiency and quality of the icon display problems. Even worse, there may be a situation where the use of other devices in the vehicle is affected due to the wrong repair plan, ultimately causing immeasurable economic risks and safety risks.

[0031] To solve the above technical problems, the present application provides a test device for in-vehicle display devices, as Figure 1 and Figure 2 shown, Figure 1 Schematic physical structure diagram of the test device for in-vehicle display devices provided in the embodiments of the present application, Figure 2 Schematic diagram of communication of the test device for in-vehicle display devices provided in the embodiments of the present application. The test device includes: device body 110, robotic arm 120, fixing component 130, video acquisition component 140, control component 150, first positioning component 160, second positioning component 170, and third positioning component 180.

[0032] Figure 2The dashed lines shown in the figure indicate that the components therein are physically co - located; the robotic arm 120 and the fixing component 130 are arranged on the device body 110, and the video acquisition component 140 is arranged on the robotic arm 120; the fixing component 130 is used to fix the test device in the interior space of the vehicle; the control component 150 and the first positioning component 160 are arranged on the device body, and the first positioning component 160 is used to position the device body 110; the second positioning component 170 is arranged on the robotic arm 120 and is used to position the robotic arm 120; the third positioning component 180 is arranged on the video acquisition component 140 and is used to position the video acquisition component 140.

[0033] The control component 150 is communicatively connected to the in - vehicle display device of the vehicle; the control component 150 is also communicatively connected to the robotic arm 120, the video acquisition component 140, the first positioning component 160, the second positioning component 170, and the third positioning component 180 respectively.

[0034] Among them, since the control component 150 is communicatively connected to the first positioning component 160, the second positioning component 170, and the third positioning component 180, the control component 150 can thus always know the positions of the device body 110, the robotic arm 120, and the video acquisition component 140 in the natural space, as well as the relative positions among the device body 110, the robotic arm 120, and the video acquisition component 140; the control component 150 is also used to control the shooting operation of the robotic arm 120 and the video acquisition operation of the video acquisition component 140 according to the control instructions. The above - mentioned control instructions can be determined by the control component 150 itself, or can be determined by an external network device and then sent to the control component 150; in the embodiments of the present application, the above - mentioned control commands are all determined by the control component in the test device.

[0035] In practical applications, the shape parameters, working parameters, etc. of each component or module in the test device can be determined according to the actual situation, as long as it can ensure efficient and accurate icon testing for the in - vehicle display device. The present application does not make specific restrictions on this.

[0036] In actual operation, the test device is placed in the interior space of the vehicle, and then the test device is installed in the interior space of the vehicle through the fixing component 130, and then the test device is used to test the icon display problem of the in - vehicle display device of the vehicle.

[0037] Among them, the "interior space" can be the space separated between the front seat of the vehicle and the front windshield; the specific structure of the fixing component 130 can be a clamping device or other structures with a fixing function, as long as it can ensure that the test device is fixed in the interior space. The present application does not make specific restrictions on this.

[0038] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the technical solutions of this application will be clearly and completely described below with reference to the accompanying drawings. Apparently, the described embodiments are some, but not all, of the embodiments of this application. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of this application without creative efforts shall fall within the scope of protection of this application.

[0039] First, an embodiment of a test method for an in-vehicle display device is provided in this application, as Figure 3 shown, Figure 3 is a schematic flowchart of the test method for the in-vehicle display device provided by the embodiment of this application. The method includes: S210~S250, details are as follows:

[0040] S210: When the test device is fixed at a first position in the vehicle interior space, construct a three-dimensional model of the vehicle interior space according to the first position.

[0041] Specifically, after the test device is installed in the vehicle interior space, the test device can determine the in-vehicle positions of the device body 110, the robotic arm 120, and the video acquisition component 140 in the vehicle interior space through the first positioning component 160, the second positioning component 170, and the third positioning component 180; in the embodiment of this application, the in-vehicle position obtained by positioning the first positioning component 160 is determined as the first position because during the test for the icon display problem of the in-vehicle display device, the in-vehicle positions of the robotic arm 120 and the video acquisition component 140 in the vehicle interior space will change, but since the device body 110 is fixed in the vehicle interior space by the fixing component 130, the relative position between the device body 110 and the vehicle interior space is relatively stable; after determining the first position, the control component 150 can construct a three-dimensional model of the vehicle interior space including the first position.

[0042] In one implementation, S210 includes: step (1)~step (4), details are as follows:

[0043] Step (1): Control the robotic arm to move in the vehicle interior space and control the video acquisition component to capture second videos of multiple angles of the vehicle interior space during the movement.

[0044] Specifically, in the embodiment of this application, the control component 150 can control the robotic arm 120 to move in the vehicle interior space, and the movement information such as the movement path of the robotic arm 120 is usually determined by the control component 150; during the movement of the robotic arm 120, the control component 150 controls the video acquisition component 140 to collect multiple second videos of multiple angles of the vehicle interior space at fixed points.

[0045] "Fixed-point acquisition" means that although the second video is taken while the robotic arm 120 carries the video acquisition component 140 and moves, the robotic arm 120 and the video acquisition component 140 are in a stationary state when the second video is taken, that is, "fixed-point"; during the process of fixed-point acquisition of the second video, each time a fixed-point acquisition is performed, that is, a second video is obtained by shooting. Subsequently, the second video is sent to the control component 150. After receiving the second video, the control component 150 determines the in-vehicle positions of the stationary robotic arm 120 and the video acquisition component 140 when the second video is taken through the second positioning component 170 and the third positioning component 180 respectively; when the control component 150 determines the two in-vehicle positions corresponding to the second video, it controls the robotic arm 120 to continue moving in the in-vehicle space.

[0046] The angle in "multi-angle" is the shooting angle; the multi-angle second video refers to the video of the in-vehicle space taken at multiple shooting angles. In actual operation, the second video can be obtained by shooting during the process of the video acquisition component 140 looking around the in-vehicle space.

[0047] In actual operation, the path when shooting the second video can be a preset moving path with a small moving range, or the infrared module can be set to sense the distance between the video acquisition component 140 and the in-vehicle objects in real time. As long as the distance between the video acquisition component 140 and the in-vehicle objects is within a safe range, the robotic arm 120 can carry the video acquisition component 140 to move "relatively freely" in the in-vehicle space, enabling the video acquisition component 140 to shoot multi-angle second videos.

[0048] Step (2): Determine the dimensional data of the in-vehicle space according to the second video.

[0049] Specifically, the control component 150 can construct a coordinate system of the in-vehicle space according to each second video and the in-vehicle positions of the robotic arm 120 and the video acquisition component 140 when each second video is taken; in actual operation, according to the picture frames of multiple in-vehicle objects simultaneously captured in at least two of the multiple second videos, the relative positions between the in-vehicle objects and the robotic arm 120 and the video acquisition component 140 are determined based on the shape changes of the in-vehicle objects in the picture frames of different second videos. Subsequently, a coordinate system of the in-vehicle space is constructed according to the relative positions.

[0050] In actual operation, although the second video can capture information of more in-vehicle objects in the vehicle interior space, it is also possible to capture images of the vehicle interior space in the form of "capturing pictures at a fixed angle"; "fixed angle" means that the video acquisition component 140 captures images of the vehicle interior space at the same multiple relative angles in each "fixed point", and "relative angle" refers to the shooting angle of the video acquisition component 140 relative to the device body 110. For example, the shooting angle can be "a shooting angle parallel to the due south of the device body 110", etc.

[0051] Step (3): Construct a coordinate system for the vehicle interior space based on the dimension data and determine the coordinates of the first position.

[0052] Specifically, when the second video or image captured at a fixed point is determined, a coordinate system can be constructed based on the data about the vehicle interior space in the second video or image; when the coordinate system of the vehicle interior space is determined, the coordinates of the first position can be determined, and subsequently, the in-vehicle positions of the robotic arm 120 and the video acquisition component 140 sent by the second positioning component 170 and the third positioning component 180 can also be converted into coordinates.

[0053] Step (4): Construct a three-dimensional model based on the dimension data and the coordinate system.

[0054] Specifically, after the coordinate system is constructed, a three-dimensional model of the vehicle interior space can be constructed based on the dimension data.

[0055] S220: Determine the second position of the in-vehicle display device for displaying the target icon in the vehicle interior space according to the three-dimensional model.

[0056] Specifically, after the three-dimensional model is constructed, the internal view images at various angles in the three-dimensional model can be determined, and subsequently, neural network models such as the Yolo model are used to identify the internal view images to determine the second position of the in-vehicle display device in the vehicle interior space; in actual operation, after the second position is determined, the coordinates of the second position can be determined according to the coordinate system.

[0057] S230: Send a synchronization test signal to the in-vehicle display device to make the in-vehicle display device display the target icon.

[0058] Specifically, in the embodiments of the present application, S210~S220 are the accurate operations before the test process for the icon display problem of the in-vehicle display screen, and S230~S250 are the test processes for the icon display problem of the in-vehicle display screen; in the actual processing process, for one test process of a vehicle, S210~S220 usually only need to be executed once, and S230~S250 need to be executed multiple times.

[0059] When it is necessary to test the icon display problem of the in-vehicle display device, the control component 150 sends a synchronization test signal to the in-vehicle display device to make the in-vehicle display device display the target icon.

[0060] In one implementation, the synchronization test signal includes: a synchronization signal and a test signal; S230 includes: step (5) to step (6), details are as follows:

[0061] Step (5): Send a synchronization signal to the in-vehicle display device to make the in-vehicle display device perform time synchronization processing according to the synchronization signal and the device operation time of the test device.

[0062] Specifically, in the embodiment of the present application, the test for the icon display problem of the in-vehicle display device includes the display delay of the test icon. In order to calculate the time interval between the in-vehicle display device receiving the icon display command and displaying the icon according to the command, it is necessary to perform time synchronization processing on the control component 150 and the in-vehicle display device, so that the actual time when the in-vehicle display device displays the icon is consistent with the recorded time when the in-vehicle display device displays the icon recorded in the first video.

[0063] In actual operation, the time synchronization processing is carried out by communication between the control component 150 and the in-vehicle display device.

[0064] Step (6): Send a test signal to the in-vehicle display device to make the in-vehicle display device display the target icon.

[0065] Specifically, after the control component 150 and the in-vehicle display device perform time synchronization, the control component 150 sends a test signal to the in-vehicle display device to make the in-vehicle display device display the target icon at the target time, and makes the video acquisition component 140 acquire the first video including the icon display situation of the in-vehicle display device at the target time.

[0066] In one implementation, the synchronization test signal includes: an information interaction signal; S230 includes: step (7), details are as follows:

[0067] Step (7): Send an information interaction signal to the in-vehicle display device to make the in-vehicle display device feedback icon attribute information.

[0068] Specifically, in the embodiment of the present application, during the process of the control component 150 communicating with the in-vehicle display device to make the in-vehicle display device display the target icon, the control component 150 can communicate with the in-vehicle display device to obtain the attribute information of the icons that the in-vehicle display device can display, which is used to determine the specific problems in the icon display of the in-vehicle display device subsequently.

[0069] S240: Control the movement of the robotic arm carrying the video acquisition component according to the first position, the second position, and the synchronization test signal, and acquire the first video of the target icon in the in-vehicle display device.

[0070] Specifically, while the control component 150 sends the synchronization test signal to the in-vehicle display device, the control component 150 also responds to the determination of the synchronization test information and controls the robotic arm 120 to carry the video acquisition component 140 to move relative to the first position, and the purpose of the movement is to approach the second position, so that the video acquisition component 140 can capture the first video of the in-vehicle display device when displaying the icon.

[0071] In one implementation, S240 includes: step (8) to step (10), and the details are as follows:

[0072] Step (8): Determine the target position according to the first position, the second position, and the three-dimensional model.

[0073] Specifically, in the embodiment of the present application, the target position is the position where the video acquisition component 140 captures the first video of the in-vehicle display device; in actual operation, the purpose of determining the target position is both to prevent the robotic arm 120 from touching the in-vehicle display device during the process of carrying the video acquisition component 140 to the in-vehicle display device, and to be able to capture a first video with a clear composition, so as to accurately diagnose the icon display problem shown in the first video subsequently.

[0074] In actual operation, the target position should be between the first position and the second position, and the target position is determined based on the three-dimensional model, and the target position determined by the three-dimensional model is in the form of coordinates.

[0075] In one implementation, step (8) includes: step (8.1) to step (8.2), and the details are as follows:

[0076] Step (8.1): Perform smoothing processing on the three-dimensional model to obtain a smoothed model and determine the shape data of the smoothed model.

[0077] Specifically, in the prior art, there are many objects in the vehicle interior space, and the surfaces of the objects may also have concave and convex shapes, so it will cause an excessive amount of calculation in the subsequent process of using the three-dimensional model. Therefore, the three-dimensional model can be smoothed so that the specific shape of the object surface is not displayed at small positions of the three-dimensional model.

[0078] In one implementation, the shape data includes: the volume of the smooth model, the first length ratio, the second length ratio, and the tilt angle; the first length ratio indicates the ratio between the body diagonal of the smooth model and a first preset length; the second length ratio indicates the ratio between the long side of the smooth model and a second preset length; the tilt angle is the included angle between the body diagonal of the smooth model and the bottom surface of the smooth model.

[0079] Specifically, since the smooth model is usually an irregular polyhedron, the process of determining the body diagonal of the smooth model is slightly more complex than that of determining the body diagonal of regular polyhedrons such as cuboids. However, since the purpose of determining the body diagonal of the smooth model is to facilitate the determination of the target position and the movement path, as long as the obtained body diagonal can provide a hint for the process of determining the target position, movement path, etc., it is sufficient.

[0080] In the process of determining the body diagonal of the smooth model, multiple alternative body diagonals need to be determined first, and then the body diagonal with the largest slope and / or the longest length is determined as the body diagonal for subsequent use in determining the first length ratio, the second length ratio, and the tilt angle.

[0081] The purpose of determining the volume, the first length ratio, the second length ratio, and the tilt angle of the smooth model is to "measure" the shape of the smooth model. For example, for a long and narrow smooth model, in the subsequent process of determining the movement path, the movement path needs to be set as short as possible to prevent touching other objects in the vehicle space. For example, for a wide smooth model, there are more options when determining the target position and / or the movement path subsequently.

[0082] Step (8.2): Determine the target position in the smooth model according to the first position, the second position, and the shape data of the smooth model.

[0083] Specifically, after determining the first position, the second position, and the shape data of the smooth model, the target position can be determined in the smooth model; in actual operation, the target position can be determined by taking the distance from the vehicle-mounted display device within a preset distance range as the standard. For example, the preset distance range can be (5 cm, 12 cm).

[0084] Step (9): Determine the movement path of the robotic arm according to the target position and the three-dimensional model.

[0085] Specifically, after determining the target position, the current in-vehicle positions of the robotic arm 120 and the video acquisition component 140 respectively determined by the second positioning component 170 and the third positioning component 180 can be obtained.

[0086] Taking the movement of the video acquisition component 140 from its current in-vehicle position to the target position as the path planning condition, plan the movement path of the robotic arm in the three-dimensional model according to the current in-vehicle position of the robotic arm 120.

[0087] Step (10): Based on the synchronization test signal, control the robotic arm to carry the video acquisition component along the movement path until the video acquisition component is at the target position and capture the first video at the target position.

[0088] Specifically, when the robotic arm 120 carries the video acquisition component 140 and moves until the video acquisition component 140 is at the target position; after the video acquisition component 140 is at the target position, the control component 150 controls the video acquisition component 140 to capture an image of the in-vehicle display device.

[0089] In one implementation, S240 includes: Step (11) to Step (14), details are as follows:

[0090] Step (11): Determine the video clarity and video composition data of the first video;

[0091] Among them, the video composition data indicates the composition of the in-vehicle display device in the image frame of the first video.

[0092] Specifically, the video clarity is used to determine the influence of light on the first video and the influence of the distance between the target position and the in-vehicle display device on the first video. If there is reflection on the surface of the in-vehicle display device, accurate test results cannot be obtained based on the corresponding first video.

[0093] The purpose of determining the video composition data is to ensure that the first video of the icon display situation of the in-vehicle display device can be clearly and accurately captured; if the in-vehicle display device is in an inclined state in the image frame of the first video, accurate test results cannot be obtained based on the corresponding first video; in actual operation, the video composition data may include data such as the area ratio of the in-vehicle display device in the image frame and the symmetry degree of the in-vehicle display device in the image frame, which are used to measure whether the composition meets the standard.

[0094] Step (12): If the video clarity and / or the video composition data do not meet their respective preset standards, control the video acquisition component to perform focus adjustment processing.

[0095] Specifically, in the embodiments of the present application, both the video clarity and the video composition data are quantifiable data. Therefore, the preset standards can be used to determine whether the video clarity and / or the video composition data of the current first video meet the standards; if they do not meet the standards, the control component 150 controls the video acquisition component 140 to perform focus adjustment processing.

[0096] Step (13): If the video clarity and / or video composition data of the first video captured by the video acquisition component after the focusing process do not meet their respective preset standards, update the target position of the video acquisition component according to the video composition data; wherein, the target position indicates the current shooting position of the video acquisition component.

[0097] Specifically, the focusing range of the video acquisition component 140 is limited, and if the light affects the clarity of the first video, it is impossible to obtain a clear and accurate first video only by controlling the video acquisition component 140 to perform the focusing process.

[0098] If the video clarity and / or video composition data of the first video captured by the video acquisition component after the focusing process do not meet their respective preset standards, it is necessary to re-determine the target position according to the video composition data, that is, it is necessary for the video acquisition component 140 to move away from the current target position.

[0099] In some embodiments, the video composition data includes: area ratio and symmetry; the area ratio indicates the area ratio of the in-vehicle display device in the image frame; the symmetry indicates the degree of symmetry of the in-vehicle display device in the image frame; Step (13) includes: Step (13.1) to Step (13.2), details are as follows:

[0100] Step (13.1): Determine the shooting distance adjustment value according to the area ratio, and / or determine the shooting angle adjustment value according to the symmetry.

[0101] Specifically, in the embodiments of the present application, the area ratio can indicate whether the composition of the current first video is reasonable. If the area ratio is small, it means that the shooting resources of the first video are wasted, and it is very likely that the icon display situation of the in-vehicle display device cannot be clearly captured.

[0102] The symmetry refers to the coincidence rate of the images on both sides of the central vertical line of the first video in the image area.

[0103] The symmetry can also indicate whether the composition of the current first video is reasonable; if the symmetry is small, it means that the inclination angle of the video acquisition component 140 relative to the in-vehicle display device is large, and it is very likely that the icon display situation of the in-vehicle display device cannot be clearly captured.

[0104] In actual operation, the determination basis for determining the shooting distance adjustment value according to the area ratio and determining the shooting angle adjustment value according to the symmetry can be determined according to actual needs. For example, multiple intervals can be set for the area ratio and symmetry, and corresponding shooting distance adjustment values and shooting angle adjustment values can be set for different intervals, so as to determine the corresponding shooting distance adjustment value and shooting angle adjustment value according to the interval where the actual area ratio and actual symmetry are located.

[0105] Step (13.2): Update the target position of the video acquisition component according to the shooting angle adjustment value and / or the shooting distance adjustment value.

[0106] Specifically, after determining the shooting angle adjustment value and the shooting distance adjustment value, the shooting angle and the shooting distance of the video acquisition component 140 can be adjusted, and the adjusted position is the updated target position.

[0107] It should be emphasized that the update operation of the target position still needs to be under the limitation of the smoothing model, otherwise it is easy to cause the robotic arm 120 to touch other objects in the vehicle space during the process of carrying the video acquisition component 140 to move.

[0108] Step (14): Repeat the step of determining the video clarity and the video composition data according to the first video until both the video clarity and the video composition data meet their respective preset standards.

[0109] Specifically, after adjusting both the shooting distance and the shooting angle of the video acquisition component 140, the step of re-shooting the first video based on the updated target position and determining the video clarity and the video composition data according to the first video can be performed until both the video clarity and the video composition data meet their respective preset standards.

[0110] S250: Determine the test result of the target icon according to the first video and the attribute information of the target icon.

[0111] Specifically, after obtaining the first video, the test result of the target icon can be determined according to the display situation of the target icon in the first video and the attribute information of the target icon.

[0112] In one implementation, the synchronization test signal includes: time information, and the time information indicates that the in-vehicle display device displays the corresponding target icon at the first moment; S250 includes: Step (15) to Step (16), the details are as follows:

[0113] Step (15): Determine the second moment when the in-vehicle display device displays the target icon according to the first video.

[0114] Specifically, in the embodiment of the present application, the control component 150 and the in-vehicle display device have undergone time synchronization processing, so the first moment in the in-vehicle display device is the same as the first moment in the first video; on this premise, according to the first video, determine the second moment when the in-vehicle display device starts to display the icon.

[0115] Step (16): Determine the display delay of the target icon according to the first moment and the second moment.

[0116] Specifically, after determining the second moment, the display delay of the target icon can be determined based on the first moment and the second moment.

[0117] In one implementation, S250 includes steps (17) to (21), details are as follows:

[0118] Step (17): Determine multiple image frames corresponding to the target icon in the first video;

[0119] Specifically, in the first video, there is usually a video segment about the display situation of the target icon; select multiple image frames from the video segment after the target icon appears to determine whether there is an icon display problem on the in-vehicle display device.

[0120] Step (18): Determine the difference degree of the target icon according to the first pixel data of the target icon shown in the image frame and the second pixel data of the target icon indicated by the attribute information.

[0121] Specifically, in the embodiments of the present application, the pixel data can be pixel values or other metrics that can measure the color distribution of an image; after determining the pixel data of the target icon in the image frame and the pixel data of the target icon indicated by the attribute information, the difference degree of the target icon can be determined according to the above pixel data; in actual operation, the sum of the differences between the first pixel data and the second pixel data corresponding to each pixel among multiple pixels can be determined as the difference degree.

[0122] Step (19): Determine the average difference degree corresponding to the target icon according to the difference degrees respectively corresponding to multiple image frames.

[0123] Specifically, in the embodiments of the present application, one image frame corresponds to one difference degree. After determining the difference degree corresponding to each image frame, determine the average difference degree corresponding to multiple image frames.

[0124] Step (20): If both the display delay and / or the average difference degree do not meet the preset standard, determine the target icon as an abnormal icon.

[0125] Specifically, if any one of the display delay and the average difference degree corresponding to the target icon does not meet the preset standard, determine the target icon as an abnormal icon.

[0126] Step (21): Determine the abnormal icon, the display delay of the abnormal icon, and the average difference degree as the test result.

[0127] In one implementation, S250 includes steps (22) to (24), details are as follows:

[0128] Step (22): Determine the blinking frequency of the target icon per unit time according to the first video.

[0129] Specifically, in the embodiments of the present application, the flashing frequency is the number of flashes per unit time.

[0130] Step (23): If the flashing frequency is greater than the preset standard, determine the target icon as an abnormal icon.

[0131] Step (24): Determine the abnormal icon and the flashing frequency as the test result.

[0132] Specifically, the above is the process of determining the test result of a single target icon; in actual operation, there may be multiple target icons. Therefore, in the test result, the test result of the in-vehicle display device can also be determined according to the display delay and / or the average difference degree of multiple target icons; the test result of the in-vehicle display device can be the "distribution of abnormal icons", the "type of in-vehicle application corresponding to the abnormal icon", etc., which can indicate the overall icon display situation of multiple target icons in the in-vehicle display device.

[0133] Second, the present application provides a test device for an in-vehicle display device. The test device includes: a device body 110, a robotic arm 120, a fixing component 130, and a video acquisition component 140. The robotic arm 120 and the fixing component 130 are arranged on the device body, and the video acquisition component 140 is arranged on the robotic arm 120; the fixing component 130 is used to fix the test device in the interior space of the vehicle; the test device is communicatively connected to the in-vehicle display device of the vehicle; as Figure 4 shown, Figure 4 is a schematic structural diagram of a control component in the test device for an in-vehicle display device provided by an embodiment of the present application. The device further includes: a model construction module 151, a position determination module 152, a signal determination module 153, a control module 154, and a test module 155 in the control component 150.

[0134] The model construction module 151 is used to construct a three-dimensional model of the interior space according to the first position when the test device is fixed at the first position in the interior space.

[0135] The position determination module 152 is used to determine the second position of the in-vehicle display device that displays the target icon in the interior space according to the three-dimensional model.

[0136] The signal determination module 153 is used to send a synchronization test signal to the in-vehicle display device to make the in-vehicle display device display the target icon.

[0137] The control module 154 is used to control the robotic arm to carry the video acquisition component to move and acquire the first video of the target icon in the in-vehicle display device according to the first position, the second position, and the synchronization test signal.

[0138] The test module 155 is used to determine the test result of the target icon according to the first video and the attribute information of the target icon.

[0139] The model construction module 151 is further used to control the robotic arm to move in the vehicle interior space and control the video acquisition component to capture a second video of multiple angles of the vehicle interior space during the movement;

[0140] The model construction module 151 is further used to determine the dimension data of the vehicle interior space according to the second video;

[0141] The model construction module 151 is further used to construct a coordinate system of the vehicle interior space according to the dimension data and determine the coordinates of the first position;

[0142] The model construction module 151 is further used to construct a three-dimensional model according to the dimension data and the coordinate system.

[0143] The control module 154 is further used to determine the target position according to the first position, the second position and the three-dimensional model;

[0144] The control module 154 is further used to determine the movement path of the robotic arm according to the target position and the three-dimensional model;

[0145] The control module 154 is further used to control the robotic arm to carry the video acquisition component to move along the movement path based on the synchronization test signal until the video acquisition component is at the target position and captures the first video at the target position.

[0146] The control module 154 is further used to perform smoothing processing on the three-dimensional model to obtain a smoothed model and determine the shape data of the smoothed model;

[0147] The control module 154 is further used to determine the target position in the smoothed model according to the first position, the second position and the shape data of the smoothed model.

[0148] In one implementation, the shape data includes: the volume of the smoothed model, the first length ratio, the second length ratio and the inclination angle; the first length ratio indicates the ratio between the body diagonal of the smoothed model and the first preset length; the second length ratio indicates the ratio between the long side of the smoothed model and the second preset length; the inclination angle is the included angle between the body diagonal of the smoothed model and the bottom surface of the smoothed model.

[0149] In one implementation, the synchronization test signal includes: the signal determination module 153 is further used to send a synchronization signal to the in-vehicle display device, so that the in-vehicle display device performs time synchronization processing according to the synchronization signal and the device operation time of the test device;

[0150] The signal determination module 153 is further used to send a test signal to the in-vehicle display device, so that the in-vehicle display device displays the target icon.

[0151] In one implementation, the control module 154 is further configured to determine the video clarity and video composition data of the first video;

[0152] wherein the video composition data indicates the composition of the image frames of the first video with respect to the in-vehicle display device;

[0153] The control module 154 is further configured to control the video acquisition component to perform a focusing process if the video clarity and / or the video composition data do not meet their respective preset standards;

[0154] The control module 154 is further configured to update the target position of the video acquisition component according to the video composition data if the video clarity and / or the video composition data of the first video acquired by the video acquisition component after the focusing process do not meet their respective preset standards;

[0155] wherein the target position indicates the current shooting position of the video acquisition component;

[0156] The control module 154 is further configured to repeatedly execute the step of determining the video clarity and video composition data according to the first video until both the video clarity and the video composition data meet their respective preset standards.

[0157] In one implementation, the video composition data includes: area ratio and symmetry; the area ratio indicates the area ratio of the in-vehicle display device in the image frame; the symmetry indicates the degree of symmetry of the in-vehicle display device in the image frame; updating the target position of the video acquisition component according to the video composition data includes:

[0158] Determining a shooting distance adjustment value according to the area ratio, and / or determining a shooting angle adjustment value according to the symmetry;

[0159] Updating the target position of the video acquisition component according to the shooting angle adjustment value and / or the shooting distance adjustment value.

[0160] In one implementation, the synchronization test signal includes: time information, and the time information indicates that the in-vehicle display device displays the corresponding target icon at a first time; the test module 155 is further configured to determine a second time when the in-vehicle display device displays the target icon according to the first video;

[0161] The test module 155 is further configured to determine the display delay of the target icon according to the first time and the second time.

[0162] In one implementation, the test module 155 is further configured to determine a plurality of image frames corresponding to the target icon in the first video;

[0163] The test module 155 is further configured to determine the difference degree of the target icon according to the first pixel data of the target icon displayed in the image frame and the second pixel data of the target icon indicated by the attribute information;

[0164] The test module 155 is further configured to determine the average difference degree corresponding to the target icon according to the difference degrees respectively corresponding to multiple image frames;

[0165] The test module 155 is further configured to determine the target icon as an abnormal icon if both the display delay and / or the average difference degree do not meet the preset standard;

[0166] The test module 155 is further configured to determine the abnormal icon, the display delay of the abnormal icon, and the average difference degree as the test result.

[0167] In one implementation, the test module 155 is further configured to determine the blinking frequency of the target icon per unit time according to the first video;

[0168] The test module 155 is further configured to determine the target icon as an abnormal icon if the blinking frequency is greater than the preset standard;

[0169] The test module 155 is further configured to determine the abnormal icon and the blinking frequency as the test result.

[0170] Third, the present application further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is run by a processor, it executes the steps of S210~S250 in the above embodiments.

[0171] Fourth, the computer program product provided by the present application includes a computer-readable storage medium storing program code. The instructions included in the program code can be used to execute the methods in the foregoing method embodiments. For specific implementation, reference can be made to the steps of S210~S250 in the method embodiments, which will not be elaborated here.

[0172] In the embodiments provided by the present application, it should be understood that the disclosed device and method can be implemented in other ways. The device embodiments described above are merely illustrative. For example, the division of the units is only a logical function division, and there may be other division methods in actual implementation. For another example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point, the displayed or discussed mutual coupling or direct coupling or communication connection may be through some communication interfaces. The indirect coupling or communication connection of the device or unit can be in an electrical, mechanical or other form.

[0173] In addition, the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed over multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0174] Furthermore, in each embodiment of the present application, the various functional modules may be integrated together to form an independent part, or each module may exist alone, or two or more modules may be integrated to form an independent part.

[0175] It should be noted that if a function is implemented in the form of a software functional module and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, in essence, or the part that contributes to the prior art, or a part of this technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned storage medium includes: USB flash drives, mobile hard disks, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical discs, etc., which can store program codes.

[0176] In this document, relational terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations.

[0177] The above description is only for the embodiments of the present application and is not intended to limit the protection scope of the present application. For those skilled in the art, the present application may have various changes and modifications. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included in the protection scope of the present application.

Claims

1. A method for testing a vehicle-mounted display device, characterized in that: Applied to a test device, the test device comprises: a device body, a mechanical arm, a fixing component and a video acquisition component, the mechanical arm and the fixing component are arranged on the device body, and the video acquisition component is arranged on the mechanical arm; the fixing component is used to fix the test device in the interior space of a vehicle; the test device is communicatively connected with an on-board display device of the vehicle; the method comprises: When the test device is fixed at a first position in the vehicle interior space, constructing a three-dimensional model of the vehicle interior space according to the first position; Determining, based on the three-dimensional model, a second position of the vehicle-mounted display device displaying the target icon in the vehicle interior space; Sending a synchronization test signal to the vehicle-mounted display device to cause the vehicle-mounted display device to display the target icon; According to the first position, the second position and the synchronous test signal, the mechanical arm is controlled to carry the video acquisition component to move, and a first video of the target icon on the vehicle-mounted display device is acquired; Determining a test result of the target icon according to the first video and the attribute information of the target icon; The step of constructing a three-dimensional model of the vehicle interior space according to the first position includes: Controlling the mechanical arm to move in the interior space of the vehicle and controlling the video acquisition component to capture a second video of multiple angles about the interior space of the vehicle during the movement; Determining the dimension data of the space inside the vehicle according to the second video; constructing a coordinate system of the vehicle interior space according to the dimension data and determining the coordinates of the first position; constructing the three-dimensional model according to the dimension data and the coordinate system; The step of controlling the mechanical arm to carry the video acquisition component to move according to the first position, the second position and the synchronous test signal to acquire a first video of the target icon on the vehicle-mounted display device includes: determining a target position according to the first position, the second position and the three-dimensional model; Determining a moving path of the robotic arm according to the target position and the three-dimensional model; Based on the synchronization test signal, control the robotic arm to carry the video acquisition component to move along the moving path until the video acquisition component is at the target position and acquires the first video at the target position; Determining the target position according to the first position, the second position and the three-dimensional model includes: Performing smoothing processing on the three-dimensional model to obtain a smoothed model and determining shape data of the smoothed model; Among them, the purpose of smoothing is to reduce the amount of calculation required when using the three-dimensional model; determining the target position in the smooth model according to the first position, the second position and the shape data of the smooth model; The controlling the mechanical arm to carry the video acquisition component to move and acquire a first video of the target icon on the vehicle-mounted display device includes: Determining video definition and video composition data of the first video; The video composition data indicates the composition of the vehicle-mounted display device in the image frame of the first video; If the video clarity and / or video composition data do not meet respective preset standards, controlling the video acquisition component to perform focus adjustment processing; If the video clarity and / or video composition data of the first video captured by the video capture component after the focus processing do not meet respective preset standards, updating the target position of the video capture component according to the video composition data; Wherein, the target position indicates the current shooting position of the video acquisition component; The step of determining the video definition and the video composition data according to the first video is repeatedly performed until the video definition and the video composition data both meet respective preset standards.

2. The method according to claim 1, characterized in that The shape data includes: the volume, first length ratio, second length ratio and tilt angle of the smooth model; the first length ratio indicates the ratio between the body diagonal of the smooth model and the first preset length; the second length ratio indicates the ratio between the long side of the smooth model and the second preset length; the tilt angle is the angle between the body diagonal of the smooth model and the bottom surface of the smooth model.

3. The method according to claim 1, characterized in that The synchronous test signal includes: a synchronous signal and a test signal; the sending of the synchronous test signal to the vehicle-mounted display device includes: Sending the synchronization signal to the vehicle-mounted display device, so that the vehicle-mounted display device performs time synchronization processing with the device running time of the test device according to the synchronization signal; The test signal is sent to the vehicle-mounted display device, so that the vehicle-mounted display device displays the target icon.

4. The method according to claim 1, characterized in that: The video composition data includes: area ratio and symmetry; the area ratio indicates the area ratio of the vehicle display device in the image frame; the symmetry indicates the degree of symmetry of the vehicle display device in the image frame; the updating of the target position of the video acquisition component according to the video composition data includes: determining a shooting distance adjustment value according to the area ratio, and / or determining a shooting angle adjustment value according to the symmetry; The target position of the video acquisition component is updated according to the shooting angle adjustment value and / or the shooting distance adjustment value.

5. The method according to claim 1, characterized in that The synchronous test signal includes: time information, the time information instructing the vehicle-mounted display device to display the corresponding target icon at a first time; and determining the test result of the target icon according to the first video and the attribute information of the target icon, including: Determining, according to the first video, a second time at which the in-vehicle display device displays the target icon; A display delay of the target icon is determined according to the first moment and the second moment.

6. The method according to claim 5, characterized in that The step of determining a test result of the target icon according to the first video and the attribute information of the target icon includes: Determining a plurality of image frames corresponding to the target icon in the first video; determining a difference degree of the target icon according to first pixel data of the target icon displayed by the image frame and second pixel data of the target icon indicated by the attribute information; Determining a mean value of the degree of difference corresponding to the target icon according to the degrees of difference respectively corresponding to the plurality of image frames; If the display delay and / or the difference average value do not meet the preset standard, the target icon is determined as an abnormal icon; The abnormal icon, the display delay of the abnormal icon, and the average value of the difference are determined as the test result.

7. The method according to claim 1, characterized in that The step of determining a test result of the target icon according to the first video and the attribute information of the target icon includes: Determine, according to the first video, a flashing frequency of the target icon per unit time; If the flashing frequency is greater than a preset standard, the target icon is determined to be an abnormal icon; The abnormal icon and the flashing frequency are determined as the test result.

8. A test device for an in-vehicle display device, characterized in that: For implementing the method of claim 1, the test device comprises: a device body, a mechanical arm, a fixing component and a video acquisition component, the mechanical arm and the fixing component are arranged on the device body, and the video acquisition component is arranged on the mechanical arm; the fixing component is used to fix the test device in the interior space of a vehicle; the test device is communicatively connected with the vehicle-mounted display device of the vehicle; the device also comprises: a model building module, a position determination module, a signal determination module, a control module and a test module; The model building module is used to build a three-dimensional model of the vehicle interior space according to a first position when the test device is fixed in the vehicle interior space; The position determination module is used to determine a second position of the vehicle-mounted display device displaying the target icon in the vehicle interior space according to the three-dimensional model; The signal determination module is used to send a synchronization test signal to the vehicle-mounted display device to make the vehicle-mounted display device display the target icon; The control module is used to control the mechanical arm to carry the video acquisition component to move according to the first position, the second position and the synchronous test signal, and acquire a first video of the target icon on the vehicle-mounted display device; The testing module is used to determine the test result of the target icon according to the first video and the attribute information of the target icon.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium is used to store program codes executed by a processor, and the program codes are used to implement the testing method of the vehicle-mounted display device according to any one of claims 1 to 7.

10. A computer program product, characterized in that The computer program product includes computer instructions. When the computer instructions are executed on an electronic device, the electronic device implements the method for testing the in-vehicle display device according to any one of claims 1 to 7.

Images