Test method of vehicle-mounted display equipment and related equipment
By using robotic arms and video acquisition components in the test equipment of the vehicle display equipment to build three-dimensional models and automatically analyze the test results, the problem of difficult to accurately test the icon display problem of vehicle display equipment in the prior art is solved, and automated testing with high accuracy and reliability is achieved.
Patent Information
- Application Number
- CN202510138694.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-02-08
- Publication Date
- 2025-03-07
- Estimated Expiration
- 2045-02-08
AI Technical Summary
In the prior art, the icon display problem of vehicle display equipment is difficult to accurately test, resulting in inaccurate maintenance plans and may cause economic and safety risks.
It provides a test method and equipment for on-board display equipment, which moves in the interior space through the robotic arm and video acquisition components, builds a three-dimensional model, determines the location of the target icon, sends synchronous test signals, collects video data, and automatically analyzes the test results to avoid artificial errors.
It realizes automated testing of vehicle-mounted display equipment, improves the accuracy of test results, reduces manual errors, and enhances the reliability and practicality of tests.
Smart Images

Figure CN119574066A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the technical field of vehicle equipment testing, and in particular to a testing method for a vehicle-mounted display device and related equipment. Background Art
[0002] In the prior art, the vehicle-mounted display device can display various icons according to the user's instructions. However, in actual operation, display problems such as icon display delay and icon flickering may occur during the display process. As the vehicle ages, the above icon display problems usually become more serious.
[0003] For the above-mentioned display problems, the icon display problem of the vehicle-mounted display device can be tested, and the corresponding repair plan can be determined based on the test results. In actual applications, since there may be multiple reasons for the above-mentioned display problems, it may be necessary to repeatedly test the icon display problem during the repair process of testing the icon display problem.
[0004] In the prior art, experienced maintenance technicians usually conduct manual tests on the display of icons, resulting in test results that do not accurately reflect the display problems of icons. In addition, due to individual differences between different maintenance technicians, errors may occur in the test results, further leading to the inability to determine the correct maintenance plan based on the test results. It may even happen that the wrong maintenance plan affects the use of other equipment in the vehicle, ultimately causing immeasurable economic and safety risks. Summary of the invention
[0005] In view of this, the purpose of the present application is to provide a testing method and related equipment for a vehicle-mounted display device, so as to solve the technical problem that the existing testing scheme for the vehicle-mounted display device leads to inaccurate test results due to human errors.
[0006] In a first aspect, the present application provides a method for testing an in-vehicle display device, which is applied to a test device, wherein the test device comprises: a device body, a mechanical arm, a fixing component and a video acquisition component, wherein the mechanical arm and the fixing component are arranged on the device body, and the video acquisition component is arranged on the mechanical arm; the fixing component is used to fix the test device in the interior space of a vehicle; the test device is communicatively connected with the in-vehicle display device of the vehicle; the method comprises: When the test device is fixed at a first position in the vehicle interior space, constructing a three-dimensional model of the vehicle interior space according to the first position; Determining, based on the three-dimensional model, a second position of the vehicle-mounted display device displaying the target icon in the vehicle interior space; Sending a synchronization test signal to the vehicle-mounted display device to cause the vehicle-mounted display device to display the target icon; According to the first position, the second position and the synchronous test signal, the mechanical arm is controlled to carry the video acquisition component to move, and a first video of the target icon on the vehicle-mounted display device is acquired; A test result of the target icon is determined according to the first video and the attribute information of the target icon.
[0007] In a second aspect, the present application provides a test device for an in-vehicle display device, the test device comprising: a device body, a mechanical arm, a fixing component and a video acquisition component, the mechanical arm and the fixing component are arranged on the device body, and the video acquisition component is arranged on the mechanical arm; the fixing component is used to fix the test device in the interior space of a vehicle; the test device is communicatively connected with the in-vehicle display device of the vehicle; the device further comprises: a model building module, a position determination module, a signal determination module, a control module and a test module; The model building module is used to build a three-dimensional model of the vehicle interior space according to a first position when the test device is fixed in the vehicle interior space; The position determination module is used to determine a second position of the vehicle-mounted display device displaying the target icon in the vehicle interior space according to the three-dimensional model; The signal determination module is used to send a synchronization test signal to the vehicle-mounted display device to make the vehicle-mounted display device display the target icon; The control module is used to control the mechanical arm to carry the video acquisition component to move according to the first position, the second position and the synchronous test signal, and acquire a first video of the target icon on the vehicle-mounted display device; The testing module is used to determine the test result of the target icon according to the first video and the attribute information of the target icon.
[0008] In a third aspect, the present application provides a computer-readable storage medium, wherein the computer-readable storage medium is used to store program codes executed by a processor, wherein the program codes are used to implement the above-mentioned test method for the vehicle-mounted display device.
[0009] In a fourth aspect, the present application provides a computer program product, which includes computer instructions. When the computer instructions are run on an electronic device, the electronic device implements the above-mentioned test method for the vehicle-mounted display device.
[0010] Beneficial effects: The present application provides a testing method for an in-vehicle display device, which is applied to the testing device, wherein the testing device comprises: a device body, a mechanical arm, a fixing component and a video acquisition component, wherein the mechanical arm and the fixing component are arranged on the device body, and the video acquisition component is arranged on the mechanical arm; the fixing component is used to fix the testing device in the interior space of the vehicle; and the testing device is communicatively connected with the in-vehicle display device of the vehicle.
[0011] The method includes: when a test device is fixed at a first position in the interior space of a vehicle, constructing a three-dimensional model of the interior space of the vehicle according to the first position; determining a second position of an on-board display device displaying a target icon in the interior space of the vehicle according to the three-dimensional model; sending a synchronous test signal to the on-board display device to make the on-board display device display the target icon; controlling a robotic arm carrying a video acquisition component to move according to the first position, the second position and the synchronous test signal to acquire a first video of the target icon in the on-board display device; and determining a test result of the target icon according to the first video and attribute information of the target icon.
[0012] In summary, the present application is used to realize automated testing of vehicle-mounted display devices by providing testing equipment and a testing method applied to the testing equipment; during the entire process, the staff only needs to fix the testing equipment in the vehicle interior space, and the testing equipment can automatically determine the vehicle interior space and interact with the vehicle-mounted display device to realize automated testing of the vehicle-mounted display device; the test results are determined based on the first video, thereby avoiding errors in manual measurement; in addition, since the automatic testing equipment in the present application is movable, it also has the advantage of strong practicality. BRIEF DESCRIPTION OF THE DRAWINGS
[0013] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the embodiments of the present application will be briefly introduced below. The following drawings only show certain embodiments of the present application and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.
[0014] Figure 1 A schematic diagram of the structure of a testing device for an in-vehicle display device provided in an embodiment of the present application; Figure 2 A communication diagram of a test device for a vehicle-mounted display device provided in an embodiment of the present application; Figure 3 A flow chart of a method for testing a vehicle-mounted display device provided in an embodiment of the present application; Figure 4 A schematic diagram of the structure of a control component in a test device for a vehicle-mounted display device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0015] In the prior art, icons in the vehicle-mounted display device may have icon display problems such as icon display delay, icon flickering, etc. during the display process; there may be many reasons for the above-mentioned icon display problems, such as unstable voltage output by the vehicle-mounted power supply, loose connection lines of the vehicle-mounted display screen, errors in the vehicle-mounted software and / or aging of the vehicle-mounted display screen may all cause icon display delays and / or icon flickering. Therefore, in the process of repairing the above-mentioned display problems, the icon display problems may need to be repeatedly tested.
[0016] In actual operation, maintenance technicians usually conduct repeated tests on icon display problems. In the above process, if we only rely on maintenance technicians for manual testing, it will not only be time-consuming and labor-intensive, but also easily cause measurement errors, which will ultimately affect the maintenance efficiency and quality of the icon display problem. It may even cause the use of other equipment in the vehicle to be affected by the wrong maintenance plan, ultimately causing immeasurable economic and safety risks.
[0017] In order to solve the above technical problems, the present application provides a testing device for a vehicle-mounted display device, such as Figure 1 and Figure 2 As shown, Figure 1 A schematic diagram of the physical structure of a test device for an in-vehicle display device provided in an embodiment of the present application, Figure 2 A communication schematic diagram of a test device for a vehicle-mounted display device provided in an embodiment of the present application, wherein the test device includes: a device body 110, a robotic arm 120, a fixing component 130, a video acquisition component 140, a control component 150, a first positioning component 160, a second positioning component 170 and a third positioning component 180.
[0018] Figure 2 The dotted lines shown in the figure indicate that the components therein are arranged together in physical structure; the mechanical arm 120 and the fixing component 130 are arranged on the device body 110, and the video acquisition component 140 is arranged on the mechanical arm 120; the fixing component 130 is used to fix the test device in the interior space of the vehicle; the control component 150 and the first positioning component 160 are arranged on the device body, and the first positioning component 160 is used to position the device body 110; the second positioning component 170 is arranged on the mechanical arm 120, and is used to position the mechanical arm 120; the third positioning component 180 is arranged on the video acquisition component 140, and is used to position the video acquisition component 140.
[0019] The control component 150 is communicatively connected with the vehicle's onboard display device; the control component 150 is also communicatively connected with the robotic arm 120, the video acquisition component 140, the first positioning component 160, the second positioning component 170 and the third positioning component 180 respectively.
[0020] Among them, since the control component 150 is communicated with the first positioning component 160, the second positioning component 170 and the third positioning component 180, the control component 150 can grasp the positions of the device body 110, the robotic arm 120 and the video acquisition component 140 in the natural space, as well as the relative positions between the device body 110, the robotic arm 120 and the video acquisition component 140 in real time; the control component 150 is also used to control the shooting operation of the robotic arm 120 and the video acquisition operation of the video acquisition component 140 according to control instructions. The above control instructions can be determined by the control component 150 itself, or they can be determined by an external network device and then sent to the control component 150; in the embodiment of the present application, the above control commands are all determined by the control component in the test equipment.
[0021] In actual applications, the shape parameters and working parameters of each component or module in the test equipment can be determined according to actual conditions. It is only necessary to ensure that efficient and accurate icon testing can be performed on the vehicle display device. This application does not impose any specific restrictions on this.
[0022] In actual operation, the test device is placed in the interior space of the vehicle, and then installed in the interior space of the vehicle through the fixing component 130, and then the icon display problem of the vehicle's onboard display device is tested by the test device.
[0023] Among them, the "in-vehicle space" can be the space between the front seat and the front glass of the vehicle; the specific structure of the fixing component 130 can be a clamping device or other structure with a fixing function. It only needs to ensure that the test equipment can be fixed in the space inside the vehicle. This application does not make any specific restrictions on this.
[0024] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the technical solution of the present application will be clearly and completely described below in conjunction with the accompanying drawings. Obviously, the described embodiments are part of the embodiments of the present application, rather than all of the embodiments. According to the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present application.
[0025] First, the present application provides an embodiment of a method for testing a vehicle-mounted display device, such as Figure 3 As shown, Figure 3 A flow chart of a method for testing a vehicle-mounted display device provided in an embodiment of the present application, the method comprising: S210 to S250, the details of which are as follows: S210: When the test device is fixed at a first position in the vehicle interior space, construct a three-dimensional model of the vehicle interior space according to the first position.
[0026] Specifically, after the test equipment is installed in the interior space of the vehicle, the test equipment can determine the interior positions of the device body 110, the robotic arm 120 and the video acquisition component 140 in the interior space of the vehicle through the first positioning component 160, the second positioning component 170 and the third positioning component 180; in the embodiment of the present application, the interior position obtained by positioning the first positioning component 160 is determined as the first position, because in the process of testing the icon display problem of the vehicle-mounted display device, the interior positions of the robotic arm 120 and the video acquisition component 140 in the interior space of the vehicle will change, but the device body 110 is fixed in the interior space of the vehicle by the fixing component 130, so the relative position between the device body 110 and the interior space of the vehicle is relatively stable; after determining the first position, the control component 150 can construct a three-dimensional model including the first position for the interior space of the vehicle.
[0027] In one implementation, S210 includes: Step (1) to Step (4), the details of which are as follows: Step (1): Control the robotic arm to move in the interior space of the vehicle and control the video acquisition component to capture a second video of the interior space of the vehicle from multiple angles during the movement.
[0028] Specifically, in an embodiment of the present application, the control component 150 can control the movement of the robotic arm 120 in the space inside the vehicle, and movement information such as the movement path of the robotic arm 120 is usually determined by the control component 150; during the movement of the robotic arm 120, the control component 150 controls the video acquisition component 140 to collect multiple second videos of multiple angles about the space inside the vehicle at a fixed point.
[0029] "Fixed-point acquisition" means that although the second video is shot while the robot arm 120 is moving while carrying the video acquisition component 140, when shooting the second video, the robot arm 120 and the video acquisition component 140 are in a stationary state, i.e., "fixed-point"; in the process of fixed-point acquisition of the second video, each fixed-point acquisition is performed once, i.e., a second video is shot, which is then sent to the control component 150. After receiving the second video, the control component 150 determines the in-vehicle positions of the robot arm 120 and the video acquisition component 140 which are in a stationary state when shooting the second video through the second positioning component 170 and the third positioning component 180 respectively; when the control component 150 determines the two in-vehicle positions corresponding to the second video, it controls the robot arm 120 to continue moving in the in-vehicle space.
[0030] The angle in “multi-angle” refers to the shooting angle; the multi-angle second video refers to a video about the interior space of the vehicle shot at multiple shooting angles. In actual operation, the second video can be shot by the video acquisition component 140 while looking around the interior space of the vehicle.
[0031] In actual operation, the path for shooting the second video can be a preset moving path with a smaller moving range, or an infrared module can be set to sense the distance between the video acquisition component 140 and the objects in the vehicle in real time. As long as the distance between the video acquisition component 140 and the objects in the vehicle is within a safe range, the robotic arm 120 can carry the video acquisition component 140 to move "relatively freely" in the space inside the vehicle, so that the video acquisition component 140 can shoot a second video from multiple angles.
[0032] Step (2): Determine the dimension data of the space inside the vehicle based on the second video.
[0033] Specifically, the control component 150 can construct a coordinate system of the space inside the vehicle based on each second video and the respective positions of the robotic arm 120 and the video acquisition component 140 inside the vehicle when each second video was shot; in actual operation, the relative positions of the objects inside the vehicle and the robotic arm 120 and the video acquisition component 140 are determined based on the picture frames of multiple objects inside the vehicle simultaneously captured by at least two second videos among the multiple second videos and based on the shape changes of the objects inside the vehicle in the picture frames in different second videos, and then the coordinate system of the space inside the vehicle is constructed based on the relative positions.
[0034] In actual operation, although the second video can capture information about more objects inside the vehicle, the image of the vehicle interior can also be captured in the form of "fixed-angle picture capture"; "fixed angle" means that the video capture component 140 captures the image of the vehicle interior at the same multiple relative angles at each "fixed point", and "relative angle" refers to the shooting angle of the video capture component 140 relative to the device body 110. For example, the shooting angle may be "a shooting angle parallel to the south of the device body 110" and the like.
[0035] Step (3): Construct a coordinate system of the interior space of the vehicle based on the dimension data and determine the coordinates of the first position.
[0036] Specifically, when the second video or image captured at a fixed point is determined, a coordinate system can be constructed based on the data about the space inside the vehicle in the second video or image; when the coordinate system of the space inside the vehicle is determined, the coordinates of the first position can be determined, and subsequently the in-vehicle positions of the robotic arm 120 and the video acquisition component 140 sent by the second positioning component 170 and the third positioning component 180 can be converted into coordinates.
[0037] Step (4): Construct a three-dimensional model based on the dimension data and coordinate system.
[0038] Specifically, after the coordinate system is constructed, a three-dimensional model of the interior space of the vehicle can be constructed based on the dimension data.
[0039] S220: Determine a second position of the vehicle-mounted display device displaying the target icon in the vehicle interior space according to the three-dimensional model.
[0040] Specifically, after the three-dimensional model is constructed, the interior view images at various angles in the three-dimensional model can be determined, and then the interior view images can be identified through neural network models such as the Yolo model to determine the second position of the vehicle display device in the vehicle interior space; in actual operation, after determining the second position, the coordinates of the second position can be determined according to the coordinate system.
[0041] S230: Sending a synchronous test signal to the vehicle-mounted display device to cause the vehicle-mounted display device to display a target icon.
[0042] Specifically, in the embodiment of the present application, S210~S220 are accurate work before the test process for the icon display problem of the vehicle display screen, and S230~S250 are the test process for the icon display problem of the vehicle display screen; in the actual processing process, for a test process of a vehicle, S210~S220 usually only needs to be executed once, and S230~S250 needs to be executed multiple times.
[0043] When it is necessary to test the icon display problem of the vehicle display screen, the control component 150 sends a synchronous test signal to the vehicle display device to make the vehicle display device display the target icon.
[0044] In one implementation, the synchronization test signal includes: a synchronization signal and a test signal; S230 includes: steps (5) to (6), the details of which are as follows: Step (5): Send a synchronization signal to the vehicle-mounted display device, so that the vehicle-mounted display device performs time synchronization processing with the device operating time of the test device according to the synchronization signal.
[0045] Specifically, in an embodiment of the present application, the test for the icon display problem of the vehicle-mounted display device includes testing the display delay of the icon. In order to calculate the time interval between the vehicle-mounted display device receiving the command to display the icon and displaying the icon according to the command, it is necessary to perform time synchronization processing on the control component 150 and the vehicle-mounted display device so that the actual moment when the vehicle-mounted display device displays the icon is consistent with the recorded moment when the vehicle-mounted display device displays the icon recorded by the first video.
[0046] In actual operation, the time synchronization process is performed by the control component 150 communicating with the vehicle-mounted display device.
[0047] Step (6): Send a test signal to the vehicle display device, so that the vehicle display device displays the target icon.
[0048] Specifically, after the control component 150 is time synchronized with the vehicle-mounted display device, the control component 150 sends a test signal to the vehicle-mounted display device, causing the vehicle-mounted display device to display the target icon at the target time, and causing the video acquisition component 140 to capture a first video including the icon display status of the vehicle-mounted display device at the target time.
[0049] In one implementation, the synchronization test signal includes: an information interaction signal; S230 includes: step (7), the details of which are as follows: Step (7): Send an information interaction signal to the vehicle-mounted display device, so that the vehicle-mounted display device feeds back icon attribute information.
[0050] Specifically, in an embodiment of the present application, during the process of the control component 150 communicating with the vehicle-mounted display device to enable the vehicle-mounted display device to display a target icon, the control component 150 may communicate with the vehicle-mounted display device to obtain attribute information of icons that can be displayed by the vehicle-mounted display device, for subsequent determination of specific problems in the icon display of the vehicle-mounted display device.
[0051] S240: According to the first position, the second position and the synchronous test signal, the robotic arm carrying the video acquisition component is controlled to move, and a first video of the target icon on the vehicle-mounted display device is acquired by acquisition.
[0052] Specifically, while the control component 150 sends a synchronization test signal to the vehicle-mounted display device, the control component 150 also controls the robotic arm 120 to carry the video acquisition component 140 to move relative to the first position in response to the determination of the synchronization test information. The purpose of the movement is to approach the second position so that the video acquisition component 140 can shoot the first video of the vehicle-mounted display device when displaying the icon.
[0053] In one implementation, S240 includes: Step (8) to Step (10), the details of which are as follows: Step (8): Determine the target position based on the first position, the second position and the three-dimensional model.
[0054] Specifically, in the embodiment of the present application, the target position is the position where the video acquisition component 140 is located when the vehicle-mounted display device shoots the first video; in actual operation, the purpose of determining the target position is to prevent the robotic arm 120 from touching the vehicle-mounted display device when carrying the video acquisition component 140 to move to the vehicle-mounted display device, and to be able to capture a first video with a clear composition, so as to facilitate the subsequent accurate diagnosis of the icon display problem shown in the first video.
[0055] In actual operation, the target position should be between the first position and the second position. The target position is determined based on the three-dimensional model. The target position determined by the three-dimensional model is in the form of coordinates.
[0056] In one implementation, step (8) includes: step (8.1) to step (8.2), the details of which are as follows: Step (8.1): Smoothing the three-dimensional model to obtain a smoothed model and determining shape data of the smoothed model.
[0057] Specifically, in the prior art, there are many objects in the space inside a car, and the surfaces of the objects may have concave and convex shapes, which will result in excessive calculations when the three-dimensional model is used in the subsequent process. Therefore, the three-dimensional model can be smoothed so that the three-dimensional model does not display the specific shape of the object surface at a smaller position.
[0058] In one implementation, the shape data includes: the volume of the smooth model, the first length ratio, the second length ratio and the inclination angle; the first length ratio indicates the ratio between the body diagonal of the smooth model and the first preset length; the second length ratio indicates the ratio between the long side of the smooth model and the second preset length; the inclination angle is the angle between the body diagonal of the smooth model and the bottom surface of the smooth model.
[0059] Specifically, since a smooth model is usually an irregular polyhedron, the process of determining the body diagonal of a smooth model is slightly more complicated than the process of determining the body diagonal of a regular polyhedron such as a cuboid. However, since the purpose of determining the body diagonal of a smooth model is to facilitate the determination of the target position and the moving path, it is sufficient as long as the obtained body diagonal can provide prompts for the process of determining the target position, the moving path, etc.
[0060] In the process of determining the body diagonal of the smooth model, it is necessary to first determine multiple candidate body diagonals, and then determine the body diagonal with the largest slope and / or the longest length as the body diagonal used to determine the first length ratio, the second length ratio and the inclination angle.
[0061] The purpose of determining the volume, the first length ratio, the second length ratio and the tilt angle of the smooth model is to "measure" the shape of the smooth model. For example, for a narrow and long smooth model, in the subsequent process of determining the moving path, it is necessary to set the moving path as short as possible to prevent it from touching other objects in the vehicle interior space. For example, for a wide smooth model, it has more options when subsequently determining the target position and / or moving path.
[0062] Step (8.2): Determine the target position in the smooth model based on the first position, the second position and the shape data of the smooth model.
[0063] Specifically, after determining the shape data of the first position, the second position and the smooth model, the target position can be determined in the smooth model; in actual operation, the target position can be determined by taking the distance between the vehicle-mounted display device and the vehicle-mounted display device as the standard within a preset distance range. For example, the preset distance range can be (5cm, 12cm).
[0064] Step (9): Determine the movement path of the robot arm based on the target position and the three-dimensional model.
[0065] Specifically, after the target position is determined, the current in-vehicle positions of the robotic arm 120 and the video acquisition component 140 may be determined by the second positioning component 170 and the third positioning component 180 , respectively.
[0066] The path planning condition is to make the video acquisition component 140 move from its current position in the vehicle to the target position, and plan the moving path of the robotic arm in the three-dimensional model according to the current position of the robotic arm 120 in the vehicle.
[0067] Step (10): Based on the synchronous test signal, control the robotic arm to carry the video acquisition component and move along the moving path until the video acquisition component is at the target position and acquires the first video at the target position.
[0068] Specifically, when the robot arm 120 carries the video acquisition component 140 and moves until the video acquisition component 140 is at the target position; when the video acquisition component 140 is at the target position, the control component 150 controls the video acquisition component 140 to capture images of the vehicle-mounted display device.
[0069] In one implementation, S240 includes: Step (11) to Step (14), the details of which are as follows: Step (11): Determine the video definition and video composition data of the first video; The video composition data indicates the composition of the vehicle-mounted display device in the image frame of the first video.
[0070] Specifically, video clarity is used to determine the impact of light on the first video and the impact of the distance between the target position and the vehicle-mounted display device on the first video. If the surface of the vehicle-mounted display device is reflective, accurate test results cannot be obtained based on the corresponding first video.
[0071] The purpose of determining the video composition data is to ensure that the first video of the icon display of the vehicle-mounted display device can be captured clearly and accurately; if the vehicle-mounted display device is in a tilted state in the image frame of the first video, accurate test results cannot be obtained based on the corresponding first video; in actual operation, the video composition data may include the proportion of the area occupied by the vehicle-mounted display device in the image frame, the degree of symmetry of the vehicle-mounted display device in the image frame, and other data used to measure whether the composition meets the standards.
[0072] Step (12): If the video clarity and / or video composition data do not meet the respective preset standards, control the video acquisition component to perform focus processing.
[0073] Specifically, in the embodiment of the present application, the video clarity and video composition data are both quantifiable data, so it can be determined whether the video clarity and / or video composition data of the current first video meets the standards through pre-set preset standards; if they do not meet the standards, the control component 150 controls the video acquisition component 140 to perform focusing processing.
[0074] Step (13): If the video clarity and / or video composition data of the first video captured by the video capture component after the focus processing do not meet the respective preset standards, the target position of the video capture component is updated according to the video composition data; wherein the target position indicates the current shooting position of the video capture component.
[0075] Specifically, the focusing range of the video acquisition component 140 is limited, and if light affects the clarity of the first video, a clear and accurate first video cannot be obtained by only controlling the video acquisition component 140 to perform focusing processing.
[0076] If the video clarity and / or video composition data of the first video captured by the video capture component after the focus processing do not meet the respective preset standards, it is necessary to redetermine the target position based on the video composition data, that is, the video capture component 140 needs to be moved from the current target position.
[0077] In some embodiments, the video composition data includes: area ratio and symmetry; the area ratio indicates the area ratio of the vehicle display device in the image frame; the symmetry indicates the degree of symmetry of the vehicle display device in the image frame; step (13) includes: step (13.1) to step (13.2), the details are as follows: Step (13.1): determining a shooting distance adjustment value according to the area ratio, and / or determining a shooting angle adjustment value according to the symmetry.
[0078] Specifically, in the embodiment of the present application, the area ratio can be used to indicate whether the composition of the current first video is reasonable. If the area ratio is small, it means that the shooting resources of the first video are wasted, which may result in the inability to clearly capture the icon display of the vehicle-mounted display device.
[0079] The degree of symmetry refers to the overlap ratio of the image area occupied by the images on both sides of the central vertical line of the first video as the boundary.
[0080] The degree of symmetry can also indicate whether the composition of the current first video is reasonable; if the degree of symmetry is small, it means that the video acquisition component 140 is tilted at a large angle relative to the vehicle-mounted display device, which may result in an inability to clearly capture the icon display of the vehicle-mounted display device.
[0081] In actual operation, the basis for determining the shooting distance adjustment value according to the area ratio and the shooting angle adjustment value according to the symmetry can be determined according to actual needs. For example, multiple intervals can be set for the area ratio and the symmetry, and corresponding shooting distance adjustment values and shooting angle adjustment values can be set for different intervals. The shooting distance adjustment value and shooting angle adjustment value can be determined according to the actual area ratio and the actual symmetry interval.
[0082] Step (13.2): Update the target position of the video acquisition component according to the shooting angle adjustment value and / or the shooting distance adjustment value.
[0083] Specifically, after determining the shooting angle adjustment value and the shooting distance adjustment value, the shooting angle and shooting distance of the video acquisition component 140 can be adjusted, and the adjusted position is the updated target position.
[0084] It should be emphasized that the update operation for the target position must still be subject to the constraints of the smooth model, otherwise it is easy to cause the robot arm 120 carrying the video acquisition component 140 to touch other objects in the vehicle space during the movement.
[0085] Step (14): Repeat the step of determining the video clarity and video composition data based on the first video until the video clarity and video composition data meet their respective preset standards.
[0086] Specifically, after adjusting the shooting distance and shooting angle of the video acquisition component 140, the first video can be re-shot based on the updated target position and the video clarity and video composition data can be determined according to the first video until the video clarity and video composition data meet their respective preset standards.
[0087] S250: Determine a test result of the target icon according to the first video and the attribute information of the target icon.
[0088] Specifically, after acquiring the first video, the test result of the target icon can be determined according to the display condition of the target icon and the attribute information of the target icon in the first video.
[0089] In one implementation, the synchronization test signal includes: time information, the time information instructs the vehicle-mounted display device to display the corresponding target icon at the first time; S250 includes: steps (15) to (16), the details of which are as follows: Step (15): Based on the first video, determine a second moment when the vehicle-mounted display device displays the target icon.
[0090] Specifically, in the embodiment of the present application, the control component 150 and the vehicle-mounted display device have been time-synchronized, so the first moment in the vehicle-mounted display device is consistent with the first moment in the first video; under the above premise, the second moment when the vehicle-mounted display device starts to display the icon is determined according to the first video.
[0091] Step (16): Determine the display delay of the target icon according to the first moment and the second moment.
[0092] Specifically, after the second moment is determined, the display delay of the target icon can be determined according to the first moment and the second moment.
[0093] In one implementation, S250 includes: Step (17) to Step (21), the details of which are as follows: Step (17): determining a plurality of image frames corresponding to the target icon in the first video; Specifically, the first video usually includes a video clip about the display of the target icon; a plurality of image frames are selected from the video clip after the target icon appears to determine whether the vehicle-mounted display device has an icon display problem.
[0094] Step (18): determining the difference of the target icon according to the first pixel data of the target icon displayed in the image frame and the second pixel data of the target icon indicated by the attribute information.
[0095] Specifically, in an embodiment of the present application, the pixel data may be a pixel value or other indicator that can measure the color distribution of the image; after determining the pixel data of the target icon in the image frame and the pixel data of the target icon indicated by the attribute information, the difference of the target icon can be determined based on the above pixel data; in actual operation, the sum of the difference between the first pixel data and the second pixel data corresponding to each pixel in the multiple pixels can be determined as the difference.
[0096] Step (19): Determine the average difference value corresponding to the target icon according to the differences corresponding to the multiple image frames.
[0097] Specifically, in the embodiment of the present application, one image frame corresponds to one degree of difference, and after the degree of difference corresponding to each image frame is determined, an average value of the degrees of difference corresponding to multiple image frames is determined.
[0098] Step (20): If the display delay and / or the difference mean value do not meet the preset standard, the target icon is determined as an abnormal icon.
[0099] Specifically, if any one of the display delay and the difference mean corresponding to the target icon does not meet the preset standard, the target icon is determined to be an abnormal icon.
[0100] Step (21): Determine the abnormal icon, the display delay of the abnormal icon, and the average value of the difference as the test result.
[0101] In one implementation, S250 includes: Step (22) to Step (24), the details of which are as follows: Step (22): Determine the flashing frequency of the target icon per unit time according to the first video.
[0102] Specifically, in the embodiment of the present application, the flashing frequency is the number of flashes per unit time.
[0103] Step (23): If the flashing frequency is greater than a preset standard, the target icon is determined to be an abnormal icon.
[0104] Step (24): Determine the abnormal icon and flashing frequency as the test result.
[0105] Specifically, the above is a process for determining the test results of a single target icon; in actual operation, there may be multiple target icons, so in the test results, the test results of the vehicle display device can also be determined based on the display delay and / or the average difference of the multiple target icons; the test results of the vehicle display device can be "the distribution of abnormal icons", "the type of vehicle application corresponding to the abnormal icon", etc., which can indicate the overall icon display situation of multiple target icons in the vehicle display device.
[0106] Second, the present application provides a test device for an in-vehicle display device, the test device comprising: a device body 110, a mechanical arm 120, a fixing component 130 and a video acquisition component 140, the mechanical arm 120 and the fixing component 130 are arranged on the device body, and the video acquisition component 140 is arranged on the mechanical arm 120; the fixing component 130 is used to fix the test device in the interior space of the vehicle; the test device is communicatively connected with the in-vehicle display device of the vehicle; Figure 4 As shown, Figure 4This is a structural schematic diagram of the control component in the test equipment of the vehicle-mounted display device provided in an embodiment of the present application. The equipment also includes: a model building module 151, a position determination module 152, a signal determination module 153, a control module 154 and a test module 155 in the control component 150.
[0107] The model building module 151 is used to build a three-dimensional model of the vehicle interior space according to the first position when the test device is fixed at the first position in the vehicle interior space.
[0108] The position determination module 152 is used to determine the second position of the vehicle-mounted display device displaying the target icon in the vehicle interior space according to the three-dimensional model.
[0109] The signal determination module 153 is used to send a synchronization test signal to the vehicle-mounted display device to make the vehicle-mounted display device display a target icon.
[0110] The control module 154 is used to control the robot arm carrying the video acquisition component to move according to the first position, the second position and the synchronous test signal, and acquire a first video of the target icon on the vehicle-mounted display device.
[0111] The testing module 155 is used to determine a test result of the target icon according to the first video and the attribute information of the target icon.
[0112] The model building module 151 is further used to control the mechanical arm to move in the vehicle interior space and control the video acquisition component to capture a second video of multiple angles about the vehicle interior space during the movement; The model building module 151 is further used to determine the dimension data of the interior space of the vehicle according to the second video; The model building module 151 is further used to build a coordinate system of the vehicle interior space according to the dimension data and determine the coordinates of the first position; The model building module 151 is also used to build a three-dimensional model according to the dimension data and the coordinate system.
[0113] The control module 154 is further used to determine the target position according to the first position, the second position and the three-dimensional model; The control module 154 is further used to determine the movement path of the robot arm based on the target position and the three-dimensional model; The control module 154 is also used to control the robot arm carrying the video acquisition component to move along the moving path based on the synchronous test signal until the video acquisition component is at the target position and the first video is acquired at the target position.
[0114] The control module 154 is further used to perform smoothing processing on the three-dimensional model to obtain a smoothed model and determine shape data of the smoothed model; The control module 154 is further configured to determine a target position in the smooth model according to the first position, the second position and the shape data of the smooth model.
[0115] In one implementation, the shape data includes: the volume of the smooth model, the first length ratio, the second length ratio and the inclination angle; the first length ratio indicates the ratio between the body diagonal of the smooth model and the first preset length; the second length ratio indicates the ratio between the long side of the smooth model and the second preset length; the inclination angle is the angle between the body diagonal of the smooth model and the bottom surface of the smooth model.
[0116] In one implementation, the synchronization test signal includes: a signal determination module 153, further configured to send a synchronization signal to the vehicle-mounted display device, so that the vehicle-mounted display device performs time synchronization processing according to the synchronization signal and the device operating time of the test device; The signal determination module 153 is further used to send a test signal to the vehicle-mounted display device to make the vehicle-mounted display device display the target icon.
[0117] In one implementation, the control module 154 is further configured to determine the video definition and video composition data of the first video; The video composition data indicates the composition of the vehicle-mounted display device in the image frame of the first video; The control module 154 is also used to control the video acquisition component to perform focus adjustment if the video clarity and / or video composition data do not meet respective preset standards; The control module 154 is further configured to update the target position of the video acquisition component according to the video composition data if the video definition and / or video composition data of the first video acquired by the video acquisition component after the focus adjustment process do not meet respective preset standards; Wherein, the target position indicates the current shooting position of the video acquisition component; The control module 154 is further configured to repeatedly execute the step of determining the video definition and the video composition data according to the first video until the video definition and the video composition data meet respective preset standards.
[0118] In one implementation, the video composition data includes: area ratio and symmetry; the area ratio indicates the area ratio of the vehicle display device in the image frame; the symmetry indicates the degree of symmetry of the vehicle display device in the image frame; according to the video composition data, the target position of the video acquisition component is updated, including: Determine a shooting distance adjustment value according to the area ratio, and / or determine a shooting angle adjustment value according to the symmetry; The target position of the video acquisition component is updated according to the shooting angle adjustment value and / or the shooting distance adjustment value.
[0119] In one implementation, the synchronization test signal includes: time information, the time information indicating that the vehicle display device displays the corresponding target icon at a first time; the test module 155 is further used to determine a second time when the vehicle display device displays the target icon according to the first video; The testing module 155 is further configured to determine a display delay of the target icon according to the first moment and the second moment.
[0120] In one implementation, the testing module 155 is further configured to determine a plurality of image frames corresponding to the target icon in the first video; The testing module 155 is further used to determine the difference degree of the target icon according to the first pixel data of the target icon displayed by the image frame and the second pixel data of the target icon indicated by the attribute information; The testing module 155 is further used to determine a mean difference value corresponding to the target icon according to the differences respectively corresponding to the plurality of image frames; The testing module 155 is further configured to determine the target icon as an abnormal icon if the display delay and / or the difference average value do not meet the preset standard; The testing module 155 is further configured to determine the abnormal icon, the display delay of the abnormal icon, and the average value of the difference as the test result.
[0121] In one implementation, the testing module 155 is further configured to determine a flashing frequency of the target icon per unit time according to the first video; The testing module 155 is further used to determine the target icon as an abnormal icon if the flashing frequency is greater than a preset standard; The testing module 155 is further configured to determine the abnormal icon and the flashing frequency as the test result.
[0122] Third, the present application also provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, steps S210 to S250 of the above embodiment are executed.
[0123] Fourth, the computer program product provided in the present application includes a computer-readable storage medium storing program code. The instructions included in the program code can be used to execute the method in the previous method embodiment. The specific implementation can refer to steps S210~S250 of the method embodiment, which will not be repeated here.
[0124] In the embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. The device embodiments described above are merely schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some communication interfaces, and the indirect coupling or communication connection of the devices or units can be electrical, mechanical or other forms.
[0125] In addition, the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0126] Furthermore, the functional modules in the various embodiments of the present application may be integrated together to form an independent part, or each module may exist independently, or two or more modules may be integrated to form an independent part.
[0127] It should be noted that if the function is implemented in the form of a software function module and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium, including several instructions for a computer device (which can be a personal computer, server, or network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), disk or optical disk, and other media that can store program codes.
[0128] In this document, relational terms such as first and second, etc. are used merely to distinguish one entity or operation from another entity or operation, but do not necessarily require or imply any such actual relationship or order between these entities or operations.
[0129] The above description is only an embodiment of the present application and is not intended to limit the protection scope of the present application. For those skilled in the art, the present application may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included in the protection scope of the present application.
Claims
1. A method for testing a vehicle-mounted display device, characterized in that: Applied to a test device, the test device comprises: a device body, a mechanical arm, a fixing component and a video acquisition component, the mechanical arm and the fixing component are arranged on the device body, and the video acquisition component is arranged on the mechanical arm; the fixing component is used to fix the test device in the interior space of a vehicle; the test device is communicatively connected with an on-board display device of the vehicle; the method comprises: When the test device is fixed at a first position in the vehicle interior space, constructing a three-dimensional model of the vehicle interior space according to the first position; Determining, based on the three-dimensional model, a second position of the vehicle-mounted display device displaying the target icon in the vehicle interior space; Sending a synchronization test signal to the vehicle-mounted display device to cause the vehicle-mounted display device to display the target icon; According to the first position, the second position and the synchronous test signal, the mechanical arm is controlled to carry the video acquisition component to move, and a first video of the target icon on the vehicle-mounted display device is acquired; A test result of the target icon is determined according to the first video and the attribute information of the target icon.
2. The method according to claim 1, characterized in that The step of constructing a three-dimensional model of the vehicle interior space according to the first position includes: Controlling the mechanical arm to move in the interior space of the vehicle and controlling the video acquisition component to capture a second video of multiple angles about the interior space of the vehicle during the movement; Determining the dimension data of the space inside the vehicle according to the second video; constructing a coordinate system of the vehicle interior space according to the dimension data and determining the coordinates of the first position; The three-dimensional model is constructed according to the dimension data and the coordinate system.
3. The method according to claim 2, characterized in that The step of controlling the mechanical arm to carry the video acquisition component to move according to the first position, the second position and the synchronous test signal to acquire a first video of the target icon on the vehicle-mounted display device includes: determining a target position according to the first position, the second position and the three-dimensional model; Determining a moving path of the robotic arm according to the target position and the three-dimensional model; Based on the synchronization test signal, the robotic arm is controlled to carry the video acquisition component and move along the moving path until the video acquisition component is at the target position and acquires the first video at the target position.
4. The method according to claim 3, characterized in that The step of determining a target position according to the first position, the second position and the three-dimensional model includes: Performing smoothing processing on the three-dimensional model to obtain a smoothed model and determining shape data of the smoothed model; The target position is determined in the smooth model based on the first position, the second position and the shape data of the smooth model.
5. The method according to claim 4, characterized in that The shape data includes: the volume, first length ratio, second length ratio and tilt angle of the smooth model; the first length ratio indicates the ratio between the body diagonal of the smooth model and the first preset length; the second length ratio indicates the ratio between the long side of the smooth model and the second preset length; the tilt angle is the angle between the body diagonal of the smooth model and the bottom surface of the smooth model.
6. The method according to claim 1, characterized in that The synchronous test signal includes: a synchronous signal and a test signal; the sending of the synchronous test signal to the vehicle-mounted display device includes: Sending the synchronization signal to the vehicle-mounted display device, so that the vehicle-mounted display device performs time synchronization processing with the device running time of the test device according to the synchronization signal; The test signal is sent to the vehicle-mounted display device, so that the vehicle-mounted display device displays the target icon.
7. The method according to claim 1, characterized in that The controlling the mechanical arm to carry the video acquisition component to move and acquire a first video of the target icon on the vehicle-mounted display device includes: Determining video definition and video composition data of the first video; The video composition data indicates the composition of the vehicle-mounted display device in the image frame of the first video; If the video clarity and / or video composition data do not meet respective preset standards, controlling the video acquisition component to perform focus adjustment processing; If the video clarity and / or video composition data of the first video captured by the video capture component after the focus processing do not meet respective preset standards, updating the target position of the video capture component according to the video composition data; Wherein, the target position indicates the current shooting position of the video acquisition component; The step of determining the video definition and the video composition data according to the first video is repeatedly performed until the video definition and the video composition data both meet respective preset standards.
8. The method according to claim 7, characterized in that The video composition data includes: area ratio and symmetry; the area ratio indicates the area ratio of the vehicle display device in the image frame; the symmetry indicates the degree of symmetry of the vehicle display device in the image frame; the updating of the target position of the video acquisition component according to the video composition data includes: determining a shooting distance adjustment value according to the area ratio, and / or determining a shooting angle adjustment value according to the symmetry; The target position of the video acquisition component is updated according to the shooting angle adjustment value and / or the shooting distance adjustment value.
9. The method according to claim 1, characterized in that: The synchronous test signal includes: time information, the time information instructing the vehicle-mounted display device to display the corresponding target icon at a first time; and determining the test result of the target icon according to the first video and the attribute information of the target icon, including: Determining, according to the first video, a second time at which the in-vehicle display device displays the target icon; A display delay of the target icon is determined according to the first moment and the second moment.
10. The method according to claim 9, characterized in that The step of determining a test result of the target icon according to the first video and the attribute information of the target icon includes: Determining a plurality of image frames corresponding to the target icon in the first video; determining a difference degree of the target icon according to first pixel data of the target icon displayed by the image frame and second pixel data of the target icon indicated by the attribute information; Determining a mean value of the degree of difference corresponding to the target icon according to the degrees of difference respectively corresponding to the plurality of image frames; If the display delay and / or the difference average value do not meet the preset standard, the target icon is determined as an abnormal icon; The abnormal icon, the display delay of the abnormal icon, and the average value of the difference are determined as the test result.
11. The method according to claim 1, characterized in that: The step of determining a test result of the target icon according to the first video and the attribute information of the target icon includes: Determine, according to the first video, a flashing frequency of the target icon per unit time; If the flashing frequency is greater than a preset standard, the target icon is determined to be an abnormal icon; The abnormal icon and the flashing frequency are determined as the test result.
12. A test device for an in-vehicle display device, characterized in that: The test device comprises: a device body, a mechanical arm, a fixing component and a video acquisition component, wherein the mechanical arm and the fixing component are arranged on the device body, and the video acquisition component is arranged on the mechanical arm; the fixing component is used to fix the test device in the interior space of a vehicle; the test device is communicatively connected with the vehicle-mounted display device of the vehicle; the device further comprises: a model building module, a position determination module, a signal determination module, a control module and a test module; The model building module is used to build a three-dimensional model of the vehicle interior space according to a first position when the test device is fixed in the vehicle interior space; The position determination module is used to determine a second position of the vehicle-mounted display device displaying the target icon in the vehicle interior space according to the three-dimensional model; The signal determination module is used to send a synchronization test signal to the vehicle-mounted display device to make the vehicle-mounted display device display the target icon; The control module is used to control the mechanical arm to carry the video acquisition component to move according to the first position, the second position and the synchronous test signal, and acquire a first video of the target icon on the vehicle-mounted display device; The testing module is used to determine the test result of the target icon according to the first video and the attribute information of the target icon.
13. A computer-readable storage medium, characterized in that: The computer-readable storage medium is used to store program codes executed by a processor, and the program codes are used to implement the testing method of the vehicle-mounted display device according to any one of claims 1 to 11.
14. A computer program product, characterized in that The computer program product includes computer instructions. When the computer instructions are executed on an electronic device, the electronic device implements the method for testing the in-vehicle display device according to any one of claims 1 to 11.
Citation Information
Patent Citations
Time delay detection method and system
CN114554181A
In-vehicle scene construction method, terminal equipment and computer readable storage medium
CN115115709A
Image processing method and device and vehicle
CN115134537A
Vehicle-mounted equipment testing method and system, electronic equipment and computer program product
CN115729757A
Adjusting method, device and equipment of vehicle-mounted head-up display system and storage medium
CN116704922A