Picture test method, test system, device, equipment, storage medium and product

Abstract

The invention discloses a picture test method, a test system, a device, equipment, a storage medium and a product. The picture test method is applied to a terminal in a head-up display picture test system, and comprises the steps that a to-be-tested image is acquired, the to-be-tested image comprises an image determined based on a head-up display picture, and the head-up display picture is generated based on scene data of a template image; determining the icon similarity between each first icon element in the template image and a second icon element corresponding to each first icon element in the to-be-tested image, if each icon similarity is greater than or equal to a preset threshold value, determining that the head-up display picture corresponding to the to-be-tested image is successfully tested, and if any icon similarity smaller than the preset threshold value exists, determining that the head-up display picture corresponding to the to-be-tested image is successfully tested. And if yes, determining that the head-up display picture test corresponding to the to-be-tested image fails. And the test accuracy and the detection efficiency are effectively improved.

Description

Technical Field

[0001] Embodiments of the present invention relate to the technical field of head-up display, and in particular to a screen testing method, testing system, device, equipment, storage medium and product. Background Art

[0002] Head-Up Display (HUD) is a device that displays important driving information (such as vehicle speed and navigation) on the windshield in front of the driver by projection. This design allows the driver to drive without looking down at the dashboard, thereby reducing the frequency of visual shifts and improving driving safety. Head-up displays were first used in military aircraft and later gradually became popular in automobiles, becoming an important part of the smart cockpit.

[0003] The existing HUD image detection usually adopts the following method: the HUD is placed on an optical test bench, and the control terminal sends an analog signal to the domain controller. The domain controller converts the analog signal into an image signal and sends it to the HUD, so that the HUD projects the image onto the windshield for display. The tester detects the HUD image by observing the image projected on the windshield and the expected material image.

[0004] However, existing head-up display image detection methods have problems with low detection efficiency and accuracy. Summary of the invention

[0005] The present invention provides a picture testing method, a testing system, a device, an equipment, a storage medium and a product to solve the problems of low detection efficiency and accuracy in the existing head-up display picture detection method.

[0006] According to one aspect of the present invention, a screen test method is provided, which is applied to a terminal in a head-up display screen test system, and the method comprises:

[0007] Acquire an image to be tested, wherein the image to be tested includes an image determined based on a head-up display screen, wherein the head-up display screen is generated based on scene data of a template image;

[0008] Determine the icon similarity between each first icon element in the template image and the second icon element corresponding to each first icon element in the image to be tested. If each of the icon similarities is greater than or equal to a preset threshold, determine that the head-up display screen test corresponding to the image to be tested is successful. If any of the icon similarities is less than the preset threshold, determine that the head-up display screen test corresponding to the image to be tested has failed.

[0009] According to another aspect of the present invention, a head-up display screen test system is provided, the head-up display screen test system comprising a terminal, a domain controller and a head-up display, wherein the terminal is communicatively connected to the domain controller, and the domain controller is communicatively connected to the head-up display, wherein:

[0010] The terminal is used to receive a template image, generate a scene simulation signal according to scene data of the template image, and send the scene simulation signal to the domain controller to perform a screen test based on the screen test method according to any embodiment of the present invention;

[0011] The domain controller is used to generate a picture signal based on the received scene simulation signal, and send the picture signal to the head-up display;

[0012] The head-up display is used to generate a head-up display picture based on the picture signal.

[0013] According to another aspect of the present invention, there is provided a screen test device, which is applied to a terminal in a head-up display screen test system, and the device comprises:

[0014] An image acquisition module, used to acquire an image to be tested, wherein the image to be tested includes an image determined based on a head-up display screen, and the head-up display screen is generated based on scene data of a template image;

[0015] A screen test module is used to determine the icon similarity between each first icon element in the template image and the second icon element corresponding to each first icon element in the image to be tested. If the icon similarities are greater than or equal to a preset threshold, it is determined that the head-up display screen test corresponding to the image to be tested is successful; if any of the icon similarities is less than the preset threshold, it is determined that the head-up display screen test corresponding to the image to be tested has failed.

[0016] According to another aspect of the present invention, a terminal is provided, the terminal comprising:

[0017] at least one processor; and

[0018] a memory communicatively connected to the at least one processor; wherein,

[0019] The memory stores a computer program executable by the at least one processor. The computer program is executed by the at least one processor so that the at least one processor can execute the screen testing method described in any embodiment of the present invention.

[0020] According to another aspect of the present invention, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the screen testing method according to any embodiment of the present invention when executed.

[0021] According to another aspect of the present invention, a computer program product is provided. The computer program product includes a computer program. When the computer program is executed by a processor, the screen testing method according to any embodiment of the present invention is implemented.

[0022] A screen test method provided by an embodiment of the present invention is applied to a terminal in a head-up display screen test system, the method comprising: obtaining an image to be tested, the image to be tested comprising an image determined based on a head-up display screen, the head-up display screen being generated based on scene data of a template image; determining the icon similarity between each first icon element in the template image and the second icon element corresponding to each first icon element in the image to be tested, if each of the icon similarities is greater than or equal to a preset threshold, determining that the head-up display screen test corresponding to the image to be tested is successful, if there is any icon similarity less than the preset threshold, determining that the head-up display screen test corresponding to the image to be tested fails. Through the above technical solution, the similarities of each corresponding icon element in the image to be tested and the template image are detected, if all are greater than the preset threshold, the screen detection is determined to be successful, otherwise it is determined to be a failure, the screen problem can be accurately identified, and the accuracy of the test is effectively improved. At the same time, no manual participation is required during the entire test process, which effectively improves the detection efficiency.

[0023] It should be understood that the contents described in this section are not intended to identify the key or important features of the embodiments of the present invention, nor are they intended to limit the scope of the present invention. Other features of the present invention will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0025] Figure 1 is a flow chart of a screen testing method provided by Embodiment 1 of the present invention;

[0026] Figure 2 is a template image provided by an embodiment of the present invention;

[0027] Figure 3 is an image to be tested provided by an embodiment of the present invention;

[0028] Figure 4 This is a schematic diagram of a successful screen test provided by the first embodiment of the present invention;

[0029] Figure 5 is a schematic diagram of a screen test failure provided by the first embodiment of the present invention;

[0030] Figure 6 It is a structural schematic diagram of a head-up display screen testing system provided by Embodiment 2 of the present invention;

[0031] Figure 7 It is a structural schematic diagram of a head-up display screen testing system provided by an embodiment of the present invention;

[0032] Figure 8 is a schematic diagram of a camera acquisition screen provided by an embodiment of the present invention;

[0033] Fig. 9 is a structural schematic diagram of a picture testing device provided by Embodiment 3 of the present invention;

[0034] Fig.10 It is a structural diagram of a terminal provided in Embodiment 4 of the present invention. DETAILED DESCRIPTION

[0035] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0036] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0037] Embodiment 1

[0038] Figure 11 is a flow chart of a screen test method provided by the first embodiment of the present invention. This embodiment is applicable to the case of testing the head-up display screen. The method can be executed by a screen test device. The screen test device can be implemented in the form of hardware and / or software. The screen test device can be configured in a terminal in the head-up display screen test system. Figure 1 As shown, the method includes:

[0039] S110 , obtaining an image to be tested, where the image to be tested includes an image determined based on a head-up display screen, and the head-up display screen is generated based on scene data of a template image.

[0040] In this embodiment, the image to be tested can be understood as an image that needs to be evaluated or analyzed during the test process. Figure 2 is an image to be tested provided by an embodiment of the present invention, such as Figure 2 shown.

[0041] The image to be tested is determined based on the head-up display screen.

[0042] The generation of the head-up display screen depends on the scene data of the template image. The template image can be understood as a comparison image used to compare the image to be tested, and the image can be an image generated according to the actual scene. It is worth noting that the size of the template image and the image to be tested can be the same or different. The scene data can be understood as data generated according to the content displayed in the template image, which may include but is not limited to vehicle driving information (such as speed and rotation speed), navigation information (such as route guidance and distance), multimedia information (such as music playback status) and incoming call information. The scene data can be determined manually based on the content displayed in the template image, or it can be determined based on the content displayed in the template image using a preset data extraction method. This example does not limit the specific preset data extraction method, for example, it can be image processing technology and deep learning methods.

[0043] The image to be tested and the template image both contain icon elements. Icon elements are image symbols used to represent specific information or functions, such as navigation arrows, speedometer icons, and multimedia playback icons. Figure 2 is a template image provided by an embodiment of the present invention, Figure 3 is an image to be tested provided by an embodiment of the present invention, such as Figure 2 and Figure 3 As shown, both the template image and the image to be tested contain icon elements “200”, “k”, “m”, “ / ” and “h”.

[0044] Specifically, the template image is input into the head-up display screen test system, the system determines the scene data of the template image, and then generates a head-up display screen based on the scene data of the template image, and the image to be tested can be determined according to the head-up display screen. Then, the image to be tested is obtained by the terminal of the system.

[0045] S120, determining the icon similarities between each first icon element in the template image and the second icon elements corresponding to each first icon element in the image to be tested; if each of the icon similarities is greater than or equal to a preset threshold, determining that the head-up display screen test corresponding to the image to be tested is successful; if any of the icon similarities is less than the preset threshold, determining that the head-up display screen test corresponding to the image to be tested is failed.

[0046] In this embodiment, the first icon element can be understood as various icon elements contained in the template image. The second icon element can be understood as the icon element corresponding to the first icon element in the image to be tested. The first icon element and the corresponding second icon element can be similar in outline and position and / or semantically corresponding, such as vehicle speed display and navigation instructions. Icon similarity is a quantitative indicator used to measure the degree of similarity between the first icon element in the template image and the second icon element in the image to be tested. The preset threshold can be understood as a pre-set value used to determine whether the icon similarity meets the requirements. If the icon similarity is greater than this preset threshold, it is considered that the first icon element in the template image and the second icon element in the image to be tested are matched; if the icon similarity is less than or equal to this preset threshold, it is considered that they do not match. The selection of the preset threshold can be determined based on actual test requirements and image quality requirements.

[0047] Specifically, after acquiring the image to be tested, it can be determined whether all the first icon elements in the template image can find corresponding second icon elements in the image to be tested. If so, it is determined that the image to be tested matches the template image.

[0048] When the image to be tested matches the template image, the icon similarity of each first icon element in the template image and the second icon element corresponding to each first icon element in the image to be tested is further calculated. Then, it is determined whether each icon similarity is greater than a preset threshold. If all icon similarities are greater than the preset threshold, it means that the image to be tested and the template image are highly consistent at the level of each image element, so the head-up display screen test corresponding to the image to be tested is determined to be successful. If there is any icon whose similarity is less than or equal to the preset threshold, it means that there is a large difference between the image to be tested and the template image in the icon element, so the head-up display screen test corresponding to the image to be tested is determined to be failed.

[0049] For example, Figure 4is a schematic diagram of a successful screen test provided by the first embodiment of the present invention, Figure 5 FIG. 1 is a schematic diagram of a screen test failure provided by the first embodiment of the present invention. Figure 4 and Figure 5 As shown, they all include the first icon element, the second icon element, the icon similarity, the judgment criteria and the result. Figure 4 It can be seen that all icon similarities are greater than 80% (preset threshold), that is, the result corresponding to each icon similarity is PASS, so the final screen test result is successful. Figure 5 There is an icon with a similarity of 77.27%, which is significantly less than 80%. The result corresponding to this icon similarity is FALL, so the final screen test result is a failure.

[0050] A screen test method provided in a first embodiment of the present invention is applied to a terminal in a head-up display screen test system, the method comprising: obtaining an image to be tested, the image to be tested comprising an image determined based on a head-up display screen, the head-up display screen being generated based on scene data of a template image; determining the icon similarity between each first icon element in the template image and the second icon element corresponding to each first icon element in the image to be tested, if each of the icon similarities is greater than or equal to a preset threshold, determining that the head-up display screen test corresponding to the image to be tested is successful, if there is any icon similarity less than the preset threshold, determining that the head-up display screen test corresponding to the image to be tested fails. Through the above technical solution, the similarities of each corresponding icon element in the image to be tested and the template image are detected, if all are greater than the preset threshold, the screen detection is determined to be successful, otherwise it is determined to be failed, the screen problem can be accurately identified, and the accuracy of the test is effectively improved. At the same time, no manual participation is required during the entire test process, which effectively improves the detection efficiency.

[0051] In some embodiments, determining the icon similarity between each first icon element in the template image and the second icon element corresponding to each first icon element in the image to be tested includes: determining the second icon element corresponding to the current first icon element in the image to be tested for each first icon element in the template image; using a preset super-resolution model to amplify the current first icon element and the second icon element corresponding to the current first icon element to obtain a first amplified icon element and a second amplified icon element; calculating a structural similarity index of the first amplified icon element and the second amplified icon element; and determining the icon similarity between the current first icon element and the second icon element corresponding to the current first icon element based on the structural similarity index.

[0052] In this embodiment, the preset super-resolution model can be understood as a pre-trained deep learning model for enlarging a low-resolution image to a high-resolution image. For example, the preset super-resolution model can be an efficient sub-pixel convolutional neural network (ESPCN). The structural similarity index (SSIM) is an indicator used to measure the similarity of two enlarged images.

[0053] Specifically, for each first icon element in the template image, a second icon element corresponding to the current first icon element is found from the image to be tested; then, a preset super-resolution model (such as ESPCN) is used to perform equal amplification operations on the two icon elements to obtain a first amplified icon element and a second amplified icon element; then, a structural similarity index of the first amplified icon element and the second amplified icon element is calculated, and the calculated structural similarity index is determined as the icon similarity between the current first icon element and the second icon element corresponding to the current first icon element.

[0054] Through the above technical solution, the two icon elements are enlarged using the preset super-resolution model, which can improve the resolution of the icon elements and make the details of the icon elements richer; the structural similarity index is combined to quantify the similarity of the two icons, which effectively improves the accuracy of the icon element similarity assessment and lays the foundation for further improving the accuracy of image detection.

[0055] In some embodiments, each first icon element in the template image is determined by: extracting each first icon element from the template image based on a preset contour extraction algorithm; determining the second icon element corresponding to the current first icon element in the image to be tested includes: determining the region coordinates of the icon element corresponding to the current first icon element from the image to be tested using a preset template matching algorithm; based on the size of the current first icon element and the region coordinates, cutting out the second icon element corresponding to the current first icon element from the image to be tested. Through the above technical solution, the determination of the first icon element and the second icon element is achieved, laying a foundation for further improving the efficiency and accuracy of the analysis of the image to be tested.

[0056] In this embodiment, the preset contour extraction algorithm is a pre-set algorithm for extracting the contour of an icon element from an image. This embodiment does not limit the specific preset contour extraction algorithm, for example, it may be an algorithm in the OpenCV library, such as Canny edge detection, or it may be a deep learning algorithm. The preset template matching algorithm is a pre-set algorithm for searching for the regional coordinates of an icon element corresponding to the current first icon element in the image to be tested. This embodiment does not limit the specific preset template matching algorithm, for example, it may be a matching algorithm based on deep learning or a matching algorithm based on grayscale information. The regional coordinates can be understood as the coordinates of the icon element corresponding to the current first icon element in the image to be tested. Generally, the coordinates of the upper left corner of the icon element are used as the regional coordinates. For example, in an image with a resolution of 800*480, the regional coordinates of the first icon element in the upper left corner are (0,0), and the coordinates of the last icon element in the lower right corner are (800,400).

[0057] Specifically, the contour of each first icon element is searched in the template image using a preset contour extraction algorithm, and each first icon element is extracted. Then, for each of the first icon elements, the icon element corresponding to the current first icon element is preliminarily determined from the image to be tested using a preset template matching algorithm, for example, an icon element with a contour and position similar to the current first icon element, and then the regional coordinates of the icon element are determined; based on the regional coordinates and the size of the current first icon element, the second icon element corresponding to the current first icon element is cut out from the image to be tested.

[0058] In some embodiments, the determining of the icon similarity between each first icon element in the template image and the second icon element corresponding to each first icon element in the image to be tested comprises: when the image to be tested matches the template image, determining the icon similarity between each first icon element in the template image and the second icon element corresponding to each first icon element in the image to be tested; wherein, before determining the icon similarity between each first icon element in the template image and the second icon element corresponding to each first icon element in the image to be tested, it further comprises: extracting the first feature point in the image to be tested and the second feature point in the template image using a preset feature matching algorithm, and matching the first feature point with the second feature point; determining the matching degree between the image to be tested and the template image based on the ratio of the number of successfully matched second feature points to the total number of second feature points; and determining that the image to be tested matches the template image when the matching degree is greater than a preset matching threshold. Through the above technical solution, the efficiency and accuracy of image matching are effectively improved, laying a foundation for ensuring a more accurate matching of two icon elements, and realizing detection from the whole to the details, further improving the accuracy of the test.

[0059] In this embodiment, the feature points can be understood as key points in the image, which are usually corner points, edge points or peculiar image features in the image. Among them, the feature points in the image to be tested are the first feature points, and the feature points in the template image are the second feature points. The preset feature matching algorithm can be understood as a pre-set algorithm for extracting feature points from an image and matching the feature points in the two images. For each feature point, the preset feature matching algorithm generates a feature vector to describe the feature point. The specific preset feature matching algorithm is not limited in this embodiment, for example, it can be a scale-invariant feature transform (SIFT) algorithm, a speeded up robust feature (SURF) algorithm, and an oriented fast and rotation-invariant BRIEF (ORB).

[0060] Specifically, a first feature point is extracted from the image to be tested using a preset feature matching algorithm, and a first feature point is represented by a first feature vector, a second feature point is extracted from the template image, and a second feature point is represented by a second feature vector, and then the feature points are matched by calculating the similarity between the first feature vector and the second feature vector. The similarity is generally calculated using a vector distance measurement method including but not limited to Euclidean distance, Hamming distance, and cosine distance. For example, for the first feature point in the image to be tested, the first two second feature points with the shortest Euclidean distance to the first feature point are searched in the template image. If the ratio of the closest distance to the second closest distance is lower than a preset ratio, the first feature point is considered to match the second feature point with the closest distance to the first feature point.

[0061] Furthermore, the ratio between the number of successfully matched second feature points (or the number of first feature points) and the total number of second feature points is calculated, and the ratio is used as the matching degree between the image to be tested and the template image. When the matching degree is greater than the preset matching threshold, it indicates that there are more successfully matched feature points, and the image to be tested and the template image are relatively similar, that is, the icon elements in the image to be tested can basically be found in the template image, so it can be determined that the image to be tested matches the template image.

[0062] Embodiment 2

[0063] Figure 6 Schematic diagram of the structure of a head-up display screen test system provided by the second embodiment of the present invention. Figure 6 As shown, the head-up display screen test system 20 includes a terminal 21, a domain controller 22 and a head-up display 23, wherein the terminal 21 is connected to the domain controller 22 for communication, and the domain controller 22 is connected to the head-up display 23 for communication.

[0064] The terminal 21 is used to receive a template image, generate a scene simulation signal according to the scene data of the template image, and send the scene simulation signal to the domain controller 22 to perform a picture test based on the picture test method as described in any embodiment of the present invention; the domain controller 22 is used to generate a picture signal based on the received scene simulation signal, and send the picture signal to the head-up display 23; the head-up display 23 is used to generate a head-up display picture based on the picture signal.

[0065] In this embodiment, the scene simulation signal is a control instruction generated by the terminal according to the scene data of the template image, and these instructions are sent to the domain controller in the form of a signal to drive the head-up display to display the corresponding picture. The terminal is connected to the domain controller for communication, and the domain controller is connected to the head-up display for communication. It is worth noting that there is at least one template image, and when performing the picture test, the system loops to complete the test of the head-up display picture generated based on each template image.

[0066] Take a template image as an example to illustrate the working process:

[0067] The terminal receives a template image input by a user, and extracts scene data of the template image, generates a scene simulation signal according to the scene data, and sends the scene simulation signal to the domain controller. The domain controller receives the scene simulation signal, generates a picture signal based on the scene simulation signal, and sends the picture signal to the head-up display. The head-up display generates a head-up display picture based on the picture signal. Furthermore, the terminal performs a picture test based on the picture test method of any embodiment of the present invention.

[0068] It is worth noting that when the terminal performs screen testing, it needs to obtain the image to be tested determined based on the head-up display screen, wherein the image to be tested determined based on the head-up display screen can be obtained by the terminal controlling the head-up display to take a screenshot. At this time, the terminal and the head-up display are in communication connection. It can also be obtained through an image acquisition device, at this time, the terminal and the image acquisition device are in communication connection.

[0069] Exemplarily, the user inputs different human-machine interface HMI materials (template images) into the terminal. After receiving the HMI materials, the terminal generates a scene simulation signal (PPS, CAN or QNX instruction) according to the scene data of the current HMI material for each HMI material, and sends the scene simulation signal to the domain controller. The domain controller receives the scene simulation signal, generates a screen signal based on the scene simulation signal, and sends the screen signal to the head-up display. The head-up display generates a head-up display screen based on the screen signal. The terminal controls the head-up display to take a screenshot, and then performs a current screen test based on the screen test method.

[0070] The technical solution provided in the second embodiment of the present invention realizes a complete test process from generating scene simulation signals from template images to the head-up display screen through the collaborative work of the terminal, the domain controller and the head-up display. It can efficiently simulate and verify the screen display effect of the head-up display, ensure its accuracy and reliability in different scenarios, and significantly improve the test efficiency and accuracy.

[0071] In some embodiments, the system also includes an image acquisition device and a windshield, wherein the terminal is communicatively connected to the image acquisition device; the head-up display is also used to project the head-up display screen onto the windshield; the image acquisition device is used to capture the projected screen on the windshield, generate an image to be tested, and send the image to be tested to the terminal.

[0072] In this embodiment, the image acquisition device is used to acquire the projection image on the windshield to generate the image to be measured. The image acquisition device may be a high-resolution camera.

[0073] Specifically, Figure 7 is a schematic diagram of the structure of a head-up display screen test system provided by an embodiment of the present invention, such as Figure 7 As shown, the system includes a terminal, a domain controller, a head-up display and an image acquisition device, wherein the system also includes a windshield (not shown in the figure), wherein the terminal is communicatively connected to the domain controller, the domain controller is communicatively connected to the head-up display, and the terminal is communicatively connected to the image acquisition device.

[0074] Take a template image as an example to illustrate the working process:

[0075] The terminal receives a template image input by a user, extracts scene data of the template image, generates a scene simulation signal according to the scene data, and sends the scene simulation signal to the domain controller; the domain controller receives the scene simulation signal, generates a picture signal based on the scene simulation signal, and sends the picture signal to the head-up display; the head-up display generates a head-up display picture based on the picture signal, and projects the head-up display picture onto the windshield; the image acquisition device acquires the projected picture on the windshield, generates an image to be tested, and sends the image to be tested to the terminal; then, the terminal performs a picture test based on the picture test method.

[0076] Exemplarily, the terminal receives different HMI materials input by the user, generates a scene simulation signal (PPS, CAN or QNX instruction) for each HMI material according to the scene data of the current HMI material, and sends the scene simulation signal to the domain controller, the domain controller receives the scene simulation signal, generates a screen signal based on the scene simulation signal, and sends the screen signal to the head-up display, and the head-up display generates a head-up display screen based on the screen signal; the terminal controls the camera (image acquisition device) to take a picture of the head-up display screen, and then performs a current screen test based on the screen test method.

[0077] Through the above technical solution, by introducing image acquisition equipment and windshield, the system can realize the actual projection and acquisition of the head-up display screen, generate the image to be tested and feed it back to the terminal for analysis, thereby more realistically simulating the actual usage scenario and effectively improving the accuracy and reliability of the test.

[0078] In some embodiments, the terminal is further used to generate a height simulation signal of the head-up display, and use the height simulation signal to adjust the height of the head-up display. Through the above technical solution, the comprehensiveness of the head-up display test is effectively improved.

[0079] In this embodiment, the height simulation signal is used to adjust the height of the head-up display.

[0080] The specific working process is as follows:

[0081] The user configures various height levels of the head-up display on the terminal, and the terminal generates corresponding height simulation signals according to the various height levels, and then adjusts the height of the head-up display according to the height simulation signals in turn.

[0082] For each height, when the head-up display is at the current height, the terminal extracts the scene data of the template image according to the template image input by the user, generates a scene simulation signal according to the scene data, and sends the scene simulation signal to the domain controller; the domain controller receives the scene simulation signal, generates a picture signal based on the scene simulation signal, and sends the picture signal to the head-up display; the head-up display generates a head-up display picture based on the picture signal, and projects the head-up display picture onto the windshield; the image acquisition device is used to acquire the projected picture on the windshield, generate an image to be tested, and send the image to be tested to the terminal; then, the terminal performs a picture test based on the picture test method.

[0083] For example, the user configures various height levels of the head-up display on the terminal, and the terminal generates corresponding height simulation signals according to the various height levels. First, the terminal controls the height of the head-up display to level 1 according to the height simulation signal, and points the camera at the windshield so that the virtual image of the windshield is in the center of the camera's field of view. Figure 8 As shown, it includes a windshield and a camera; further, the terminal receives different HMI materials input by the user, generates a scene simulation signal (PPS, CAN or QNX instruction) according to the scene data of the current HMI material for each HMI material, and sends the scene simulation signal to the domain controller, the domain controller receives the scene simulation signal, generates a picture signal based on the scene simulation signal, and sends the picture signal to the head-up display, and the head-up display generates a head-up display picture based on the picture signal; the terminal controls the camera to take a picture of the head-up display picture, and further, performs a current picture test based on the picture test method.

[0084] Then, adjust the height of the head-up display and repeat the above process until the head-up display screen test corresponding to all heights is successful.

[0085] Embodiment 3

[0086] Fig. 9 1 is a schematic diagram of the structure of a screen test device provided by Embodiment 3 of the present invention, and the device is applied to a terminal in a head-up display screen test system. Fig. 9 As shown, the device comprises:

[0087] An image acquisition module 31, used to acquire an image to be tested, wherein the image to be tested includes an image determined based on a head-up display screen, wherein the head-up display screen is generated based on scene data of a template image;

[0088] The screen test module 32 is used to determine the icon similarity between each first icon element in the template image and the second icon element corresponding to each first icon element in the image to be tested. If each of the icon similarities is greater than or equal to a preset threshold, it is determined that the head-up display screen test corresponding to the image to be tested is successful. If any of the icon similarities is less than the preset threshold, it is determined that the head-up display screen test corresponding to the image to be tested has failed.

[0089] The technical solution provided in the third embodiment of the present invention realizes detection from the whole to the details, and can more accurately identify the problems in the picture, thereby effectively improving the accuracy of the test. At the same time, no human participation is required in the entire test process, which effectively improves the detection efficiency.

[0090] Optionally, the picture testing module 32 includes:

[0091] An element determination unit, configured to determine, for each first icon element in the template image, a second icon element in the image to be tested that corresponds to the current first icon element;

[0092] an element magnifying unit, configured to magnify the current first icon element and a second icon element corresponding to the current first icon element by using a preset super-resolution model, so as to obtain a first magnified icon element and a second magnified icon element;

[0093] An index calculation unit, used to calculate a structural similarity index between the first magnified icon element and the second magnified icon element;

[0094] The similarity determination unit is used to determine the icon similarity between the current first icon element and the second icon element corresponding to the current first icon element based on the structural similarity index.

[0095] Optionally, each first icon element in the template image is determined by:

[0096] Extracting each first icon element from the template image based on a preset contour extraction algorithm;

[0097] The determining of the second icon element corresponding to the current first icon element in the image to be tested includes:

[0098] Determine the region coordinates of the icon element corresponding to the current first icon element from the image to be tested by using a preset template matching algorithm;

[0099] Based on the size of the current first icon element and the region coordinates, a second icon element corresponding to the current first icon element is clipped from the image to be tested.

[0100] Optionally, a picture testing module 32 is used to determine the icon similarity between each first icon element in the template image and the second icon element corresponding to each first icon element in the image to be tested when the image to be tested matches the template image;

[0101] Optionally, the picture testing device further includes:

[0102] A feature point matching module, used to extract a first feature point in the image to be tested and a second feature point in the template image using a preset feature matching algorithm, and match the first feature point with the second feature point;

[0103] A matching degree determination module, used to determine the matching degree between the image to be tested and the template image based on the ratio of the number of successfully matched second feature points to the total number of the second feature points;

[0104] The image matching module is used to determine that the image to be tested matches the template image when the matching degree is greater than a preset matching threshold.

[0105] The screen test device provided in the embodiment of the present invention can execute the screen test method provided in any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the execution method.

[0106] Embodiment 4

[0107] Fig.10 : is a schematic diagram of the structure of a terminal provided in Embodiment 4 of the present invention. The terminal may be an electronic device intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices (such as helmets, glasses, watches, etc.), and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present invention described and / or required herein.

[0108] like Fig.10 As shown, the electronic device 10 includes at least one processor 11, and a memory connected to the at least one processor 11, such as a read-only memory (ROM) 12, a random access memory (RAM) 13, etc., wherein the memory stores a computer program that can be executed by at least one processor, and the processor 11 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 12 or the computer program loaded from the storage unit 18 to the random access memory (RAM) 13. In the RAM 13, various programs and data required for the operation of the electronic device 10 can also be stored. The processor 11, the ROM 12, and the RAM 13 are connected to each other through a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.

[0109] A number of components in the electronic device 10 are connected to the I / O interface 15, including: an input unit 16, such as a keyboard, a mouse, etc.; an output unit 17, such as various types of displays, speakers, etc.; a storage unit 18, such as a disk, an optical disk, etc.; and a communication unit 19, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0110] The processor 11 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc. The processor 11 performs the various methods and processes described above, such as the picture test method.

[0111] In some embodiments, the screen test method may be implemented as a computer program, which is tangibly contained in a computer-readable storage medium, such as a storage unit 18. In some embodiments, part or all of the computer program may be loaded and / or installed on the electronic device 10 via the ROM 12 and / or the communication unit 19. When the computer program is loaded into the RAM 13 and executed by the processor 11, one or more steps of the screen test method described above may be performed. Alternatively, in other embodiments, the processor 11 may be configured to execute the screen test method in any other appropriate manner (e.g., by means of firmware).

[0112] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0113] Computer programs for implementing the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that when the computer program is executed by the processor, the functions / operations specified in the flow chart and / or block diagram are implemented. The computer program may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0114] In the context of the present invention, a computer-readable storage medium may be a tangible medium that may contain or store a computer program for use by or in combination with an instruction execution system, device or equipment. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or equipment, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0115] To provide interaction with a user, the systems and techniques described herein may be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and a pointing device (e.g., a mouse or trackball) through which the user can provide input to the electronic device. Other types of devices may also be used to provide interaction with the user; for example, the feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form (including acoustic input, voice input, or tactile input).

[0116] The systems and techniques described herein may be implemented in a computing system that includes backend components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes frontend components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such backend components, middleware components, or frontend components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0117] A computing system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The client and server relationship is generated by computer programs running on the corresponding computers and having a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system to solve the defects of difficult management and weak business scalability in traditional physical hosts and VPS services.

[0118] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps described in the present invention can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solution of the present invention can be achieved, and this document does not limit this.

[0119] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

[0120] An embodiment of the present invention further provides a computer program product, including a computer program and / or instructions, and when the computer program is executed by a processor, the screen testing method provided in any embodiment of the present application is implemented.

[0121] In the process of implementation, the computer program product can be written in one or more programming languages ​​or a combination thereof to perform the computer program code of the present invention, including object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer can be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computer (for example, using an Internet service provider to connect through the Internet).

[0122] Note that the above are only preferred embodiments of the present invention and the technical principles used. Those skilled in the art will understand that the present invention is not limited to the specific embodiments herein, and that various obvious changes, readjustments and substitutions can be made by those skilled in the art without departing from the scope of protection of the present invention. Therefore, although the present invention has been described in more detail through the above embodiments, the present invention is not limited to the above embodiments, and may include more other equivalent embodiments without departing from the concept of the present invention, and the scope of the present invention is determined by the scope of the appended claims.

Claims

1. A screen testing method, characterized in that: A terminal used in a head-up display screen test system, the method comprising: Acquire an image to be tested, wherein the image to be tested includes an image determined based on a head-up display screen, wherein the head-up display screen is generated based on scene data of a template image; Determine the icon similarity between each first icon element in the template image and the second icon element corresponding to each first icon element in the image to be tested. If each of the icon similarities is greater than or equal to a preset threshold, determine that the head-up display screen test corresponding to the image to be tested is successful. If any of the icon similarities is less than the preset threshold, determine that the head-up display screen test corresponding to the image to be tested has failed.

2. The method according to claim 1, characterized in that The determining of the icon similarity between each first icon element in the template image and the second icon element corresponding to each first icon element in the image to be tested includes: For each first icon element in the template image, determining a second icon element in the image to be tested that corresponds to the current first icon element; A preset super-resolution model is used to enlarge the current first icon element and the second icon element corresponding to the current first icon element to obtain a first enlarged icon element and a second enlarged icon element; Calculating a structural similarity index between the first magnified icon element and the second magnified icon element; Based on the structural similarity index, the icon similarity between the current first icon element and the second icon element corresponding to the current first icon element is determined.

3. The method according to claim 2, characterized in that Each first icon element in the template image is determined in the following manner: Extracting each first icon element from the template image based on a preset contour extraction algorithm; The determining of the second icon element corresponding to the current first icon element in the image to be tested includes: Determine the region coordinates of the icon element corresponding to the current first icon element from the image to be tested by using a preset template matching algorithm; Based on the size of the current first icon element and the region coordinates, a second icon element corresponding to the current first icon element is clipped from the image to be tested.

4. The method according to claim 1, characterized in that The determining of the icon similarity between each first icon element in the template image and the second icon element corresponding to each first icon element in the image to be tested includes: In the case where the image to be tested matches the template image, determining the icon similarity between each first icon element in the template image and the second icon element corresponding to each first icon element in the image to be tested; Wherein, before determining the icon similarity between each first icon element in the template image and the second icon element corresponding to each first icon element in the image to be tested, the method further includes: Extracting a first feature point in the image to be tested and a second feature point in the template image by using a preset feature matching algorithm, and matching the first feature point with the second feature point; Determining a degree of matching between the image to be tested and the template image based on a ratio of the number of successfully matched second feature points to the total number of the second feature points; When the matching degree is greater than a preset matching threshold, it is determined that the image to be tested matches the template image.

5. A head-up display screen testing system, characterized in that: The head-up display screen test system comprises a terminal, a domain controller and a head-up display, wherein the terminal is connected to the domain controller for communication, and the domain controller is connected to the head-up display for communication, wherein: The terminal is used to receive a template image, generate a scene simulation signal according to scene data of the template image, and send the scene simulation signal to the domain controller, and perform a picture test based on the picture test method according to any one of claims 1 to 4; The domain controller is used to generate a picture signal based on the received scene simulation signal, and send the picture signal to the head-up display; The head-up display is used to generate a head-up display picture based on the picture signal.

6. The system according to claim 5, characterized in that The system further comprises an image acquisition device and a windshield, wherein the terminal is communicatively connected to the image acquisition device; The head-up display is further used to project the head-up display screen onto the windshield; The image acquisition device is used to acquire the projection picture on the windshield, generate the image to be tested, and send the image to be tested to the terminal.

7. The system according to claim 6, characterized in that The terminal is further used to generate a height simulation signal of the head-up display, and adjust the height of the head-up display by using the height simulation signal.

8. A picture testing device, characterized in that: A terminal used in a head-up display screen test system, the device comprising: An image acquisition module, used to acquire an image to be tested, wherein the image to be tested includes an image determined based on a head-up display screen, and the head-up display screen is generated based on scene data of a template image; A screen test module is used to determine the icon similarity between each first icon element in the template image and the second icon element corresponding to each first icon element in the image to be tested. If the icon similarities are greater than or equal to a preset threshold, it is determined that the head-up display screen test corresponding to the image to be tested is successful; if any of the icon similarities is less than the preset threshold, it is determined that the head-up display screen test corresponding to the image to be tested has failed.

9. A terminal, characterized in that: The terminal comprises: at least one processor; and a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the screen testing method according to any one of claims 1 to 4.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the screen testing method as described in any one of claims 1 to 4 is implemented.

11. A computer program product, characterized in that The computer program product comprises a computer program, and when the computer program is executed by a processor, the computer program implements the picture testing method according to any one of claims 1 to 4.

Images