Method, device and system for adjusting head-up display system, medium and equipment

Abstract

The embodiment of the invention provides an adjustment method, device and system of a head-up display system, a computer readable storage medium and electronic equipment, and relates to the technical field of vehicle display, and the method comprises the steps: obtaining a to-be-processed image, determining the position deviation information based on the to-be-processed image, and determining the image rotation angle of the to-be-processed image; determining an adjustment parameter of an adjustment unit according to the position deviation information under the condition that the position deviation information and the picture rotation angle are combined to determine that the to-be-processed image is not in a qualified range; and adjusting an adjusting unit according to the adjusting parameters so as to adjust the head-up display system of the vehicle. According to the embodiment of the invention, the head-up display system can be accurately adjusted.

Description

Technical Field

[0001] The present disclosure relates to the field of vehicle display technology, and in particular to a head-up display system adjustment method, a head-up display system adjustment device, a head-up display system adjustment system, a computer-readable storage medium, and an electronic device. Background Art

[0002] Currently, many HUD vehicle end-of-line calibration devices test HUD optical parameters. This is done by installing a camera on the mechanical structure to capture test images projected by the vehicle's HUD device. The HUD optical parameters are calculated based on the test principles provided by the HUD supplier to achieve the testing purpose. In this way, if some HUD parameters fail to meet the requirements, the vehicle needs to be driven to a repair station for manual adjustment, and the repaired vehicle can then be put back on line for testing.

[0003] In related technologies, when inspecting the HUD of a vehicle, an image can be acquired and its optical parameters can be detected, and then the HUD installation position can be directly adjusted. The adjustment of the installation position thus changes the optical parameters of the HUD.

[0004] In the above method, since the default installation position of some vehicles is poor and exceeds the maximum adjustment range of the adjustment system, it cannot be adjusted. It has certain limitations and poor adjustment accuracy. Summary of the Invention

[0005] The purpose of the present disclosure is to provide an adjustment method for a head-up display system, an adjustment device for a head-up display system, an adjustment system for a head-up display system, a computer-readable storage medium, and an electronic device, thereby at least to a certain extent overcoming the problem of being unable to make precise adjustments due to the limitations and defects of related technologies.

[0006] Other features and advantages of the present disclosure will become apparent from the following detailed description, or may be learned in part by practice of the present disclosure.

[0007] According to one aspect of the present disclosure, a method for adjusting a head-up display system is provided, comprising: acquiring an image to be processed, determining position deviation information based on the image to be processed, and determining a screen rotation angle of the image to be processed; in a case where it is determined that the image to be processed is not within a qualified range in combination with the position deviation information and the screen rotation angle, determining adjustment parameters of an adjustment unit according to the position deviation information; and performing an adjustment operation on the adjustment unit according to the adjustment parameters to adjust the head-up display system of the vehicle.

[0008] According to one aspect of the present disclosure, there is provided an adjustment device for a head-up display system, comprising: an information acquisition module for acquiring an image to be processed, determining position deviation information based on the image to be processed, and determining a screen rotation angle of the image to be processed; an adjustment parameter determination module for determining adjustment parameters of an adjustment unit according to the position deviation information when it is determined that the image to be processed is not within a qualified range in combination with the position deviation information and the screen rotation angle; and an adjustment operation execution module for performing an adjustment operation on the adjustment unit according to the adjustment parameters to adjust the head-up display system of the vehicle.

[0009] According to one aspect of the present disclosure, there is provided an adjustment system for a head-up display system, comprising: a conformal mechanism for fixing the installation position of the adjustment system of the head-up display system; a testing unit for acquiring an image to be processed and determining position deviation information of the image to be processed and a screen rotation angle; an adjustment unit for determining adjustment parameters of the adjustment unit when it is determined that the image to be processed is not within a qualified range in combination with the position deviation information and the screen rotation angle, and performing an adjustment operation on the adjustment unit based on the adjustment parameters; and a positioning unit for performing positioning correction on the position of the adjustment system of the head-up display system.

[0010] According to one aspect of the present disclosure, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the computer program implements any one of the above-mentioned methods for adjusting the head-up display system.

[0011] According to one aspect of the present disclosure, an electronic device is provided, comprising: a processor; and a memory for storing executable instructions of the processor; wherein the processor is configured to execute any one of the above-mentioned methods for adjusting a head-up display system by executing the executable instructions.

[0012] In the technical solution provided in the embodiments of the present disclosure, on the one hand, by determining that the image to be processed is not within the qualified range by combining the position deviation information and the image rotation angle, the adjustment parameters of multiple adjustment units are determined, and then the adjustment units are adjusted according to the adjustment parameters. Since the adjustment parameters of the adjustment units can be directly designed according to the optical test parameters, and then the imaging parameters of the head-up display system are adjusted based on the adjustment parameters, the problem of being unable to adjust due to the poor installation position of the whole vehicle in the related art is avoided, the adjustment limitations are avoided, the accuracy of the adjustment parameters can be improved, and the scope of application is increased. On the other hand, since the adjustment parameters of the adjustment units can be determined according to the position deviation information, the online adjustment of the imaging parameters of the head-up display system is realized, which improves the convenience and efficiency of the adjustment, avoids the waste of resources, reduces errors, and improves the adjustment effect.

[0013] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] The accompanying drawings are incorporated into and constitute a part of the specification, illustrate embodiments consistent with the present disclosure, and together with the specification, are used to explain the principles of the present disclosure. Obviously, the drawings described below are only some embodiments of the present disclosure, and those skilled in the art can derive other drawings based on these drawings without inventive effort.

[0015] Figure 1 A flowchart schematically illustrates a method for adjusting a head-up display system according to an embodiment of the present disclosure.

[0016] Figure 2 The overall architecture diagram of the adjustment system in the embodiment of the present disclosure is schematically shown.

[0017] Figure 3 A schematic diagram schematically illustrates the system locations in an embodiment of the present disclosure.

[0018] Figure 4 A schematic diagram schematically illustrates the calibration process in an embodiment of the present disclosure.

[0019] Figure 5 A schematic diagram schematically illustrating position deviation information in an embodiment of the present disclosure.

[0020] Figure 6 A schematic diagram schematically illustrates the structure of an adjustment unit in an embodiment of the present disclosure.

[0021] Figure 7 A schematic diagram schematically illustrates a lower viewing angle in an embodiment of the present disclosure.

[0022] Figure 8 A schematic diagram schematically illustrates the center of the camera face and the center of the image to be processed in an embodiment of the present disclosure.

[0023] Figure 9 A schematic diagram schematically illustrates a specific process flow for adjusting the adjustment unit in an embodiment of the present disclosure.

[0024] Figure 10 A block diagram schematically illustrates an adjustment device for a head-up display system in an embodiment of the present disclosure.

[0025] Figure 11 A block diagram schematically illustrates an adjustment system for a head-up display system in an embodiment of the present disclosure.

[0026] Figure 12 The structural diagram of the conformal mechanism in the embodiment of the present disclosure is schematically shown.

[0027] Figures 13A-13B The structural diagram of the positioning unit in the embodiment of the present disclosure is schematically shown.

[0028] Figure 14 The structural diagram of the adjustment unit in the embodiment of the present disclosure is schematically shown.

[0029] Figure 15 A block diagram schematically illustrates an electronic device in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0030] Example embodiments will now be described more fully with reference to the accompanying drawings. However, example embodiments can be implemented in a variety of forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that the present disclosure will be more comprehensive and complete and will fully convey the concepts of the example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, many specific details are provided to provide a full understanding of the embodiments of the present disclosure. However, those skilled in the art will appreciate that the technical solutions of the present disclosure may be practiced while omitting one or more of the specific details, or that other methods, components, devices, steps, etc. may be employed. In other cases, well-known technical solutions are not shown or described in detail to avoid obscuring various aspects of the present disclosure.

[0031] In addition, the accompanying drawings are merely schematic illustrations of the present disclosure and are not necessarily drawn to scale. Identical reference numerals in the figures denote identical or similar parts, and thus repetitive descriptions thereof will be omitted. Some of the block diagrams shown in the accompanying drawings are functional entities that do not necessarily correspond to physically or logically separate entities. These functional entities may be implemented in software, in one or more hardware modules or integrated circuits, or in different networks and / or processor devices and / or microcontroller devices.

[0032] In some embodiments, many HUD vehicle end-of-line calibration devices currently test HUD optical parameters by installing a camera on the mechanical structure to capture test images projected by the vehicle HUD device. The HUD optical parameters are calculated based on the test principles provided by the HUD supplier to achieve the testing purpose. In this way, when some HUD parameters fail to meet the requirements, the vehicle needs to be driven to a repair station for manual adjustment, and the repaired vehicle can then be put back on line for testing.

[0033] When testing a vehicle's HUD, an industrial camera is typically mounted on a robotic arm. The arm is then used to penetrate the vehicle interior, simulating the position of a human eye in the eye box. Communication equipment communicates with the vehicle's computer to retrieve a test image, which is then captured by the industrial camera. After acquiring the image, the optical parameters of the image are tested using the algorithm provided by the HUD supplier. An adjustment system is then used to adjust the HUD's mounting position, which in turn changes the HUD's optical parameters. Currently, some small vehicles have poor default mounting positions, exceeding the adjustment system's maximum adjustment range and making adjustments impossible. Furthermore, some automakers compile offline adjustment data and record it as default adjustment parameters, but this has been less effective.

[0034] In order to solve the above technical problems, the present disclosure provides an adjustment method for a head-up display system, which can be applied to any type and size of vehicle or any type of transportation vehicle with a head-up display system HUD. Here, the application of the method to a vehicle is used as an example for description. Figure 1 As shown in , it mainly includes the following steps:

[0035] In step S110 , an image to be processed is acquired, position deviation information is determined based on the image to be processed, and a rotation angle of the image to be processed is determined.

[0036] In the embodiment of the present disclosure, the entire adjustment operation can be performed online through the adjustment system of the head-up display system. Figure 2 As shown in , the adjustment system may include a conforming mechanism 201, a test unit 202, an adjustment unit 203 and a positioning unit 204. The conforming mechanism 201 is used to fix the overall installation position of the adjustment system. The test unit 202 is used to capture the HUD image as the image to be processed and calculate the HUD imaging parameters so that the adjustment parameters of the adjustment unit are determined based on the calculated position deviation information; when the image to be processed is not within the qualified range, the test unit will transmit the calculated adjustment parameters to the adjustment unit. The adjustment unit 203 adjusts the state of the adjustment unit according to the adjustment parameters transmitted by the test unit; the positioning unit 204 is used to correct the position of the device represented by the adjustment system because the long-term use of the device will cause slight changes in position.

[0037] The test unit includes a camera that can capture images at a pre-set shooting position to obtain an image to be processed. The shooting position here can be, for example, the eye box position. The camera's shooting position will be determined according to the design value of the optical path during product design. During on-site testing, the corresponding eye box coordinates will be determined in real space based on the three-coordinate system according to the design value determined based on the optical path, so that the camera can capture images at the position corresponding to the eye box coordinates. It should be noted that the three-coordinate system can also be used to determine the position of a cross target in the optical path to verify the eye box position using the cross target. Since long-term use of the mechanical structure may cause the position to change, the cross target can be photographed by the camera to adjust the center of the image captured by the camera to the center of the target screen. The three coordinates are the eye box data designed according to the machine, and the three coordinates are used to determine the eye box coordinates X, Y, and Z in the actual space of the site.

[0038] Before performing the entire adjustment operation, the position calibration can be performed based on the camera, calibration plate and the entire adjustment system. For example, the position of the eye box after determining the three coordinates is verified so that the center of the camera shooting picture coincides with the cross cursor of the calibration plate, that is, coincides with the target in the calibration plate. Further, a special inspection tool can be configured to calibrate the camera and adjust the manipulator. The position of the inspection tool can be referred to Figure 3 As shown in . The positions of the camera and calibration plate are arranged according to the theoretical relative positions in the optical path diagram. Among them, the camera target is fixed and installed on the ground; the main body of the inspection fixture is in the form of a mobile cart. When calibrating the manipulator, push the main body of the inspection fixture to a fixed position, place the entire adjustment system on the inspection fixture, and use the camera to capture the image. When the center of the camera coincides with the center of the target, the calibration can be considered complete, that is, the camera and manipulator are calibrated. For the specific calibration process, please refer to Figure 4 As shown in .

[0039] After calibration, a camera can be used to capture images to be processed at the eyebox location. These images can include background and HUD images captured by the camera. The camera can be the camera provided by the camera unit in the test unit. The standard eyebox location refers to the optimal viewing position for users set by the head-up display system manufacturer. By capturing images to be processed at the eyebox location, the simulated human eye can be tested.

[0040] After capturing the image to be processed, image recognition can be performed on the image to be processed to determine the center position of the image to be processed and the center position of the HUD screen image. The center position of the image to be processed and the center position of the HUD screen image may coincide or may be offset to a certain extent. In order to improve accuracy, the position deviation information of the image to be processed may be determined based on the difference between the center position of the image to be processed and the center position of the HUD screen image. The position deviation information is used to describe the pixel difference between the center position of the image to be processed and the center position of the HUD screen image. The position deviation information may include horizontal position deviation information and vertical position deviation information. For example, the horizontal position deviation information may be determined based on the difference between the horizontal coordinates of the center position of the image to be processed and the center position of the HUD screen image, and the vertical position deviation information may be determined based on the difference between the vertical coordinates of the center position of the image to be processed and the center position of the HUD screen image. Reference Figure 5 As shown in , between point A and point B, the horizontal position deviation information can be expressed as ΔX, and the vertical position deviation information can be expressed as ΔY.

[0041] In some embodiments, since the centers may overlap but the angles may be completely different, to improve accuracy, after determining that there is no positional deviation in the image to be processed, that is, the center position of the image to be processed coincides with the center position of the HUD screen image, the rotation angle of the HUD screen image relative to the image to be processed may be determined. This rotation angle can be arbitrary and is determined based on actual measurement results. The image to be processed may contain portions that include background and portions that do not. The angle between the HUD screen image and the image to be processed may be completely consistent, or there may be a certain rotation angle, such as 30 degrees or 90 degrees.

[0042] In step S120 , when it is determined that the image to be processed is not within a qualified range based on the position deviation information and the image rotation angle, an adjustment parameter of an adjustment unit is determined according to the position deviation information.

[0043] In the disclosed embodiments, the adjustment unit may be processed in different ways depending on whether the image to be processed is within the qualified range. For example, if the image to be processed is not within the qualified range, the adjustment unit may be adjusted; if the image to be processed is within the qualified range, no adjustment is required.

[0044] When determining whether the image to be processed is within the acceptable range, the position deviation information can be combined, or the position deviation information and the screen rotation angle can be used to determine whether the image is within the acceptable range. For example, if the position deviation information is greater than a pixel threshold, the image to be processed is determined to be outside the acceptable range. If the position deviation information is less than or equal to the pixel threshold, the image rotation angle can be combined to determine whether the image to be processed is within the acceptable range. In some embodiments, if the position deviation information is less than or equal to the pixel threshold, the image rotation angle can be further determined to be greater than an angle threshold. If the image rotation angle is greater than the angle threshold, the image is determined to be outside the acceptable range; if the image rotation angle is less than or equal to the angle threshold, the image is determined to be within the acceptable range. The pixel threshold can be a pre-set threshold. The pixel threshold can be determined based on device parameters of the adjustment component in the adjustment unit, such as the size of the adjustment component and its minimum adjustment range. The angle threshold can be determined based on the pixel rotation angle obtained through field testing. For example, if the field requirement is that the HUD screen image deviate from the standard image to ±5mm, and the actual pixel-to-millimeter ratio is 0.56, the pixel threshold can be, for example, 9 pixels. When the pixel rotation angle obtained from field testing is 0.22°, the angle threshold may be 2.005.

[0045] For example, if the pixel threshold is a 9-pixel range, then when the position deviation information is outside the 9-pixel range, or when the position deviation information is within the 9-pixel range but the image rotation angle is greater than the angle threshold of 2.005, the adjustment unit needs to be adjusted. When the position deviation information is within the 9-pixel range and the image rotation angle is less than or equal to the angle threshold, the adjustment unit does not need to be adjusted.

[0046] The adjustment unit may include multiple adjustment components. When it is determined that the position deviation information is outside the range of 9 pixels, or when the position deviation information is within the range of 9 pixels but the image rotation angle is greater than the angle threshold of 2.005, the multiple adjustment components in the adjustment unit may be adjusted. The adjustment component may be a screw gun or a bolt. Figure 6 As shown, the number of adjustment components in the adjustment unit can be multiple, for example, it can include a first adjustment component and a second adjustment component. The first adjustment component can represent a left bolt, and the second adjustment component can represent a right bolt. Figure 6As shown in the figure, the left and right HUD bolts can be adjusted when the first adjustment component 601 and the second adjustment component 602 rotate. Adjusting the left HUD bolt with the first adjustment component 601 produces horizontal image movement; adjusting the right HUD bolt with the second adjustment component 602 produces vertical image movement. In addition, there is a cover plate above the HUD area. After the AR HUD image is calibrated and adjusted, this cover plate is installed on the production line to prevent the adjustment bolts from being manually rotated. This cover plate does not affect the projection of the AR HUD image.

[0047] Adjustment parameters are used to describe the adjustment range of each adjustment component in the adjustment unit. Different adjustment components can have the same or different corresponding adjustment ranges, depending on actual needs. For example, the adjustment range can be the number of adjustment turns or the adjustment angle of the adjustment component. Here, the adjustment angle is used as an example.

[0048] First, based on the vehicle parameters, the pixels that may change when each adjustment component is rotated can be determined. Because each adjustment component affects a different range of change, the pixels that change may include both horizontal and vertical pixels. For example, one adjustment component can be fixed while the other is rotated to determine the pixels that change when the other is rotated. For example, the second adjustment component can be fixed and the first adjustment component rotated one rotation to determine the horizontal pixels that change with one rotation of the first adjustment component. Similarly, the first adjustment component can be fixed and the second adjustment component rotated to determine the vertical pixels that change with one rotation of the second adjustment component. In some embodiments, vehicle parameters may include vehicle model and size. Different vehicle parameters correspond to different horizontal and vertical pixel changes. For example, for a certain vehicle, the horizontal pixel change may be 18 pixels, and the vertical pixel change may be 60 pixels. Based on this, for a certain vehicle, if the right bolt is fixed and the left bolt is rotated, the image changes horizontally by 18 pixels per rotation of the left bolt. If the left bolt is fixed and the right bolt is rotated, the image changes vertically by 60 pixels per rotation of the right bolt.

[0049] On this basis, the number of rotations in the direction can be determined by combining the position deviation information and the changed pixels in the direction of the position deviation information. The number of rotations here refers to the number of rotations of each adjustment component when the influence between multiple adjustment components is not considered. For example, the number of rotations of the adjustment component in the direction can be determined based on the ratio of the position deviation information to the changed pixels in the direction of the position deviation information. For example, for the first adjustment component in the horizontal direction, the number of adjustment turns L of the first adjustment component can be determined based on the horizontal position deviation information ΔX and the ratio of the horizontal changed pixels; for the second adjustment component in the vertical direction, the number of adjustment turns R of the second adjustment component can be determined based on the vertical position deviation information ΔY and the ratio of the vertical changed pixels. The number of rotations can be specifically calculated by formula (1):

[0050]

[0051] It should be noted that since multiple adjustment components may affect each other, rotating one adjustment component may affect other adjustment components. Therefore, it is necessary to correct the number of adjustment turns calculated according to formula (1) to obtain a corrected number of adjustment turns, so as to eliminate the mutual influence between the multiple adjustment components and obtain the actual number of adjustment turns of the adjustment components.

[0052] In some embodiments, one adjustment component can be fixed while another adjustment component is adjusted, and historical test data for each adjustment operation can be recorded. The historical test data can include historical change data in the horizontal direction and historical change data in the vertical direction. The historical test data can be further integrated and analyzed to determine that each adjustment component satisfies the linear relationship y = kx + b. The linear relationship between the first adjustment component in the horizontal direction and the second adjustment component in the vertical direction can be different. For the linear relationship of each adjustment component, the linear constant can be the number of rotations of the adjustment component itself, and the independent variable can be the number of rotations of the other adjustment component.

[0053] For example, a plurality of historical test data may be averaged to obtain the linear coefficient corresponding to each adjustment component. Alternatively, the linear coefficient of each adjustment component may be obtained by other methods, which are not specifically limited here.

[0054] By analyzing historical test data, it can be found that the linear coefficient k in the linear relationship corresponding to the first adjustment component can be 0.44, and the linear coefficient k in the linear relationship corresponding to the second adjustment component can be -0.01. The linear relationship L of the first adjustment component and the linear relationship R of the second adjustment component can be expressed as formula (2):

[0055]

[0056] After determining the linear relationship between each adjustment component, the adjustment number of each adjustment component can be adjusted based on the linear relationship to obtain a corrected adjustment number of turns. In some embodiments, the product of the linear coefficient of the first adjustment component and the adjustment number of turns of the second adjustment component can be determined, and the product can be summed with the adjustment number of turns of the first adjustment component to obtain the corrected adjustment number of turns of the first adjustment component. Similarly, the product of the linear coefficient of the second adjustment component and the adjustment number of turns of the first adjustment component can be determined, and the product can be summed with the adjustment number of the second adjustment component to obtain the corrected adjustment number of turns of the second adjustment component.

[0057] After obtaining the corrected number of adjustment turns of each adjustment component, the adjustment angle of each adjustment component can be determined based on the corrected number of adjustment turns. For example, the adjustment angle can be determined based on the product of the corrected number of adjustment turns and a preset threshold. The preset threshold can be 360. Specifically, the adjustment angles of the first adjustment component and the second adjustment component can be calculated using formula (3):

[0058]

[0059] When the adjustment angle is a positive value, it indicates that the adjustment component is rotating in the forward direction; when the adjustment angle is a negative value, it indicates that the adjustment component is rotating in the reverse direction.

[0060] After obtaining the adjustment parameters of the adjustment component, the test unit may send the adjustment parameters to the adjustment unit in the adjustment system, so that the adjustment unit is adjusted according to the adjustment parameters.

[0061] In the disclosed embodiment, by combining position deviation information and the image rotation angle to determine that the image to be processed is not within the qualified range, the adjustment parameters of multiple adjustment components are determined, and then the adjustment operations are performed on each adjustment component according to the adjustment parameters. Since the adjustment parameters of the adjustment components can be directly designed based on the optical test parameters, the problem of being unable to adjust due to the poor installation position of the entire vehicle in the related art is avoided, the accuracy of the adjustment parameters can be improved, and the scope of application is expanded. In addition, since the adjustment parameters of the adjustment components can be determined based on the position deviation information, online adjustment can be achieved, which improves the convenience and efficiency of adjustment, avoids resource waste, reduces errors, and improves the adjustment effect.

[0062] Next, continue to refer to Figure 1 As shown in , in step S130 , an adjustment operation is performed on the adjustment unit according to the adjustment parameters to adjust the head-up display system of the vehicle.

[0063] In the disclosed embodiment, adjustment parameters transmitted by a test unit can be received, and the adjustment components in the adjustment unit can be adjusted in angle based on the adjustment parameters, thereby adjusting the imaging parameters of the vehicle's head-up display system. The adjustment parameters can include an adjustment angle and an adjustment direction, where the adjustment direction can be used to represent forward or reverse rotation. Based on this, each adjustment component in the adjustment unit can be rotated forward or reverse according to the corresponding adjustment angle.

[0064] For example, if the adjustment parameter of the first adjustment component is +720 degrees, the first adjustment component may be rotated 720 degrees in the forward direction; if the adjustment parameter of the second adjustment component is -720 degrees, the second adjustment component may be rotated 720 degrees in the reverse direction.

[0065] It should be added that the test items of the image to be processed can also be evaluated to determine the qualified status of the test items, and the adjustment unit can be adjusted according to the qualified status of the test items. For example, when it is determined that the qualified status of the test item is unqualified, the adjustment unit can be adjusted. In some embodiments, the actual test requirements can be used as input conditions to design corresponding test items. The test item here can be a lower viewing angle test. The lower viewing angle can be the angle between the line connecting the eye box position and the center point of the virtual image and the horizontal line, for example Figure 7 As shown in .

[0066] In some embodiments, the left viewing angle can be determined based on the horizontal position deviation information, the camera pixel data, and the camera focal length, and the lower viewing angle can be determined based on the vertical position deviation information, the camera pixel data, and the camera focal length. Specifically, a first product of the horizontal position deviation information and the camera pixel data can be calculated, and the ratio of the first product to the camera focal length can be determined as the left viewing angle. A second product of the vertical position deviation information, the camera pixel data, and the camera focal length can be calculated, and the ratio of the second product to the camera focal length can be determined as the lower viewing angle.

[0067] refer to Figure 8 As shown in the figure, assuming that the camera faces the center point to the actual test Figure 10 The distance between the dot centers is ΔX and ΔY pixels, the focal length of the camera used is f, and the camera pixel data is t. The camera pixel data refers to the size of one pixel on the image corresponding to the pixel.

[0068] Based on this, the left viewing angle LOA and the bottom viewing angle LDA can be calculated according to formula (4):

[0069]

[0070] After determining the left angle of view and the lower angle of view, it can be determined whether the lower angle of view and the left angle of view are qualified, and based on whether the left angle of view or the lower angle of view is qualified, it can be determined whether the adjustment unit needs to be adjusted. If the lower angle of view or the left angle of view is less than the preset angle threshold, it can be considered qualified. The preset angle threshold can be set according to actual needs, for example, it can be 0.3°. When the left angle of view and the lower angle of view are qualified, the adjustment operation of the adjustment unit can be stopped. When the lower angle of view or the left angle of view is unqualified, the adjustment operation of the adjustment unit can be performed. Specifically, the adjustment parameters of each adjustment component in the adjustment unit can be calculated, and the angle of the adjustment component can be adjusted according to the adjustment parameters. After the adjustment operation of the adjustment unit is performed, the camera can continue to capture the image to be processed based on the adjusted adjustment unit, and the lower angle of view and the left angle of view can be calculated based on the re-captured image to be processed, so as to determine whether to continue the adjustment operation based on the qualified status of the lower angle of view and the left angle of view. When the left angle of view and the lower angle of view are qualified, the adjustment operation of the adjustment unit can be stopped. When the lower or left viewing angle is unqualified, the adjustment parameters can be further calculated based on the position deviation information in the re-shot image to be processed to adjust the adjustment unit, and the above steps can be repeated until the left or lower viewing angle in the shot image to be processed is qualified.

[0071] In the disclosed embodiment, the position deviation information and optical test parameters such as the image rotation angle sent by the test unit are used to directly determine the adjustment parameters of the adjustment component in the adjustment unit. The adjustment parameters are then sent to the adjustment unit to implement the adjustment operation of the adjustment unit, thereby adjusting the imaging parameters of the HUD. Since the adjustment parameters can be determined based on the position deviation information sent by the test unit, the accuracy of the adjustment parameters is improved, and the HUD imaging parameters can be accurately adjusted, thereby improving the adjustment effect. In addition, online adjustments can be made once the entire vehicle passes the line, eliminating the need for offline adjustments, thereby improving operational convenience and efficiency.

[0072] Figure 9 The specific flow chart for adjusting the adjustment unit is schematically shown in FIG. Figure 9 As shown in , it mainly includes the following steps:

[0073] In step S902, the test requirement is used as an input condition to determine the corresponding test item. The test item may be the bottom view angle. The specific process is the same as in the above steps and will not be repeated here.

[0074] In step S904, a test platform is designed according to the test content.

[0075] The test platform is usually composed of the following parts: camera calibration hardware platform, test hardware platform and adjustment hardware platform. At the beginning of the project, the camera calibration hardware platform will calibrate the position of the eye box after the three-coordinate marking, so that the center of the camera shooting image coincides with the cross cursor of the calibration plate. The test hardware platform mainly provides a camera shooting platform. The adjustment hardware platform is mainly used to adjust the HUD. The test hardware platform can be equipped with special inspection tools to calibrate the visual camera and adjust the manipulator, such as Figure 3 The calibration process can be referred to Figure 4 As shown in .

[0076] In step S906 , the testing unit determines position deviation information in the image to be processed.

[0077] In step S908 , the adjustment unit receives the position deviation information and determines whether the position deviation information and the image rotation angle are within a qualified range; if so, the process proceeds to step S914 ; if not, the process proceeds to step S910 .

[0078] In step S910 , an adjustment parameter of the adjustment unit is calculated according to the position deviation information.

[0079] In step S912 , the adjustment unit performs an adjustment operation on the adjustment unit according to the adjustment parameter.

[0080] In step S914 , the adjustment operation on the adjustment unit is stopped.

[0081] In the disclosed embodiment, the camera unit provided in the test hardware platform can be used to capture images at a standard eyebox position. The shooting position will be determined according to the design value of the optical path during product design. The specific on-site test will use three coordinates to determine the eyebox coordinates in the actual space according to the design value. Since the camera captures images at this eyebox position, the three coordinates are also used to determine the position of the cross target in the optical path. The function of the cross target is mainly to verify the eyebox position. If the mechanical structure changes due to long-term use, the cross target will be used to capture the cross target, and the center of the camera image needs to be adjusted to the center of the target image.

[0082] The test unit mainly tests the images transmitted by the camera unit according to the specification requirements. The test unit will judge the test results (position deviation information) according to the qualified range specified in the test specification. When the test results exceed the qualified range, the test parameters will be sent to the adjustment unit for corresponding adjustments.

[0083] The adjustment unit calculates the adjustment parameters for the left and right screw guns based on the parameters transmitted by the test unit and sends the adjustment parameters to the corresponding screw guns. After receiving the adjustment parameters sent by the adjustment unit, the screw guns perform the adjustment operations according to the adjustment parameters.

[0084] In the disclosed embodiment, the adjustment parameters of the adjustment unit come from the test unit. The accuracy of the test unit can be guaranteed by three coordinates, and the photographing position in the test unit can be double-guaranteed by calibration and verification of the calibration plate. Therefore, the accuracy of the test unit is high, and the accuracy of the product test data measured by the test unit is high. The adjustment parameters are determined according to the high-precision test results (position deviation information) sent by the test unit, which can improve the accuracy of the adjustment parameters of the adjustment unit, realize high-precision adjustment operations on the adjustment unit, and enhance the adjustment effect. Since the test unit shoots the image to be processed for online measurement to obtain the measurement data, it can be transmitted to the adjustment system to realize online adjustment of the HUD imaging parameters. Compared with the offline adjustment of traditional equipment, the adjustment efficiency and convenience are improved, the accuracy is improved, and resource consumption is reduced.

[0085] Next, in the embodiment of the present disclosure, an adjustment device for a head-up display system is also provided. Figure 10 As shown in , the adjustment device 1000 of the head-up display system mainly includes:

[0086] The information acquisition module 1001 is used to acquire an image to be processed, determine position deviation information based on the image to be processed, and determine a rotation angle of the image to be processed;

[0087] An adjustment parameter determination module 1002 is configured to determine an adjustment parameter of an adjustment unit according to the position deviation information when it is determined that the image to be processed is not within a qualified range based on the position deviation information and the image rotation angle;

[0088] The adjustment operation execution module 1003 is configured to perform an adjustment operation on the adjustment unit according to the adjustment parameters to adjust the head-up display system of the vehicle.

[0089] In an exemplary embodiment of the present disclosure, the adjustment unit includes multiple adjustment components; determining the adjustment parameters of the adjustment unit based on the position deviation information includes: determining the number of adjustment turns of the multiple adjustment components based on the position deviation information; fusing the adjustment numbers of each adjustment component, correcting the adjustment numbers of each adjustment component, and obtaining the corrected adjustment numbers; determining the adjustment angle based on the corrected number of adjustment turns, so as to use the adjustment angle as the adjustment parameter.

[0090] In an exemplary embodiment of the present disclosure, the position deviation information includes horizontal position deviation information and vertical position deviation information; determining the number of adjustment turns of multiple adjustment components based on the position deviation information includes: determining the number of adjustment turns of a first adjustment component among the multiple adjustment components based on the horizontal position deviation information and the horizontal change pixels; and determining the number of adjustment turns of a second adjustment component among the multiple adjustment components based on the vertical position deviation information and the vertical change pixels.

[0091] In an exemplary embodiment of the present disclosure, the fusing of the adjustment turns of each adjustment component and correcting the adjustment turns of each adjustment component to obtain the corrected adjustment turns include: determining the linear relationship between each adjustment component, and fusing the adjustment turns of multiple adjustment components based on the linear relationship to obtain the corrected adjustment turns.

[0092] In an exemplary embodiment of the present disclosure, the determination that the image to be processed is not within the qualified range by combining the position deviation information and the screen rotation angle includes: when the position deviation information is greater than a pixel threshold, determining that the image to be processed is not within the qualified range; or when the position deviation information is not greater than the pixel threshold and the screen rotation angle is greater than a rotation angle threshold, determining that the image to be processed is not within the qualified range.

[0093] In an exemplary embodiment of the present disclosure, the device further includes: determining a test item in combination with position deviation information in the image to be processed; and determining an adjustment parameter of the adjustment unit according to the position deviation information when the test item fails.

[0094] In an exemplary embodiment of the present disclosure, the test item is determined in combination with the position deviation information in the image to be processed, including: determining a first product of the horizontal position deviation information and the camera pixel data, and determining the left viewing angle based on the ratio of the first product to the camera focal length; determining a second product of the vertical position deviation information and the camera pixel data, and determining the lower viewing angle based on the ratio of the second product to the camera focal length.

[0095] In addition, in the embodiment of the present disclosure, a head-up display system adjustment system 1100 is provided. Figure 11 As shown in , it mainly includes:

[0096] The conformable mechanism 1101 is used to fix the installation position of the adjustment system of the head-up display system;

[0097] The testing unit 1102 is configured to obtain an image to be processed and determine position deviation information and an image rotation angle of the image to be processed;

[0098] The adjusting unit 1103 is configured to determine an adjustment parameter of the adjusting unit when it is determined that the image to be processed is not within a qualified range based on the position deviation information and the image rotation angle, and to adjust the adjusting unit based on the adjustment parameter;

[0099] The positioning unit 1104 is used to perform positioning correction on the position of the adjustment system of the head-up display system.

[0100] In the adjustment system of the entire head-up display system, the test unit is connected to the adjustment unit, and the adjustment unit is used to receive the position deviation information obtained by the test unit and calculate the corresponding adjustment parameters.

[0101] For example, the shape-adapting mechanism is used to fix the overall installation position of the device. Figure 12 As shown in the figure, the conformal mechanism will enter the vehicle interior when detecting the entire vehicle. The positioning unit can refer to Figure 13A As shown, the positioning unit will be stuck at the vehicle chassis positioning point at the bottom of the vehicle, such as Figure 13B As shown in position 1.

[0102] The test unit is used to capture HUD images and calculate HUD imaging parameters such as position deviation information and image rotation angle.

[0103] The adjustment unit is used to receive the position deviation information sent by the test unit, calculate the adjustment parameters, and adjust the adjustment component according to the adjustment parameters when it is determined that the position deviation information and the image rotation angle are not within the qualified range. The adjustment unit may include a first adjustment component and a second adjustment component. The first adjustment component may be a left screw gun, which is used to generate horizontal movement of the image; the second adjustment component may be a right screw gun, which is used to generate vertical movement of the image. For the specific structure, please refer to Figure 14 As shown in .

[0104] Positioning unit: Since the long-term use of the equipment may cause slight changes in the position, the positioning unit is used to correct the position of the equipment.

[0105] In the disclosed embodiment, the conformal mechanism, the test unit, the adjustment unit, and the positioning unit enable online adjustment of the adjustment unit, thereby enabling online adjustment of the imaging parameters of the head-up display system, thereby improving adjustment accuracy, efficiency, and feasibility.

[0106] It should be noted that the specific details of the adjustment device of the above-mentioned head-up display system and the various parts of the adjustment system of the head-up display system have been described in detail in the implementation method of the head-up display system. The undisclosed details can be found in the implementation content of the method part, and thus will not be repeated here.

[0107] In an exemplary embodiment of the present disclosure, an electronic device capable of implementing the above method is also provided.

[0108] Those skilled in the art will appreciate that various aspects of the present disclosure may be implemented as systems, methods, or program products. Therefore, various aspects of the present disclosure may be implemented in the following forms: a complete hardware implementation, a complete software implementation (including firmware, microcode, etc.), or a combination of hardware and software implementations, which may be collectively referred to herein as "circuits," "modules," or "systems."

[0109] Refer to the following Figure 15 15 to describe the electronic device 1500 according to this embodiment of the present disclosure. Figure 15 The electronic device 1500 shown is merely an example and should not limit the functionality and scope of use of the embodiments of the present disclosure.

[0110] like Figure 15 As shown, electronic device 1500 is implemented as a general-purpose computing device. Components of electronic device 1500 may include, but are not limited to, the aforementioned at least one processing unit 1510, the aforementioned at least one storage unit 1520, a bus 1530 connecting various system components (including storage unit 1520 and processing unit 1510), and a display unit 1540.

[0111] The storage unit stores program codes, which can be executed by the processing unit 1510, so that the processing unit 1510 performs the steps described in the "Exemplary Method" section of the present disclosure according to various exemplary embodiments. For example, the processing unit 1510 can perform the following steps: Figure 1 . The storage unit 1520 may include a readable medium in the form of a volatile storage unit, such as a random access memory unit (RAM) 15201 and / or a cache memory unit 15202, and may further include a read-only memory unit (ROM) 15203. The storage unit 1520 may also include a program / utility 15204 having a set (at least one) of program modules 15205. Such program modules 15205 include, but are not limited to: an operating system, one or more application programs, other program modules, and program data. Each of these examples or some combination thereof may include the implementation of a network environment.

[0112] Bus 1530 may represent one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a processing unit, or a local bus using any of a variety of bus architectures.

[0113] Electronic device 1500 can also communicate with one or more external devices 1600 (e.g., a keyboard, pointing device, Bluetooth device, etc.), one or more devices that enable a user to interact with electronic device 1500, and / or any device that enables electronic device 1500 to communicate with one or more other computing devices (e.g., a router, modem, etc.). Such communication can occur via input / output (I / O) interface 1550. Furthermore, electronic device 1500 can communicate with one or more networks (e.g., a local area network (LAN), a wide area network (WAN), and / or a public network such as the Internet) via network adapter 1560. As shown, network adapter 1560 communicates with other modules of electronic device 1500 via bus 1530. It should be understood that, although not shown, other hardware and / or software modules can be used in conjunction with electronic device 1500, including but not limited to microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

[0114] Through the description of the above embodiments, it is easy for those skilled in the art to understand that the example embodiments described herein can be implemented by software or by combining software with necessary hardware. Therefore, the technical solution according to the embodiments of the present disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, and includes several instructions to enable a computing device (which can be a personal computer, a server, a terminal device, or an electronic device, etc.) to execute the method according to the embodiments of the present disclosure.

[0115] In exemplary embodiments of the present disclosure, a computer-readable storage medium is also provided, on which is stored a program product capable of implementing the aforementioned methods of this specification. In some possible implementations, various aspects of the present disclosure may also be implemented in the form of a program product comprising program code. When the program product is executed on a terminal device, the program code is configured to cause the terminal device to execute the steps described in the "Exemplary Methods" section of this specification according to various exemplary embodiments of the present disclosure.

[0116] According to an embodiment of the present disclosure, a program product for implementing the above-mentioned method can be a portable compact disc read-only memory (CD-ROM) and include program code, and can be run on a terminal device, such as a personal computer. However, the program product of the present disclosure is not limited thereto. In this document, a readable storage medium can be any tangible medium containing or storing a program, which can be used by or in conjunction with an instruction execution system, apparatus, or device.

[0117] The program product may be implemented in any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or component, or any combination thereof. More specific examples (a non-exhaustive list) of readable storage media include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof.

[0118] A computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, which carries readable program code. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A readable signal medium may also be any readable medium other than a readable storage medium that can transmit, propagate, or transfer a program for use by or in conjunction with an instruction execution system, apparatus, or device.

[0119] The program code embodied on the readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

[0120] The program code for performing the operations of the present disclosure may be written in any combination of one or more programming languages, including object-oriented programming languages such as Java, C++, and the like, as well as conventional procedural programming languages such as "C" or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user device, as a stand-alone software package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server. In cases involving a remote computing device, the remote computing device may be connected to the user computing device via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computing device (e.g., via the Internet using an Internet service provider).

[0121] Furthermore, the figures above are merely illustrative of the processes included in the methods according to exemplary embodiments of the present disclosure and are not intended to be limiting. It is readily understood that the processes illustrated in the figures above do not indicate or limit the temporal order of these processes. Furthermore, it is readily understood that these processes may be executed synchronously or asynchronously, for example, in multiple modules.

[0122] Other embodiments of the present disclosure will readily occur to those skilled in the art after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present disclosure that follow from the general principles of the present disclosure and include common knowledge or customary techniques in the art not invented herein. The specification and examples are to be considered as exemplary only, with the true scope and spirit of the present disclosure being indicated by the claims.

[0123] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes can be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A method for adjusting a head-up display system, characterized in that: include: Acquire an image to be processed, determine position deviation information based on the image to be processed, and determine a rotation angle of the image to be processed; In a case where it is determined that the image to be processed is not within a qualified range by combining the position deviation information and the image rotation angle, determining an adjustment parameter of an adjustment unit according to the position deviation information; An adjustment operation is performed on the adjustment unit according to the adjustment parameters to adjust the head-up display system of the vehicle.

2. The method for adjusting the head-up display system according to claim 1, characterized in that: The adjustment unit includes a plurality of adjustment components; and determining the adjustment parameters of the adjustment unit according to the position deviation information includes: determining the number of adjustment turns of the plurality of adjustment components according to the position deviation information; The adjustment turns of each adjustment component are integrated, and the adjustment turns of each adjustment component are corrected to obtain a corrected adjustment turn number; An adjustment angle is determined according to the corrected number of adjustment turns, so as to use the adjustment angle as the adjustment parameter.

3. The method for adjusting the head-up display system according to claim 2, characterized in that: The position deviation information includes horizontal position deviation information and vertical position deviation information; and determining the number of adjustment turns of the plurality of adjustment components according to the position deviation information includes: determining the number of adjustment turns of a first adjustment component among the plurality of adjustment components according to the horizontal position deviation information and the horizontal change pixels; The number of adjustment turns of a second adjustment component among the multiple adjustment components is determined according to the vertical position deviation information and the vertical change pixels.

4. The method for adjusting the head-up display system according to claim 2, wherein: The step of fusing the adjustment turns of each adjustment component and correcting the adjustment turns of each adjustment component to obtain the corrected adjustment turns includes: The linear relationship between the adjustment components is determined, and the adjustment turns of the multiple adjustment components are merged based on the linear relationship to obtain a corrected adjustment turn.

5. The method for adjusting the head-up display system according to claim 1, wherein: The determining that the image to be processed is not within a qualified range by combining the position deviation information and the image rotation angle includes: When the position deviation information is greater than the pixel threshold, determining that the image to be processed is not within the qualified range; or When the position deviation information is not greater than the pixel threshold and the picture rotation angle is greater than the rotation angle threshold, it is determined that the image to be processed is not within the qualified range.

6. The method for adjusting the head-up display system according to claim 1, characterized in that: The method further comprises: Determining a test item based on position deviation information in the image to be processed; In a case where the test item fails, an adjustment parameter of the adjustment unit is determined according to the position deviation information.

7. The method for adjusting the head-up display system according to claim 6, characterized in that: The determining of the test items in combination with the position deviation information in the image to be processed includes: Determine a first product of the horizontal position deviation information and the camera pixel data, and determine a left viewing angle based on a ratio of the first product to the camera focal length; A second product of the vertical position deviation information and the camera pixel data is determined, and a lower viewing angle is determined according to a ratio of the second product to the camera focal length.

8. An adjustment device for a head-up display system, characterized in that: include: An information acquisition module is used to acquire an image to be processed, determine position deviation information based on the image to be processed, and determine a rotation angle of the image to be processed; an adjustment parameter determination module, configured to determine an adjustment parameter of an adjustment unit according to the position deviation information when it is determined that the image to be processed is not within a qualified range in combination with the position deviation information and the image rotation angle; The adjustment operation execution module is used to perform an adjustment operation on the adjustment unit according to the adjustment parameters to adjust the head-up display system of the vehicle.

9. An adjustment system for a head-up display system, characterized in that: include: A conformable mechanism for fixing the installation position of the adjustment system of the head-up display system; A testing unit, configured to obtain an image to be processed and determine position deviation information and an image rotation angle of the image to be processed; an adjusting unit, configured to determine an adjustment parameter of the adjusting unit when it is determined that the image to be processed is not within a qualified range based on the position deviation information and the image rotation angle, and perform an adjustment operation on the adjusting unit based on the adjustment parameter; A positioning unit is used to correct the position of the adjustment system of the head-up display system.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method for adjusting the head-up display system according to any one of claims 1 to 7 is implemented.

11. An electronic device, characterized in that: include: processor; as well as a memory for storing executable instructions of the processor; The processor is configured to execute the head-up display system adjustment method according to any one of claims 1 to 7 by executing the executable instructions.

Images