Adjustment method, device and storage medium for heads-up display (HUD)

By automatically calibrating the HUD settings using driver information and a linear relationship model, the problems of low efficiency and high cost of manual calibration are solved, achieving efficient and low-cost HUD settings calibration.

CN115330699BActive Publication Date: 2026-01-23NEUSOFT CORP +1
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202210894257.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-07-27
Publication Date
2026-01-23
Estimated Expiration
2042-07-27

AI Technical Summary

Technical Problem

In existing technologies, each HUD setting requires manual calibration, which is inefficient and costly.

Method used

By acquiring the driver's eye information, the target gear is determined, and a linear relationship model is used to automatically calibrate the virtual image parameter values ​​of the uncalibrated gear based on the virtual image parameter values ​​of the calibrated gear, thus reducing human intervention.

Benefits of technology

This improves the calibration efficiency of HUDs and reduces calibration costs.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115330699B_ABST
    Figure CN115330699B_ABST
Patent Text Reader

Abstract

The present disclosure relates to a method, device and storage medium for adjusting a head-up display (HUD). The method for adjusting a head-up display (HUD) comprises: obtaining current information of a person's eye of a driver; determining a target gear of the HUD corresponding to the current information; determining a target virtual image parameter value corresponding to the target gear of the HUD according to a correspondence between gears and virtual image parameter values; and outputting a virtual image of the HUD according to the target virtual image parameter value. The correspondence between gears and virtual image parameter values is determined by: obtaining virtual image parameter values corresponding to at least two calibrated gears of the HUD; determining model coefficients of a parameter determination model according to the virtual image parameter values corresponding to the at least two calibrated gears, to obtain the parameter determination model; and determining a virtual image parameter value corresponding to a to-be-calibrated gear of the HUD according to the parameter determination model.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This disclosure relates to the field of HUD equipment technology, and more specifically, to an adjustment method, apparatus, and storage medium for a head-up display (HUD). Background Technology

[0002] With the development of automotive intelligent technology, the cost of head-up displays (HUDs) has decreased, and more and more cars are equipped with HUDs. HUDs can display information such as vehicle speed, engine speed, navigation, and fault warnings within the driver's line of sight, and combine them with the surrounding real-time view, reducing the frequency of the driver looking down at the instrument panel to improve driving safety, while also enhancing the driver's perception of the surrounding environment.

[0003] Currently, for example, before vehicle delivery, each HUD position needs to be manually calibrated to adjust the virtual image parameter value of the HUD at each position. Then, based on the virtual image parameter value of the HUD corresponding to the position, the virtual image of the HUD corresponding to the virtual image parameter value is obtained through HUD projection. However, calibrating each HUD position manually is inefficient and costly. Summary of the Invention

[0004] The purpose of this disclosure is to provide an adjustment method, apparatus, and storage medium for a head-up display (HUD).

[0005] To achieve the above objectives, according to a first aspect of the present disclosure, a method for adjusting a head-up display (HUD) is provided, comprising:

[0006] Obtain current information about the driver's eyes;

[0007] Determine the target setting of the HUD corresponding to the current information;

[0008] Based on the correspondence between gear level and virtual image parameter value, the target virtual image parameter value corresponding to the target gear level of the HUD is determined, wherein the correspondence is obtained based on a parameter determination model that characterizes the linear relationship between the gear level and virtual image parameter of the HUD.

[0009] Output the HUD virtual image based on the target virtual image parameter values;

[0010] The correspondence between the gear position and the virtual image parameter value is determined in the following way:

[0011] Obtain the virtual image parameter values ​​corresponding to at least two calibrated gears in the HUD, wherein the number of calibrated gears is less than the total number of gears in the HUD;

[0012] Based on the virtual image parameter values ​​corresponding to the at least two calibrated gear positions, the model coefficients of the parameter determination model are determined to obtain the parameter determination model, wherein the parameter determination model is a linear relationship model between the gear position of the HUD and the virtual image parameter.

[0013] Based on the parameters, the model is determined, and the virtual image parameter value corresponding to the calibrated position in the HUD is determined.

[0014] Optionally, determining the model coefficients of the parameter determination model based on the virtual image parameter values ​​corresponding to the at least two calibrated gear positions includes:

[0015] Based on the least squares method, the model coefficients of the parameter determination model are determined according to the virtual image parameter values ​​corresponding to the at least two calibrated gear positions.

[0016] Optionally, the step of determining the model coefficients of the parameter determination model based on the least squares method and the virtual image parameter values ​​corresponding to the at least two calibrated gear positions includes:

[0017] The model coefficients are determined by the parameters using the following formula:

[0018]

[0019] Where, x i Let y be the gear value of the i-th calibrated gear position of the HUD. i Let be the virtual image parameter value corresponding to the i-th calibrated gear position, N be the total number of gear positions of the HUD, and k and b be the model coefficients, where k is the slope and b is the intercept.

[0020] Optionally, the virtual image parameter values ​​include at least one of the following parameter values:

[0021] The coordinates of the intersection point of the plane containing the virtual image and the line containing the normal of the HUD's eye box in the world coordinate system;

[0022] The coordinates of the center point of the HUD's eye box in the world coordinate system;

[0023] The width and height of the virtual image;

[0024] The normal vector of the plane containing the virtual image;

[0025] The normal vector of the plane containing the eye box of the HUD;

[0026] The field of view of the HUD;

[0027] The resolution of the effective display area of ​​the virtual image.

[0028] Optionally, the calibrated gear positions include the lowest gear position and the highest gear position. Before determining the virtual image parameter value corresponding to the gear position to be calibrated in the HUD gear positions, the method further includes:

[0029] The step size of the gear is determined based on the total number of gears, the lowest gear, and the highest gear.

[0030] The gear to be calibrated is determined based on the step size of the gear.

[0031] Optionally, the method further includes calibrating the virtual image parameter values ​​corresponding to the calibrated gears in the HUD gear settings by:

[0032] Obtain the coordinates of the marked object located outside the vehicle in the world coordinate system;

[0033] Based on the transformation relationship between the world coordinate system and the two-dimensional image coordinate system, the image position of the marked object in the two-dimensional image coordinate system is obtained, and a virtual image representing the image position is output.

[0034] Adjust the parameters to determine the virtual image parameter value of the set gear in the model until the virtual image and the marked object observed from the field of view of the HUD completely overlap, and obtain the virtual image parameter value of the set gear.

[0035] According to a second aspect of the present disclosure, an adjustment device for a head-up display (HUD) is provided, comprising:

[0036] The acquisition module is used to acquire the current information of the driver's eyes;

[0037] The first determining module is used to determine the target level of the HUD corresponding to the current information;

[0038] The second determining module is used to determine the target virtual image parameter value corresponding to the target gear of the HUD based on the correspondence between the gear and the virtual image parameter value, wherein the correspondence is obtained based on a parameter determining model that characterizes the linear relationship between the gear and the virtual image parameter of the HUD.

[0039] The output module is used to output a HUD virtual image based on the target virtual image parameter values;

[0040] The correspondence between the gear position and the virtual image parameter value is determined in the following way:

[0041] Obtain the virtual image parameter values ​​corresponding to at least two calibrated gears in the HUD, wherein the number of calibrated gears is less than the total number of gears in the HUD;

[0042] Based on the virtual image parameter values ​​corresponding to the at least two calibrated gear positions, the model coefficients of the parameter determination model are determined to obtain the parameter determination model, wherein the parameter determination model is a linear relationship model between the gear position of the HUD and the virtual image parameter.

[0043] Based on the parameters, the model is determined, and the virtual image parameter value corresponding to the calibrated position in the HUD is determined.

[0044] Optionally, the second determining module determines the model coefficients of the model by using the following method:

[0045] Based on the least squares method, the model coefficients of the parameter determination model are determined according to the virtual image parameter values ​​corresponding to the at least two calibrated gear positions.

[0046] Optionally, the second determining module uses the least squares method to determine the model coefficients of the parameter determining model based on the virtual image parameter values ​​corresponding to the at least two calibrated gear positions:

[0047] The model coefficients are determined by the parameters using the following formula:

[0048]

[0049] Where, x i Let y be the gear value of the i-th calibrated gear position of the HUD. i Let be the virtual image parameter value corresponding to the i-th calibrated gear position, N be the total number of gear positions of the HUD, and k and b be the model coefficients, where k is the slope and b is the intercept.

[0050] Optionally, the virtual image parameter values ​​include at least one of the following parameter values:

[0051] The coordinates of the intersection point of the plane containing the virtual image and the line containing the normal of the HUD's eye box in the world coordinate system;

[0052] The coordinates of the center point of the HUD's eye box in the world coordinate system;

[0053] The width and height of the virtual image;

[0054] The normal vector of the plane containing the virtual image;

[0055] The normal vector of the plane containing the eye box of the HUD;

[0056] The field of view of the HUD;

[0057] The resolution of the effective display area of ​​the virtual image.

[0058] Optionally, the calibrated gear positions include the lowest gear position and the highest gear position. Before determining the virtual image parameter value corresponding to the gear position to be calibrated in the HUD gear positions, the device further includes:

[0059] The third determining module is used to determine the step size of the gear based on the total number of gears, the lowest gear, and the highest gear.

[0060] The gear to be calibrated is determined based on the step size of the gear.

[0061] Optionally, the second determining module is further configured to calibrate the virtual image parameter values ​​corresponding to the calibrated gears in the HUD gear settings in the following manner:

[0062] Obtain the coordinates of the marked object located outside the vehicle in the world coordinate system;

[0063] Based on the transformation relationship between the world coordinate system and the two-dimensional image coordinate system, the image position of the marked object in the two-dimensional image coordinate system is obtained, and a virtual image representing the image position is output.

[0064] Adjust the parameters to determine the virtual image parameter value of the set gear in the model until the virtual image and the marked object observed from the field of view of the HUD completely overlap, and obtain the virtual image parameter value of the set gear.

[0065] According to a third aspect of the present disclosure, a non-transitory computer-readable storage medium is provided, on which a computer program is stored, which, when executed by a processor, implements the steps of the method described in the first aspect.

[0066] According to a fourth aspect of the present disclosure, an electronic device is provided, comprising:

[0067] A memory on which computer programs are stored;

[0068] A processor for executing the computer program in the memory to implement the steps of the method in the first aspect.

[0069] The above technical solution acquires the driver's current eye information, determines the target HUD gear corresponding to the current information, and determines the target virtual image parameter value corresponding to the target HUD gear based on the correspondence between the gear and the virtual image parameter value. Specifically, a parameter determination model based on the linear relationship between the HUD gear and the virtual image parameter is used to obtain the correspondence, and the HUD virtual image is output based on the target virtual image parameter value. By calibrating at least two gears for the HUD, and then determining the model coefficients of the parameter determination model based on the virtual image parameter values ​​corresponding to the at least two calibrated gears, the virtual image parameter values ​​corresponding to other gears are determined according to the parameter determination model, thereby improving the HUD calibration efficiency and reducing the HUD calibration cost.

[0070] Other features and advantages of this disclosure will be described in detail in the following detailed description section. Attached Figure Description

[0071] The accompanying drawings are provided to further illustrate the present disclosure and form part of the specification. They are used together with the following detailed description to explain the present disclosure, but do not constitute a limitation thereof. In the drawings:

[0072] Figure 1 This is a flowchart illustrating, according to an exemplary embodiment, a method for determining the correspondence between the level of a head-up display (HUD) and virtual image parameter values.

[0073] Figure 2 This is a flowchart illustrating an adjustment method for a head-up display (HUD) according to an exemplary embodiment.

[0074] Figure 3 This is a block diagram illustrating an adjustment device for a head-up display (HUD) according to an exemplary embodiment.

[0075] Figure 4 This is a block diagram illustrating an electronic device according to an exemplary embodiment. Detailed Implementation

[0076] The specific embodiments of this disclosure will be described in detail below with reference to the accompanying drawings. It should be understood that the specific embodiments described herein are for illustration and explanation only and are not intended to limit this disclosure.

[0077] It should be noted that all actions involving the acquisition of signals, information, or data in this disclosure are carried out in compliance with the relevant data protection laws and policies of the country where the location is situated, and with authorization from the owner of the relevant device.

[0078] Figure 1This is a flowchart illustrating, according to an exemplary embodiment, a method for determining the correspondence between the level of a head-up display (HUD) and virtual image parameter values, such as... Figure 1 As shown, the method for determining the correspondence between the HUD level and the virtual image parameter value includes the following steps.

[0079] In step S11, the virtual image parameter values ​​corresponding to at least two calibrated HUD positions are obtained.

[0080] According to the HUD imaging principle, a light beam emanating from an optical imaging system, representing the image to be imaged, is reflected (or refracted) by the windshield (or windshield glass) and enters the human eye, thus allowing the eye to observe the image. Since the human eye and the optical imaging system are located on the same side of the windshield, this image is a virtual image. Therefore, in this disclosure, the parameter values ​​that can project a virtual image can be referred to as virtual image parameter values.

[0081] The number of calibrated gears is less than the total number of gears in the HUD.

[0082] In related technologies, before vehicle delivery—such as before a vehicle rolls off the assembly line at the factory or before it is delivered to a customer at a 4S dealership—and after vehicle repairs, when the HUD needs to be recalibrated, each HUD setting must be manually calibrated to adjust the virtual image parameter values ​​at each setting. Since HUDs typically have ten settings, manually calibrating all ten settings is labor-intensive, difficult to implement, inefficient, and costly.

[0083] Therefore, in this disclosure, at least two HUD settings are first calibrated, and then the model coefficients of the parameter determination model are determined based on the virtual image parameter values ​​corresponding to the at least two calibrated settings. Then, for other settings besides the calibrated settings, the virtual image parameter values ​​corresponding to the other settings are determined based on the parameter determination model, thereby improving the calibration efficiency of the HUD.

[0084] For example, the HUD's settings can be calibrated in the following ways:

[0085] The system acquires the position of a marker object located outside the vehicle in the world coordinate system. Based on the transformation relationship between the world coordinate system and the 2D image coordinate system, it obtains the image position of the marker object in the 2D image coordinate system and outputs a virtual image representing the image position through the HUD. Then, it adjusts the virtual image parameter value of the current gear in the HUD until the virtual image and the marker object observed from a set viewing angle inside the vehicle completely overlap. This virtual image parameter value is then calibrated.

[0086] The virtual image parameter values ​​of the HUD may include at least one of the following parameters: the coordinates of the intersection point of the plane containing the virtual image and the line containing the normal of the HUD's eye box in the world coordinate system; the position of the center point of the HUD's eye box in the world coordinate system; the width and height of the virtual image; the normal vector of the plane containing the virtual image; the normal vector of the plane containing the HUD's eye box; the field of view of the HUD; and the resolution of the effective display area of ​​the virtual image.

[0087] For example, the marked position of an object in the world coordinate system is denoted as (X). W Y W Z W Let (u, v) mark the image position of the object in the two-dimensional image coordinate system. Then, according to the HUD imaging principle, we know that:

[0088]

[0089] in, The external parameter matrix of the HUD. This is the intrinsic parameter matrix of the HUD. To mark the image position of the object projected onto the windshield via the HUD, Zc represents the component of the marked object in the Z direction of the camera coordinate system.

[0090] Since the extrinsic and intrinsic parameter matrices of the HUD can be measured, that is:

[0091] The center point of the HUD eye box is T. Based on the position of the eye box center point in the world coordinate system, the normal vector of the plane containing the virtual image, and the position of the intersection point of the virtual image plane and the line containing the eye box normal in the world coordinate system, the rotation matrix R from the world coordinate system to the HUD coordinate system is calculated. The distance from the center point of the HUD eye box to the virtual image plane is determined, which is the focal length f of the HUD. Based on the width and height of the virtual image and the effective display area, the number of millimeters dx represented by one pixel in the x direction and the number of millimeters dy represented in the y direction in the two-dimensional image coordinate system are calculated.

[0092] Therefore, according to the above formula, the image position of the marked object projected onto the windshield via the HUD in the two-dimensional image coordinate system can be obtained, and a virtual image representing the image position can be output through the HUD. Then, the virtual image parameter value of the current gear position of the HUD is adjusted until the virtual image observed from the HUD's field of view completely overlaps with the marked object. This yields the virtual image parameter value for the current gear position, which is the virtual image parameter value for the current gear position that needs to be calibrated.

[0093] In step S12, the model coefficients of the parameter determination model are determined based on the virtual image parameter values ​​corresponding to at least two calibrated gear positions, so as to obtain the parameter determination model.

[0094] The parameter determination model is a linear relationship model between the HUD's gear position and the virtual image parameters.

[0095] In this disclosure, the model coefficients of the model are determined based on the virtual image parameter values ​​corresponding to at least two calibrated gear positions, for example, by determining the parameters in the following manner:

[0096] Based on the least squares method, the model coefficients of the parameter determination model are determined according to the virtual image parameter values ​​corresponding to at least two calibrated gear positions.

[0097] Among them, based on the least squares method, the model coefficients of the parameter determination model are determined according to the virtual image parameter values ​​corresponding to at least two calibrated gear positions, including:

[0098] The model coefficients are determined by the parameters using the following formula:

[0099]

[0100] Where, x i Let y be the value of the i-th calibrated gear position of the HUD. i Let be the virtual image parameter value corresponding to the i-th calibrated gear position, N be the total number of gear positions of the HUD, and k and b be the model coefficients, where k is the slope and b is the intercept.

[0101] Therefore, after determining k and b, the parameter-determined model y = kx + b can be obtained.

[0102] Furthermore, for gears other than the calibrated gears, the gear value (x) of the corresponding gear is substituted into the parameter determination model to obtain the virtual image parameter value of the corresponding gear.

[0103] For example, if the corresponding level 3 value is 3, then x in y = kx + b is assigned the value 3. Based on the determined k and b, the virtual image parameter values ​​corresponding to level 3 are obtained, namely: the coordinates of the intersection point of the plane where the virtual image corresponding to level 3 is located and the line containing the normal of the HUD's eye box in the world coordinate system; the position of the center point of the HUD's eye box in the world coordinate system; the width and height of the virtual image corresponding to level 3; the normal vector of the plane where the virtual image corresponding to level 3 is located; the normal vector of the plane where the HUD's eye box is located; the field of view of the HUD corresponding to level 3; and the resolution of the effective display area of ​​the virtual image corresponding to level 3.

[0104] In step S13, the model is determined based on the parameters, and the virtual image parameter value corresponding to the position to be calibrated in the HUD is determined.

[0105] Furthermore, when the calibrated gears include the lowest gear and the highest gear, this disclosure can determine the step size of the gears based on the total number of gears, the lowest gear, and the highest gear, and then quickly determine the gear to be calibrated (i.e., the intermediate gear) of the adjustment model based on the step size of the gears.

[0106] For example, if the lowest level of the HUD is 1, the highest level is 10, and the total number of levels is 5, then: step size = (10-1) / (5-1) = 2.25, rounded down to get a step size of 2, and the intermediate levels are obtained as level 3, level 5 and level 7 according to the principle of equal spacing.

[0107] In an exemplary embodiment of this disclosure, by calibrating at least two HUD positions, and then determining the model coefficients of a parameter determination model based on the virtual image parameter values ​​corresponding to the at least two calibrated positions, and then determining the virtual image parameter values ​​corresponding to other positions other than the calibrated positions based on the parameter determination model, the calibration efficiency of the HUD is improved and the calibration cost of the HUD is reduced.

[0108] Figure 2 This is a flowchart illustrating an adjustment method for a head-up display (HUD) according to an exemplary embodiment, such as... Figure 2 As shown, the adjustment method for a head-up display (HUD) includes the following steps.

[0109] In step S21, the current information of the driver's eyes is obtained.

[0110] In this disclosure, for example, a camera installed on the A-pillar on the driver's side can periodically capture facial images of the driver and store the position information of the driver's eyes.

[0111] In step S22, the target HUD setting corresponding to the current information is determined.

[0112] Based on the pre-stored correspondence between the position of the human eye and the HUD's settings, the target HUD setting corresponding to the current information of the human eye is determined.

[0113] In step S23, the target virtual image parameter value corresponding to the target gear of the HUD is determined according to the correspondence between the gear position and the virtual image parameter value.

[0114] The correspondence between the HUD settings and the virtual image parameter values ​​is established through... Figure 1 The correspondence between the head-up display (HUD) level and the virtual image parameter value is shown in the figure.

[0115] In step S24, the HUD virtual image is output according to the target virtual image parameter value.

[0116] In an exemplary embodiment of this disclosure, current information of the driver's eyes is acquired, the target gear of the HUD corresponding to the current information is determined, and the target virtual image parameter value corresponding to the target gear of the HUD is determined according to the correspondence between the gear and the virtual image parameter value. Specifically, a parameter determination model based on a linear relationship between the gear and the virtual image parameter of the HUD is used to obtain the correspondence between the gear and the virtual image parameter value, and the HUD virtual image is output according to the target virtual image parameter value. This approach improves the calibration efficiency and reduces the calibration cost of the HUD by calibrating at least two gears, then determining the model coefficients of the parameter determination model based on the virtual image parameter values ​​corresponding to the at least two calibrated gears, and finally determining the virtual image parameter values ​​corresponding to other gears (excluding the calibrated gears) according to the parameter determination model.

[0117] Figure 3 This is a block diagram illustrating an adjustment device 300 for a head-up display (HUD) according to an exemplary embodiment. (Refer to...) Figure 3 The adjustment mechanism for a head-up display (HUD) includes:

[0118] The acquisition module 301 is used to acquire the current information of the driver's eyes;

[0119] The first determining module 302 is used to determine the target level of the HUD corresponding to the current information;

[0120] The second determining module 303 is used to determine the target virtual image parameter value corresponding to the target gear of the HUD according to the correspondence between the gear and the virtual image parameter value, wherein the correspondence is obtained based on a parameter determining model that characterizes the linear relationship between the gear and the virtual image parameter of the HUD.

[0121] Output module 304 is used to output a HUD virtual image according to the target virtual image parameter value;

[0122] The correspondence between the gear position and the virtual image parameter value is determined in the following way:

[0123] Obtain the virtual image parameter values ​​corresponding to at least two calibrated gears in the HUD, wherein the number of calibrated gears is less than the total number of gears in the HUD;

[0124] Based on the virtual image parameter values ​​corresponding to the at least two calibrated gear positions, the model coefficients of the parameter determination model are determined to obtain the parameter determination model, wherein the parameter determination model is a linear relationship model between the gear position of the HUD and the virtual image parameter.

[0125] Based on the parameters, the model is determined, and the virtual image parameter value corresponding to the calibrated position in the HUD is determined.

[0126] Optionally, the second determining module 303 determines the model coefficients of the parameter determining model based on the virtual image parameter values ​​corresponding to the at least two calibration gear positions in the following manner:

[0127] Based on the least squares method, the model coefficients of the parameter determination model are determined according to the virtual image parameter values ​​corresponding to the at least two calibrated gear positions.

[0128] Optionally, the second determining module 303 determines the model coefficients of the parameter determining model based on the least squares method and the virtual image parameter values ​​corresponding to the at least two calibrated gear positions:

[0129] The model coefficients are determined by the parameters using the following formula:

[0130]

[0131] Where, x i Let y be the gear value of the i-th calibrated gear position of the HUD. i Let be the virtual image parameter value corresponding to the i-th calibrated gear position, N be the total number of gear positions of the HUD, and k and b be the model coefficients, where k is the slope and b is the intercept.

[0132] Optionally, the virtual image parameter values ​​include at least one of the following parameter values:

[0133] The coordinates of the intersection point of the plane containing the virtual image and the line containing the normal of the HUD's eye box in the world coordinate system;

[0134] The coordinates of the center point of the HUD's eye box in the world coordinate system;

[0135] The width of the virtual image;

[0136] The value of the normal vector of the plane containing the virtual image;

[0137] The value of the normal vector of the plane where the HUD's eye box is located;

[0138] The field of view of the HUD;

[0139] The resolution of the effective display area of ​​the virtual image.

[0140] Optionally, the calibrated gear positions include the lowest gear position and the highest gear position. Before determining the virtual image parameter value corresponding to the gear position to be calibrated in the HUD gear positions, the device further includes:

[0141] The third determining module is used to determine the step size of the gear based on the total number of gears, the lowest gear, and the highest gear.

[0142] The gear to be calibrated is determined based on the step size of the gear.

[0143] Optionally, the second determining module 303 is further configured to calibrate the virtual image parameter values ​​corresponding to the calibrated gears in the HUD gear settings in the following manner:

[0144] Obtain the coordinates of the marked object located outside the vehicle in the world coordinate system;

[0145] Based on the transformation relationship between the world coordinate system and the two-dimensional image coordinate system, the image position of the marked object in the two-dimensional image coordinate system is obtained, and a virtual image representing the image position is output.

[0146] Adjust the parameters to determine the virtual image parameter value of the set gear in the model until the virtual image and the marked object observed from the field of view of the HUD completely overlap, and obtain the virtual image parameter value of the set gear.

[0147] Regarding the apparatus in the above embodiments, the specific manner in which each module performs its operation has been described in detail in the embodiments related to the method, and will not be elaborated upon here.

[0148] Figure 4 This is a block diagram illustrating an electronic device 700 according to an exemplary embodiment. Figure 4 As shown, the electronic device 700 may include a processor 701 and a memory 702. The electronic device 700 may also include one or more of a multimedia component 703, an input / output (I / O) interface 704, and a communication component 705.

[0149] The processor 701 controls the overall operation of the electronic device 700 to complete all or part of the steps in the above-described adjustment method for a head-up display (HUD). The memory 702 stores various types of data to support the operation of the electronic device 700. This data may include, for example, instructions for any application or method operating on the electronic device 700, and application-related data such as contact data, sent and received messages, pictures, audio, video, etc. The memory 702 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as Static Random Access Memory (SRAM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Erasable Programmable Read-Only Memory (EPROM), Programmable Read-Only Memory (PROM), Read-Only Memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk. Multimedia component 703 may include a screen and an audio component. The screen may be, for example, a touchscreen, and the audio component is used to output and / or input audio signals. For example, the audio component may include a microphone for receiving external audio signals. The received audio signals may be further stored in memory 702 or transmitted via communication component 705. The audio component also includes at least one speaker for outputting audio signals. I / O interface 704 provides an interface between processor 701 and other interface modules, such as a keyboard, mouse, buttons, etc. These buttons may be virtual or physical buttons. Communication component 705 is used for wired or wireless communication between the electronic device 700 and other devices. Wireless communication, such as Wi-Fi, Bluetooth, Near Field Communication (NFC), 2G, 3G, 4G, NB-IoT, eMTC, or other 5G technologies, or combinations thereof, is not limited here. Therefore, the corresponding communication component 705 may include: a Wi-Fi module, a Bluetooth module, an NFC module, etc.

[0150] In an exemplary embodiment, the electronic device 700 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above-described adjustment method for a head-up display (HUD).

[0151] In another exemplary embodiment, a computer-readable storage medium including program instructions is also provided, which, when executed by a processor, implement the steps of the above-described adjustment method for a head-up display (HUD). For example, the computer-readable storage medium may be the memory 702 including the program instructions, which may be executed by the processor 701 of the electronic device 700 to complete the above-described adjustment method for a head-up display (HUD).

[0152] In another exemplary embodiment, a computer program product is also provided, the computer program product comprising a computer program executable by a programmable device, the computer program having a code portion for performing the above-described adjustment method for a head-up display (HUD) when executed by the programmable device.

[0153] The preferred embodiments of this disclosure have been described in detail above with reference to the accompanying drawings. However, this disclosure is not limited to the specific details of the above embodiments. Within the scope of the technical concept of this disclosure, various simple modifications can be made to the technical solutions of this disclosure, and these simple modifications all fall within the protection scope of this disclosure.

[0154] It should also be noted that the various specific technical features described in the above specific embodiments can be combined in any suitable manner without contradiction. In order to avoid unnecessary repetition, this disclosure will not describe the various possible combinations separately.

[0155] Furthermore, various different embodiments of this disclosure can be combined in any way, as long as they do not violate the spirit of this disclosure, they should also be regarded as the content disclosed in this disclosure.

Claims

1. A method for adjusting a head-up display (HUD), characterized in that, include: Obtain current information about the driver's eyes; Determine the target setting of the HUD corresponding to the current information; Based on the correspondence between the gear level and the virtual image parameter value, determine the target virtual image parameter value corresponding to the target gear level of the HUD; Output the HUD virtual image based on the target virtual image parameter values; The correspondence between the gear position and the virtual image parameter value is determined in the following way: Obtain the virtual image parameter values ​​corresponding to at least two calibrated gears in the HUD, wherein the number of calibrated gears is less than the total number of gears in the HUD; Based on the virtual image parameter values ​​corresponding to the at least two calibrated gear positions, the model coefficients of the parameter determination model are determined to obtain the parameter determination model, wherein the parameter determination model is a linear relationship model between the gear position of the HUD and the virtual image parameter. The model is determined based on the parameters, and the virtual image parameter value corresponding to the calibrated position in the HUD is determined. The virtual image parameter values ​​include at least one of the following parameter values: The coordinates of the intersection point of the plane containing the virtual image and the line containing the normal of the HUD's eye box in the world coordinate system; The coordinates of the center point of the HUD's eye box in the world coordinate system; The width and height of the virtual image; The normal vector of the plane containing the virtual image; The normal vector of the plane containing the eye box of the HUD; The field of view of the HUD; The resolution of the effective display area of ​​the virtual image.

2. The method according to claim 1, characterized in that, The step of determining the model coefficients of the parameter determination model based on the virtual image parameter values ​​corresponding to the at least two calibrated gear positions includes: Based on the least squares method, the model coefficients of the parameter determination model are determined according to the virtual image parameter values ​​corresponding to the at least two calibrated gear positions.

3. The method according to claim 2, characterized in that, The determination of model coefficients for the parameter determination model based on the least squares method, according to the virtual image parameter values ​​corresponding to the at least two calibrated gear positions, includes: The model coefficients are determined by the parameters using the following formula: Where, x i Let y be the gear value of the i-th calibrated gear position of the HUD. i Let be the virtual image parameter value corresponding to the i-th calibrated gear position, N be the total number of gear positions of the HUD, and k and b be the model coefficients, where k is the slope and b is the intercept.

4. The method according to claim 1, characterized in that, The calibrated gears include the lowest gear and the highest gear. Before determining the virtual image parameter value corresponding to the gear to be calibrated in the HUD gears, the method further includes: The step size of the gear is determined based on the total number of gears, the lowest gear, and the highest gear. The gear to be calibrated is determined based on the step size of the gear.

5. The method according to claim 1, characterized in that, The method further includes calibrating the virtual image parameter values ​​corresponding to the calibrated gears in the HUD gear settings in the following manner: Obtain the coordinates of the marked object located outside the vehicle in the world coordinate system; Based on the transformation relationship between the world coordinate system and the two-dimensional image coordinate system, the image position of the marked object in the two-dimensional image coordinate system is obtained, and a virtual image representing the image position is output. Adjust the parameters to determine the virtual image parameter value of the set level in the model until the virtual image and the marked object observed from the field of view of the HUD completely overlap, and obtain the virtual image parameter value of the set level.

6. An adjustment device for a head-up display (HUD), characterized in that, include: The acquisition module is used to acquire the current information of the driver's eyes; The first determining module is used to determine the target level of the HUD corresponding to the current information; The second determining module is used to determine the target virtual image parameter value corresponding to the target gear of the HUD based on the correspondence between the gear and the virtual image parameter value, wherein the correspondence is obtained based on a parameter determining model that characterizes the linear relationship between the gear and the virtual image parameter of the HUD. The output module is used to output a HUD virtual image based on the target virtual image parameter values; The correspondence between the gear position and the virtual image parameter value is determined in the following way: Obtain the virtual image parameter values ​​corresponding to at least two calibrated gears in the HUD, wherein the number of calibrated gears is less than the total number of gears in the HUD; Based on the virtual image parameter values ​​corresponding to the at least two calibrated gear positions, the model coefficients of the parameter determination model are determined to obtain the parameter determination model, wherein the parameter determination model is a linear relationship model between the gear position of the HUD and the virtual image parameter. The model is determined based on the parameters, and the virtual image parameter value corresponding to the calibrated position in the HUD is determined. The virtual image parameter values ​​include at least one of the following parameter values: The coordinates of the intersection point of the plane containing the virtual image and the line containing the normal of the HUD's eye box in the world coordinate system; The coordinates of the center point of the HUD's eye box in the world coordinate system; The width and height of the virtual image; The normal vector of the plane containing the virtual image; The normal vector of the plane containing the eye box of the HUD; The field of view of the HUD; The resolution of the effective display area of ​​the virtual image.

7. The apparatus according to claim 6, characterized in that, The second determining module determines the model coefficients of the model using the following method: Based on the least squares method, the model coefficients of the parameter determination model are determined according to the virtual image parameter values ​​corresponding to the at least two calibrated gear positions.

8. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that, When executed by a processor, the program implements the steps of the method described in any one of claims 1-5.

9. An electronic device, characterized in that, include: A memory on which computer programs are stored; A processor for executing the computer program in the memory to implement the steps of the method according to any one of claims 1-5.

Citation Information

Patent Citations

  • Alignment method and alignment device for display equipment, and vehicle-mounted display system

    CN114022565A

  • Head-up display

    CN114228490A