Target mark adjusting method and system of AR-HUD system

Abstract

The invention relates to the technical field of vehicles, and provides a target mark adjustment method and system of an AR-HUD system. The method comprises the following steps: S1, in response to HUD height adjustment operation, generating a first regulation and control instruction; s2, adjusting the vertical height of the AR-HUD system based on the first regulation and control instruction to obtain a first height parameter of the HUD at the current moment; s3, comparing a first height parameter of the HUD at the current moment with a second height parameter of the HUD before adjustment, and judging whether to trigger a preset compensation strategy or not based on an output comparison result; and S4, if the first comparison result is output, triggering a preset compensation strategy, and re-determining the target coordinate of the target mark. Compared with the prior art, on the premise that extra hardware cost is not increased, accurate tracking and rapid repositioning of the target mark can be achieved, and the fusion precision and user experience of the AR-HUD system are remarkably improved.

Description

TECHNICAL FIELD

[0001] The application relates to the technical field of vehicles, in particular to a target marker adjustment method and system of an AR-HUD system. BACKGROUND

[0002] With the rapid development of intelligent and networked technologies of automobiles, an intelligent cockpit system has become one of key elements affecting the purchase decision of users. As a key technology in the field of intelligent display of an intelligent cockpit, an augmented reality head-up display system (AR-HUD) is accelerating the penetration from high-end luxury vehicles to the market of medium and high-end intelligent electric vehicles. The technology realizes the real-time dynamic superposition of driving information and a real road scene by accurately projecting driving information such as a navigation path guide, a front collision warning, a lane departure warning and the like into the field of view of a driver in a way of virtual-real fusion, thereby significantly improving the driving safety and the human-machine interaction experience.

[0003] A current mainstream technical solution realizes the augmented reality fusion display of a front vehicle target by fusing multiple sensors (including a visual camera, a millimeter wave radar and the like) to realize the real-time sensing of the front vehicle, and dynamically rendering a virtual marker to the corresponding position of a windshield based on vehicle positioning information and parameters of an HUD optical system. However, in actual application, due to the individual differences (such as height, sitting posture and the like) of drivers, the eye level is different, and users often need to manually adjust the "virtual height" of the projection picture of the HUD through a central control screen or physical buttons to obtain the best viewing effect. In this adjustment process, the vertical displacement of the projection picture will destroy the original calibration relationship, resulting in the spatial position deviation between the virtual marker and the actual target object, which seriously affects the fusion accuracy and user experience of the AR-HUD. In the existing solution, some high-end vehicles realize automatic calibration by increasing auxiliary sensors such as a DMS (driver monitoring system) or a seat angle encoder, but this kind of solution significantly increases the system complexity and hardware cost. SUMMARY

[0004] The application aims to provide a target marker adjustment method and system of an AR-HUD system, which realizes the accurate tracking and rapid repositioning of the target marker by realizing the real-time sensing of the change of the HUD height parameter and calculating the spatial position compensation amount of the target marker, without increasing the additional hardware cost, thereby significantly improving the fusion accuracy and user experience of the AR-HUD system. The specific scheme is as follows:

[0005] A target marker adjustment method of an AR-HUD system, the method comprising the following steps:

[0006] Step S1: generating a first control instruction in response to a HUD height adjustment operation;

[0007] Step S2: adjusting the vertical height of the AR-HUD system based on the first control instruction to obtain a first height parameter of the HUD at the current time;

[0008] Step S3: comparing the first height parameter of the HUD at the current time with a second height parameter of the HUD before the adjustment, and determining whether to trigger a preset compensation strategy based on an output comparison result;

[0009] Step S4: if the output first comparison result, triggering the preset compensation strategy and re-determining the target coordinates of the target marker.

[0010] Optionally, the step S4 specifically comprises:

[0011] if the first absolute difference between the first height parameter at the current time and the second height parameter of the HUD before the adjustment is greater than a first threshold value, re-generating the target coordinates of the target marker based on the first height parameter at the current time through the AR rendering module;

[0012] adjusting the projection image of the AR-HUD at the current time based on the generated target coordinates of the target marker.

[0013] Optionally, the step S4 specifically further comprises:

[0014] if the first absolute difference between the first height parameter at the current time and the second height parameter of the HUD before the adjustment is greater than a second threshold value, triggering a secondary compensation strategy; wherein the second threshold value is greater than the first threshold value;

[0015] obtaining the upper body posture inclination change of the driver and the facial image of the driver based on the secondary compensation strategy;

[0016] if the upper body posture inclination change of the driver is greater than a first angle, obtaining a compensation offset of the HUD based on the posture inclination of the driver according to a corresponding relationship between the posture inclination and the compensation amount, to adjust the projection image of the AR-HUD at the current time.

[0017] Optionally, if the upper body posture inclination change of the driver is greater than a first angle, obtaining a compensation offset of the HUD based on the posture inclination of the driver according to a corresponding relationship between the posture inclination and the compensation amount, to adjust the projection image of the AR-HUD at the current time, specifically comprising:

[0018] if the compensation offset is greater than a preset value, detecting whether the current driver wears glasses;

[0019] if the driver wears glasses, obtaining the facial image of the current driver and obtaining the identity information of the driver based on the facial image of the driver;

[0020] Based on the driver's identity information, the eyeglasses parameter database is traversed to obtain the current driver's eyeglasses parameters; wherein, the eyeglasses parameters include at least: the driver's myopia refractive power and lens reflectivity;

[0021] If the value of at least one of the myopia refractive power and the lens reflectivity is greater than the corresponding diopter threshold, the diopter compensation strategy is triggered.

[0022] Optionally, if the value of at least one of the myopia refractive power and the lens reflectivity is greater than the corresponding diopter threshold, a diopter compensation strategy is triggered, specifically including:

[0023] If the myopia refractive error is greater than the refractive error threshold, then the second difference between the myopia refractive error and the refractive error threshold is obtained, and the first compensation value of the HUD is obtained from the pre-calibrated correspondence between the difference and the height compensation value based on the second difference; the first compensation value includes HUD vertical height compensation and target mark width compensation.

[0024] Based on the first compensation value of the HUD, adjust the projected image of the AR-HUD at the current moment;

[0025] If the reflectivity of the lens is greater than the reflectivity threshold, the third difference between the reflectivity of the lens and the reflectivity threshold and the brightness value of the current external environment of the vehicle are obtained, and the projection parameters of the HUD are adjusted according to the third difference and the current brightness value; the projection parameters of the HUD include at least: projection brightness and projection angle.

[0026] Optionally, if the value of at least one of the myopia refractive power and the lens reflectivity is greater than the corresponding diopter threshold, a diopter compensation strategy is triggered, specifically including:

[0027] If the myopia refractive error is greater than the refractive error threshold, then obtain the second difference between the myopia refractive error and the refractive error threshold;

[0028] Based on the second difference, a first compensation frequency for the degree compensation strategy is generated; wherein, the second difference is set proportionally to the first compensation frequency;

[0029] Based on the first compensation frequency, the rate of change of the driver's lens reflectivity within a preset unit time is obtained;

[0030] Based on the lens reflectivity change rate, the compensation coefficient corresponding to the diopter compensation strategy is obtained, and the first compensation frequency is readjusted based on the compensation coefficient to obtain the target compensation frequency of the diopter compensation strategy.

[0031] A target marker adjustment system for an AR-HUD system, the system comprising:

[0032] Generation module: Configured to generate the first adjustment command in response to HUD height adjustment operation;

[0033] The first adjustment module is configured to adjust the vertical height of the AR-HUD system based on the first control command, so as to obtain the first height parameter of the HUD at the current moment;

[0034] The judgment module is configured to compare the first height parameter of the HUD at the current moment with the second height parameter of the HUD before adjustment, and determine whether to trigger the preset compensation strategy based on the output comparison result.

[0035] The strategy compensation module is configured to trigger a preset compensation strategy and redetermine the target coordinates of the target marker if the first comparison result is output.

[0036] An electronic device includes: a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory communicate with each other via the communication bus; the memory stores a computer program, which, when executed by the processor, causes the processor to perform the steps of the method.

[0037] A computer-readable storage medium storing a computer program executable by an electronic device, which, when run on the electronic device, causes the electronic device to perform the steps of the method described herein.

[0038] A simulation platform, comprising:

[0039] An electronic device for implementing the steps of the method;

[0040] A processor that runs a program, and when the program runs, it executes the steps of the method from data output by the electronic device.

[0041] A storage medium for storing a program that, when run, executes the steps of the method on data output from an electronic device.

[0042] The above solution achieves the following beneficial technical effects:

[0043] This application provides a target marker adjustment method and system for an AR-HUD system. The method includes the following steps: generating a first adjustment command in response to a HUD height adjustment operation; adjusting the vertical height of the projection interface of the AR-HUD system according to the first adjustment command to obtain a first height parameter of the HUD at the current moment; comparing the first height parameter of the HUD at the current moment with a second height parameter of the HUD before adjustment, and determining whether to trigger a preset compensation strategy based on the output comparison result; and redetermining the target coordinates of the target marker through the preset compensation strategy. It can be understood that this application can achieve accurate tracking and rapid repositioning of target markers compared with the prior art, significantly improving the fusion accuracy and user experience of the AR-HUD system. Attached Figure Description

[0044] Fig. 1 A flowchart illustrating the method for adjusting target markers in an AR-HUD system;

[0045] Fig. 2 This is a flowchart illustrating a target marker adjustment method for an AR-HUD system, as shown in one embodiment. Detailed Implementation

[0046] To make the purpose, technical solution, and advantages of this application clearer, the following will be described in conjunction with the appendix. Figs. 1-2 This application will be described in further detail. It is obvious that the described embodiments are merely some, not all, of the embodiments described herein. All other embodiments obtained by those skilled in the art based on the embodiments of this application without inventive effort are within the scope of protection of this application.

[0047] The terminology used in the embodiments of this application is for the purpose of describing particular embodiments only and is not intended to limit the application. The singular forms “a,” “said,” and “the” used in the embodiments of this application and the appended claims are also intended to include the plural forms, and “multiple” generally includes at least two unless the context clearly indicates otherwise.

[0048] It should be understood that the term "and / or" used in this article is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, and B existing alone. Additionally, the character " / " in this article generally indicates that the preceding and following related objects have an "or" relationship.

[0049] It should be understood that although the terms first, second, third, etc., may be used in the embodiments of this application, these descriptions should not be limited to these terms. These terms are only used to distinguish the descriptions. For example, first may also be referred to as second without departing from the scope of the embodiments of this application, and similarly, second may also be referred to as first.

[0050] Depending on the context, the words “if” or “suppose” as used here can be interpreted as “when” or “in response to determination” or “in response to detection.” Similarly, depending on the context, the phrases “if determination” or “if detection (of the stated condition or event)” can be interpreted as “when determination” or “in response to determination” or “when detection (of the stated condition or event)” or “in response to detection (of the stated condition or event).”

[0051] It should also be noted that the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that an article or device that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such an article or device. Without further limitation, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the article or device that includes said element.

[0052] It should be noted that any symbols and / or numbers present in the specification that are not marked in the accompanying drawings are not reference numerals.

[0053] like Fig. 1 The method for adjusting target markers in an AR-HUD system, as shown, includes the following steps:

[0054] Step S1: In response to the HUD height adjustment operation, generate the first adjustment command;

[0055] Step S2: Based on the first control command, adjust the vertical height of the AR-HUD system to obtain the first height parameter of the HUD at the current moment;

[0056] Step S3: Compare the first height parameter of the HUD at the current moment with the second height parameter of the HUD before adjustment, and determine whether to trigger the preset compensation strategy based on the output comparison result;

[0057] Step S4: If the first comparison result is output, the preset compensation strategy is triggered, and the target coordinates of the target mark are redefined.

[0058] Specifically, in the embodiments provided in this application, a first control command is first generated in response to the HUD height adjustment operation; according to the first control command, the vertical height of the projection interface of the AR-HUD system is adjusted to obtain the first height parameter of the HUD at the current moment; the first height parameter of the HUD at the current moment is compared with the second height parameter of the HUD before adjustment, and based on the output comparison result, it is determined whether to trigger a preset compensation strategy; through the preset compensation strategy, the target coordinates of the target marker are re-determined; it can be understood that, compared with the prior art, this application can achieve accurate tracking and rapid repositioning of the target marker, significantly improving the fusion accuracy and user experience of the AR-HUD system.

[0059] In one specific embodiment, step S4 specifically includes:

[0060] If the first absolute difference between the first height parameter at the current moment and the second height parameter of the HUD before adjustment is greater than the first threshold, the target coordinates of the target marker will be regenerated by the AR rendering module based on the first height parameter at the current moment.

[0061] Adjust the projected image of the AR-HUD at the current moment based on the target coordinates of the generated target marker.

[0062] It should be further explained that if the first absolute value of the first height parameter of the HUD at the current moment and the second height parameter of the HUD before adjustment is less than or equal to the first threshold (e.g., the first absolute value is less than or equal to 1cm), then the preset compensation strategy is not triggered, and the second comparison result is output. When the first absolute value is greater than 1cm, the preset compensation strategy is triggered, and the first comparison result is output. The advantage of this design is that it has a fast response speed and can quickly align the target marker with the real scene. The driver can hardly feel the offset of the target marker, which not only improves the user experience of the HUD, but also avoids the driver's attention being distracted by the offset of the target marker, thus affecting driving safety.

[0063] For example Fig. 2 As shown, the user initiates HUD height adjustment.

[0064] ②The CSC system receives the operation signal and sends it to the HUD controller.

[0065] ③ After receiving the CSC signal, the HUD controller performs an adjustment operation. Once the adjustment is successful, it sends the current height parameters to the HUD's AR rendering module.

[0066] ④ The AR rendering module continuously listens for HUD status messages and compares them with the previous HUD parameter cache messages. When the height parameter changes, it enters the HUD compensation process.

[0067] ⑤ The HUD has been standardized and calibrated before leaving the factory. The previous height parameter is set as y, and the current height adjustment is set as Δy. The new coordinates are y' = Δy + y.

[0068] ⑥ The AR rendering module uses the updated coordinates y' to convert them into the coordinates of the virtual marker (the vehicle's original algorithm is sufficient), and the image is transmitted to the HUD optical unit via LVDS; the HUD projects the image onto the windshield, and the user sees the aligned and blended marker; the whole process is completed within 100ms, and the user is almost unaware of it.

[0069] For example, in the C801 project, a typical application scenario is that different users have different height adjustment habits for the HUD. When a user adjusts the HUD height, if no action is taken, the target marker of the vehicle following the car in front will deviate from the actual vehicle position. At this time, the system needs to be able to dynamically adjust the position of the target marker according to the user's height adjustment.

[0070] 2. HUD Height (User Side): This refers to the "visual height" of the virtual image seen by the driver on the windshield from the ground. Adjusting the HUD height via the central control screen essentially adjusts the vertical position of the virtual image.

[0071] 3. Downward viewing angle: refers to the downward tilt angle (unit: degrees °) of the virtual image rays relative to the vehicle's horizontal reference plane in the HUD optical system. This angle is determined by the deflection angle of the internal mirrors of the HUD or the DLP micromirrors.

[0072] 4. When a user adjusts the height of the HUD, they are actually adjusting the deflection angle of the internal reflector, thereby adjusting the downward viewing angle. The visual effect is a change in the height of the virtual image.

[0073] 5. Cause of the problem: When the user adjusts the HUD height, the downward viewing angle θ changes, and the virtual image moves as a whole; however, if the AR rendering module does not perceive the change in θ, it still uses the original θ to calculate the marker position, resulting in marker drift.

[0074] It is understandable that this application, without increasing costs, solves the problem of target fusion deviation of the front vehicle based on pre-calibrated data after the height of the HUD screen changes, thus providing users with a better visual experience.

[0075] Furthermore, step S4 specifically includes:

[0076] If the first absolute difference between the first height parameter at the current moment and the second height parameter of the HUD before adjustment is greater than the second threshold, then a secondary compensation strategy is triggered; wherein the second threshold is greater than the first threshold.

[0077] Based on a secondary compensation strategy, the driver's upper body sitting posture tilt angle change and the driver's facial image are obtained.

[0078] If the driver's upper body posture tilt angle changes more than the first angle, the compensation offset of the HUD is obtained based on the driver's posture tilt angle and the correspondence between posture tilt angle and compensation amount, so as to adjust the projection image of the AR-HUD at the current moment.

[0079] Specifically, this application triggers a secondary compensation strategy when the first absolute difference between the first height parameter and the second height parameter of the HUD before adjustment is greater than a second threshold. This indicates that the HUD height adjustment range is relatively large. The advantage of this design is that when the first absolute difference is greater than the first threshold and less than or equal to the second threshold, the secondary compensation strategy is not triggered, which can reduce the computing power consumption of the vehicle system and avoid response delay caused by excessive operation. Then, when the first absolute difference is greater than the second threshold, the secondary compensation strategy is triggered. Based on the driver's upper body posture tilt angle and the correspondence between posture tilt angle and compensation amount, the corresponding compensation offset is obtained. Ultimately, this ensures that the projection adjustment of the AR-HUD is more accurate and matches the driver's current posture view, so that the target mark cannot be seen due to the correct height adjustment but posture problem.

[0080] If the driver's upper body posture tilt angle changes more than the first angle, then based on the driver's posture tilt angle and the correspondence between posture tilt angle and compensation amount, the compensation offset of the HUD is obtained to adjust the projection image of the AR-HUD at the current moment, specifically including:

[0081] If the compensation offset is greater than the preset value, then check whether the current driver is wearing glasses;

[0082] If the driver is wearing glasses, obtain the driver's facial image and obtain the driver's identity information based on the facial image;

[0083] Based on the driver's identity information, the eyeglasses parameter database is traversed to obtain the current driver's eyeglasses parameters; wherein, the eyeglasses parameters include at least: the driver's myopia refractive power and lens reflectivity;

[0084] If the value of at least one of the myopia refractive power and the lens reflectivity is greater than the corresponding diopter threshold, the diopter compensation strategy is triggered.

[0085] Specifically, if the driver's upper body posture angle changes by more than 5°, the HUD height offset compensation amount is first determined based on the correspondence between posture angle and compensation amount, thereby adjusting the current AR-HUD projected image. If the compensation offset is greater than 3mm, it detects whether the driver is wearing glasses. If the driver is wearing glasses, the driver's identity information is obtained based on the collected driver's facial image, and the driver's glasses parameters are queried through the pre-entered glasses parameter database. If either the myopia degree or the lens reflectivity in the glasses parameters exceeds the corresponding degree threshold, the compensation strategy is triggered. The advantage of this design is that it achieves precise compensation based on the driver's posture and glasses parameters. This avoids HUD target marker offset caused by tilted posture and solves the technical problem of blurry and offset HUD projection for drivers wearing glasses. As a result, the HUD display always matches the driver's state, which greatly improves the driving experience for people wearing glasses. At the same time, it can filter out small and unnecessary compensations by checking whether the compensation offset exceeds the preset value, reducing the waste of system computing power and ensuring that the target marker projected by the HUD is always accurately tracked and quickly positioned with respect to the actual vehicle position. This significantly improves the fusion accuracy and user experience of the AR-HUD system.

[0086] In one specific embodiment, if the value of at least one of the myopia refractive power and the lens reflectivity is greater than the corresponding diopter threshold, a diopter compensation strategy is triggered, specifically including:

[0087] If the myopia refractive error is greater than the refractive error threshold, then the second difference between the myopia refractive error and the refractive error threshold is obtained, and the first compensation value of the HUD is obtained from the pre-calibrated correspondence between the difference and the height compensation value based on the second difference; the first compensation value includes HUD vertical height compensation and target mark width compensation.

[0088] Based on the first compensation value of the HUD, adjust the projected image of the AR-HUD at the current moment;

[0089] If the reflectivity of the lens is greater than the reflectivity threshold, the third difference between the reflectivity of the lens and the reflectivity threshold and the brightness value of the current external environment of the vehicle are obtained, and the projection parameters of the HUD are adjusted according to the third difference and the current brightness value; the projection parameters of the HUD include at least: projection brightness and projection angle.

[0090] Specifically, if the myopia refractive power is greater than a refractive power threshold, a second difference between the myopia refractive power and the refractive power threshold is obtained. Based on this second difference, a first compensation value for the HUD is obtained from a pre-calibrated correspondence between difference and height compensation value. If the lens reflectivity is greater than a reflectivity threshold, a third difference between the lens reflectivity and the reflectivity threshold, along with the brightness value of the vehicle's current external environment, is obtained. Based on the third difference and the current brightness value, the HUD's projection parameters are adjusted. The HUD's projection parameters include at least projection brightness and projection angle. The advantage of this design is that by calculating the difference between the driver's glasses parameters and the corresponding diopter threshold, and considering the brightness of the vehicle's current external environment, the HUD's projected display is ensured to be both clear and accurately aligned with reality. Furthermore, it can precisely match drivers with different myopia levels, ensuring that the HUD projected image seen by the current driver remains clear at all times.

[0091] For example, if the driver's myopia is 600° greater than 300°, the second difference is 300°, and the corresponding vertical compensation displacement is 1cm. The width of the target mark is increased by 5%, such as the original arrow width of 2cm becoming 2.1cm. If the inherent reflectivity of the lens itself is 65, which is greater than the preset reflectivity threshold of 50, the third difference is 15. If the vehicle is driving on a city expressway at noon and the external ambient brightness is 1200 lux, based on the third difference and the current high ambient brightness, the HUD projection brightness is increased from the default 700nit to 00nit to ensure that the HUD image can be clearly displayed under strong light without being obscured by lens reflection due to low brightness. At the same time, the projection angle is slightly adjusted downward by 2° from 15° to ensure that the driver can clearly see the target marks such as vehicle speed and navigation arrows.

[0092] If at least one of the myopia refractive power and the lens reflectivity is greater than the corresponding diopter threshold, a diopter compensation strategy is triggered, specifically including:

[0093] If the myopia refractive error is greater than the refractive error threshold, then obtain the second difference between the myopia refractive error and the refractive error threshold;

[0094] Based on the second difference, a first compensation frequency for the degree compensation strategy is generated; wherein, the second difference is set proportionally to the first compensation frequency;

[0095] Based on the first compensation frequency, the rate of change of the driver's lens reflectivity within a preset unit time is obtained;

[0096] Based on the lens reflectivity change rate, the compensation coefficient corresponding to the diopter compensation strategy is obtained, and the first compensation frequency is readjusted based on the compensation coefficient to obtain the target compensation frequency of the diopter compensation strategy.

[0097] Specifically, in this embodiment, the driver's myopia refractive power is first compared with a refractive power threshold. When the myopia refractive power is greater than the refractive power threshold, a first compensation frequency for the diopter compensation strategy is generated based on a second difference between the myopia refractive power and the refractive power threshold. The second difference is proportional to the first compensation frequency; that is, the greater the myopia, the greater the compensation frequency. Based on the first compensation frequency, the rate of change of reflectivity of the driver's lens within a preset unit time is obtained. The rate of change of reflectivity of the driver's lens changes dynamically due to the influence of the vehicle's external environment. Based on the rate of change of reflectivity, a compensation coefficient corresponding to the diopter compensation strategy is obtained, and the first compensation frequency is readjusted based on the compensation coefficient to obtain the target compensation frequency of the diopter compensation strategy. This ensures the accuracy of HUD compensation while reducing computational resources.

[0098] For example, if driver A's myopia refractive error is 500°, which is greater than the refractive error threshold of 250°, then the second difference obtained is 250°. The first compensation frequency of the diopter compensation strategy generated based on the second difference is 0.5s / time. It can be understood that the larger the second difference, the higher the driver's myopia, the higher the first compensation frequency, and the shorter the compensation cycle of the diopter compensation strategy, thereby ensuring that the target mark seen by the driver is always clearly visible and avoiding driver perception delay.

[0099] During driving, the real-time reflectivity of the lens changes synchronously with changes in ambient light. For example, when the reflectivity change rate is less than 10% / s, the diopter compensation strategy remains unchanged, maintaining the first compensation frequency. When the reflectivity change rate falls into the range of 10% / s-20% / s, the corresponding compensation coefficient becomes 0.2, effectively shortening the current first compensation frequency by 20%. It can be understood that as the reflectivity change rate increases, the corresponding compensation coefficient increases, the adjusted first compensation frequency increases, and the compensation cycle shortens. Conversely, lower compensation frequencies and longer compensation cycles correspond to lower myopia and lower reflectivity change rates, thus reducing computational resources while maintaining compensation accuracy.

[0100] On the other hand, this application provides a target marker adjustment system for an AR-HUD system, the system comprising:

[0101] Generation module: Configured to generate the first adjustment command in response to HUD height adjustment operation;

[0102] The first adjustment module is configured to adjust the vertical height of the AR-HUD system based on the first control command, so as to obtain the first height parameter of the HUD at the current moment;

[0103] The judgment module is configured to compare the first height parameter of the HUD at the current moment with the second height parameter of the HUD before adjustment, and determine whether to trigger the preset compensation strategy based on the output comparison result.

[0104] The strategy compensation module is configured to trigger a preset compensation strategy and redetermine the target coordinates of the target marker if the first comparison result is output.

[0105] It is worth noting that although this system only discloses the generation module, the first adjustment module, the judgment module, and the strategy compensation module, it does not mean that this system is limited to the above-mentioned basic functional modules. On the contrary, what this invention intends to express is that, based on the above-mentioned basic functional modules, those skilled in the art can add one or more functional modules in combination with the prior art to form an infinite number of embodiments or technical solutions. That is to say, this system is open rather than closed. It should not be assumed that the scope of protection of the claims of this invention is limited to the above-disclosed basic functional modules just because this embodiment only discloses a few basic functional modules.

[0106] On the other hand, this application provides an electronic device, including: a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory communicate with each other through the communication bus;

[0107] The memory stores a computer program that, when executed by a processor, causes the processor to perform the steps of the method.

[0108] On the other hand, this application provides a computer-readable storage medium having a computer program / instructions stored thereon, which, when executed by a processor, implement the steps of the method.

[0109] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, data stored, data displayed, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties.

[0110] Those skilled in the art will understand that all or part of the processes in the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium, and when executed, it can include the processes of the embodiments described above. Any references to memory, databases, or other media used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetically switched memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can take many forms. The databases involved in the embodiments provided in this application can include at least one of relational and non-relational databases. Non-relational databases can include blockchain-based distributed databases, etc., and are not limited thereto. The processors involved in the various embodiments provided in this application may be general-purpose processors, central processing units, graphics processors, digital signal processors, programmable logic devices, quantum computing-based data processing logic devices, etc., and are not limited thereto.

[0111] A simulation platform, comprising:

[0112] An electronic device for implementing the steps of the method;

[0113] A processor that runs a program, which, when running, executes the steps of the method claimed in the electronic device from data output by the program.

[0114] A storage medium for storing a program that, when run, executes the steps of the method on data output from an electronic device.

[0115] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0116] The embodiments described above are merely illustrative of several implementation methods of this application, and while the descriptions are specific and detailed, they should not be construed as limiting the scope of this application. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the protection scope of this application. Therefore, the protection scope of this application should be determined by the appended claims.

Claims

1. A method for adjusting target markers in an AR-HUD system, characterized in that, The method includes the following steps: Step S1: In response to the HUD height adjustment operation, generate the first adjustment command; Step S2: Based on the first control command, adjust the vertical height of the AR-HUD system to obtain the first height parameter of the HUD at the current moment; Step S3: Compare the first height parameter of the HUD at the current moment with the second height parameter of the HUD before adjustment, and determine whether to trigger the preset compensation strategy based on the output comparison result; Step S4: If the first comparison result is output, the preset compensation strategy is triggered, and the target coordinates of the target mark are redefined.

2. The method according to claim 1, characterized in that, Step S4 specifically includes: If the first absolute difference between the first height parameter at the current moment and the second height parameter of the HUD before adjustment is greater than the first threshold, the target coordinates of the target marker will be regenerated by the AR rendering module based on the first height parameter at the current moment. Adjust the projection image of the AR-HUD at the current moment based on the target coordinates of the generated target marker.

3. The method according to claim 2, characterized in that, Step S4 further includes: If the first absolute difference between the first height parameter at the current moment and the second height parameter of the HUD before adjustment is greater than the second threshold, then a secondary compensation strategy is triggered; wherein the second threshold is greater than the first threshold. Based on a secondary compensation strategy, the driver's upper body sitting posture tilt angle change and the driver's facial image are obtained. If the driver's upper body posture tilt angle changes more than the first angle, the compensation offset of the HUD is obtained based on the driver's posture tilt angle and the correspondence between posture tilt angle and compensation amount, so as to adjust the projection image of the AR-HUD at the current moment.

4. The method according to claim 3, characterized in that, If the driver's upper body posture tilt angle changes more than the first angle, then based on the driver's posture tilt angle and the correspondence between posture tilt angle and compensation amount, the compensation offset of the HUD is obtained to adjust the projection image of the AR-HUD at the current moment, specifically including: If the compensation offset is greater than the preset value, then check whether the current driver is wearing glasses; If the driver is wearing glasses, obtain the driver's facial image and obtain the driver's identity information based on the facial image; Based on the driver's identity information, the eyeglasses parameter database is traversed to obtain the current driver's eyeglasses parameters; wherein, the eyeglasses parameters include at least: the driver's myopia refractive power and lens reflectivity; If the value of at least one of the myopia refractive power and the lens reflectivity is greater than the corresponding diopter threshold, the diopter compensation strategy is triggered.

5. The method according to claim 4, characterized in that, If at least one of the myopia refractive power and the lens reflectivity is greater than the corresponding diopter threshold, a diopter compensation strategy is triggered, specifically including: If the myopia refractive error is greater than the refractive error threshold, then the second difference between the myopia refractive error and the refractive error threshold is obtained, and the first compensation value of the HUD is obtained from the pre-calibrated correspondence between the difference and the height compensation value based on the second difference; the first compensation value includes HUD vertical height compensation and target mark width compensation. Based on the first compensation value of the HUD, adjust the projected image of the AR-HUD at the current moment; If the reflectivity of the lens is greater than the reflectivity threshold, the third difference between the reflectivity of the lens and the reflectivity threshold and the brightness value of the current external environment of the vehicle are obtained, and the projection parameters of the HUD are adjusted according to the third difference and the current brightness value; the projection parameters of the HUD include at least: projection brightness and projection angle.

6. The method according to claim 5, characterized in that, If at least one of the myopia refractive power and the lens reflectivity is greater than the corresponding diopter threshold, a diopter compensation strategy is triggered, specifically including: If the myopia refractive error is greater than the refractive error threshold, then obtain the second difference between the myopia refractive error and the refractive error threshold; Based on the second difference, a first compensation frequency for the degree compensation strategy is generated; wherein, the second difference is set proportionally to the first compensation frequency; Based on the first compensation frequency, the rate of change of the driver's lens reflectivity within a preset unit time is obtained; Based on the lens reflectivity change rate, the compensation coefficient corresponding to the diopter compensation strategy is obtained, and the first compensation frequency is readjusted based on the compensation coefficient to obtain the target compensation frequency of the diopter compensation strategy.

7. A target marking adjustment system for an AR-HUD system, characterized in that, The system includes: Generation module: Configured to generate the first adjustment command in response to HUD height adjustment operation; The first adjustment module is configured to adjust the vertical height of the AR-HUD system based on the first control command, so as to obtain the first height parameter of the HUD at the current moment; The judgment module is configured to compare the first height parameter of the HUD at the current moment with the second height parameter of the HUD before adjustment, and determine whether to trigger the preset compensation strategy based on the output comparison result. The strategy compensation module is configured to trigger a preset compensation strategy and redetermine the target coordinates of the target marker if the first comparison result is output.

8. An electronic device, comprising: The system comprises a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory communicate with each other via the communication bus; characterized in that the memory stores a computer program, which, when executed by the processor, causes the processor to perform the steps of the method as described in any one of claims 1 to 6.

9. A computer-readable storage medium storing a computer program executable by an electronic device, characterized in that, When a computer program is run on an electronic device, it causes the electronic device to perform the steps of the method as described in any one of claims 1 to 6.

10. A simulation platform, characterized in that, include: An electronic device for implementing the steps of the method according to any one of claims 1 to 6; A processor that runs a program that, when the program is running, performs the steps of the method according to any one of claims 1 to 6 from data output by an electronic device. A storage medium for storing a program that, when run, performs the steps of the method according to any one of claims 1 to 6 on data output from an electronic device.

Images