Heads-up display control method and system

Abstract

Provided in the present application are a heads-up display control method and system. The method comprises: detecting an abnormal state of a windshield in real time, so as to acquire an abnormal region of the windshield on the basis of the abnormal state; mapping the abnormal region into a projection picture of a heads-up display, so as to determine a UI element to be adjusted of the heads-up display; and on the basis of a preset adjustment rule, adjusting said UI element. By means of detecting the state of a windshield in real time, and when the windshield is broken, adjusting UI elements in a broken region and moving a UI element to be adjusted to an unbroken region, the present application effectively solves the technical problem of it being impossible to ensure that a driver can clearly acquire required driving information due to an existing heads-up display system lacking an effective UI element movement avoidance strategy when the windshield is broken, thereby effectively reducing driving risks and improving the safety of vehicle driving.

Description

A head-up display control method and system Technical Field

[0001] This application belongs to the field of head-up display technology, specifically relating to a head-up display control method and system. Background Technology

[0002] As consumers increasingly demand higher levels of driving safety and experience, HUD (Heads-Up Display) systems have become a popular choice due to their ability to provide rich driving information, reduce the frequency of drivers looking down at the instrument panel, and improve driving safety. However, in vehicles using HUDs, the display quality can be severely affected if an accident occurs resulting in a broken windshield. Specific adverse effects include reduced image clarity, ghosting, or distortion. Degraded display quality means that some important information cannot be displayed correctly, which not only inconveniences drivers but also potentially poses safety hazards. For example, if the HUD projection element corresponding to the broken windshield is the speedometer, the driver may not be able to see the current speed, potentially leading to speeding violations in speed-limited areas. On highways, the inability to obtain real-time speed information is even more dangerous, potentially leading to rear-end collisions.

[0003] In existing technologies, head-up display (HUD) systems do not have corresponding UI element (User Interface) avoidance strategies for windshield breakage. When the windshield breaks, the HUD system continues to operate according to the original display scheme, and key driving information may not be clearly displayed or may be obscured by the broken part, which causes many inconveniences to the driver and poses many potential safety risks to road traffic. Summary of the Invention

[0004] To address the aforementioned technical problems, this application proposes a head-up display control method and system that can effectively adjust the UI elements of the head-up display in real time according to the cracked area of ​​the windshield.

[0005] Specifically, this application proposes a head-up display control method, including:

[0006] Real-time detection of abnormal windshield conditions, and acquisition of abnormal areas of windshield based on the abnormal conditions (S100).

[0007] The abnormal area is mapped onto the head-up display projection screen to determine the UI elements to be adjusted in the head-up display (S200).

[0008] And, the UI element to be adjusted is adjusted based on the preset adjustment rules (S300).

[0009] The aforementioned technical solution enables the UI element layout of the head-up display (HUD) to be adjusted according to the extent of the windshield breakage when the windshield cracks. This ensures that critical driving information is displayed correctly and not obscured by the broken area. This allows the driver to clearly obtain crucial driving information through the HUD even with a broken windshield. By monitoring and adjusting the UI element layout in real time, the system can respond differently to various situations, ensuring the stability and reliability of the HUD and effectively improving vehicle driving safety.

[0010] As one implementation method, the real-time detection of abnormal windshield conditions includes:

[0011] Real-time monitoring of the operating status of multiple resistance sensors in the head-up display area of ​​the windshield.

[0012] When the operating state of any resistance sensor changes, the windshield at the location of the resistance sensor is found to be in an abnormal state.

[0013] By monitoring the operational status of resistance sensors in real time, windshield anomalies can be detected promptly, and warning signals can be issued. The distribution of multiple resistance sensors allows for precise location of the anomaly within the windshield. The system automatically detects changes in the resistance sensor status and reports anomaly information without manual intervention. This reduces manual inspection costs and improves inspection efficiency. It ensures the HUD display area is always in optimal condition, preventing driver distraction or misreading of information due to windshield issues. Ultimately, this enhances driving safety and reduces potential accidents caused by HUD display problems.

[0014] Furthermore, the resistance sensor includes at least a horizontal resistance sensor and a vertical resistance sensor, and the head-up display area is divided into multiple display sub-areas based on the horizontal resistance sensor and the vertical resistance sensor.

[0015] The HUD display area is divided into multiple sub-regions by using lateral and longitudinal resistance sensors, enabling independent monitoring of each sub-region. This allows for more precise location of abnormal areas on the windshield, improving the accuracy of windshield anomaly detection. By detecting changes in different directions using lateral and longitudinal resistance sensors, a multi-dimensional detection network is formed. This ensures comprehensive coverage of the HUD display area, avoiding blind spots in single-direction detection and improving the reliability of windshield anomaly detection. Cross-detection by the lateral and longitudinal resistance sensors allows for precise location of the specific sub-region where the anomaly occurred. Through the division and detection of display sub-regions, the system can better cope with the impact of complex environments on the windshield, enhancing the adaptability and stability of the HUD system in different environments.

[0016] Furthermore, the step of obtaining the abnormal area of ​​the windshield based on the abnormal state includes:

[0017] The positions of the lateral and longitudinal resistance sensors are obtained based on the abnormal state of the windshield.

[0018] Obtain the intersection point of the positions of the lateral resistance sensor and the longitudinal resistance sensor.

[0019] All the display sub-regions containing the intersection points are merged, and the resulting merged region is taken as the abnormal region.

[0020] By using the intersection of the lateral and longitudinal resistance sensor positions, the range of abnormal areas on the windshield can be accurately located, avoiding unnecessary inspections or repairs of the entire windshield and improving anomaly detection efficiency. When the lateral and longitudinal resistance sensors detect new abnormal states, the range of the abnormal area can be dynamically updated, reflecting changes in the windshield's condition in real time and ensuring the stability of the HUD display area. Through the combined processing of intersection points and display sub-regions, irregular or complex-shaped abnormal areas can be detected, adapting to various abnormal states that may occur on the windshield. Cross-validation and combined processing of multi-dimensional sensors avoid false alarms from a single sensor, improving the reliability of windshield anomaly detection.

[0021] Furthermore, determining the UI elements to be adjusted in the header display includes:

[0022] The projected image of the head-up display is divided into multiple grids, and the multiple display sub-regions are mapped to the multiple grids. Based on the mapping relationship between the multiple grids and the abnormal regions in the multiple display sub-regions, the abnormal display grids of the projected image are obtained. Based on the UI elements included in the abnormal display grids, the UI elements to be adjusted are obtained.

[0023] By dividing the head-up display (HUD) projection image into multiple grids and mapping the display sub-areas to the grids, abnormal locations in the HUD projection image can be precisely located. This avoids adjusting the entire HUD image when a windshield malfunctions, improving the accuracy and efficiency of adjustments. Based on the correspondence between the abnormal display grids and UI elements, the UI elements that need adjustment can be quickly identified, reducing system computation and improving system response speed. Furthermore, the gridded division of the HUD projection image allows the system to adapt to HUD display devices with different resolutions, improving system compatibility and applicability.

[0024] Furthermore, after mapping the plurality of display sub-regions to the plurality of grids, the method further includes:

[0025] Based on one or more display sub-regions covered by each grid, obtain the mapping relationship between each grid and the display sub-region.

[0026] By acquiring the mapping relationship between each grid and the display sub-region, when a sub-region on the windshield is cracked, the corresponding grid in the HUD projection can be accurately located, enabling refined management of the HUD projection image. This improves the positioning accuracy of abnormal areas and abnormal projection images. Based on the mapping relationship, UI elements within the abnormal display grid can be precisely adjusted.

[0027] Furthermore, before obtaining the UI element to be adjusted based on the UI elements included in the abnormal display grid, the process further includes:

[0028] The UI elements in the head-up display projection are annotated to obtain all UI elements of the abnormal display grid.

[0029] By annotating UI elements, it becomes possible to accurately identify the UI elements contained in each anomaly display grid. This ensures that when an anomaly occurs in the windshield, the UI elements in the affected area are adjusted accordingly, avoiding accidental adjustments or omissions of critical UI elements. Annotation establishes a clear relationship between UI elements and their respective grid areas, providing a clear data foundation for subsequent UI element adjustments and improving adjustment efficiency. Through annotation, the importance of UI elements can be identified, and these elements can be prioritized for adjustment, ensuring that high-priority information is always visible and improving driving safety.

[0030] Furthermore, the preset adjustment rules include at least:

[0031] Based on the abnormal area, prioritize adjusting the left and right translation of UI elements, and then adjust the up and down translation of UI elements.

[0032] When the UI element is larger than the non-abnormal area, the UI element is scaled until the UI element is smaller than or equal to the non-abnormal area, and then the UI element is adjusted to the non-abnormal area.

[0033] By prioritizing the horizontal translation of UI elements, critical information is ensured to be displayed outside abnormal areas, improving driving safety and preventing driver distraction or misoperation due to information obstruction. Prioritizing horizontal translation, followed by vertical translation, aligns with the human eye's sensitivity to horizontal information, improving adjustment efficiency and reducing impact on the driver's line of sight. When a UI element exceeds the size of a non-abnormal area, the system automatically scales it to fit the available space, ensuring complete display within the limited area, preventing information loss, maximizing the use of display space in non-abnormal areas, optimizing the HUD display effect, and enhancing the user experience.

[0034] Furthermore, the adjustment of the UI element to be adjusted based on preset adjustment rules includes:

[0035] Based on the abnormal display grid and the mapping relationship, the adjustable area of ​​the UI element to be adjusted is obtained.

[0036] The UI elements to be adjusted are adjusted based on the adjustable area and preset adjustment rules.

[0037] Based on the anomaly display grid and mapping relationships, the adjustable areas of UI elements can be accurately determined, avoiding blind adjustments and improving the targeting and efficiency of UI element adjustments. Combining adjustable areas and preset adjustment rules, the optimal adjustment strategy can be selected, ensuring that the UI elements to be adjusted are clearly displayed after adjustment, thus improving driving safety. According to changes in the adjustable areas, the system can dynamically adjust the position and size of UI elements to adapt to various abnormal states that may occur on the windshield. Through optimized utilization of the adjustable areas, the efficiency of the HUD display space is maximized, ensuring that critical information is always clearly visible.

[0038] Furthermore, after adjusting the UI element to be adjusted based on the preset adjustment rules, the process also includes:

[0039] Continuously monitor abnormal areas of the windshield, and adjust the UI elements corresponding to the abnormal areas when the abnormal areas change.

[0040] By continuously monitoring changes in abnormal areas of the windshield and adjusting corresponding UI elements in real time, the system ensures that the HUD display information is always clearly visible, improving driving safety. The continuous monitoring and dynamic adjustment mechanism enables the system to respond quickly to changes in abnormal areas, reducing the loss or obstruction of display information caused by these changes. Adjusting UI elements ensures the continuity of displayed information, improving the system's reliability and stability.

[0041] Based on the same inventive concept, this application also proposes a head-up display control system, which includes at least a domain controller (400), the domain controller (400) being used to acquire an abnormal state of the windshield and adjust the UI elements of the head-up display to be adjusted according to the abnormal state.

[0042] In the above technical solution, the system can detect the windshield status in real time and adjust the UI elements of the head-up display in real time when an abnormal windshield status is detected, ensuring the normal display of the projected image of the head-up display and ensuring that the driver can obtain driving information through the head-up display content, thereby improving the safety of the driving process.

[0043] Furthermore, the domain controller includes at least a memory (410) and a processor (420); the memory (410) is used to store computer instructions for multiple functional layers, the functional layers including at least an adjustment functional layer (411) and a monitoring functional layer (412), each functional layer including one or more functional modules; the processor (420) communicates with the memory (410) via a bus (430) to execute each computer instruction of the functional layer stored in the memory (410).

[0044] Furthermore, the adjustment function layer (411) includes at least an anomaly detection module (4111), a region acquisition module (4112), an element determination module (4113), and an element adjustment module (4114); the anomaly detection module (4111) includes computer instructions for real-time detection of abnormal states of the windshield; the anomaly detection module (4111) provides the abnormal state to the region acquisition module (4112); the region acquisition module (4112) includes computer instructions for acquiring abnormal regions of the windshield based on the abnormal state; the region acquisition module (4112) provides the abnormal region to the element determination module (4113); the element determination module (4113) includes computer instructions for mapping the abnormal region onto the head-up display projection screen to determine the UI elements to be adjusted in the head-up display; and the element adjustment module (4114) includes computer instructions for adjusting the UI elements to be adjusted based on preset adjustment rules.

[0045] Furthermore, the monitoring function layer (412) includes a continuous monitoring module (4121), which includes computer instructions for continuously monitoring abnormal areas of the windshield and adjusting the UI elements corresponding to the abnormal areas when the abnormal areas change.

[0046] Furthermore, the head-up display control system also includes a resistance sensor (500), which is used to acquire the windshield status and send the windshield status as input data to the anomaly detection module (4111) and the continuous monitoring module (4121).

[0047] Compared with the prior art, this application has at least the following beneficial effects:

[0048] This application enables the rapid adjustment of the UI element layout of the head-up display (HUD) projection image based on the severity of an anomaly, such as a crack, in the windshield of a vehicle. This ensures that critical driving information is displayed correctly without being obstructed by the cracked area. Even with a cracked windshield, the driver can still clearly, quickly, and accurately obtain the necessary information through the HUD system, improving driving convenience and comfort, aligning with modern automotive demands for user-friendliness and interactive experience, while also ensuring the safety of the driver and passengers. Furthermore, this application can also handle other anomalies that may obstruct the HUD display, extending beyond windshield crack scenarios. By monitoring and dynamically adjusting the UI element layout in real time, the system can flexibly respond to different situations, maintaining the stability and reliability of the HUD display function. Attached Figure Description

[0049] Figure 1 is a flowchart illustrating a head-up display control method according to an embodiment of this application.

[0050] Figure 2 is a schematic diagram of the display sub-region shown in an embodiment of this application.

[0051] Figure 3 is a schematic diagram of the abnormal area shown in an embodiment of this application.

[0052] Figure 4 is a schematic diagram of mesh mapping shown in an embodiment of this application.

[0053] Figure 5 is a schematic diagram of a head-up display control system according to an embodiment of this application.

[0054] Figure 6 is a schematic diagram of the domain controller structure shown in an embodiment of this application.

[0055] Figure 7 is a schematic diagram of the memory structure shown in an embodiment of this application. Detailed Implementation

[0056] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those of ordinary skill in the art without creative effort are within the scope of protection of this application.

[0057] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this application described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or server that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or devices.

[0058] Example 1:

[0059] Please refer to Figure 1. The head-up display control method mainly includes steps S100 to S300.

[0060] Step S100 includes: real-time detection of abnormal windshield conditions to identify abnormal areas of the windshield based on these abnormal conditions. The abnormal conditions of the windshield can be at least a crack, but are not limited to this. For example, the abnormal conditions may also include localized obstruction due to rain or dust accumulation, abnormal reflectivity in localized areas due to prolonged use, or slight deformation in localized areas due to large temperature differences between the inside and outside of the vehicle. The abnormal conditions of the windshield can be detected primarily using a resistance sensor. When a change in the resistance value of the sensor is detected in a localized area, it is determined that an abnormal condition has occurred in that area of ​​the windshield. The area where the resistance value of the resistance sensor changes is designated as the abnormal area of ​​the windshield.

[0061] Step S200 includes: mapping the abnormal area onto the projected image of the head-up display to determine the UI elements to be adjusted in the head-up display. Specifically, by mapping the abnormal area onto the projected image of the head-up display, a mapping relationship between the abnormal area and the projected image is obtained; based on the mapping relationship, an abnormal projected image in the projected image is obtained; and the UI elements in the abnormal projected image are used as the UI elements to be adjusted.

[0062] Furthermore, step S300 includes: adjusting the UI element to be adjusted based on a preset adjustment rule. Since the human eye is more sensitive to horizontal information, the preset adjustment rule can be set to prioritize horizontal translation of the UI element to be adjusted in abnormal areas, followed by vertical translation. To fully utilize the available area, when the UI element to be adjusted is larger than the non-abnormal area, the UI element can be scaled until it is smaller than or equal to the non-abnormal area, at which point the UI element is adjusted to the non-abnormal area.

[0063] In practice, the resistance value of the built-in resistance sensor in the windshield can be monitored in real time. If the resistance value remains stable, the windshield is considered to be normal; if the resistance value changes, an abnormality is identified. The location of the resistance sensor where the resistance value changes is used to identify the abnormal area of ​​the windshield. When an abnormality is detected, the identified abnormal area is mapped onto the head-up display (HUD) projection. Based on the mapping between the abnormal area and the HUD projection, an abnormal projection image is obtained, and the UI elements in this image are selected as UI elements to be adjusted. The UI elements to be adjusted are preferably shifted horizontally or vertically to a non-abnormal area, or scaled to ensure they are located within a non-abnormal area.

[0064] In some embodiments, the specific circumstances under which the windshield malfunctions may include: temperature changes causing the internal resistance sensor of the windshield to fail; moisture or water entering the glass interlayer causing the internal resistance sensor of the windshield to fail; and external electromagnetic interference sources, such as high-voltage power lines or wireless equipment, interfering with the normal operation of the internal resistance sensor of the windshield. These abnormalities can all lead to abnormal display of key driving information projected by the head-up display system.

[0065] Poor sealing or damage to the windshield can allow moisture or water to enter the glass interlayer, causing malfunctions in the lateral and longitudinal resistance sensors inside the windshield. This alteration in the resistance of the sensors can lead to blurry, ghosting, or distorted images on the head-up display (HUD). In this case, the abnormal area of ​​the windshield can be identified by detecting the resistance values ​​of the resistance sensors. This abnormal area is then mapped onto the HUD projection, and UI elements in the projection affected by the windshield malfunction are selected. Finally, the selected UI elements are adjusted according to preset adjustment rules until they are fully displayed in the area of ​​the windshield where no malfunction has occurred.

[0066] In some embodiments, the real-time detection of abnormal windshield conditions includes:

[0067] Real-time monitoring of the operating status of multiple resistance sensors in the head-up display area of ​​the windshield.

[0068] When the operating state of any resistance sensor changes, the windshield at the location of the resistance sensor is found to be in an abnormal state.

[0069] Referring to Figure 2, multiple resistance sensors are embedded within a fixed head-up display area in the windshield. The number of resistance sensors can be set according to specific circumstances and is not limited. For example, as shown in Figure 2, the number of resistance sensors can be set to 15. The area where the resistance sensors are located can completely cover the head-up display area in the windshield. When the operating state of any resistance sensor changes, i.e., when the resistance value of the resistance sensor changes, it is determined that an abnormal state has occurred in the windshield at the location of that resistance sensor. For example, if the resistance value of the resistance sensor labeled h in Figure 2 changes, it is determined that an abnormal state has occurred in the windshield at the location of resistance sensor h.

[0070] Optionally, the resistance sensor includes at least a lateral resistance sensor and a longitudinal resistance sensor, and the head-up display area is divided into multiple display sub-areas based on the lateral resistance sensor and the longitudinal resistance sensor.

[0071] As shown in Figure 2, y1 to y6 are horizontal resistance sensors, and x1 to x4 are vertical resistance sensors. Based on these horizontal and vertical resistance sensors, the fixed head-up display area in the windshield is divided into a to o display sub-areas.

[0072] Optionally, obtaining the abnormal area of ​​the windshield based on the abnormal state includes:

[0073] The positions of the lateral and longitudinal resistance sensors are obtained based on the abnormal state of the windshield.

[0074] Obtain the intersection point of the positions of the lateral resistance sensor and the longitudinal resistance sensor.

[0075] All the display sub-regions containing the intersection points are merged, and the resulting merged region is taken as the abnormal region.

[0076] When an abnormal state is detected in the windshield, the corresponding positions of the lateral and longitudinal resistance sensors are obtained based on this abnormal state. Referring to Figure 3, a change in the resistance values ​​of longitudinal resistance sensors x2 and x3 and lateral resistance sensors y3, y4, y5 is detected, indicating an abnormal position for these sensors. The intersection points of the lateral and longitudinal resistance sensor positions are obtained, as shown by the "×" in Figure 3. The display sub-regions containing these intersection points are then merged, and this merged region is designated as the abnormal region. For example, the display sub-regions d, e, f, g, h, i, j, k, l, m, n, and o in Figure 3 are merged to represent the abnormal region of the windshield.

[0077] Optionally, determining the UI elements to be adjusted in the header display includes:

[0078] The projected image of the head-up display is divided into multiple grids, and the multiple display sub-regions are mapped to the multiple grids; based on the mapping relationship between the multiple grids and the abnormal regions in the multiple display sub-regions, the abnormal display grids of the projected image are obtained; based on the UI elements included in the abnormal display grids, the UI elements to be adjusted are obtained.

[0079] Referring to Figure 4, the head-up display projection image can be divided into multiple grids of the same size. Each grid is labeled with an identifier, i.e., multiple grids from A to O in Figure 4. The display sub-regions from a to o of the fixed head-up display area in the windshield are mapped to these multiple grids from A to O. The mapping relationship between the display sub-regions and the grids is obtained. Based on the mapping relationship and the abnormal areas in the display sub-regions, abnormal display grids are obtained. UI elements in the abnormal display grids are identified as UI elements to be adjusted.

[0080] Optionally, after mapping the plurality of display sub-regions to the plurality of grids, the method further includes:

[0081] Based on one or more display sub-regions covered by each grid, obtain the mapping relationship between each grid and the display sub-region.

[0082] As shown in Figure 4, after mapping the display sub-area to the head-up display projection screen, the corresponding mapping relationship is obtained through one or more display sub-areas covered by each grid. Based on the display sub-areas covered by each grid, the obtained mapping relationship between the grid and the display sub-area can be: A(a, b, d, e), B(b, e), C(c, f), D(d, e, g, h), E(e, h), F(f, i), G(g, h, j, k), H(h, k), I(i, l), J(j, k, m, n), K(k, n), L(l, o), M(m, n), N(n), O(o).

[0083] Optionally, before obtaining the UI element to be adjusted based on the UI elements included in the abnormal display grid, the method further includes:

[0084] The UI elements in the head-up display projection are annotated to obtain all UI elements of the abnormal display grid.

[0085] For example, the UI element for displaying vehicle speed can be labeled. The grid occupied by the UI element for displaying vehicle speed can be J, K, L, M, N, O. When the windshield corresponding to any of the grids is in an abnormal state, such as being broken, the UI element for displaying vehicle speed can be adjusted to a non-abnormal area, which can effectively prevent the display of vehicle speed from being unclear.

[0086] Optionally, the preset adjustment rules include at least:

[0087] Based on the abnormal area, prioritize adjusting the left and right translation of UI elements, and then adjust the up and down translation of UI elements.

[0088] When the UI element is larger than the non-abnormal area, the UI element is scaled until the UI element is smaller than or equal to the non-abnormal area, and then the UI element is adjusted to the non-abnormal area.

[0089] For example, if a crack appears on the left side of the windshield, obscuring the vehicle speed display area in the HUD projection, the system first shifts the speed display information to the right to avoid the abnormal area on the left. If neither the left nor right side can completely avoid the abnormal area, the system then adjusts the vehicle speed display information to shift it up or down to avoid the abnormal area. If the speed display information is still larger than the non-abnormal area after shifting, the system scales the speed display information to fit the currently available area, ensuring the driver can clearly read the speed information.

[0090] Optionally, adjusting the UI element to be adjusted based on preset adjustment rules includes:

[0091] Based on the abnormal display grid and the mapping relationship, the adjustable area of ​​the UI element to be adjusted is obtained.

[0092] The UI elements to be adjusted are adjusted based on the adjustable area and preset adjustment rules.

[0093] For example, when a crack is detected on the left side of the windshield, covering the vehicle speed display area in the head-up display projection, based on the abnormal display grid and mapping relationship on the left side of the windshield, the adjustable area of ​​the vehicle speed display area is determined to be the non-abnormal area on the right. Based on the non-abnormal area on the right and the preset adjustment rules, the vehicle speed display is controlled to shift to the right until the vehicle speed display is adjusted to the non-abnormal area on the right. If the space in the non-abnormal area on the right is insufficient, the vehicle speed display is shrunk to fit the currently available area.

[0094] Optionally, after adjusting the UI element to be adjusted based on preset adjustment rules, the method further includes:

[0095] Continuously monitor abnormal areas of the windshield, and adjust the UI elements corresponding to the abnormal areas when the abnormal areas change.

[0096] For example, if an anomaly occurs on the left side of the windshield, such as a crack, the speed display covering the abnormal area will be shifted to the right to avoid the abnormal area. By continuously monitoring the abnormal area of ​​the windshield, when the abnormal area begins to expand, for example, if the abnormal area expands to the right and covers the speed display area, the speed display information will be further shifted to the right to avoid the expanded abnormal area, ensuring that the driver can clearly read the speed information.

[0097] Example 2:

[0098] Referring to Figure 5, this application also proposes a head-up display control system, which includes at least a domain controller (400). The domain controller (400) is used to acquire the abnormal state of the windshield and adjust the UI elements of the head-up display to be adjusted according to the abnormal state.

[0099] Referring to Figure 6, the domain controller (400) includes at least a memory (410) and a processor (420); the memory (410) is used to store computer instructions for multiple functional layers, the functional layers including at least an adjustment functional layer (411) and a monitoring functional layer (412), each functional layer including one or more functional modules; the processor (420) communicates with the memory (410) via a bus (430) to execute each computer instruction of the functional layer stored in the memory (410).

[0100] The memory (410) includes, but is not limited to, RAM (Random Access Memory), ROM (Read-Only Memory), EPROM (Erasable Programmable Read-Only Memory), and CD-ROM (Compact Disc Read-Only Memory); the processor (420) includes a central processing unit or a device or module with processing capabilities.

[0101] Furthermore, referring to Figure 7, the adjustment function layer (411) includes at least an anomaly detection module (4111), a region acquisition module (4112), an element determination module (4113), and an element adjustment module (4114).

[0102] The anomaly detection module (4111) includes computer instructions for real-time detection of anomalies in the windshield; the anomaly detection module (4111) provides the anomaly status to the region acquisition module (4112); the region acquisition module (4112) includes computer instructions for acquiring an anomaly region of the windshield based on the anomaly status; the region acquisition module (4112) provides the anomaly region to the element determination module (4113); the element determination module (4113) includes computer instructions for mapping the anomaly region onto the head-up display projection screen to determine the UI elements to be adjusted in the head-up display; and the element adjustment module (4114) includes computer instructions for adjusting the UI elements to be adjusted based on preset adjustment rules.

[0103] The domain controller (400) uses the specific implementation method of Embodiment 1 to detect abnormal states of the windshield and adjust the UI elements to be adjusted in the head-up display.

[0104] The monitoring function layer (412) includes a continuous monitoring module (4121), which includes computer instructions for continuously monitoring abnormal areas of the windshield and adjusting the UI elements corresponding to the abnormal areas when the abnormal areas change.

[0105] Furthermore, the head-up display control system also includes a resistance sensor (500), which is used to acquire the windshield status and send the windshield status as input data to the anomaly detection module (4111) and the continuous monitoring module (4121). The resistance sensor may include at least a lateral resistance sensor and a longitudinal resistance sensor, which accurately acquire the location where the windshield anomaly occurs.

[0106] In summary, this application enables rapid adjustment of the UI element layout of the head-up display (HUD) projection image based on the damage to the windshield, such as a crack, ensuring that critical driving information is displayed correctly without being obstructed by the cracked area. Even with a cracked windshield, the driver can still clearly, quickly, and accurately obtain the necessary information through the HUD system, improving driving convenience and comfort, meeting modern automotive demands for user-friendliness and interactive experience, while also ensuring the safety of the driver and passengers. Furthermore, this application can also handle other abnormal situations that may obstruct the HUD display, not just scenarios involving a cracked windshield. By monitoring and dynamically adjusting the UI element layout in real time, the system can flexibly respond to different situations, maintaining the stability and reliability of the HUD display function.

[0107] In the several embodiments provided in this application, it will be understood that each block in the flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions marked in the blocks may occur in a different order than those shown in the figures. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved.

[0108] If the aforementioned functions are implemented as software functional modules and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause an electronic device to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0109] The specific embodiments described above further illustrate the purpose, technical solution, and beneficial effects of this application. It should be understood that the above descriptions are merely specific embodiments of this application and are not intended to limit the scope of protection of this application. In particular, it should be noted that any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the scope of protection of this application for those skilled in the art.

Claims

1. A head-up display control method, wherein, The method comprises: real-time detecting an abnormal state of a windshield, to obtain an abnormal area of the windshield based on the abnormal state (S100); mapping the abnormal area to a projection picture of a head-up display, to determine a UI element to be adjusted of the head-up display (S200); and adjusting the UI element to be adjusted based on a preset adjustment rule (S300).

2. The head-up display control method according to claim 1, wherein The real-time detecting of the abnormal state of the windshield comprises: real-time detecting working states of a plurality of resistance sensors in a head-up display area of the windshield; when a working state of any resistance sensor changes, determining that the windshield at the position of the resistance sensor has an abnormal state.

3. The head-up display control method according to claim 2, wherein The resistance sensors comprise at least a transverse resistance sensor and a longitudinal resistance sensor, and the head-up display area is divided into a plurality of display sub-areas based on the transverse resistance sensor and the longitudinal resistance sensor.

4. The head-up display control method according to claim 3, wherein The obtaining of the abnormal area of the windshield based on the abnormal state comprises: obtaining corresponding transverse resistance sensor positions and longitudinal resistance sensor positions based on the abnormal state of the windshield; obtaining intersection points of the transverse resistance sensor positions and the longitudinal resistance sensor positions; collecting display sub-areas where all the intersection points are located, to obtain a collection area as the abnormal area.

5. The head-up display control method according to claim 4, wherein The determining of the UI element to be adjusted of the head-up display comprises: dividing the projection picture of the head-up display into a plurality of grids, and mapping the plurality of display sub-areas to the plurality of grids; obtaining an abnormal display grid of the projection picture based on a mapping relationship between the plurality of grids and the abnormal area in the plurality of display sub-areas; obtaining the UI element to be adjusted according to UI elements included in the abnormal display grid.

6. The head-up display control method according to claim 5, wherein After the mapping of the plurality of display sub-areas to the plurality of grids, the method further comprises: obtaining a mapping relationship between each grid and a display sub-area based on one or more display sub-areas covered by each grid.

7. The head-up display control method according to claim 5, wherein Before the obtaining of the UI element to be adjusted according to UI elements included in the abnormal display grid, the method further comprises: annotating UI elements in the projection picture of the head-up display, to obtain all the UI elements of the abnormal display grid.

8. The head-up display control method according to claim 5, wherein The preset adjustment rule comprises at least: preferentially adjusting left-right translation of a UI element in the abnormal area, and secondarily adjusting up-down translation of the UI element; when the UI element is larger than a non-abnormal area, performing scaling processing on the UI element until the UI element is smaller than or equal to the non-abnormal area, and adjusting the UI element to the non-abnormal area.

9. The head-up display control method according to claim 6, wherein The adjusting of the UI element to be adjusted based on the preset adjustment rule comprises: obtaining an adjustable area of the UI element to be adjusted based on the abnormal display grid and the mapping relationship; and adjusting the UI element to be adjusted based on the adjustable area and the preset adjustment rule.

10. The head-up display control method according to claim 1, wherein After the adjusting of the UI element to be adjusted based on the preset adjustment rule, the method further comprises: continuously monitoring the abnormal area of the windshield, and adjusting a UI element corresponding to the abnormal area when the abnormal area changes.

11. A heads-up display control system, wherein, At least comprising a domain controller (400), the domain controller (400) is configured to acquire an abnormal state of a windshield, and adjust a UI element to be adjusted of a head-up display according to the abnormal state.

12. The head-up display control system of claim 11, wherein, The domain controller at least comprises a memory (410) and a processor (420); The memory (410) is configured to store computer instructions of a plurality of function layers, the function layers at least comprising an adjustment function layer (411) and a monitoring function layer (412), each function layer comprising one or more function modules; The processor (420) is configured to execute each computer instruction of the function layers stored in the memory (410) through a bus (430) in communication with the memory (410).

13. The head-up display control system of claim 12, wherein, The adjustment function layer (411) at least comprises an abnormality detection module (4111), a region acquisition module (4112), an element determination module (4113), and an element adjustment module (4114); The abnormality detection module (4111) comprises computer instructions for detecting an abnormal state of a windshield in real time; the abnormality detection module (4111) provides the abnormal state to the region acquisition module (4112); The region acquisition module (4112) comprises computer instructions for acquiring an abnormal region of the windshield based on the abnormal state; the region acquisition module (4112) provides the abnormal region to the element determination module (4113); The element determination module (4113) comprises computer instructions for mapping the abnormal region to a projection picture of the head-up display to determine a UI element to be adjusted of the head-up display; And the element adjustment module (4114) comprises computer instructions for adjusting the UI element to be adjusted based on a preset adjustment rule.

14. The head-up display control system of claim 13, wherein, The monitoring function layer (412) comprises a continuous monitoring module (4121), the continuous monitoring module (4121) comprises computer instructions for continuously monitoring the abnormal region of the windshield, and adjusting a UI element corresponding to the abnormal region when the abnormal region changes.

15. The head-up display control system of claim 14, wherein, The head-up display control system further comprises a resistance sensor (500), the resistance sensor is configured to acquire a windshield state, and deliver the windshield state as input data to the abnormality detection module (4111) and the continuous monitoring module (4121).

Images