Head-up display method and device, vehicle, electronic equipment and storage medium
By dynamically adjusting the display position of the function mark in AR-HUD, the interference between UI mark and real road conditions is solved, and driving safety and user experience are improved.
Patent Information
- Application Number
- CN202310526480.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-05-10
- Publication Date
- 2024-11-12
AI Technical Summary
The UI logos in existing augmented reality head-up displays (AR-HUDs) may be confused with real road conditions or interfere with each other, resulting in visual confusion and affecting the HUD usage experience and driving safety.
By obtaining driving scene information, we can judge the relationship or complexity between the functional marker and road condition information, and dynamically adjust the display position of the marker on the close-up or long-range display layer to ensure the clarity of the marker.
It effectively avoids identification interference, improves users' visibility and driving safety of functional identification, and improves the HUD usage experience.
Smart Images

Figure CN118938473A_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to the field of display technology, and in particular to a head-up display method, device, vehicle, electronic device and storage medium. Background Art
[0002] In some functions of the far layer (AR layer) display of the existing augmented reality head-up display (AR-HUD), AR real-time fusion displays UI logos (such as UI logos for calibrating objects). However, the UI logos may be confused with the actual road conditions, or interfere with the instrument information displayed in the near layer, causing visual confusion and affecting the HUD usage experience and driving safety. Summary of the invention
[0003] The purpose of the embodiments of the present disclosure is to provide a head-up display method, device, vehicle, electronic device and storage medium, which can solve the technical problem in the prior art that UI logos displayed on the head-up display interfere with other logos or real road conditions, causing visual confusion and affecting the HUD usage experience and driving safety.
[0004] In order to solve the above technical problems, the embodiments of the present disclosure adopt the following technical solutions:
[0005] A head-up display method, applied to a first vehicle, comprising:
[0006] Acquire current driving scene information of the first vehicle, where the driving scene information includes travel information of the first vehicle and road condition information around the first vehicle;
[0007] Determining whether a function identifier displayed on a head-up display of the first vehicle has a preset association relationship with the road condition information, or determining whether the complexity of the road condition information meets a preset condition, wherein the function identifier is determined according to the driving information and / or the road condition information;
[0008] If so, determine the display position of the function identifier on the head-up display according to the association relationship or the road condition information.
[0009] In some embodiments, the function identifier includes at least one of a mark identifier of a target object in a road scene where the first vehicle is located, a driving prompt identifier of the first vehicle, a mark identifier of lane information of a road where the first vehicle is located, a mark identifier of traffic information around the first vehicle, and a navigation prompt identifier of the first vehicle;
[0010] The target object includes an obstacle located in front of the first vehicle and / or a point of interest in a road environment where the first vehicle is located.
[0011] In some embodiments, determining the display position of the function identifier on the head-up display according to the association relationship or the road condition information includes:
[0012] Displaying the function identifier on a near-view display layer or a far-view display layer of the head-up display according to the association relationship or the road condition information; or
[0013] The display layer of the function identifier is switched according to the association relationship or the road condition information.
[0014] In some embodiments, the near-view display layer is a plane display layer, the plane display layer displays a road condition rendering image rendered according to the driving scene information, and the function identifier is displayed at a corresponding position of the road condition rendering image;
[0015] The distant view display layer is an AR display layer, and the function identifier is fused with the real driving scene information for rendering and display.
[0016] In some embodiments, the method further comprises:
[0017] The display parameters of the function identifier are adjusted according to the display position of the function identifier.
[0018] In some embodiments, determining whether there is a preset association relationship between the function identifier displayed on the head-up display of the first vehicle and the road condition information includes:
[0019] Determining whether the distance between the first vehicle and the target object meets a preset distance condition; and / or
[0020] Determining whether the display characteristics of the functional identifier are the same as or similar to the display characteristics of the target object; and / or
[0021] Determine whether the function identifier is blocked by an obstacle in the road scene.
[0022] In some embodiments, the target object is a moving obstacle located in front of the first vehicle, the functional identifier is a marking identifier of the target object, and the distance between the first vehicle and the target object satisfies a preset distance condition.
[0023] Determining the display position of the function identifier on the head-up display according to the association relationship includes: determining the display position of the function identifier according to the distance between the first vehicle and the target object; wherein,
[0024] If the distance between the first vehicle and the target object is within a first distance range, displaying the function identifier on the near-view display layer;
[0025] If the distance between the first vehicle and the target object is within a second distance range, displaying the function identifier in the distant view display layer, wherein the second distance range is greater than the first distance range;
[0026] If the distance between the first vehicle and the target object is close to the maximum distance threshold of the first distance range or the maximum distance threshold of the second distance range, the function identifier is gradually transitioned from the current first display layer to the second display layer, wherein the first display layer is one of the near-view display layer and the distant view display layer, and the second display layer is the other of the near-view display layer and the distant view display layer.
[0027] In some embodiments, the target object is a point of interest in a road scene where the first vehicle is located, the function identifier is a mark identifier of the point of interest, and the distance between the first vehicle and the target object meets a preset distance condition.
[0028] Determining the display position of the function identifier on the head-up display according to the association relationship includes: determining the display position of the function identifier according to the distance between the first vehicle and the target object; wherein,
[0029] If the distance between the first vehicle and the target object is within a third distance range, displaying the function identifier on the near-view display layer, and the function identifier gradually moves from the front of the first vehicle to the rear of the first vehicle as the first vehicle moves forward;
[0030] If the distance between the first vehicle and the target object is within a fourth distance range, displaying the function identifier on the distant view display layer, and the function identifier is gradually enlarged or clearly displayed as the distance between the first vehicle and the target object decreases, and the fourth distance range is greater than the third distance range;
[0031] If the distance between the first vehicle and the target object is within a fifth distance range, displaying the function identifier on the distant view display layer, and the function identifier gradually changes from a simple display to a detailed display as the distance between the first vehicle and the target object decreases, and the fifth distance range is greater than the fourth distance range;
[0032] If the distance between the first vehicle and the target object gradually decreases to a minimum distance threshold within the fourth distance range, when the distance between the first vehicle and the target object approaches the minimum distance threshold, the function identifier is displayed close to the FOV boundary of the distant display layer, and when the distance between the first vehicle and the target object is the minimum distance threshold, the function identifier is hidden.
[0033] In some embodiments, determining whether the complexity of the road condition information meets a preset condition includes:
[0034] Determining whether the number of obstacles in the road scene exceeds a preset threshold; and / or
[0035] Determine whether the lane information or traffic information in the road condition information and an obstacle in the road scene where the first vehicle is located obstruct each other.
[0036] In some embodiments, determining the display position of the function identifier on the head-up display according to the road condition information includes:
[0037] If the lane information or traffic information in the road condition information and an obstacle in the road scene where the first vehicle is located are mutually blocked, and the mutual blocking situation lasts for a preset time, displaying the function identifier in the distant view display layer;
[0038] If the lane information or traffic information does not block any obstacle in the road scene where the first vehicle is located, displaying the function identifier in the near-view display layer; and / or
[0039] The display layer of the function indicator is switched according to changes in the mutual occlusion between the lane information or the traffic information and obstacles in the road scene where the first vehicle is located.
[0040] The present disclosure also provides a head-up display device, including:
[0041] an acquisition module, configured to acquire current driving scene information of the first vehicle, the driving scene information including travel information of the first vehicle and road condition information around the first vehicle;
[0042] a determination module configured to determine whether a function identifier displayed on a head-up display of the first vehicle has a preset association relationship with the road condition information, or to determine whether the complexity of the road condition information meets a preset condition, wherein the function identifier is determined according to the driving information and / or the road condition information;
[0043] The determination module is configured to determine the display position of the function identifier on the head-up display according to the association relationship or the road condition information if there is a preset association relationship between the function identifier displayed on the head-up display of the first vehicle and the road condition information, or the complexity of the road condition information meets a preset condition.
[0044] The disclosed embodiment also provides a means of transportation, comprising the above-mentioned head-up display device.
[0045] An embodiment of the present disclosure further provides an electronic device, comprising at least a memory and a processor, wherein the memory stores a computer program, and the processor implements the steps of the above method when executing the computer program in the memory.
[0046] The embodiment of the present disclosure further provides a computer-readable storage medium, wherein the computer-readable medium stores a computer program, and when the computer program is executed by a processor, the steps of the above method are implemented.
[0047] The head-up display method, device, vehicle, electronic device and storage medium provided by the embodiments of the present disclosure obtain the current driving scene information of the first vehicle during the driving of the first vehicle, and judge whether there is a preset correlation between the function identifier displayed on the head-up display of the first vehicle and the road condition information, or judge whether the complexity of the road condition information meets the preset conditions, so as to determine whether the function identifier exists or may be interfered with or interfere with the road condition information, and then determine the display position of the function identifier on the head-up display according to the interference situation of the function identifier, so that the user can always clearly see the function identifier displayed on the head-up display during the driving of the first vehicle, so as to facilitate the user to quickly obtain information, improve the user's HUD usage experience, and improve the user's driving safety. BRIEF DESCRIPTION OF THE DRAWINGS
[0048] In order to more clearly illustrate the embodiments of the present disclosure or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.
[0049] Figure 1 is a flow chart of a head-up display method according to an embodiment of the present disclosure;
[0050] Figure 2 A schematic diagram of displaying a near-view display layer and a far-view display layer of a head-up display according to an embodiment of the present disclosure;
[0051] Figure 3 A schematic diagram of determining the display position of a function identifier in the first display method of an embodiment of the present disclosure;
[0052] Figure 4 A first display schematic diagram of a function identifier on a head-up display in a first display method of an embodiment of the present disclosure;
[0053] Figure 5 This is a second display schematic diagram of a function identifier on a head-up display in the first display method of an embodiment of the present disclosure;
[0054] Figure 6 A schematic diagram of determining the display position of a function identifier in the second display method of an embodiment of the present disclosure;
[0055] Figure 7 This is a first display schematic diagram of a function identifier on a head-up display in a second display method of an embodiment of the present disclosure;
[0056] Figure 8 A second display schematic diagram of a function identifier on a head-up display in a second display method of an embodiment of the present disclosure;
[0057] Fig. 9 This is a third display schematic diagram of a function identifier on a head-up display in the second display method of an embodiment of the present disclosure;
[0058] Fig.10 This is a fourth display schematic diagram of a function identifier on a head-up display in the second display method of an embodiment of the present disclosure;
[0059] Fig.11 This is a fifth display schematic diagram of a function identifier on a head-up display in the second display method of an embodiment of the present disclosure;
[0060] Fig.12 This is a sixth display schematic diagram of a function identifier on a head-up display in the second display method of an embodiment of the present disclosure;
[0061] Fig.13 This is a first display schematic diagram of a function identifier on a head-up display in a third display method of an embodiment of the present disclosure;
[0062] Fig.14 This is a second display schematic diagram of a function identifier on a head-up display in a third display method of an embodiment of the present disclosure;
[0063] Fig.15 Schematic diagram of the structure of the head-up display device according to an embodiment of the present disclosure. DETAILED DESCRIPTION
[0064] Various aspects and features of the present disclosure are described herein with reference to the drawings.
[0065] It should be understood that various modifications may be made to the embodiments of the present application. Therefore, the above description should not be considered as limiting, but only as an example of an embodiment. Other modifications within the scope and spirit of the present disclosure will occur to those skilled in the art.
[0066] The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate embodiments of the present disclosure and, together with the general description of the present disclosure given above and the detailed description of the embodiments given below, serve to explain the principles of the present disclosure.
[0067] These and other characteristics of the present disclosure will become apparent from the following description of a preferred form of embodiment given as a non-limiting example, with reference to the attached drawings.
[0068] It should also be understood that, although the present disclosure has been described with reference to some specific examples, those skilled in the art will be able to realize many other equivalent forms of the present disclosure that have the features described in the claims and are therefore within the scope of protection defined thereby.
[0069] The above and other aspects, features and advantages of the present disclosure will become more apparent from the following detailed description when taken in conjunction with the accompanying drawings.
[0070] Specific embodiments of the present disclosure are described hereinafter with reference to the accompanying drawings; however, it should be understood that the embodiments claimed are merely examples of the present disclosure, which may be implemented in a variety of ways. Well-known and / or repeated functions and structures are not described in detail to avoid obscuring the present disclosure with unnecessary or redundant details. Therefore, the specific structural and functional details claimed herein are not intended to be limiting, but merely serve as a basis and representative basis for the claims to teach those skilled in the art to use the present disclosure in a variety of ways with substantially any suitable detailed structure.
[0071] This specification may use the phrases "in one embodiment," "in another embodiment," "in a further embodiment," or "in other embodiments," all of which may refer to one or more of the same or different embodiments according to the present disclosure.
[0072] Figure 1 A flow chart of the head-up display method of an embodiment of the present disclosure is shown. Figure 1 As shown, an embodiment of the present disclosure provides a head-up display method, which is applied to a first vehicle, and the method includes:
[0073] S101: Acquire current driving scene information of a first vehicle, where the driving scene information includes travel information of the first vehicle and road condition information around the first vehicle.
[0074] Among them, the driving information of the first vehicle includes vehicle information and current driving status information of the first vehicle, the vehicle information includes vehicle model, engine model, etc., the current driving status information includes vehicle speed, engine speed, fuel consumption, speed limit warning, fatigue driving warning, water temperature alarm and other information of the first vehicle, and the driving information of the first vehicle can be obtained through the vehicle's electronic controller unit (ECU).
[0075] The road condition information around the first vehicle includes the position and speed information of the vehicle in front of the first vehicle, speed limit signs, obstacle (including vehicles and pedestrians) / hazardous object information, lane line information (including lane line type, lane line fit information, lane departure warning prompt information, etc.), signal light status information, navigation information, etc. The navigation information may include route guidance information, destination information and coordinate information relative to the first vehicle, navigation arrow form information, navigation remaining distance information, navigation remaining time information, etc. The road condition information around the first vehicle can be collected and acquired by a collection device such as a camera, a sensor (such as a laser radar) set on the first vehicle.
[0076] S102: Determine whether there is a preset association between a function identifier displayed on the head-up display of the first vehicle and the road condition information, or determine whether the complexity of the road condition information meets a preset condition, wherein the function identifier is determined based on the driving information and / or the road condition information.
[0077] The function logo is a virtual logo (UI logo) displayed on the head-up display after rendering. The function logo is determined according to the driving information and / or the road condition information in the driving scene information to achieve different functions. For example, the function logo can be used for the front vehicle locking, obstacle collision reminder, ACC (automatic following system) following distance control, lane line pressure reminder, POI (Point of Interest) reminder and other functions.
[0078] The functional identification may specifically include at least one of a marking identification of a target object in the road scene where the first vehicle is located, a driving prompt identification of the first vehicle, a marking identification of lane information of the road where the first vehicle is located, a marking identification of traffic information around the first vehicle, and a navigation prompt identification of the first vehicle.
[0079] The target object includes an obstacle located in front of the first vehicle, and / or a POI in the road environment where the first vehicle is located; the obstacle includes a fixed obstacle such as a roadblock, and a mobile obstacle such as a second vehicle and pedestrians in front. Exemplarily, the mark identification of the target object in the road scene where the first vehicle is located includes a front vehicle lock identification, a mark identification of an object close to the vehicle during vehicle following detection, an obstacle reminder identification, etc. The driving prompt identification of the first vehicle includes an instrument information identification (such as vehicle speed), a distance information identification (such as the distance to the front vehicle, which can be directly displayed as a digital driving display), a line-crossing situation identification, a lane departure identification, etc. The marking identification of the lane information of the road where the first vehicle is located includes identifications such as lane names and lane translation information. The marking identification of the traffic information around the first vehicle includes marking identifications of signal lights such as traffic lights and marking identifications of speed limit signs, etc. The navigation prompt identification of the first vehicle includes identifications such as navigation arrows (such as navigation information under hidden exit conditions).
[0080] In step S102, by determining whether there is a preset association relationship between the function identifier displayed on the head-up display of the first vehicle and the road condition information, it can be determined whether the currently displayed function identifier is blocked or interfered with, etc., which affects the user's ability to see the function identifier clearly. If there is a preset association relationship between the function identifier displayed on the head-up display of the first vehicle and the road condition information, it is determined that the road condition information will interfere with the display of the function identifier; if there is no preset association relationship between the function identifier displayed on the head-up display of the first vehicle and the road condition information, it is determined that the road condition information will not interfere with the display of the function identifier, that is, the road condition information does not affect the normal display of the function identifier on the head-up display.
[0081] For example, when the first vehicle locks the vehicle in front, as the second vehicle locked in front of the road gets closer and closer to the vehicle (the first vehicle), the first function identifier used to mark the second vehicle will become closer and closer visually, and the display size will become larger and larger. The first function identifier may overlap with the second function identifier such as the instrument information of the first vehicle currently displayed, resulting in a display conflict between the two function identifiers, making it impossible for the user to see the two function identifiers clearly, that is, the road condition information of the first vehicle (the relative position relationship with the second vehicle in front) is associated with the first function identifier, which may affect the display of the first function identifier and the second function identifier.
[0082] For another example, when the imaging distance of the function logo is greater than the distance between the first vehicle and the obstacle in front (such as the second vehicle) (the function logo is associated with the obstacle in front of the first vehicle), the function logo will overlap with the obstacle, causing a visual convergence conflict for the user, making it impossible to see the function logo clearly, affecting the HUD usage experience, and possibly failing to see the obstacle clearly, causing a collision with the first vehicle.
[0083] In step S102, by judging whether the complexity of the road condition information meets the preset conditions, it can be judged whether the function logo overlaps with the road condition information to cause visual confusion, or whether important road condition information in the road condition information is blocked, resulting in the inability to effectively display the function logo generated based on the important road condition information, making it impossible for the user to see the function logo clearly, and safety accidents such as collisions may also occur, affecting the user's driving safety.
[0084] If the complexity of the road condition information of the road where the first vehicle is located or the surrounding roads is greater than or equal to a preset threshold, it is determined that the function identification is or may be interfered with or interfere with the road condition information; if the complexity of the road condition information of the road where the first vehicle is located or the surrounding roads is less than the preset threshold, it is determined that the function identification is not interfered with or interferes with the road condition information.
[0085] S103: If yes, determine the display position of the function identifier on the head-up display according to the association relationship or the road condition information.
[0086] If the function identifier displayed on the head-up display of the first vehicle has a preset association relationship with the road condition information, or the complexity of the road condition information meets the preset conditions, it is determined that the function identifier currently displayed or to be displayed is or may be interfered with or interfere with the road condition information, which affects the user's ability to see the function identifier clearly or affects driving safety. At this time, the display position of the currently displayed function identifier is re-determined according to the above-mentioned association relationship or the road condition information, or the display position of the function identifier to be displayed is determined in advance (for example, the display position of other function identifiers to be displayed can be accurately determined based on the display position of the currently displayed function identifier), so that the user can see the above-mentioned function identifier clearly, avoid mutual interference between different function identifiers, or avoid mutual interference between function identifiers and road condition information, thereby improving the user's HUD usage experience and improving the user's driving safety.
[0087] For example, when the first vehicle is locking the front vehicle, as the distance to the second vehicle in front is getting closer and closer, the two currently displayed function logos affect each other, and the display position of one of the function logos can be adjusted according to the above-mentioned distance change association relationship, so that the user can see the two function logos clearly. For another example, when the road condition information is relatively complex (there are many vehicles in front of the first vehicle), the mark logo of the locked second vehicle in front is small, and if it is directly displayed on the head-up display, the user cannot see the logo clearly. At this time, the mark logo can be enlarged and displayed at the position of the head-up display, so that the user can see the logo clearly even under relatively complex road conditions.
[0088] The head-up display method provided by the embodiment of the present disclosure obtains the current driving scene information of the first vehicle during the driving of the first vehicle, and determines whether there is a preset correlation between the function identifier displayed on the head-up display of the first vehicle and the road condition information, or determines whether the complexity of the road condition information meets a preset condition, so as to determine whether the function identifier is or may be interfered with or interfere with the road condition information, and then determines the display position of the function identifier on the head-up display according to the interference situation of the function identifier, so that the user can always clearly see the function identifier displayed on the head-up display during the driving of the first vehicle, which is convenient for the user to quickly obtain information, improve the user's HUD usage experience, and improve the user's driving safety.
[0089] In some embodiments, in step S103, determining the display position of the function identifier on the head-up display according to the association relationship or the road condition information includes:
[0090] Displaying the function identifier on a near-view display layer or a far-view display layer of the head-up display according to the association relationship or the road condition information; or
[0091] The display layer of the function identifier is switched according to the association relationship or the road condition information.
[0092] like Figure 2 As shown, the head-up display includes a near-view display layer 201 and a far-view display layer 202. The near-view display layer 201 is located below the far-view display layer 202, and the function logo can be displayed on the near-view display layer 201 and / or the far-view display layer 202. Among them, the near-view display layer 201 is a flat display layer (the logo layer of the traditional HUD), which displays a rendered virtual image, such as the vehicle speed, traffic signs (such as speed limit signs), and some navigation information that are usually unrelated to the real scene. As a preferred embodiment, Figure 2 As shown, in this embodiment, the function identifier can be a virtual image rendered according to the road condition information, that is, the 3D road condition can be rendered according to the environmental information around the first vehicle, and the 3D road condition includes a lane line model, a 3D model of the first vehicle, a 3D model of the second vehicle in front, etc. Function identifiers such as the front vehicle mark identifier (the mark identifier of the second vehicle) can be rendered and displayed in the above 3D road condition, that is, the near-view display layer 201 displays the road condition rendering image 2011 rendered according to the driving scene information, and at the same time, the function identifier is displayed at the corresponding position of the road condition rendering image 2011, so that the user can understand the driving scene information of the first vehicle more intuitively. For example, Figure 2 In the embodiment, a road condition rendering image 2011 can be displayed in the middle of the near-view display layer 201, and a first function identifier 101 (a mark identifier of a second vehicle) for locking the front vehicle is displayed at a position corresponding to the second vehicle in the road condition rendering image 2011, and the first function identifier 101 marks the rendered second vehicle with a box; and a second function identifier 102 such as instrument information that is not related to the real scene is displayed on both sides of the road condition rendering image 2011, so that the first function identifier 101 and the second function identifier 102 can be displayed distinguishably, and it is convenient for users to clearly understand the vehicle condition and road condition information; in addition, a road condition rendering image 2011 rendered according to the driving scene information is displayed on the near-view display layer 201, and the first function identifier 101 is displayed at a corresponding display position in the road condition rendering image 2011, so that users can view function identifiers that are closer to the real driving scene regardless of whether they are in the near-view display layer 201 or the far-view display layer 202, further improving the user HUD usage experience.
[0093] The distant view display layer is an AR display layer, which displays a virtual image fused with a real scene, that is, the AR display layer can fuse and render the functional logo with the real scene.
[0094] In this embodiment, when it is determined through step S102 that there is a preset association relationship between the function identifier displayed on the head-up display of the first vehicle and the road condition information around the first vehicle, or when it is determined that the complexity of the road condition information around the first vehicle meets the preset conditions, the display layer of the function identifier is adjusted according to the above-mentioned association relationship or road condition information, so that the function identifier is clearly displayed on the corresponding display layer, thereby improving the user's HUD usage experience.
[0095] In some embodiments, the method further comprises:
[0096] S104: adjusting display parameters of the function identifier according to the display position of the function identifier.
[0097] Different function identifiers can be displayed in different positions of the head-up display with different colors, different sizes and other display parameters, with clear priorities and in a comprehensive manner, so that the driver can comprehensively or specifically grasp the driving-related information of the first vehicle. In this step, after the display position of the function identifier is determined in step S103, the display parameters of the function identifier can also be adjusted according to the display position of the function identifier to better match the environmental information of the display position, thereby further improving the user's HUD usage experience.
[0098] Adjusting the display parameters of the function logo includes adjusting the display brightness, display color, display size, etc. of the function logo. For example, when it is determined that the color of the locked second vehicle is white, the color of the function logo can be adjusted to black to form a contrast with the rendered image of the second vehicle or the real second vehicle, thereby improving the display effect of the function logo.
[0099] In some embodiments, in step S102, determining whether there is a preset association relationship between the function identifier displayed on the head-up display of the first vehicle and the road condition information includes:
[0100] S1021: Determine whether the distance between the first vehicle and the target object meets a preset distance condition.
[0101] Among them, the target object is a moving object relative to the first vehicle or the road in the driving scene of the first vehicle, and may include mobile obstacles in the road condition information (such as the second vehicle in front of the first vehicle, pedestrians, etc.), points of interest or destinations in the road condition information, etc., and may also include other functional indicators displayed in the head-up display (such as instrument information).
[0102] In this step, by judging whether the distance between the first vehicle and the target object meets the preset distance condition, it can be judged whether the first function identifier displayed in real time conflicts with other objects, so as to accurately judge whether the function identifier will be interfered by the road condition information or other function identifiers when using the function identifier to perform functions such as front vehicle locking, ACC following, obstacle collision reminder and point of interest prompt, thereby affecting the realization of the above functions.
[0103] For example, it can be determined whether there is a conflict between different function identifiers displayed on the same display layer. For example, as the second vehicle locked in front of the road gets closer and closer to the vehicle (the first vehicle), the first function identifier used to lock the front vehicle (mark the second vehicle) will be closer and closer visually, and the display size will be larger and larger. When the distance between the first vehicle and the second vehicle is less than a certain distance, it will interfere with the second function identifier such as the near-layer instrument information, affecting the user's HUD experience. Therefore, when the distance between the first vehicle and the second vehicle in front is less than a preset distance, it is determined that the first function identifier for locking the front vehicle displayed in the near-view display layer and the second function identifier such as the instrument information displayed in the near-view display layer may have a display conflict; when the distance between the first vehicle and the second vehicle in front is greater than the preset distance, it is determined that there is no display conflict between the first function identifier and the second function identifier, and the display positions of the first function identifier and the second function identifier can be determined according to the driving scene information in step S101, without adjusting the display position of the first function identifier through step S103.
[0104] In some other embodiments, the distance between the first vehicle and the target object is too large and may also affect the clear display of the function logo. For example, as the distance between the first vehicle and the second vehicle increases, the display size of the first function logo displayed in the long-range display layer will become smaller and smaller, making it impossible for the user to see the first function logo clearly, that is, the road condition information of the distance between the first vehicle and the second vehicle will affect the display of the first function logo. Therefore, in this embodiment, it is possible to determine whether the first function logo is associated with the road condition information by determining whether the distance between the first vehicle and the second vehicle in front is within a preset distance range, and then determine whether it will affect the effective display of the first function logo. When the distance between the first vehicle and the second vehicle is within the preset distance range, it is determined that the road condition information will not interfere with the display of the first function logo; and when the distance between the first vehicle and the second vehicle is outside the preset distance range, it is determined that the road condition information will interfere with the display of the first function logo.
[0105] In some other embodiments, in step S102, determining whether there is a preset association relationship between the function identifier displayed on the head-up display of the first vehicle and the road condition information includes:
[0106] S1022: Determine whether the display feature of the function identifier is the same as or similar to the display feature of the target object.
[0107] In this step, it is possible to directly determine whether the target object will affect the display of the function identifier by determining whether the display characteristics of the function identifier are the same or similar to the display characteristics of the target object. Still taking the locking of the preceding vehicle as an example, if the color of the first function identifier used for locking the preceding vehicle is the same or similar to the color of the locked second vehicle (for example, both are blue), when the first function identifier and the real scene fusion rendering containing the second vehicle are displayed in the distant display layer, the user cannot see the first function identifier clearly, affecting the HUD usage experience, and because the user cannot see the first function identifier clearly, he may think that the preceding vehicle has not been locked and the second vehicle is within a safe distance of the first vehicle, and may control the first vehicle to accelerate, which may cause a collision with the second vehicle, affecting driving safety.
[0108] In some other embodiments, in step S102, determining whether there is a preset association relationship between the function identifier displayed on the head-up display of the first vehicle and the road condition information includes:
[0109] S1023: Determine whether the function identifier is blocked by an obstacle in the road scene.
[0110] In this step, the blocking situation of the function logo can be directly judged to determine whether it will affect the user's viewing of the function logo. For example, when the signal light logo used to mark the signal light is blocked by the truck in front of the first vehicle, the user may not be able to see the signal light clearly, resulting in failure to slow down in time when driving to the intersection, and running a red light. In a specific implementation, the signal light at the intersection can be identified in combination with a high-precision map. At the same time, the image in front of the first vehicle is collected by a camera set at the front of the first vehicle. When the high-precision map is used to identify that there is a signal light at a certain intersection in front of the first vehicle, and the camera does not collect the image of the signal light, it is determined that the signal light is blocked, and the signal light logo integrated with the real-scene signal light is blocked, resulting in the user being unable to see the signal light logo and the color of the signal light logo on the head-up display. In other embodiments, it can be directly determined according to the user's choice whether the function logo is blocked by an obstacle in the road scene. For example, when the front vehicle locking function is activated, if the first function logo for locking the front vehicle does not appear in the head-up display, it is determined that the function logo is blocked.
[0111] The function identifiers in the above steps S1021 to S1023 are pre-determined based on the driving information and / or the road condition information in the driving scene information, and are displayed at the corresponding position of the head-up display. At least one of the steps S1021 to S1023 can effectively determine whether the currently displayed function identifier is not clearly visible to the user, and then the display position of the function identifier that affects the user's viewing is adjusted through step S103, so that the user can adjust the display of the function identifier in time according to the real-time changing driving scene information, thereby improving the user's HUD usage experience and driving safety.
[0112] It is understandable that, in a specific implementation, other methods may be used to determine whether there is a preset association between the function identifier displayed on the head-up display of the first vehicle and the road condition information. In step S1021, the detection is convenient, fast and low-cost by distance detection. In step S1022, the determination is intuitive and convenient by determining whether the display features of the function identifier are the same or similar to the display features of the target object.
[0113] In a preferred embodiment, the target object is a moving obstacle located in front of the first vehicle, the functional identifier is a marking identifier of the target object, and the distance between the first vehicle and the target object satisfies a preset distance condition.
[0114] In step S103, determining the display position of the function identifier on the head-up display according to the association relationship includes: determining the display position of the function identifier according to the distance between the first vehicle and the target object; specifically including:
[0115] S201: If the distance between the first vehicle and the target object is within a first distance range, displaying the function identifier in the near-view display layer;
[0116] S202: If the distance between the first vehicle and the target object is within a second distance range, displaying the function identifier in the distant view display layer, wherein the second distance range is greater than the first distance range;
[0117] S203: If the distance between the first vehicle and the target object is close to the maximum distance threshold of the first distance range or the maximum distance threshold of the second distance range, gradually transition the function identifier from the current first display layer to the second display layer, wherein the first display layer is one of the near-view display layer and the distant view display layer, and the second display layer is the other of the near-view display layer and the distant view display layer.
[0118] like Figure 3As shown, the above steps S201 to S203 are still specifically described based on the previous vehicle lock. The target object is the second vehicle locked in front of the first vehicle, and the distance between the first vehicle and the target object is within the range of X1-X2, where X1 is greater than or equal to 0, and X2 is greater than X1, and the unit is m or km. It is determined that the distance between the first vehicle and the second vehicle meets the preset distance condition, triggering the display of the previous vehicle lock mark (first function mark 101), and under the preset distance condition, the function mark displayed on the head-up display may be interfered with or interfere with the road condition information as the first vehicle and the second vehicle travel. At this time, it is further determined based on the distance between the first vehicle and the second vehicle whether there is a situation that affects the clear display of the previous vehicle lock mark, and the display position of the previous vehicle lock mark is determined based on the specific situation, so that the previous vehicle lock mark can always be clearly displayed during the driving of the first vehicle.
[0119] like Figure 3 and Figure 4 As shown, if the distance between the first vehicle and the second vehicle is within the first distance range (between X1-Z), the first function identifier 101 used to mark the second vehicle is displayed on the near-view display layer 201, and the first function identifier 101 is displayed in the form of a border on the rendered image of the second vehicle.
[0120] like Figure 3 and Figure 5 As shown, if the distance between the first vehicle and the second vehicle is within the second distance range (between Z-X2), the first function logo 101 used to mark the second vehicle will be displayed on the distant display layer 202, and the first function logo 101 will lock the second vehicle display in real time, that is, the function logo is displayed in real time in fusion with the real scene, and the size of the logo is adjusted according to the change in the distance between the first vehicle and the second vehicle. The greater the distance between the first vehicle and the second vehicle, the smaller the first function logo 101; the smaller the distance between the first vehicle and the second vehicle, the larger the first function logo 101, so as to meet the human visual experience.
[0121] When the distance between the first vehicle and the second vehicle approaches the distance threshold Z, the first function logo 101 gradually transitions between the near-view display layer 201 and the far-view display layer 202. When the distance between the first vehicle and the second vehicle gradually increases within the first distance range (between X1-Z) to approach the distance threshold Z, the first function logo 101 gradually transitions from being displayed in the near-view display layer 201 to being displayed in the far-view display layer 202. As the distance between the first vehicle and the second vehicle continues to increase (between the second distance range Z-X2), the first function logo 101 transitions to being displayed in the far-view display layer 202, and the display size of the first function logo 101 gradually decreases as the distance increases. When the distance between the first vehicle and the second vehicle gradually decreases within the second distance range (between Z-X2) to approach the distance threshold Z, the first function identifier 101 gradually transitions from being displayed in the distant display layer 202 to being displayed in the near display layer 201. As the distance between the first vehicle and the second vehicle continues to decrease (between the first distance range X1-Z), the first function identifier 101 transitions to being displayed in the distant display layer 202, and the display size of the first function identifier 101 may gradually increase as the distance decreases, or may remain unchanged. The above distance threshold Z is the critical value for the first function identifier 101 to be displayed in the near display layer 201 or the distant display layer 202.
[0122] It should be noted that when the first function logo 101 gradually transitions between the near view display layer 201 and the far view display layer 202, the display parameters of the first function logo 101 displayed in the near view display layer 201 and the far view display layer 202 can be the same (for example, both are displayed in the form of a box) or different. In particular, since the near view display layer 201 displays the road condition rendering image 2011, Figure 3 As shown, the first function identifier 101 can be displayed in the near-view display layer 201 in the form of a simple identifier such as a certain shape; because the distant display layer 202 displays the image after the function identifier is integrated with the real scene (such as the first function identifier 101 of the second vehicle locked in real time as mentioned above), the first function identifier 101 can be displayed in the distant display layer 202 in the form of a detailed identifier. For example, while marking the second vehicle with a certain shape, the optimal safety distance between the second vehicle and the first vehicle is also displayed, so that the first vehicle controls the speed of the vehicle and the second vehicle is between the above-mentioned optimal safety distance, effectively avoiding a collision.
[0123] The above steps S1031 to S1032 are mainly applicable to the scenario where the target object is a mobile obstacle that moves relative to the road and the first vehicle (for example, the above-mentioned front vehicle locking, ACC following, obstacle alarm reminder, etc.), and the distance between the mobile obstacle and the first vehicle changes in real time, thereby causing the first function identifier 101 used to mark the mobile obstacle and the near-field display layer 201 to display a conflict with the second function identifier 102, so that the first function identifier 101 and the second function identifier 102 can be clearly displayed respectively.
[0124] In another preferred embodiment, the target object is a point of interest in a road scene where the first vehicle is located, the function identifier is a marking identifier of the point of interest, and the distance between the first vehicle and the target object meets a preset distance condition.
[0125] In step S103, determining the display position of the function identifier on the head-up display according to the association relationship includes: determining the display position of the function identifier according to the distance between the first vehicle and the target object; specifically including:
[0126] S301: If the distance between the first vehicle and the target object is within a third distance range, display the function identifier on the near-view display layer, and the function identifier gradually moves from the front of the first vehicle to the rear of the first vehicle as the first vehicle moves forward;
[0127] S302: if the distance between the first vehicle and the target object is within a fourth distance range, displaying the function identifier on the distant view display layer, and the function identifier is gradually enlarged or clearly displayed as the distance between the first vehicle and the target object decreases, and the fourth distance range is greater than the third distance range;
[0128] S303: if the distance between the first vehicle and the target object is within a fifth distance range, displaying the function identifier on the distant view display layer, and the function identifier gradually changes from a simple display to a detailed display as the distance between the first vehicle and the target object decreases, and the fifth distance range is greater than the fourth distance range;
[0129] S304: If the distance between the first vehicle and the target object gradually decreases to a minimum distance threshold of the fourth distance range within the fourth distance range, when the distance between the first vehicle and the target object approaches the minimum distance threshold, the function identifier is displayed close to the FOV boundary of the distant display layer, and when the distance between the first vehicle and the target object is the minimum distance threshold, the function identifier is hidden.
[0130] When the target object is a point of interest in the road scene where the first vehicle is located, such as Figure 6 As shown, similar to the locked second vehicle described above, if the distance between the first vehicle and the point of interest is within the range of X1-X2, where X1 is greater than or equal to 0 and X2 is greater than X1, and the unit is m or km, it is determined that the distance between the first vehicle and the second vehicle meets the preset distance condition, triggering the display of the point of interest mark (third function mark 103), and under the preset distance condition, the point of interest mark displayed on the head-up display may be interfered with or interfere with the road condition information as the first vehicle and the second vehicle travel. At this time, it is further determined based on the distance between the first vehicle and the second vehicle whether there is a situation that affects the clear display of the point of interest mark, and the display position of the point of interest mark is determined based on the specific situation, so that the point of interest mark can always be clearly displayed during the driving of the first vehicle.
[0131] Similar to the locked second vehicle described above, in this embodiment, a distance threshold Z is set within the range of X1-X2, such as Figure 7 and Figure 8 As shown, if the distance between the first vehicle and the point of interest is within a third distance range (between X1 and Z), a third functional identifier 103 for marking the point of interest is displayed in the near-view display layer 201. Figures 9 to 12 As shown, if the distance between the first vehicle and the point of interest is between Z-X2, the third function identifier 103 for marking the point of interest is displayed in the distant display layer 202. In this embodiment, another distance threshold Y is set between Z-X2, and the display of the mark of the point of interest in the distant display layer 202 is further distinguished in detail, so that the user can see the point of interest clearly according to the distance between the first vehicle and the point of interest, and have a detailed understanding of the point of interest. Specifically, the display of the third function identifier 103 in the distant display layer 202 and the near display layer 201 is specifically described by taking the first vehicle moving forward and the distance between the first vehicle and the point of interest continuously decreasing as an example.
[0132] like Figure 6 , Fig. 9 and Fig.10 As shown, if the distance between the first vehicle and the point of interest is within the fifth distance range (between Y and X2), it is determined that the distance between the first vehicle and the point of interest is far. At this time, step S303 is executed to display the third function identifier 103 in the distant view display layer 202, and the third function identifier 103 locks the point of interest in real time. As the distance between the first vehicle and the point of interest decreases to the distance threshold Y (the minimum distance threshold of the fifth distance range), the third function identifier 103 is changed from displaying a simple identifier (such as Fig. 9 ) to display detailed identification (such as Fig.10The simple identification includes a marking identification for marking the point of interest (which may be marked with a border or highlight display, etc.), and the detailed identification includes a marking identification for the point of interest and an explanation identification for detailing or explaining the point of interest. For example, the explanation identification may include detailed information such as the name and category of the point of interest. When the distance between the first vehicle and the point of interest is within the fifth distance range (between Y-X2), the simple identification displayed on the distant view display layer 202 may gradually increase to better match the user's vision and improve the user's HUD usage experience.
[0133] like Figure 6 , Fig.10 and Fig.11 As shown, if the first vehicle continues to move forward so that the distance between the first vehicle and the point of interest is within a fourth distance range (between ZY), step S302 is executed, and the third function identifier 103 displayed on the distant view display layer 202 is gradually enlarged or clearly displayed as the distance between the first vehicle and the target object decreases, so that the user can clearly see the above-mentioned mark identifier and description identifier when the distance between the point of interest and the first vehicle is close.
[0134] like Fig.11 and Fig.12 As shown, as the distance between the first vehicle and the point of interest continues to decrease, step S304 is executed to gradually move the third function indicator 103 (detailed indicator) displayed in detail from the inside to the outside toward the FOV (Field of View) boundary of the distant view display layer 202, and the detailed indicator is gradually retracted until it gradually disappears. That is, when the distance between the first vehicle and the point of interest decreases to the FOV boundary, the third function indicator 103 is hidden. In this embodiment, the FOV boundary is the above-mentioned distance threshold Z (the minimum distance threshold of the fourth distance range).
[0135] As the detailed mark gradually approaches the FOV boundary, the brightness of the detailed mark may gradually dim so that it merges with the real scene and gradually disappears. In a specific implementation, the contrast and other parameters of the detailed mark may also be adjusted to make the detailed mark displayed according to the dynamic change of the distance between the first vehicle and the point of interest more natural.
[0136] like Figure 6 , Figure 7 and Figure 8As shown, as the distance between the first vehicle and the point of interest continues to decrease, the distance between the first vehicle and the point of interest is within the third distance range (between X1 and Z), step S301 is executed to display the third function identifier 103 in the near-view display layer 201 in the form of a simple identifier, and the third function identifier 103 gradually moves from the front of the first vehicle to the rear of the first vehicle as the first vehicle moves forward (the distance between the first vehicle and the point of interest gradually approaches X1) until it disappears, so that the user can dynamically change the point of interest relative to the first vehicle according to the driving experience of the first vehicle. In particular, as Figure 7 and Figure 8 As shown, while the third function logo 103 is moved to the rear of the first vehicle and displayed, the display brightness of the third function logo 103 gradually dims to merge with the road condition rendering image 2011 rendered according to the road condition information, thereby improving the user's AR visual experience.
[0137] The display of the function identification in the above steps S1034 to S1037 can also be applied to situations where there is a certain variable distance between the destination prompt and the first vehicle and there is a certain correlation between the display of the function identification and the FOV boundary.
[0138] In another preferred embodiment, the function identifier is a marking identifier of the target object, and the display characteristics of the function identifier are the same as or similar to the display characteristics of the target object.
[0139] In step S103, the display position of the function identifier on the head-up display is determined according to the association relationship, including: displaying the function identifier on the near-view display layer.
[0140] Specifically, if it is determined through step S1022 that the color of the function identifier is similar to the color of the locked front vehicle (the second vehicle), and it is determined that there is a preset association relationship between the function identifier displayed on the head-up display of the first vehicle and the road condition information, then the function identifier (the first function identifier 101) is displayed in the near-view display layer 201 according to the road condition rendering image 2011 rendered by the real-time road condition information. Since the color and other parameters of the locked front vehicle in the road condition rendering image 2011 can be adjusted according to the color of the function identifier, for example, when the preset function identifier is red, the color of the front vehicle matching the function identifier can be rendered as white when rendering the road condition information, thereby effectively avoiding the problem of display conflict between the function identifier displayed in the distant display layer 202 and the real-time road condition information. In a specific implementation, the color and other display parameters of the function identifier can also be adjusted according to the road condition rendering image 2011. That is, in the above embodiment, when the display characteristics of the function identifier are the same or similar to the display characteristics of the target object, the function identifier displayed in the distant display layer 202 is controlled to temporarily disappear, and the function identifier is controlled to be displayed in the near-view display layer 201 according to the road condition rendering image 2011 rendered in real time.
[0141] Optionally, in this embodiment, the display position of the function logo can be determined in combination with the distance between the first vehicle and the target object. For example, when it is determined that the color of the function logo is similar to the color of the locked front vehicle (the second vehicle), if the distance between the first vehicle and the second vehicle is greater than the distance threshold Z, the function logo will be displayed in the distant display layer 202; if the distance between the first vehicle and the second vehicle is less than the distance threshold Z, the function logo displayed in the distant display layer 202 will be hidden, and the function logo will be displayed in the near display layer 201.
[0142] In some embodiments, in step S102, determining whether the complexity of the road condition information meets a preset condition includes:
[0143] S1024: Determine whether the number of obstacles in the road scene exceeds a preset threshold.
[0144] In this step, the complexity of the road condition information can be determined by judging the number of obstacles in the road scene. When the number of obstacles in the road scene exceeds a preset threshold, the road condition is determined to be relatively complex. The overlap of the function logo to be displayed on the head-up display and the road condition is likely to cause visual confusion. The function logo and the road condition information interfere with each other, affecting the user's driving experience. Optionally, vehicles usually travel on urban roads. Therefore, in this embodiment, when the first vehicle is traveling, obstacles such as other vehicles and pedestrians in the road ahead of the first vehicle can be identified in real time, and the complexity of the road condition information can be determined based on the number of obstacles identified.
[0145] In some other embodiments, in step S102, determining whether the complexity of the road condition information meets a preset condition includes:
[0146] S1025: Determine whether the lane information or traffic information in the road condition information and obstacles in the road scene where the first vehicle is located obstruct each other.
[0147] In this step, the complexity of the road condition information can be determined by judging whether the lane information of the road where the first vehicle is located or the traffic information around the first vehicle and the obstacles in the road scene where the first vehicle is located are mutually blocked, and then judging whether the functional identification such as the marking identification of the lane information (such as lane lines, speed limit information in the lane or bus-only lane) to be displayed on the head-up display or the marking identification of the traffic information (such as traffic lights, turn signs) interferes with obstacles such as vehicles and pedestrians, resulting in the user being unable to see the above-mentioned functional identification and unable to determine the lane line pressing situation or the color of the traffic light, causing driving safety hazards.
[0148] For example, when the first vehicle is driving, the signal light in front of the first vehicle may be blocked by a truck in front of the first vehicle. If the signal light logo indicating the signal light is displayed in the distant view display layer 202 of the head-up display, it will overlap with the blocking truck. From a visual perspective, the user cannot see the signal light logo clearly, which affects the driving experience and driving safety.
[0149] In a specific implementation, the road condition information outside the vehicle can be collected by using cameras, external sensors (such as laser radar, etc.), etc. to determine whether the complexity of the road condition information meets the preset conditions.
[0150] It is understandable that the above steps S1024 and S1025 can be performed separately or in conjunction to improve the accuracy of the complexity judgment of the road condition information, thereby more accurately determining the display position of the function identifier on the head-up display, and improving the judgment and recognition efficiency of the complexity of the road condition information. For example, after it is determined in step S1024 that the number of obstacles exceeds the preset threshold, it can be determined in step S1025 whether the identified obstacles are mutually blocked with the lane information or traffic information in the road condition information, that is, according to the mutual blocking between the obstacle identification and the lane line or traffic light, etc.; if step S1024 determines that the number of obstacles does not exceed the preset threshold, it is determined according to the lane line or traffic light, etc. whether there is mutual blocking with the obstacle, so as to avoid repeated identification caused by traversing all image recognition and identifying with different targets.
[0151] In some embodiments, in step S103, determining the display position of the function identifier on the head-up display according to the road condition information includes:
[0152] S401: If the lane information or traffic information in the road condition information and an obstacle in the road scene where the first vehicle is located are mutually blocked, and the mutual blocking situation lasts for a preset time, displaying the function identifier in the near-view display layer;
[0153] S402: If the lane information or traffic information does not block any obstacle in the road scene where the first vehicle is located, display the function identifier in the distant view display layer; and / or
[0154] S403: Switching the display layer of the function indicator according to changes in the mutual occlusion between the lane information or the traffic information and obstacles in the road scene where the first vehicle is located.
[0155] After determining the mutual occlusion between the lane information or traffic information and the obstacle in step S1025, the specific display position of the function indicator is determined through steps S401 to S403.
[0156] Specifically, Fig.13 As shown, if the signal light and the truck in front of the first vehicle are mutually blocked (the signal light is blocked by the truck), and the blocking situation lasts for a certain period of time, the fourth function indicator 104 used to mark the signal light is displayed on the near-view display layer 201 to avoid visual overlap between the fourth function indicator 104 and the blocking truck when the fourth function indicator 104 is displayed on the far-view display layer 202. Fig.14 As shown, if the signal light and the truck in front of the first vehicle do not block each other (the signal light is not blocked by the truck), the fourth function mark 104 for marking the signal light is displayed in the distant display layer 202, so that the user can view a clearer fourth function mark 104 according to the real road condition information. If it is determined that the signal light is converted from being blocked to being unblocked, the fourth function mark 104 is gradually transferred from being displayed in the near display layer 201 to being displayed in the distant display layer 202; if it is determined that the signal light is converted from being unblocked to being unblocked, the fourth function mark 104 is gradually transferred from being displayed in the distant display layer 202 to being displayed in the near display layer 201.
[0157] Preferably, when the fourth function indicator 104 is displayed in the near-view display layer 201, it can be fused with the road condition rendering image 2011 rendered according to the driving scene information to improve the display effect. Fig.13 As shown, in this embodiment, the fourth function indicator 104 is displayed at the rear side of the middle part (the side away from the user along the driving direction of the first vehicle) of the road condition rendering image 2011. In addition, the display parameters such as the display size of the fourth function indicator 104 can be determined according to the display area size of the near-view display layer 201 and the far-view display layer 202, etc., and are not specifically limited in the present disclosure.
[0158] Fig.15 FIG. 2 shows a schematic diagram of the structure of a head-up display device according to an embodiment of the present disclosure. Fig.15 As shown, based on the above head-up display method, the embodiment of the present disclosure further provides a head-up display device, including:
[0159] An acquisition module 100 is configured to acquire current driving scene information of a first vehicle, wherein the driving scene information includes driving information of the first vehicle and road condition information around the first vehicle;
[0160] a judgment module 200, configured to judge whether there is a preset association relationship between a function identifier displayed on a head-up display of the first vehicle and the road condition information, or to judge whether the complexity of the road condition information meets a preset condition, wherein the function identifier is determined according to the driving information and / or the road condition information;
[0161] The determination module 300 is configured to determine the display position of the function identifier on the head-up display according to the association relationship or the road condition information if there is a preset association relationship between the function identifier displayed on the head-up display of the first vehicle and the road condition information, or the complexity of the road condition information meets a preset condition.
[0162] In some embodiments, the function identifier includes at least one of a mark identifier of a target object in a road scene where the first vehicle is located, a driving prompt identifier of the first vehicle, a mark identifier of lane information of a road where the first vehicle is located, a mark identifier of traffic information around the first vehicle, and a navigation prompt identifier of the first vehicle;
[0163] The target object includes an obstacle located in front of the first vehicle and / or a point of interest in a road environment where the first vehicle is located.
[0164] In some embodiments, the determination module 300 is further configured to:
[0165] Displaying the function identifier on a near-view display layer or a far-view display layer of the head-up display according to the association relationship or the road condition information; or
[0166] The display layer of the function identifier is switched according to the association relationship or the road condition information.
[0167] In some embodiments, the near-view display layer is a plane display layer, the plane display layer displays a road condition rendering image rendered according to the driving scene information, and the function identifier is displayed at a corresponding position of the road condition rendering image;
[0168] The distant view display layer is an AR display layer, and the function identifier is fused with the real driving scene information for rendering and display.
[0169] In some embodiments, the determination module 300 is further configured to:
[0170] The display parameters of the function identifier are adjusted according to the display position of the function identifier.
[0171] In some embodiments, the determination module 200 includes a first determination unit configured to:
[0172] Determining whether the distance between the first vehicle and the target object meets a preset distance condition; and / or
[0173] Determining whether the display characteristics of the functional identifier are the same as or similar to the display characteristics of the target object; and / or
[0174] Determine whether the function identifier is blocked by an obstacle in the road scene.
[0175] In some embodiments, the target object is a moving obstacle located in front of the first vehicle, the functional identifier is a marking identifier of the target object, and the distance between the first vehicle and the target object satisfies a preset distance condition.
[0176] The determination module 300 is further configured to: determine the display position of the function indicator according to the distance between the first vehicle and the target object; wherein,
[0177] If the distance between the first vehicle and the target object is within a first distance range, displaying the function identifier on the near-view display layer;
[0178] If the distance between the first vehicle and the target object is within a second distance range, displaying the function identifier in the distant view display layer, wherein the second distance range is greater than the first distance range;
[0179] If the distance between the first vehicle and the target object is close to the maximum distance threshold of the first distance range or the maximum distance threshold of the second distance range, the function identifier is gradually transitioned from the current first display layer to the second display layer, wherein the first display layer is one of the near-view display layer and the distant view display layer, and the second display layer is the other of the near-view display layer and the distant view display layer.
[0180] In some embodiments, the target object is a point of interest in a road scene where the first vehicle is located, the function identifier is a mark identifier of the point of interest, and the distance between the first vehicle and the target object meets a preset distance condition.
[0181] The determination module 300 is further configured to: determine the display position of the function indicator according to the distance between the first vehicle and the target object; wherein,
[0182] If the distance between the first vehicle and the target object is within a third distance range, displaying the function identifier on the near-view display layer, and the function identifier gradually moves from the front of the first vehicle to the rear of the first vehicle as the first vehicle moves forward;
[0183] If the distance between the first vehicle and the target object is within a fourth distance range, displaying the function identifier on the distant view display layer, and the function identifier is gradually enlarged or clearly displayed as the distance between the first vehicle and the target object decreases, and the fourth distance range is greater than the third distance range;
[0184] If the distance between the first vehicle and the target object is within a fifth distance range, displaying the function identifier on the distant view display layer, and the function identifier gradually changes from a simple display to a detailed display as the distance between the first vehicle and the target object decreases, and the fifth distance range is greater than the fourth distance range;
[0185] If the distance between the first vehicle and the target object gradually decreases to a minimum distance threshold within the fourth distance range, when the distance between the first vehicle and the target object approaches the minimum distance threshold, the function identifier is displayed close to the FOV boundary of the distant display layer, and when the distance between the first vehicle and the target object is the minimum distance threshold, the function identifier is hidden.
[0186] In some embodiments, the determination module 200 includes a second determination unit configured to:
[0187] Determining whether the number of obstacles in the road scene exceeds a preset threshold; and / or
[0188] Determine whether the lane information or traffic information in the road condition information and an obstacle in the road scene where the first vehicle is located obstruct each other.
[0189] In some embodiments, the determination module 300 is further configured to:
[0190] If the lane information or traffic information in the road condition information and an obstacle in the road scene where the first vehicle is located are mutually blocked, and the mutual blocking situation lasts for a preset time, displaying the function identifier in the distant view display layer;
[0191] If the lane information or traffic information does not block any obstacle in the road scene where the first vehicle is located, displaying the function identifier in the near-view display layer; and / or
[0192] The display layer of the function indicator is switched according to changes in the mutual occlusion between the lane information or the traffic information and obstacles in the road scene where the first vehicle is located.
[0193] It should be noted that the head-up display device provided in the embodiment of the present disclosure corresponds to the head-up display method in the above-mentioned embodiment. Based on the above-mentioned head-up display method, technicians in this field can understand the specific implementation methods of the head-up display device for delivery information in the embodiment of the present disclosure and its various variations. Any optional items in the head-up display method embodiment are also applicable to the head-up display device, which will not be repeated here.
[0194] The embodiment of the present disclosure further provides a means of transportation, including the above-mentioned head-up display device. The means of transportation may be a car, a truck, a train, an airplane, or other means of transportation.
[0195] An embodiment of the present disclosure further provides an electronic device, comprising at least a memory and a processor, wherein the memory stores a computer program, and the processor implements the steps of the above method when executing the computer program in the memory.
[0196] In some embodiments, the processor executing the computer program may be a processing device including one or more general-purpose processing devices, such as a microprocessor, a central processing unit (CPU), a graphics processing unit (GPU), etc. More specifically, the processor may be a complex instruction set computing (CISC) microprocessor, a reduced instruction set computing (RISC) microprocessor, a very long instruction word (VLIW) microprocessor, a processor running other instruction sets, or a processor running a combination of instruction sets. The processor may also be one or more special-purpose processing devices, such as an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA), a digital signal processor (DSP), a system on a chip (SoC), etc.
[0197] The memory may be a read-only memory (ROM), a random access memory (RAM), a phase-change random access memory (PRAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), an electrically erasable programmable read-only memory (EEPROM), other types of random access memory (RAM), a flash disk or other form of flash memory, a cache, a register, a static memory, a compact disk read-only memory (CD-ROM), a digital versatile disk (DVD) or other optical storage, a cassette or other magnetic storage device, or any other possible non-temporary medium used to store information or instructions that can be accessed by a computer device.
[0198] The electronic devices of the embodiments of the present disclosure may include but are not limited to fixed terminal devices such as servers, desktop computers, digital TVs, etc., and mobile terminal devices such as vehicle-mounted devices (such as head-up display devices), handheld devices (such as mobile phones, tablet computers, etc.), wearable devices (such as smart watches, smart bracelets, etc.), etc.
[0199] The embodiment of the present disclosure further provides a computer-readable storage medium, wherein the computer-readable medium stores a computer program, and when the computer program is executed by a processor, the steps of the above method are implemented.
[0200] The computer-readable storage medium of the embodiments of the present disclosure may adopt any combination of one or more computer-readable media. The computer-readable medium may be a computer-readable signal medium or a computer-readable storage medium. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. In the embodiments of the present disclosure, the computer-readable storage medium may be any tangible medium containing or storing a program, which may be used by or in combination with an instruction execution system, device or device, for example, the memory described above.
[0201] The computer programs of the embodiments of the present disclosure may be organized into one or more computer executable components or modules. Any number and combination of such components or modules may be used to implement the various aspects of the present disclosure. For example, the various aspects of the present disclosure are not limited to the specific computer executable instructions or specific components or modules shown in the drawings and described herein. Other embodiments may include different computer executable instructions or components with more or less functions than those shown and described herein.
[0202] The above description is only a preferred embodiment of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosed concept. For example, the above features are replaced with the technical features with similar functions disclosed in the present disclosure (but not limited to) by each other to form a technical solution.
Claims
1. A head-up display method, applied to a first vehicle, It is characterized in that include: Acquire current driving scene information of the first vehicle, where the driving scene information includes travel information of the first vehicle and road condition information around the first vehicle; Determining whether a function identifier displayed on a head-up display of the first vehicle has a preset association relationship with the road condition information, or determining whether the complexity of the road condition information meets a preset condition, wherein the function identifier is determined according to the driving information and / or the road condition information; If so, determine the display position of the function identifier on the head-up display according to the association relationship or the road condition information.
2. The method according to claim 1, It is characterized in that The function identifier includes at least one of a mark identifier of a target object in a road scene where the first vehicle is located, a driving prompt identifier of the first vehicle, a mark identifier of lane information of a road where the first vehicle is located, a mark identifier of traffic information around the first vehicle, and a navigation prompt identifier of the first vehicle; The target object includes an obstacle located in front of the first vehicle and / or a point of interest in a road environment where the first vehicle is located.
3. The method according to claim 2, It is characterized in that Determining a display position of the function identifier on the head-up display according to the association relationship or the road condition information includes: Displaying the function identifier on a near-view display layer or a far-view display layer of the head-up display according to the association relationship or the road condition information; or The display layer of the function identifier is switched according to the association relationship or the road condition information.
4. The method according to claim 3, It is characterized in that The near-view display layer is a plane display layer, and the plane display layer displays a road condition rendering image rendered according to the driving scene information, and the function identifier is displayed at a corresponding position of the road condition rendering image; The distant view display layer is an AR display layer, and the function identifier is fused with the real driving scene information for rendering and display.
5. The method according to claim 3, It is characterized in that The method further comprises: The display parameters of the function identifier are adjusted according to the display position of the function identifier.
6. The method according to claim 3, It is characterized in that Determining whether there is a preset association relationship between the function identifier displayed on the head-up display of the first vehicle and the road condition information includes: Determining whether the distance between the first vehicle and the target object meets a preset distance condition; and / or Determining whether the display characteristics of the functional identifier are the same as or similar to the display characteristics of the target object; and / or Determine whether the function identifier is blocked by an obstacle in the road scene.
7. The method according to claim 6, It is characterized in that The target object is a moving obstacle located in front of the first vehicle, the functional identifier is a marking identifier of the target object, and the distance between the first vehicle and the target object meets a preset distance condition. Determining the display position of the function identifier on the head-up display according to the association relationship includes: determining the display position of the function identifier according to the distance between the first vehicle and the target object; wherein, If the distance between the first vehicle and the target object is within a first distance range, displaying the function identifier on the near-view display layer; If the distance between the first vehicle and the target object is within a second distance range, displaying the function identifier in the distant view display layer, wherein the second distance range is greater than the first distance range; If the distance between the first vehicle and the target object is close to the maximum distance threshold of the first distance range or the maximum distance threshold of the second distance range, the function identifier is gradually transitioned from the current first display layer to the second display layer, wherein the first display layer is one of the near-view display layer and the distant view display layer, and the second display layer is the other of the near-view display layer and the distant view display layer.
8. The method according to claim 6, It is characterized in that The target object is a point of interest in a road scene where the first vehicle is located, the function identifier is a mark identifier of the point of interest, and the distance between the first vehicle and the target object meets a preset distance condition. Determining the display position of the function identifier on the head-up display according to the association relationship includes: determining the display position of the function identifier according to the distance between the first vehicle and the target object; wherein, If the distance between the first vehicle and the target object is within a third distance range, displaying the function identifier on the near-view display layer, and the function identifier gradually moves from the front of the first vehicle to the rear of the first vehicle as the first vehicle moves forward; If the distance between the first vehicle and the target object is within a fourth distance range, the function identifier is displayed on the distant view display layer, and the function identifier is gradually enlarged or clearly displayed as the distance between the first vehicle and the target object decreases, and the fourth distance range is greater than the third distance range; If the distance between the first vehicle and the target object is within a fifth distance range, displaying the function identifier on the distant view display layer, and the function identifier gradually changes from a simple display to a detailed display as the distance between the first vehicle and the target object decreases, and the fifth distance range is greater than the fourth distance range; If the distance between the first vehicle and the target object gradually decreases to a minimum distance threshold within the fourth distance range, when the distance between the first vehicle and the target object approaches the minimum distance threshold, the function identifier is displayed close to the FOV boundary of the distant display layer, and when the distance between the first vehicle and the target object is the minimum distance threshold, the function identifier is hidden.
9. The method according to claim 3, It is characterized in that Determining whether the complexity of the road condition information meets a preset condition includes: Determining whether the number of obstacles in the road scene exceeds a preset threshold; and / or Determine whether the lane information or traffic information in the road condition information and an obstacle in the road scene where the first vehicle is located obstruct each other.
10. The method according to claim 9, It is characterized in that Determining a display position of the function identifier on the head-up display according to the road condition information includes: If the lane information or traffic information in the road condition information and an obstacle in the road scene where the first vehicle is located are mutually blocked, and the mutual blocking situation lasts for a preset time, displaying the function identifier in the distant view display layer; If the lane information or traffic information does not block any obstacle in the road scene where the first vehicle is located, displaying the function identifier in the near-view display layer; and / or The display layer of the function indicator is switched according to changes in the mutual occlusion between the lane information or the traffic information and obstacles in the road scene where the first vehicle is located.
11. A head-up display device, It is characterized in that include: an acquisition module, configured to acquire current driving scene information of the first vehicle, the driving scene information including travel information of the first vehicle and road condition information around the first vehicle; a judgment module configured to judge whether there is a preset association relationship between a function identifier displayed on a head-up display of the first vehicle and the road condition information, or to judge whether the complexity of the road condition information meets a preset condition, wherein the function identifier is determined according to the driving information and / or the road condition information; The determination module is configured to determine the display position of the function identifier on the head-up display according to the association relationship or the road condition information if there is a preset association relationship between the function identifier displayed on the head-up display of the first vehicle and the road condition information, or the complexity of the road condition information meets a preset condition.
12. A means of transportation, It is characterized in that It comprises the head-up display device as claimed in claim 11.
13. An electronic device, It is characterized in that The method comprises at least a memory and a processor, wherein the memory stores a computer program, and the processor implements the steps of the method according to any one of claims 1 to 10 when executing the computer program on the memory.
14. A computer-readable storage medium, It is characterized in that The computer readable medium stores a computer program, and when the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 10 are implemented.
Citation Information
Cited By
Display method and related apparatus
WO2026148494A1
