Head-up display method and device, vehicle, electronic equipment and storage medium

By adjusting the lower viewing angle of the virtual image, the problem of incomplete display of AR information caused by insufficient vertical field of view angle of the head-up display is solved, and the integrity of information and driving safety are improved.

CN119024562APending Publication Date: 2024-11-26FUTURUS TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202310945815.6
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2023-05-24
Filing Date
2023-07-28
Publication Date
2024-11-26

AI Technical Summary

Technical Problem

The vertical field of view of the existing head-up display is insufficient, and the AR information display at different positions in the virtual image cannot be taken into account, resulting in some information being unable to be fully displayed within the field of view angle, affecting the HUD usage experience and driving safety.

Method used

By determining whether the information to be displayed can be fully displayed within the field of view of the head-up display, if not, adjust the lower view angle of the virtual image according to the relative position relationship between the object and the virtual image in the real environment corresponding to the information, so that the virtual image after the adjustment Full display in.

Benefits of technology

It realizes the complete display of each AR information in the virtual image, improves the user's HUD experience and driving safety, and solves the problem of incomplete information display caused by insufficient vertical field of view angle.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119024562A_ABST
    Figure CN119024562A_ABST
Patent Text Reader

Abstract

The embodiment of the invention provides a head-up display method and device, a vehicle, electronic equipment and a storage medium. The head-up display method comprises the following steps: judging whether to-be-displayed first information can be completely displayed in a virtual image in a field angle range of a head-up display or not; and if not, according to a relative position relationship between a first object in a real environment corresponding to the first information and the virtual image, adjusting a lower visual angle of the virtual image so as to enable the first information to be completely displayed in the adjusted virtual image.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to the field of display technology, and in particular to a head-up display method, device, vehicle, electronic device and storage medium. Background Art

[0002] The vertical field of view (VFOV) supported by the existing head-up display (HUD) has certain limitations and cannot cover all usage scenarios in the driving environment. For example, in some scenarios, the information that needs to be displayed in the virtual image (such as augmented reality AR information that needs to be superimposed on objects such as buildings, vehicles in front, road signs, pedestrians, etc. in the real environment) cannot be fully displayed in the limited vertical field of view, that is, it cannot be fully displayed on the virtual image within the vertical field of view, so it is impossible to take into account the display of AR information at different positions in the virtual image. Summary of the invention

[0003] The purpose of the embodiments of the present disclosure is to provide a method that can solve the technical problem in the prior art that the vertical field of view of the head-up display is insufficient and the AR information display at different positions in the virtual image cannot be taken into account.

[0004] The embodiments of the present disclosure adopt the following technical solutions:

[0005] A head-up display method, comprising:

[0006] determining whether the first information to be displayed can be completely displayed in a virtual image within a field of view of the head-up display;

[0007] If not, the lower viewing angle of the virtual image is adjusted according to the relative positional relationship between the first object in the real environment corresponding to the first information and the virtual image so that the first information is completely displayed in the adjusted virtual image.

[0008] In some embodiments, adjusting the lower viewing angle of the virtual image according to the relative positional relationship between the first object in the real environment corresponding to the first information and the virtual image so that the first information is completely displayed in the adjusted virtual image includes:

[0009] Determine, according to the position of the first object in the real environment, a relative positional relationship between the first object and the virtual image in a height direction of the virtual image, wherein the relative positional relationship includes whether the first object is above or below the virtual image;

[0010] According to the relative position relationship, the lower viewing angle of the virtual image is adjusted.

[0011] In some embodiments, adjusting the lower viewing angle of the virtual image according to the relative position relationship includes:

[0012] If the first object is below the virtual image, increasing the lower viewing angle of the virtual image; or,

[0013] If the first object is above the virtual image, the lower viewing angle of the virtual image is reduced.

[0014] In some embodiments, before adjusting the lower viewing angle of the virtual image according to the relative positional relationship between the first object in the real environment corresponding to the first information and the virtual image so that the first information is completely displayed in the adjusted virtual image, the method further includes:

[0015] If there are multiple first information to be displayed that cannot be completely displayed within the field of view angle range, determine the first information with the highest priority among the multiple first information;

[0016] The adjusting the lower viewing angle of the virtual image according to the relative positional relationship between the first object in the real environment corresponding to the first information and the virtual image so that the first information is completely displayed in the adjusted virtual image includes:

[0017] According to the relative positional relationship between the first object in the real environment corresponding to the first information with the highest priority and the virtual image, the lower viewing angle of the virtual image is adjusted so that the first information with the highest priority is completely displayed in the adjusted virtual image.

[0018] In some embodiments, before adjusting the lower viewing angle of the virtual image according to the relative positional relationship between the first object in the real environment corresponding to the first information and the virtual image so that the first information is completely displayed in the adjusted virtual image, the method further includes:

[0019] determining second information displayed in the virtual image having a priority greater than the first information;

[0020] If the second information cannot be fully displayed in the adjusted virtual image after the current lower viewing angle of the virtual image is adjusted, determine not to adjust the current lower viewing angle; otherwise, adjust the lower viewing angle of the virtual image so that the first information is fully displayed in the adjusted virtual image.

[0021] In some embodiments, the determining whether the first information to be displayed can be completely displayed in a virtual image within a field of view of the head-up display includes:

[0022] Obtaining a vertical field of view angle of the head-up display;

[0023] Determine the spatial range formed by the upper edge, the lower edge and the road surface of the vertical field of view;

[0024] According to the position of the first object in the real environment corresponding to the first information and the spatial range, it is determined whether the first information to be displayed can be completely displayed in the virtual image within the field of view of the head-up display.

[0025] In some embodiments, judging whether the first information to be displayed can be completely displayed in a virtual image within a field of view of a head-up display according to a position of a first object in a real environment corresponding to the first information and the spatial range includes:

[0026] If the first object is located in the first area, determining that the first object cannot be fully displayed within the field of view angle;

[0027] If the first object is located in the second area, determining that the first object can be fully displayed within the field of view angle;

[0028] Among them, the first area is the area enclosed by the lower edge of the vertical field of view angle and the road surface on the side close to the eye box range, and the second area is the area enclosed by the lower edge of the vertical field of view angle, the road surface on the side away from the eye box range and the upper edge of the vertical field of view angle.

[0029] In some embodiments, the determining whether the first information to be displayed can be completely displayed in a virtual image within a field of view of the head-up display includes:

[0030] Determining whether the first information can be fully displayed within the field of view of the head-up display according to the coordinate position and display size of the first information in the display screen displayed by the image generation unit of the head-up display; and / or

[0031] Acquire location information of the first object in the real environment;

[0032] Obtaining rendering parameters of a rendering camera in a renderer of the head-up display, wherein the rendering parameters include a rendering angle and a rendering position;

[0033] According to the position information of the first object in the real environment and the rendering parameters of the rendering camera, it is determined whether the first information can be fully displayed within the field of view of the head-up display.

[0034] In some embodiments, the determining whether the first information to be displayed can be completely displayed in a virtual image within a field of view of the head-up display includes:

[0035] determining a criterion for determining whether the first information can be displayed according to the type of the first information;

[0036] determining, according to the judgment criterion, whether the first information can be fully displayed within the field of view of the head-up display;

[0037] If the first information is a preceding vehicle lock mark and the distance between the target vehicle and the preceding vehicle is less than a preset distance threshold, it is determined that the first information cannot be fully displayed within the field of view of the head-up display.

[0038] In some embodiments, before determining whether the first information to be displayed can be completely displayed in the virtual image within the field of view of the head-up display, the method further includes:

[0039] Determining whether there is currently the first information to be displayed, wherein the first information is used for fusion display with the first object in the real environment;

[0040] In the presence of the first information to be displayed, determining a current vehicle speed;

[0041] The height of the virtual image is adjusted according to the current vehicle speed.

[0042] In some embodiments, adjusting the height of the virtual image according to the current vehicle speed includes:

[0043] When the current vehicle speed exceeds a preset speed threshold, increasing the height of the virtual image; or,

[0044] When the current vehicle speed is lower than the preset speed threshold, the height of the virtual image is maintained.

[0045] The present disclosure also provides a head-up display device, including:

[0046] a determination module configured to determine whether the first information to be displayed can be completely displayed in a virtual image within a field of view of the head-up display;

[0047] The adjustment module is configured to adjust the lower viewing angle of the virtual image according to the relative position relationship between a first object in a real environment corresponding to the first information and the virtual image if the first information to be displayed cannot be fully displayed in the virtual image within the field of view of the head-up display so that the first information can be fully displayed in the adjusted virtual image.

[0048] The disclosed embodiment also provides a means of transportation, comprising the above-mentioned head-up display device.

[0049] An embodiment of the present disclosure further provides an electronic device, comprising at least a memory and a processor, wherein the memory stores a computer program, and the processor implements the steps of the above method when executing the computer program in the memory.

[0050] The embodiment of the present disclosure further provides a computer-readable storage medium, wherein the computer-readable medium stores a computer program, and when the computer program is executed by a processor, the steps of the above method are implemented.

[0051] The head-up display method, device, vehicle, electronic device and storage medium provided by the embodiments of the present disclosure determine whether the first information to be displayed can be completely displayed in the virtual image within the field of view angle of the head-up display. When it is determined that the first information cannot be completely displayed in the virtual image within the field of view angle of the head-up display, the lower viewing angle of the virtual image is adjusted to make the first information completely displayed in the adjusted virtual image. The lower viewing angle can be adjusted in time according to the information to be displayed to ensure that each AR information is completely displayed in the virtual image, thereby solving the technical problem in the prior art that the display of AR information at different positions cannot be taken into account due to insufficient vertical field of view, thereby improving the user's HUD usage experience and driving safety. BRIEF DESCRIPTION OF THE DRAWINGS

[0052] In order to more clearly illustrate the embodiments of the present disclosure or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0053] Figure 1 This is the imaging principle diagram of the head-up display;

[0054] Figure 2 A schematic diagram of a head-up display;

[0055] Figure 3 is a flow chart of a head-up display method according to an embodiment of the present disclosure;

[0056] Figure 4 is a schematic diagram of displaying a virtual image of a head-up display in a head-up display method according to an embodiment of the present disclosure;

[0057] Figure 5 A first display schematic diagram of downward viewing angle adjustment in the head-up display method of an embodiment of the present disclosure (including a cross-sectional view of the viewing angle along the direction of the road ahead);

[0058] Figure 6 A second display schematic diagram of the downward viewing angle adjustment in the head-up display method of an embodiment of the present disclosure (including a cross-sectional view of the viewing angle along the direction of the road ahead);

[0059] Figure 7 A third display schematic diagram of the downward viewing angle adjustment in the head-up display method of an embodiment of the present disclosure (including a cross-sectional view of the viewing angle along the direction of the road ahead);

[0060] Figure 8 Schematic diagram of imaging of a head-up display in a head-up display method according to an embodiment of the present disclosure;

[0061] Fig. 9 Schematic diagram of the structure of the head-up display device according to an embodiment of the present disclosure. DETAILED DESCRIPTION

[0062] Various aspects and features of the present disclosure are described herein with reference to the drawings.

[0063] It should be understood that various modifications may be made to the embodiments of the present application. Therefore, the above description should not be considered as limiting, but only as an example of an embodiment. Other modifications within the scope and spirit of the present disclosure will occur to those skilled in the art.

[0064] The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate embodiments of the present disclosure and, together with the general description of the present disclosure given above and the detailed description of the embodiments given below, serve to explain the principles of the present disclosure.

[0065] These and other characteristics of the present disclosure will become apparent from the following description of a preferred form of embodiment given as a non-limiting example, with reference to the attached drawings.

[0066] It should also be understood that, although the present disclosure has been described with reference to some specific examples, those skilled in the art will be able to realize many other equivalent forms of the present disclosure that have the features described in the claims and are therefore within the scope of protection defined thereby.

[0067] The above and other aspects, features and advantages of the present disclosure will become more apparent from the following detailed description when taken in conjunction with the accompanying drawings.

[0068] Specific embodiments of the present disclosure are described hereinafter with reference to the accompanying drawings; however, it should be understood that the embodiments claimed are merely examples of the present disclosure, which may be implemented in a variety of ways. Well-known and / or repeated functions and structures are not described in detail to avoid obscuring the present disclosure with unnecessary or redundant details. Therefore, the specific structural and functional details claimed herein are not intended to be limiting, but merely serve as a basis and representative basis for the claims to teach those skilled in the art to use the present disclosure in a variety of ways with substantially any suitable detailed structure.

[0069] This specification may use the phrases "in one embodiment," "in another embodiment," "in a further embodiment," or "in other embodiments," all of which may refer to one or more of the same or different embodiments according to the present disclosure.

[0070] like Figure 1 and Figure 2 As shown in FIG. 1 , AR-HUD superimposes the projected virtual image of driving information with the real environment to achieve deep fusion of the image and the real world. The information that needs to be displayed in the virtual image (Virtual Image) projected by AR-HUD is mainly AR information (such as UI logos, text, etc.) that is fused (or called superimposed) with real objects such as the front vehicle, intersections, buildings, pedestrians, etc. in the real environment. The display position of AR information on the virtual image is usually determined by the position of these real objects. In some cases, if the overall height of the virtual image is too high when the head-up display is designed, when the distance between the vehicle and the vehicle in front is too close, the display position of the front vehicle lock mark that can be integrated with the position of the front vehicle (when the front vehicle lock mark is displayed in the virtual image, it is displayed as superimposed on the position of the front vehicle, for example, superimposed on the bottom position of the front vehicle, used to prompt the user to pay attention to the front vehicle) is located outside the field of view angle (that is, beyond the virtual image range and below the virtual image). Therefore, the front vehicle lock mark that was originally required to be displayed in the virtual image cannot be displayed normally in the virtual image, resulting in the user being unable to see the front vehicle lock mark. That is, when the field of view angle is limited, some AR information cannot be displayed in the virtual image, affecting the HUD usage experience and driving safety.

[0071] Among them, Figure 2 As shown in the figure, the field of view is the angle between the two sides of the observable virtual image and the line connecting the center of the pupil of the human eye when the human eye is within the eye box of the AR-HUD (for example, at the center of the eye box), including the horizontal field of view (HFOV) and the vertical field of view (VFOV, also known as the longitudinal field of view). The field of view determines the coverage distance, lane range and display content of the head-up display. The field of view range is the virtual image range in which the user can see the virtual image clearly. If Figure 1 The virtual image projected in Figure 2 Within the field of view of , the human eye can observe the complete virtual image information; if Figure 1 Some of the information in the projected virtual image exceeds Figure 2 Within the field of view angle range, the human eye has a visual blind spot and cannot see the complete virtual image information.

[0072] In view of this, embodiments of the present disclosure provide a head-up display method, device, vehicle, electronic device, and storage medium.

[0073] Figure 3 A flow chart of the head-up display method of an embodiment of the present disclosure is shown. Figure 3 As shown, the embodiment of the present disclosure provides a head-up display method, including:

[0074] S101: Determine whether first information to be displayed can be completely displayed in a virtual image within a field of view of a head-up display.

[0075] Among them, the first information is AR information that integrates the real environment display of roads, buildings, front vehicles, pedestrians, road signs, etc., such as driving guides in the form of arrows that are superimposed on the front road and intersection and guide users to go straight, turn, etc., front vehicle lock marks for following or locking the front vehicle, traffic lights, names corresponding to places, types corresponding to places, icons corresponding to places, and other POI information (Point of Interest). In this embodiment, the field of view angle range of the head-up display is the virtual image range of the virtual image projected by the head-up display, so judging whether the first information can be fully displayed within the field of view angle range of the head-up display is to judge whether the first information can be fully displayed in the virtual image within the field of view angle range.

[0076] In this step, the first information to be displayed can be determined based on the driving state of the target vehicle on which the head-up display is installed. For example, when other vehicles appear in front of the target vehicle and the front vehicle is locked, the front vehicle lock mark can be determined as the first information to be displayed. After determining the first information to be displayed, it can be determined based on the predetermined field of view angle range of the head-up display whether the first information can be fully displayed in the virtual image within the field of view angle range. For example, the screen that the current FOV can cover (i.e., the virtual image within the current FOV) can be determined based on the field of view angle range, and then it can be determined whether the first information can be fully displayed in the screen.

[0077] S102: If not, adjusting the lower viewing angle of the virtual image according to the relative positional relationship between the first object in the real environment corresponding to the first information and the virtual image so that the first information is completely displayed in the adjusted virtual image.

[0078] The first object is a real object in a real environment that is fused with the first information and displayed. For example, the first information is a locking mark 10 ( Figure 4 When the dotted line mark 10 is located at the rear wheel, the first object is the front vehicle locked in front of the current vehicle, or a part of the front vehicle (such as the bottom of the front vehicle). In this embodiment, the first object corresponding to the front vehicle locking mark 10 is the rear tire of the target vehicle.

[0079] The lower viewing angle (LDA) of the virtual image is the angle between the line connecting the center point of the eye box and the center point of the virtual image and the horizontal direction.

[0080] Since the first information is AR information displayed by integrating the real objects in the real environment, the display position of the first information in the virtual image corresponds to the real object. Therefore, in this step, when it is determined that the first information cannot be fully displayed within the field of view angle of the head-up display, the lower viewing angle of the virtual image is adjusted according to the relative position relationship between the first object in the real environment corresponding to the first information and the virtual image, so that the display position of the front vehicle locking mark that can be integrated with the front vehicle position always falls within the field of view angle of the head-up display, that is, falls within the display range of the virtual image, so that the front vehicle locking mark can be fully displayed in the adjusted virtual image (that is, the virtual image after the lower viewing angle is adjusted).

[0081] The head-up display method provided by the embodiment of the present disclosure determines whether the first information to be displayed can be completely displayed in the virtual image within the field of view angle of the head-up display. When it is determined that the first information cannot be completely displayed in the virtual image within the field of view angle of the head-up display, the lower viewing angle of the virtual image is adjusted to make the first information completely displayed in the adjusted virtual image. The lower viewing angle can be adjusted in time according to the information to be displayed to ensure that each AR information is completely displayed in the virtual image, thereby solving the technical problem in the prior art that the display of AR information at different positions cannot be taken into account due to insufficient vertical field of view, thereby improving the user's HUD usage experience and driving safety.

[0082] In some embodiments, in step S102, adjusting the lower viewing angle of the virtual image according to the relative positional relationship between the first object in the real environment corresponding to the first information and the virtual image so that the first information is completely displayed in the adjusted virtual image includes:

[0083] S1021: determining, according to the position of the first object in the real environment, a relative position relationship between the first object and the virtual image in a height direction of the virtual image, wherein the relative position relationship includes whether the first object is above or below the virtual image;

[0084] S1022: adjusting the bottom viewing angle of the virtual image according to the relative position relationship.

[0085] In this step, the position of the first object in the real environment can be obtained by means of a camera, sensor, radar or other equipment installed in the target vehicle, or in combination with a vehicle navigation system, to determine whether the first object is in an upper or lower position relative to the virtual image in the height direction of the virtual image, and then the lower viewing angle of the virtual image is adjusted according to the relative position relationship, thereby adjusting the height of the virtual image so that the first information can be fully displayed in the virtual image.

[0086] Determining the relative positional relationship between the first object and the virtual image in the height direction of the virtual image may include determining the display position corresponding to the first object on the plane where the virtual image is located, and determining the relative positional relationship between the first object and the virtual image in the height direction of the virtual image according to the display position. For example, the intersection of the line connecting the first object and the center of the eye box range and the plane where the virtual image is located may be used as the display position corresponding to the first object on the plane where the virtual image is located, and according to the positional relationship of the display position in the height direction of the virtual image relative to a preset position in the virtual image (e.g., the center of the virtual image, the bottom of the virtual image, and the lower edge of the virtual image), it is determined whether the display position is above or below the virtual image, wherein when the display position is above the virtual image, it is determined that the first object is above the virtual image, and when the display position is below the virtual image, it is determined that the first object is below the virtual image.

[0087] Optionally, adjusting the lower viewing angle of the virtual image according to the relative positional relationship between the first object in the real environment corresponding to the first information and the virtual image so that the first information is completely displayed in the adjusted virtual image includes:

[0088] Determine a display position corresponding to the first object on the plane where the virtual image is located, and adjust the lower viewing angle of the virtual image according to the positional relationship of the display position in the virtual image height direction relative to a preset position in the virtual image so that the first information is fully displayed in the adjusted virtual image.

[0089] Furthermore, in this embodiment, the relative position relationship between the first object and the virtual image in the height direction of the virtual image can be determined in combination with the first information to be displayed and the driving state of the target vehicle. For example, when the first information to be displayed is a locking mark of a preceding vehicle, when the distance between the locked preceding vehicle and the target vehicle is relatively close, it is determined that the preceding vehicle is at a lower position relative to the virtual image of the head-up display of the target vehicle, or when the distance between the locked preceding vehicle and the target vehicle is relatively far, it is determined that the preceding vehicle is at an upper position relative to the virtual image of the head-up display of the target vehicle.

[0090] In some embodiments, in step S1022, adjusting the bottom viewing angle of the virtual image according to the relative position relationship includes:

[0091] If the first object is below the virtual image, increasing the lower viewing angle of the virtual image; or,

[0092] If the first object is above the virtual image, the lower viewing angle of the virtual image is reduced.

[0093] like Figure 5 As shown in FIG. 1 , if the first object is lower than the virtual image, it is determined that the overall height of the virtual image is higher, or the display position of the first information to be displayed is lower. In this case, Figure 6As shown, the lower viewing angle of the virtual image is increased, so that the virtual image moves downward as a whole, and its overall height is reduced, so that the first information that needs a lower display position can be within the virtual image range of the virtual image. If the first object is higher than the virtual image, it is determined that the overall height of the virtual image is lower, or the display position of the first information to be displayed is higher. At this time, the lower viewing angle of the virtual image is reduced, so that the virtual image moves upward as a whole, and its overall height is increased, so that the first information that needs a higher display position can be within the virtual image range of the virtual image.

[0094] When specifically adjusting the lower viewing angle of the virtual image, Figure 5 and Figure 6 As shown, the lower viewing angle adjustment parameters of the virtual image can be determined according to the relative position relationship between the first object in the real environment corresponding to the first information and the virtual image and the current lower viewing angle (LDA1) of the virtual image; the virtual image is adjusted according to the lower viewing angle adjustment parameters, so that the lower viewing angle is adjusted from LDA1 to LDA2, so that the first information can be fully displayed in the adjusted virtual image, so that the user can observe the complete first information.

[0095] In this embodiment, increasing or decreasing the lower viewing angle refers to increasing or decreasing the absolute value of the lower viewing angle. Figure 5 As shown, the lower viewing angle is below the horizontal direction AB, and the lower viewing angle is usually defined as a negative value, such as -3°. Increasing the lower viewing angle means increasing the absolute value of the lower viewing angle, such as adjusting it to -4°; decreasing the lower viewing angle means decreasing the absolute value of the lower viewing angle, such as adjusting it to -2.5°.

[0096] In other embodiments, when adjusting the lower viewing angle of the virtual image, the adjustment parameters of the lower viewing angle of the virtual image may be determined in combination with the viewing angle range within which the driver can see the virtual image. Figure 7 As shown, the lower viewing angle of the virtual image can be directly adjusted to LDA3 to ensure that the user can observe the complete first information. That is, in this embodiment, the lower viewing angle can be adjusted according to the DMS data (the viewing angle range when the driver's eyes can see the display screen) and the relative position relationship between the first object and the virtual image in the height direction of the virtual image to ensure that the display position of the first information to be displayed does not exceed the vertical viewing angle range when the driver's eyes can see the display screen of the virtual image.

[0097] When determining the specific adjustment angle of the lower viewing angle, since different drivers have different heights and different eye heights, when drivers of different heights view the virtual image, the viewing angle range of the virtual image that can be seen is also different. For example, some drivers can only see the upper half of the virtual image, another part of the drivers can see the middle part of the virtual image, and another part can only see the lower half of the virtual image. Therefore, when determining the adjustment angle value of the lower viewing angle, it is necessary to consider the eye height of the driver. For example, the longitudinal viewing angle range when a driver can see the display screen is -1.5° to -4.5° (i.e., the angle range between the line of sight and the horizontal direction when the driver can see the virtual image). When the lower viewing angle is adjusted, the adjusted lower viewing angle will not exceed the longitudinal viewing angle range, thereby ensuring that the first information displayed in the adjusted virtual image can be viewed by the driver.

[0098] In a specific embodiment, when the target vehicle passes through a narrow section of road, the first information to be displayed includes indicators such as the width distance between the outermost side of the vehicle and the edge of the road and / or the difficulty of passing through the section of road. The first information needs to be displayed in contact with the road surface or at a lower height from the road surface, that is, the first object is lower than the virtual image, and the display position of the first information is lower. At this time, it is necessary to increase the lower viewing angle of the virtual image to reduce the overall height of the virtual image so that the first information displayed at a lower position can be fully displayed within the virtual image range of the virtual image.

[0099] In another specific embodiment, when the target vehicle is far from the intersection (the first object corresponding to the AR turning guide arrow), the intersection is above the virtual image, and the display position required for the AR turning guide arrow is high. At this time, it is necessary to reduce the lower viewing angle of the virtual image and increase the overall height of the virtual image so that the AR turning guide arrow with a higher display position can be fully displayed within the virtual image range of the virtual image; as the target vehicle moves forward, the target vehicle is getting closer and closer to the intersection. When the target vehicle is closer to the intersection, the intersection gradually fits the road surface display, that is, the intersection is lower relative to the virtual image, and the display position required for the AR turning guide arrow is lower. At this time, it is necessary to increase the lower viewing angle of the virtual image and reduce the overall height of the virtual image so that the AR turning guide arrow with a lower display position can be fully displayed within the virtual image range of the virtual image. That is, in this embodiment, the lower viewing angle of the virtual image can be adjusted dynamically in real time according to the driving state of the vehicle, so that the first information can be fully displayed in real time according to the positional relationship of the dynamically changing first object relative to the virtual image.

[0100] In another specific embodiment, when POIs such as buildings appear in front of or on both sides of the road, the above-mentioned POIs are usually located above the road surface, and the real objects corresponding to the POIs are relatively above the virtual image. At this time, the lower viewing angle of the virtual image can be lowered and the overall height of the virtual image can be increased, so that the POIs with higher display positions can be fully displayed within the virtual image range of the virtual image.

[0101] For example, Figure 4 As shown, when the POI is a probe identifier 30, when the target vehicle is far away from the probe, the probe is centered relative to the virtual image. As the target vehicle gets closer and closer to the probe, the probe is biased upward relative to the virtual image. At this time, the required display position of the probe identifier 30 is relatively high. At this time, it is necessary to lower the lower viewing angle of the virtual image and increase the overall height of the virtual image so that the probe identifier 30 with a higher display position can be fully displayed within the virtual image range of the virtual image.

[0102] It is understandable that, after the first information to be displayed in the virtual image is displayed, the lower viewing angle of the virtual image can be switched to the default lower viewing angle, so that the lower viewing angle can be adjusted only in special circumstances, and in the case of normal driving of the target vehicle, the virtual image is displayed using the default lower viewing angle that can fully display most of the AR information. Alternatively, after the first information is displayed, the lower viewing angle can be re-determined according to the DMS, and the display position of the display screen of the virtual image can be dynamically adjusted according to the re-determined lower viewing angle. For example, according to the eye height of the driver detected by the DMS, the lower viewing angle corresponding to the eye height is determined, and the virtual image height is adjusted according to the lower viewing angle. Among them, the eye height and the lower viewing angle have a one-to-one correspondence.

[0103] In some embodiments, before executing step S102, the method further includes:

[0104] S103: If there are multiple first information to be displayed that cannot be completely displayed within the field of view angle range, determine the first information with the highest priority among the multiple first information;

[0105] In step S102, adjusting the lower viewing angle of the virtual image according to the relative positional relationship between the first object in the real environment corresponding to the first information and the virtual image so that the first information is completely displayed in the adjusted virtual image specifically includes:

[0106] According to the relative positional relationship between the first object in the real environment corresponding to the first information with the highest priority and the virtual image, the lower viewing angle of the virtual image is adjusted so that the first information with the highest priority is completely displayed in the adjusted virtual image.

[0107] For example, Figure 4 As shown, when the target vehicle moves forward, the vehicle ahead is locked in real time, and the first information to be displayed includes a front vehicle locking mark 10. When the distance between the target vehicle and the vehicle ahead is too close, a collision warning mark 20 ( Figure 4The first information (the triangle mark displayed behind the front vehicle) is used to prompt the user to avoid collision in time. The display position of the collision warning mark 20 is higher than the display position of the locking mark 10 of the front vehicle. At this time, due to the high importance of the collision warning mark 20, the lower viewing angle of the virtual image is adjusted according to the position relationship of the first object (the rear window glass of the front vehicle) corresponding to the collision warning mark 20 relative to the virtual image. The position of the rear window glass of the front vehicle is higher than the virtual image. At this time, the lower viewing angle of the virtual image can be reduced, and the overall height of the virtual image can be moved up, so that the collision warning mark 20 is completely displayed within the virtual image range of the virtual image, so that the user can view the collision warning mark 20 fully displayed in the virtual image.

[0108] In some embodiments, before executing step S102, the method further includes:

[0109] S104: Determine second information displayed in the virtual image with a priority greater than the first information;

[0110] S105: If the second information cannot be fully displayed in the adjusted virtual image after the current lower viewing angle of the virtual image is adjusted, determine not to adjust the current lower viewing angle; otherwise, adjust the lower viewing angle of the virtual image so that the first information is fully displayed in the adjusted virtual image.

[0111] In this embodiment, the second information currently displayed in the virtual image can also be considered, and then according to the priority of the first information and the second information, it is determined whether the lower viewing angle of the virtual image needs to be adjusted. For example, the second information currently displayed is the signal light sign at the intersection ahead. When the target vehicle is about to drive to the intersection, in order to avoid traffic accidents such as running a red light, the importance of the signal light sign is greater than the importance of the front vehicle lock sign 10, that is, the priority of the second information display is greater than the priority of the first information display. At this time, it can be pre-determined whether the adjustment of the lower viewing angle according to the first information will affect the complete display of the second information. If it does, the current lower viewing angle will not be adjusted, and the complete display of the second information will be prioritized; if it does not affect, the current lower viewing angle is adjusted through step S102 to ensure the complete display of the first information.

[0112] In some embodiments, Figure 5 As shown, in step S101, the step of determining whether the first information to be displayed can be completely displayed in a virtual image within the field of view of the head-up display includes:

[0113] S201: Acquire the vertical field of view angle of the head-up display;

[0114] S202: Determine a spatial range formed by an upper edge, a lower edge of the vertical field of view angle and a road surface;

[0115] S203: judging, according to the position of the first object in the real environment corresponding to the first information and the spatial range, whether the first information to be displayed can be completely displayed in a virtual image within the field of view of the head-up display.

[0116] Since in this embodiment, the lower viewing angle of the virtual image is mainly adjusted, therefore, in this embodiment, Figure 5 As shown, the height h of the eye box range (for example, the center of the eye box range), the VID distance (imaging distance of the virtual image), the vertical field of view (VFOV), the current lower viewing angle (the angle LDA between the direction OA and the direction AB, A is the center of the eye box range) and other data can be obtained through the DMS to calculate the nearest ground position (point a) that can be covered by the VFOV in the current state, and determine the spatial range formed by the upper edge AB and the lower edge AC of the vertical field of view and the road surface MN. Then, according to parameters such as the position and size of the first object P in the real environment, the specific spatial range of the first object P is determined, and then the specific spatial range of the first object P is compared with the field of view range of the head-up display (the range formed by ∠BAC) to determine whether the first information can be fully displayed in the virtual image within the field of view range of the head-up display.

[0117] Further, in step S203, judging whether the first information to be displayed can be completely displayed in a virtual image within the field of view of the head-up display according to the position of the first object in the real environment corresponding to the first information and the spatial range includes:

[0118] S2031: If the first object is located in the first area, determine that the first object cannot be completely displayed within the field of view angle range;

[0119] S2032: If the first object is located in the second area, determine that the first object can be fully displayed within the field of view angle range;

[0120] Among them, the first area is the area enclosed by the lower edge of the vertical field of view angle and the road surface on the side close to the eye box range, and the second area is the area enclosed by the lower edge of the vertical field of view angle, the road surface on the side away from the eye box range and the upper edge of the vertical field of view angle.

[0121] Specifically, Figure 5 The cross-sectional view of the field of view along the road ahead is shown in FIG. Figure 5As shown, the lower edge of the vertical field of view, that is, the plane where the lower boundary of the virtual image and the center of the eye box range are located, AC is located in the plane; the upper edge of the vertical field of view, that is, the plane where the upper boundary of the virtual image and the center of the eye box range are located, AB is located in the plane. That is, according to the upper edge and lower edge of the vertical field of view and the road surface, the space area in front of the target vehicle is divided into two areas, namely the first area and the second area. The second area is the space surrounded (or formed) by the directions BA, Aa, and aN, and the first area is the space surrounded (or formed) by the directions Aa and aM. The vertical plane corresponding to BOC is the virtual image range of the virtual image. When the first object P is in the first area, the first information corresponding to the first object P is located outside the user's field of view range (BAC), and the first information cannot be fully displayed; when the first object P is in the second area, the first information corresponding to the first object P is located within the user's field of view range (BAC), and the first information can be fully displayed.

[0122] like Figure 6 As shown, by increasing the downward viewing angle from LDA1 to LDA2, the first position changes from a to b. At this time, the first object P is in the second area (the space surrounded by BA, Ab, and bN), which is within the field of view range (BAC) of the head-up display, and the first information can be fully displayed. Figure 7 As shown, after the lower viewing angle is reduced from LDA1 to LDA3, the first position is C, and the first information can be completely displayed in the second area (the space surrounded by BA, AC, and CN) at the first object P.

[0123] In some other embodiments, in step S203, determining whether the first information to be displayed can be completely displayed in a virtual image within the field of view of the head-up display includes:

[0124] S301: Determine whether the first information can be fully displayed within the field of view of the head-up display according to the coordinate position and display size of the first information in the display screen displayed by the image generation unit of the head-up display.

[0125] The picture displayed by the image generation unit (PGU, referred to as the image source, such as an LCD liquid crystal display) in the HUD is the picture to be displayed by the virtual image in the current FOV. Therefore, in this embodiment, it is possible to directly determine whether the first information is being fully displayed within the field of view of the head-up display based on the coordinate position and display size data of the first information on the pgu, without determining the first object corresponding to the first information, thereby avoiding inaccurate determination when the first object is not accurately determined.

[0126] In some further embodiments, in step S203, the determining whether the first information to be displayed can be completely displayed in a virtual image within the field of view of the head-up display includes:

[0127] S401: Acquire location information of the first object in a real environment;

[0128] S402: Obtain rendering parameters of a rendering camera in a renderer of the head-up display, wherein the rendering parameters include a rendering angle and a rendering position;

[0129] S403: Determine whether the first information can be fully displayed within the field of view of a head-up display according to the position information of the first object in the real environment and the rendering parameters of the rendering camera.

[0130] Since the HUD display screen is rendered in real time in the renderer, in this embodiment, the position information of the first object in the real environment corresponding to the first information to be displayed (such as the front vehicle lock mark 10 displayed on the bottom of the rear tire) can be obtained first, and then, the rendering camera angle and position can be combined in the renderer to confirm whether the first information can be displayed in the current FOV and whether it can be fully displayed in the current FOV.

[0131] It can be understood that the above steps S201 to S203, S301 and S401 to S403 can be executed separately or in combination to accurately determine whether the first information can be fully displayed within the field of view of the head-up display. For example, the judgment can be made through steps S201 to S203, and the judgment results of S201 to S203 can be verified through S301 or S401 to S403.

[0132] In some other embodiments, in step S203, determining whether the first information in the driving scene can be fully displayed within the field of view of the head-up display includes:

[0133] S501: Determine a criterion for determining whether the first information can be displayed according to the type of the first information;

[0134] S502: Determine, according to the judgment standard, whether the first information can be fully displayed within the field of view of the head-up display;

[0135] If the first information is a preceding vehicle lock mark and the distance between the target vehicle and the preceding vehicle is less than a preset distance threshold, it is determined that the first information cannot be fully displayed within the field of view of the head-up display.

[0136] The types of the first information are different, so the criteria for judging whether the first information can be displayed on the head-up display are also different. Therefore, in this embodiment, a judgment is made based on the type of the first information and the criteria for judging whether the first information can be displayed, so as to improve the judgment efficiency and the subsequent downward viewing angle adjustment efficiency and effect.

[0137] For example, when the first information is the front vehicle locking mark 10, when the distance between the target vehicle and the front vehicle is greater than the preset distance threshold, whether the front vehicle locking mark 10 can be fully displayed in the virtual image has little impact on the user's driving safety. At this time, there is no need to adjust the lower viewing angle. When the distance between the target vehicle and the front vehicle is less than the preset distance threshold, for example, less than the safe distance, in order to ensure driving safety, at this time, it is determined that the first information cannot be fully displayed within the field of view angle range of the head-up display, and then according to the relative position relationship between the first object corresponding to the first information and the virtual image, the lower viewing angle of the virtual image is adjusted to ensure that the first information is fully displayed within the virtual image range of the virtual image, so that when the target vehicle is close to the front vehicle, the front vehicle can be locked in real time, and the corresponding prompt information (such as the above-mentioned front vehicle locking mark 10) can be displayed in time.

[0138] In other embodiments, if the first information is a traffic light sign, it can be determined whether the first information can be fully displayed within the field of view of the head-up display according to the distance between the target vehicle and the intersection ahead.

[0139] In the above embodiment, the case where the first information is AR information is mainly described, and the adjustment of the lower viewing angle of the AR display layer is explained. Figure 8 As shown, since the centers of the virtual images coincide, that is, the lower viewing angles of the near-layer (head-up display layer) virtual image and the far-layer (AR display layer, which may be multiple layers arranged at intervals) virtual image change simultaneously, the display screen of the near-layer virtual image usually displays instrument information such as vehicle speed, fuel consumption, and speed limit signs, and the above information does not need to be integrated with real objects in the real environment, and the display screen of the far-layer virtual image displays AR information integrated with the real environment.

[0140] After adjusting the lower viewing angle of the display picture of the far layer, the display picture of the near layer may not be adjusted, and the lower viewing angle of the display picture of the near layer changes with the adjustment of the lower viewing angle of the far layer.

[0141] In other embodiments, after adjusting the lower viewing angle of the far layer display screen, the UI information such as the instrument information displayed in the near layer display screen can be moved, so that the information displayed in the near layer display screen remains unchanged in the user's perception. That is, when the lower viewing angle is increased so that the heights of the near layer and far layer display screens decrease at the same time, the UI information displayed in the near layer moves up in the near layer display screen and keeps consistent with the rate of decrease in the height of the near layer display screen (corresponding to the adjustment rate of the lower viewing angle) until it reaches the boundary of the near layer display screen and no longer moves up. In this way, the display position of the same UI information in the near layer seen by the user remains unchanged, achieving consistency in the display effect of the near layer display screen, avoiding the information in the near layer display screen occupying too much attention of the user, and focusing more on the AR information of the AR display layer, thereby improving the user's HUD usage experience.

[0142] In some embodiments, before executing step S101 to determine whether the first information to be displayed can be completely displayed in the virtual image within the field of view of the head-up display, the method further includes:

[0143] S601: Determine whether there is the first information to be displayed currently, wherein the first information is used for fusion display with the first object in the real environment;

[0144] S602: if the first information to be displayed exists, determine the current vehicle speed;

[0145] S603: Adjusting the height of the virtual image according to the current vehicle speed.

[0146] The inventors of the present disclosure found during the research process that, under different vehicle speed conditions, in order to give the driver the same reaction time, the trigger distance of the AR information display is different. For example, the AR information is a turn prompt information that needs to be integrated with the intersection position (i.e., superimposed display). The turn prompt information is used to prompt the driver to turn at the intersection. When the vehicle is traveling at a speed of 120km / h, it is necessary to prompt the intersection position in advance when the distance between the vehicle and the intersection is about 200m, that is, it is necessary to display the AR information when it is 200m away from the intersection (the 200m distance is the trigger distance), so that the driver has about 6s to reach the intersection (i.e., the driver has 6s reaction time); when the vehicle is traveling at a speed of 30km / h, it is necessary to display the AR information when it is 50m away from the intersection, so that the driver's reaction time is also 6s.

[0147] like Figure 4As shown, when the AR information is displayed in the display screen of the head-up display, when the distance between the first object and the current vehicle (i.e., the vehicle equipped with the above-mentioned head-up display, or referred to as the target vehicle) is different, the display position of the AR information superimposed and displayed with the first object in the virtual image (xy plane) of the head-up display is different. For example, the first information corresponding to the first object located at the first mark 401 is displayed at a lower position in the virtual image, and the first information corresponding to the first object located at the second mark 402 is displayed at a higher position in the virtual image. Therefore, at different trigger distances, the display position of the AR information in the display screen of the head-up display is different. The display position of the AR information displayed at a distance of 200m from the intersection is higher than the display position of the AR information displayed at a distance of 50m from the intersection. However, when the vertical field of view (VFOV) of the head-up display is limited, the display of AR information at some distances may not be taken into account. For example, when the AR information corresponding to the first object 50m away from the intersection is displayed in the display screen, due to the limited range of the vertical field of view, the AR information corresponding to the first object 200m away from the intersection located at a higher position in the virtual image may not be displayed or may not be fully displayed. If the current vehicle speed is 120km / h, the AR information 200m away from the intersection cannot be displayed or cannot be fully displayed, and the user cannot be prompted to turn in time. When the AR information is displayed again 50m away from the intersection, it is already delayed, affecting driving safety.

[0148] Therefore, in this embodiment, when there is first information to be displayed (such as the above-mentioned AR information), the current vehicle speed is determined, and the height of the virtual image of the head-up display is adjusted according to the current vehicle speed, so that the height of the virtual image can match the current vehicle speed, and the height of the virtual image is more reasonable, so that the AR information can be displayed in the virtual image within the field of view. Among them, in order to make the height of the virtual image better adapt to the AR information to be displayed, steps S101 and S102 are further executed to further determine whether it can be fully displayed, and the lower viewing angle is adjusted accordingly. The height of the virtual image is adjusted again, so that the height of the virtual image can always match the first information to be displayed, thereby improving the user's HUD usage experience and driving experience, and solving the technical problem in the prior art that the AR information cannot be fully displayed in the display screen at different vehicle speeds due to the limited vertical field of view.

[0149] In step S603, the height of the virtual image is adjusted by adjusting the lower viewing angle of the virtual image as described above, or by other methods. For example, the height of the virtual image can be adjusted by adjusting the parameters of the optical system of the head-up display (such as the reflection position of the reflector).

[0150] In some embodiments, in step S603, adjusting the height of the virtual image projected by the head-up display according to the current vehicle speed includes:

[0151] S6031: when the current vehicle speed exceeds a preset speed threshold, increasing the height of the virtual image; or,

[0152] S6032: When the current vehicle speed is lower than the preset speed threshold, maintain the height of the virtual image.

[0153] Under the condition that the driver's reaction time is the same, if the vehicle speed is high, the turn prompt information needs to be displayed at a position farther from the intersection for prompting. Therefore, when the current vehicle speed exceeds the preset speed threshold, the height of the virtual image is increased so that the turn prompt information can be displayed in the virtual image after the height adjustment; when the current vehicle speed is lower than the preset speed threshold, the height of the virtual image can be kept unchanged, or step S101 is further performed, that is, determining whether the first information to be displayed can be fully displayed in the virtual image within the field of view of the head-up display. The above-mentioned preset speed threshold can be 90km / h, 80km / h, or other values, which are not specifically limited in the present disclosure.

[0154] Fig. 9 FIG. 2 shows a schematic diagram of the structure of a head-up display device according to an embodiment of the present disclosure. Fig. 9 As shown, based on the above head-up display method, the embodiment of the present disclosure further provides a head-up display device, including:

[0155] A determination module 100 determines whether the first information to be displayed can be completely displayed in a virtual image within a field of view of the head-up display;

[0156] The adjustment module 200 is configured to adjust the lower viewing angle of the virtual image according to the relative position relationship between a first object in a real environment corresponding to the first information and the virtual image if the first information to be displayed cannot be fully displayed in the virtual image within the field of view of the head-up display so that the first information can be fully displayed in the adjusted virtual image.

[0157] In some embodiments, the adjustment module 200 is further configured to:

[0158] Determine, according to the position of the first object in the real environment, a relative positional relationship between the first object and the virtual image in a height direction of the virtual image, wherein the relative positional relationship includes whether the first object is above or below the virtual image;

[0159] According to the relative position relationship, the lower viewing angle of the virtual image is adjusted.

[0160] In some embodiments, the adjustment module 200 is further configured to:

[0161] If the first object is below the virtual image, increasing the lower viewing angle of the virtual image; or,

[0162] If the first object is above the virtual image, the lower viewing angle of the virtual image is reduced.

[0163] In some embodiments, the head-up display device further includes:

[0164] a determination module configured to, before adjusting the lower viewing angle of the virtual image according to the relative positional relationship between the first object in the real environment corresponding to the first information and the virtual image so that the first information is completely displayed in the adjusted virtual image, determine the first information with the highest priority among the multiple first information if there are multiple first information to be displayed that cannot be completely displayed within the field of view angle range;

[0165] The adjustment module 200 is further configured as follows:

[0166] According to the relative positional relationship between the first object in the real environment corresponding to the first information with the highest priority and the virtual image, the lower viewing angle of the virtual image is adjusted so that the first information with the highest priority is completely displayed in the adjusted virtual image.

[0167] In some embodiments, the determination module is further configured to determine second information displayed in the virtual image having a priority greater than the first information before adjusting the lower viewing angle of the virtual image according to the relative positional relationship between the first object in the real environment corresponding to the first information and the virtual image so that the first information is fully displayed in the adjusted virtual image;

[0168] If the second information cannot be fully displayed in the adjusted virtual image after the current lower viewing angle of the virtual image is adjusted, determine not to adjust the current lower viewing angle; otherwise, adjust the lower viewing angle of the virtual image so that the first information is fully displayed in the adjusted virtual image.

[0169] In some embodiments, the determination module 100 is further configured to:

[0170] Obtaining a vertical field of view angle of the head-up display;

[0171] Determine the spatial range formed by the upper edge, the lower edge and the road surface of the vertical field of view;

[0172] According to the position of the first object in the real environment corresponding to the first information and the spatial range, it is determined whether the first information to be displayed can be completely displayed in the virtual image within the field of view of the head-up display.

[0173] In some embodiments, the determination module 100 is further configured to:

[0174] If the first object is located in the first area, determining that the first object cannot be fully displayed within the field of view angle;

[0175] If the first object is located in the second area, determining that the first object can be fully displayed within the field of view angle;

[0176] Among them, the first area is the area enclosed by the lower edge of the vertical field of view angle and the road surface on the side close to the eye box range, and the second area is the area enclosed by the lower edge of the vertical field of view angle, the road surface on the side away from the eye box range and the upper edge of the vertical field of view angle.

[0177] In some embodiments, the determination module 100 is further configured to:

[0178] Determining whether the first information can be fully displayed within the field of view of the head-up display according to the coordinate position and display size of the first information in the display screen displayed by the image generation unit of the head-up display; and / or

[0179] Acquire location information of the first object in the real environment;

[0180] Obtaining rendering parameters of a rendering camera in a renderer of the head-up display, wherein the rendering parameters include a rendering angle and a rendering position;

[0181] According to the position information of the first object in the real environment and the rendering parameters of the rendering camera, it is determined whether the first information can be fully displayed within the field of view of the head-up display.

[0182] In some embodiments, the determination module 100 is further configured to:

[0183] determining a criterion for determining whether the first information can be displayed according to the type of the first information;

[0184] determining, according to the judgment criterion, whether the first information can be fully displayed within the field of view of the head-up display;

[0185] If the first information is a preceding vehicle lock mark and the distance between the target vehicle and the preceding vehicle is less than a preset distance threshold, it is determined that the first information cannot be fully displayed within the field of view of the head-up display.

[0186] In some embodiments, the adjustment module 200 is further configured to: before determining whether the first information to be displayed can be completely displayed in the virtual image within the field of view of the head-up display,

[0187] Determining whether there is currently the first information to be displayed, wherein the first information is used for fusion display with the first object in the real environment;

[0188] In the presence of the first information to be displayed, determining a current vehicle speed;

[0189] The height of the virtual image is adjusted according to the current vehicle speed.

[0190] In some embodiments, the adjustment module 200 is further configured to:

[0191] When the current vehicle speed exceeds a preset speed threshold, increasing the height of the virtual image; or,

[0192] When the current vehicle speed is lower than the preset speed threshold, the height of the virtual image is maintained. It should be noted that the head-up display device provided in the embodiment of the present disclosure corresponds to the head-up display method in the above embodiment. Based on the above head-up display method, those skilled in the art can understand the specific implementation of the head-up display device in the embodiment of the present disclosure and its various variations. Any optional items in the head-up display method embodiment are also applicable to the head-up display device, which will not be described in detail here.

[0193] The embodiment of the present disclosure also provides a means of transportation, including the above-mentioned display device. The means of transportation may be a car, a truck, a train, an airplane, or other means of transportation.

[0194] An embodiment of the present disclosure further provides an electronic device, comprising at least a memory and a processor, wherein the memory stores a computer program, and the processor implements the steps of the above method when executing the computer program in the memory.

[0195] In some embodiments, the processor executing the computer program may be a processing device including one or more general-purpose processing devices, such as a microprocessor, a central processing unit (CPU), a graphics processing unit (GPU), etc. More specifically, the processor may be a complex instruction set computing (CISC) microprocessor, a reduced instruction set computing (RISC) microprocessor, a very long instruction word (VLIW) microprocessor, a processor running other instruction sets, or a processor running a combination of instruction sets. The processor may also be one or more special-purpose processing devices, such as an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA), a digital signal processor (DSP), a system on a chip (SoC), etc.

[0196] The memory may be a read-only memory (ROM), a random access memory (RAM), a phase-change random access memory (PRAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), an electrically erasable programmable read-only memory (EEPROM), other types of random access memory (RAM), a flash disk or other form of flash memory, a cache, a register, a static memory, a compact disk read-only memory (CD-ROM), a digital versatile disk (DVD) or other optical storage, a cassette or other magnetic storage device, or any other possible non-temporary medium used to store information or instructions that can be accessed by a computer device.

[0197] The electronic devices of the embodiments of the present disclosure may include but are not limited to fixed terminal devices such as servers, desktop computers, digital TVs, etc., and mobile terminal devices such as vehicle-mounted devices (such as head-up display devices), handheld devices (such as mobile phones, tablet computers, etc.), wearable devices (such as smart watches, smart bracelets, etc.), etc.

[0198] The embodiment of the present disclosure further provides a computer-readable storage medium, wherein the computer-readable medium stores a computer program, and when the computer program is executed by a processor, the steps of the above method are implemented.

[0199] The computer-readable storage medium of the embodiments of the present disclosure may adopt any combination of one or more computer-readable media. The computer-readable medium may be a computer-readable signal medium or a computer-readable storage medium. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. In the embodiments of the present disclosure, the computer-readable storage medium may be any tangible medium containing or storing a program, which may be used by or in combination with an instruction execution system, device or device, for example, the above-mentioned memory.

[0200] The computer programs of the embodiments of the present disclosure may be organized into one or more computer executable components or modules. Any number and combination of such components or modules may be used to implement the various aspects of the present disclosure. For example, the various aspects of the present disclosure are not limited to the specific computer executable instructions or specific components or modules shown in the drawings and described herein. Other embodiments may include different computer executable instructions or components with more or less functions than those shown and described herein.

[0201] The above description is only a preferred embodiment of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosed concept. For example, the above features are replaced with the technical features with similar functions disclosed in the present disclosure (but not limited to) by each other to form a technical solution.

Claims

1. A head-up display method, It is characterized in that include: determining whether the first information to be displayed can be completely displayed in a virtual image within a field of view of the head-up display; If not, according to the relative positional relationship between the first object in the real environment corresponding to the first information and the virtual image, the lower viewing angle of the virtual image is adjusted so that the first information is completely displayed in the adjusted virtual image.

2. The method according to claim 1, It is characterized in that The adjusting the lower viewing angle of the virtual image according to the relative positional relationship between the first object in the real environment corresponding to the first information and the virtual image so that the first information is completely displayed in the adjusted virtual image includes: Determine, according to the position of the first object in the real environment, a relative positional relationship between the first object and the virtual image in a height direction of the virtual image, wherein the relative positional relationship includes whether the first object is above or below the virtual image; According to the relative position relationship, the lower viewing angle of the virtual image is adjusted.

3. The method according to claim 2, It is characterized in that The adjusting the lower viewing angle of the virtual image according to the relative position relationship comprises: If the first object is below the virtual image, increasing the lower viewing angle of the virtual image; or, If the first object is above the virtual image, the lower viewing angle of the virtual image is reduced.

4. The method according to claim 1, It is characterized in that According to the relative positional relationship between the first object in the real environment corresponding to the first information and the virtual image, before adjusting the lower viewing angle of the virtual image so that the first information is completely displayed in the adjusted virtual image, the method further includes: If there are multiple first information to be displayed that cannot be completely displayed within the field of view angle range, determine the first information with the highest priority among the multiple first information; The adjusting the lower viewing angle of the virtual image according to the relative positional relationship between the first object in the real environment corresponding to the first information and the virtual image so that the first information is completely displayed in the adjusted virtual image includes: According to the relative positional relationship between the first object in the real environment corresponding to the first information with the highest priority and the virtual image, the lower viewing angle of the virtual image is adjusted so that the first information with the highest priority is completely displayed in the adjusted virtual image.

5. The method according to claim 4, It is characterized in that According to the relative positional relationship between the first object in the real environment corresponding to the first information and the virtual image, before adjusting the lower viewing angle of the virtual image so that the first information is completely displayed in the adjusted virtual image, the method further includes: determining second information displayed in the virtual image having a priority greater than the first information; If the second information cannot be fully displayed in the adjusted virtual image after the current lower viewing angle of the virtual image is adjusted, determine not to adjust the current lower viewing angle; otherwise, adjust the lower viewing angle of the virtual image so that the first information is fully displayed in the adjusted virtual image.

6. The method according to claim 1, It is characterized in that The determining whether the first information to be displayed can be completely displayed in a virtual image within the field of view of the head-up display includes: Obtaining a vertical field of view angle of the head-up display; Determine the spatial range formed by the upper edge, the lower edge and the road surface of the vertical field of view; According to the position of the first object in the real environment corresponding to the first information and the spatial range, it is determined whether the first information to be displayed can be completely displayed in the virtual image within the field of view of the head-up display.

7. The method according to claim 6, It is characterized in that The determining, based on the position of the first object in the real environment corresponding to the first information and the spatial range, whether the first information to be displayed can be completely displayed in a virtual image within the field of view of the head-up display includes: If the first object is located in the first area, determining that the first object cannot be fully displayed within the field of view angle; If the first object is located in the second area, determining that the first object can be fully displayed within the field of view angle; Among them, the first area is the area enclosed by the lower edge of the vertical field of view angle and the road surface on the side close to the eye box range, and the second area is the area enclosed by the lower edge of the vertical field of view angle, the road surface on the side away from the eye box range and the upper edge of the vertical field of view angle.

8. The method according to claim 1, It is characterized in that The determining whether the first information to be displayed can be completely displayed in a virtual image within the field of view of the head-up display includes: Determining whether the first information can be fully displayed within the field of view of the head-up display according to the coordinate position and display size of the first information in the display screen displayed by the image generation unit of the head-up display; and / or Acquire location information of the first object in the real environment; Obtaining rendering parameters of a rendering camera in a renderer of the head-up display, wherein the rendering parameters include a rendering angle and a rendering position; According to the position information of the first object in the real environment and the rendering parameters of the rendering camera, it is determined whether the first information can be fully displayed within the field of view of the head-up display.

9. The method according to claim 1, It is characterized in that The determining whether the first information to be displayed can be completely displayed in a virtual image within the field of view of the head-up display includes: determining a criterion for determining whether the first information can be displayed according to the type of the first information; determining, according to the judgment criterion, whether the first information can be fully displayed within the field of view of the head-up display; If the first information is a preceding vehicle lock mark and the distance between the target vehicle and the preceding vehicle is less than a preset distance threshold, it is determined that the first information cannot be fully displayed within the field of view of the head-up display.

10. The method according to claim 1, It is characterized in that Before determining whether the first information to be displayed can be completely displayed in the virtual image within the field of view angle range of the head-up display, the method further includes: Determining whether there is currently the first information to be displayed, wherein the first information is used for fusion display with the first object in the real environment; In the presence of the first information to be displayed, determining a current vehicle speed; The height of the virtual image is adjusted according to the current vehicle speed.

11. The method according to claim 10, It is characterized in that The adjusting the height of the virtual image according to the current vehicle speed includes: When the current vehicle speed exceeds a preset speed threshold, increasing the height of the virtual image; or, When the current vehicle speed is lower than the preset speed threshold, the height of the virtual image is maintained.

12. A head-up display device, It is characterized in that include: a determination module configured to determine whether the first information to be displayed can be completely displayed in a virtual image within a field of view of the head-up display; The adjustment module is configured to adjust the lower viewing angle of the virtual image according to the relative position relationship between a first object in a real environment corresponding to the first information and the virtual image if the first information to be displayed cannot be fully displayed in the virtual image within the field of view of the head-up display so that the first information can be fully displayed in the adjusted virtual image.

13. A means of transportation, It is characterized in that Comprising the display device as claimed in claim 12.

14. An electronic device, It is characterized in that The method comprises at least a memory and a processor, wherein the memory stores a computer program, and the processor implements the steps of the method according to any one of claims 1 to 11 when executing the computer program on the memory.

15. A computer-readable storage medium, It is characterized in that The computer-readable medium stores a computer program, and when the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 11 are implemented.