Display method, display device, storage medium and vehicle

By projecting the virtual outline of the hood and the front image of the vehicle on the HUD display device, the problem of the single enhanced display function of the HUD display device is solved, auxiliary prompts for the vehicle's surrounding environment are realized, and driving safety is improved.

CN119335755BActive Publication Date: 2025-10-03南京睿维视科技有限公司
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202411854178.2
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-12-17
Publication Date
2025-10-03
Estimated Expiration
2044-12-17

AI Technical Summary

Technical Problem

Existing HUD display devices have a single enhanced display function and are unable to provide auxiliary prompts for the vehicle's surrounding environment, making it difficult for drivers to accurately judge the relative position of the vehicle and surrounding objects in complex environments, which can easily cause collisions.

Method used

By superimposing the virtual outline of the hood and the front image of the vehicle captured by the vehicle's integrated camera in the projection area of ​​the HUD display device, the driver is assisted in intuitively viewing the obscured front environment, and accurate position relationship prompts are provided using virtual outlines and distance markers.

Benefits of technology

It improves the driver's ability to accurately judge the vehicle's surrounding environment, reduces unnecessary scratches on the vehicle, enhances the auxiliary enhanced display function of the HUD display device, and improves driving safety.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119335755B_ABST
    Figure CN119335755B_ABST
Patent Text Reader

Abstract

This application relates to the field of projection display technology, and more particularly to a display method, display device, storage medium, and vehicle. This application implements an auxiliary enhanced display by at least partially superimposing the projection area of ​​a HUD display device on the hood. By projecting a virtual outline reflecting the hood's shape and an image of the front of the vehicle captured by the vehicle's integrated camera onto the physical hood, the forward environment obscured by the hood is intuitively displayed, providing the driver with an experience of viewing the vehicle's surroundings through the hood. This application can enrich the auxiliary enhanced display capabilities of the HUD display device, helping the driver accurately judge the vehicle's surroundings and avoiding unnecessary scratches on the vehicle.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of projection display technology, and in particular to a display method, a display device, a storage medium, and a vehicle. Background Art

[0002] A HUD (Head Up Display) is a new in-vehicle display technology that utilizes reflections from the vehicle's windshield. The HUD's optical engine emits display light, which is projected onto the windshield through appropriate optical lenses to create a virtual image, enhancing the real world outside the windshield. With the rise of AR-HUD, HUD devices have enhanced their capabilities in terms of enhanced display. However, they are currently primarily focused on applications such as navigation, essentially displaying navigation signs and other information directly on the road, resulting in relatively limited display functionality. Summary of the Invention

[0003] The purpose of this application is to provide a display method, a display device, a storage medium and a vehicle, which solve the technical problem that the HUD display device in the prior art has a single enhanced display function and cannot provide auxiliary prompts for the vehicle's surrounding environment.

[0004] In order to solve the above technical problems, this application adopts the following technical solutions.

[0005] In a first aspect, the present application provides a display method, comprising:

[0006] At least a first area of ​​the HUD display device projection is displayed in close contact with the hood of the vehicle;

[0007] The first area is configured to display a virtual contour line reflecting the shape of the hood and a first image reflecting the real scene blocked by the hood. The first image is displayed in conjunction with the virtual contour line based on the relative positional relationship between the real scene blocked by the hood and the hood. The virtual contour line is the perspective structure of the hood within the scope of the first area, and the first image is the shooting content of the vehicle integrated camera corresponding to the scope of the first area.

[0008] In an optional implementation of the first aspect, the color of the virtual contour line is consistent with the color of the vehicle body.

[0009] According to the above description, the optional implementation method can intuitively display the real scene blocked in front of the vehicle on the hood, and can judge the approximate distance between the blocked real scene and the front of the vehicle through the effect of viewing the perspective structure, helping the driver to make accurate driving decisions.

[0010] In an optional implementation manner of the first aspect, displaying the first image in coordination with the virtual contour line according to a relative positional relationship between the real scene blocked by the hood and the hood includes:

[0011] A first distance mark is displayed between the hood represented by the virtual outline and the real scene blocked by the hood in the first image, for indicating the actual distance value between the hood and the surrounding environment.

[0012] In an optional implementation of the first aspect, the actual distance data is determined by a vehicle-mounted distance sensor.

[0013] In an optional implementation of the first aspect, the actual distance data is determined by analyzing the first image.

[0014] According to the above description, an optional implementation method can use a more intuitive numerical display to assist the driver's judgment based on the intuitive display of the image of the obstructed real scene. Specifically, the first distance mark will continuously update the value as the vehicle moves.

[0015] In an optional implementation of the first aspect, the first area is configured to display a virtual outline reflecting the shape of the hood and a first image reflecting a real scene blocked by the hood, including:

[0016] In response to the vehicle triggering a turn, the virtual contour line and the first image are projected and displayed in the first area.

[0017] In an optional implementation of the first aspect, the first area is configured to display a virtual outline reflecting the shape of the hood and a first image reflecting a real scene blocked by the hood, including:

[0018] In response to the driver raising his or her sight line so that the eye position reaches a predetermined height, the virtual contour line and the first image are projected and displayed in the first area.

[0019] According to the above description, the optional implementation method will only call out the virtual contour line and the first image to assist the driver in making decisions when the vehicle needs to make complex decisions, thereby reducing the information burden of the projection display on the driver and reducing the pressure on HUD processing.

[0020] In an optional implementation of the first aspect, the first area is configured to display a virtual outline reflecting the shape of the hood and a first image reflecting a real scene blocked by the hood, including:

[0021] In response to the vehicle being in a normal driving state, the virtual contour line and the first image are hidden and displayed, and the first area is configured to display vehicle driving state information.

[0022] According to the above description, in the optional implementation mode, the utilization rate of the projection area can be maximized, more information can be displayed by switching between different states, and conventional information can be displayed when the vehicle is normally moving straight.

[0023] In an optional implementation of the first aspect, the display method further includes:

[0024] The HUD display device projects a second area, which is adjacent to the first area and located at the outer edge of the hood. The second area is configured to display a second image reflecting the environment next to the real scene blocked by the hood. The second image is the shooting content of the vehicle integrated camera corresponding to the range of the second area, and the first image and the second image form a continuous splicing.

[0025] According to the above description, an optional implementation method uses a second image to achieve a transition between a virtual image and a real object. The second image can basically coincide with the real environment within the second area, thereby improving the smoothness of the virtual and real display and enhancing the user's viewing experience.

[0026] In an optional implementation manner of the first aspect, the virtual contour line is a perspective structure of the hood within the first area, including:

[0027] The virtual contour line includes a first virtual contour line that coincides with the upper surface of the hood and a second virtual contour line that reflects the outer shape of the front surface of the hood.

[0028] According to the above description, an optional implementation can merge the virtual contour line with the real shape of the hood and present the shape of the obscured front surface of the hood through a perspective structure, thereby providing users with a real feeling of being able to see through the hood.

[0029] In an optional implementation manner of the first aspect, the first image is captured by a vehicle-integrated camera corresponding to the first area and includes:

[0030] Acquiring an image of the front of the vehicle hood captured by the vehicle integrated camera;

[0031] The image in front of the hood is converted into the first image according to the position of the first area.

[0032] According to the above description, an optional implementation manner may utilize a front camera or the like to obtain the real scene in front of the vehicle blocked by the hood, and then convert the obtained image to meet the need of framing from the first area.

[0033] In an optional implementation manner of the first aspect, displaying the first image in coordination with the virtual contour line according to a relative positional relationship between the real scene blocked by the hood and the hood includes:

[0034] The coordination relationship between the first image and the virtual contour line is adjusted according to the viewpoint position of the driver.

[0035] According to the above description, the optional implementation method adapts to the parallax under different eye positions by adjusting the positional coordination relationship between the two, providing the user with a more realistic viewing effect and more easily assisting the user to judge the distance ahead based on dynamic parallax.

[0036] In an optional implementation of the first aspect, the display method further includes:

[0037] The HUD display device projection has a third area, and the third area is located directly above the front wheels of the vehicle;

[0038] The third area is configured to display the status of the front wheels of the vehicle.

[0039] In an optional implementation of the first aspect, the vehicle front wheel is the left front wheel of the vehicle.

[0040] In an optional implementation of the first aspect, the third area is configured to display the status of the front wheels of the vehicle, including:

[0041] In response to the vehicle triggering a turn, the status of the vehicle's front wheels is projected and displayed in the third area.

[0042] According to the above description, the optional implementation method can assist the driver in obtaining the actual status of the vehicle's front wheels, expand the richness of information prompts, and support on-demand display.

[0043] In an optional implementation of the first aspect, the third area is configured to display the status of the front wheels of the vehicle, including:

[0044] A schematic steering model of the vehicle's front wheels and a third image of a real scene next to the vehicle's front wheels are displayed, where the third image is the vicinity of the vehicle's front wheels captured by the vehicle's integrated camera.

[0045] In an optional implementation manner of the first aspect, the third image displaying the steering schematic model of the front wheels of the vehicle and the real scene beside the front wheels of the vehicle includes:

[0046] A second distance mark is displayed between the turning schematic model and the real scene in the third image to prompt the actual distance value.

[0047] In an optional implementation manner of the first aspect, the third image displaying the steering schematic model of the front wheels of the vehicle and the real scene beside the front wheels of the vehicle includes:

[0048] The third image is displayed in conjunction with the steering schematic model based on the relative positional relationship between the real scene beside the front wheels of the vehicle and the front wheels of the vehicle.

[0049] According to the above description, the optional implementation method can enable the driver to more intuitively understand the relative distance between the front wheels of the vehicle and surrounding objects, thereby preventing the wheels from scratching surrounding objects.

[0050] In an optional implementation of the first aspect, the display method further includes:

[0051] simulating a driving trajectory of the vehicle according to a steering angle of the front wheels of the vehicle;

[0052] The HUD display device projects the driving trajectory on the road ahead.

[0053] In an optional implementation of the first aspect, the HUD display device projecting the driving trajectory on the road ahead includes:

[0054] The HUD display device projection has a fourth area, the fourth area is in contact with the road ahead, and the driving track is configured in the fourth area.

[0055] In an optional implementation of the first aspect, the HUD display device projecting the driving trajectory on the road ahead includes:

[0056] The position of the front wheels of the vehicle after a predetermined time is marked on the driving trajectory according to the driving speed of the vehicle.

[0057] According to the above description, an optional implementation method can prompt the driver of the vehicle's future path by fitting the driving trajectory projected on the road, and further mark the positions that the vehicle's front wheels may pass through.

[0058] In an optional implementation of the first aspect, the display method further includes:

[0059] The HUD display device projection has a fifth area, and the fifth area is configured to display a reference point mark for assisted driving at a specific position on the hood.

[0060] In an optional implementation manner of the first aspect, the fifth area is configured to display a reference point mark for assisted driving at a specific position on the hood, including:

[0061] The reference point mark is highlighted according to the driving intention of the vehicle.

[0062] In an optional implementation of the first aspect, the first region is the same as the fifth region.

[0063] In an optional real-time manner of the first aspect, the distance between the vehicle head and the specific object is displayed in the second area.

[0064] According to the above description, an optional implementation method can directly project points on the hood to assist in determining the relationship between the vehicle and the road, guiding the driver to look in the direction of the points to observe the situation of the vehicle and the road.

[0065] In a second aspect, the present application provides a display device comprising a memory, a processor, and a computer program stored in the memory and running on the processor, wherein the processor implements the steps of the display method described in the first aspect when executing the computer program.

[0066] In a third aspect, the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the display method described in the first aspect are implemented.

[0067] In a fourth aspect, the present application provides a vehicle comprising the display device described in the second aspect or the computer-readable storage medium described in the third aspect.

[0068] Compared to existing technologies, this application superimposes the HUD display device's projection area at least partially on the hood to achieve auxiliary enhanced display. By projecting a virtual outline reflecting the hood's shape and the image of the front of the vehicle captured by the vehicle's integrated camera onto the physical hood, the forward environment obscured by the hood is intuitively displayed, providing the driver with a perspective view of the vehicle's surroundings. This application can enrich the auxiliary enhanced display capabilities of the HUD display device, helping the driver accurately judge the vehicle's surroundings and avoid unnecessary scratches on the vehicle. BRIEF DESCRIPTION OF THE DRAWINGS

[0069] To more clearly illustrate the technical solution of this application, the following briefly introduces the drawings required for describing the technical solution. Obviously, the drawings described below are merely examples of the invention, and those skilled in the art can derive other drawings based on these drawings without inventive effort.

[0070] Figure 1 Schematic diagram of HUD projection display in some examples of this application.

[0071] Figure 2 This is a schematic diagram of the in-vehicle projection display effects in some examples of this application.

[0072] Figure 3 This is a schematic diagram of in-vehicle projection navigation information in some examples of this application.

[0073] Figure 4 Schematic diagram of the driver's line of sight in a car in some examples of this application.

[0074] Figure 5 Schematic diagram of the driver's field of view in a car in some examples of this application.

[0075] Figure 6 This is a schematic diagram of the division of the first area and the second area in some examples of this application.

[0076] Figure 7 This is a schematic diagram of auxiliary enhanced display of the first area in some examples of this application.

[0077] Figure 8 In some examples of the present application, the first region is schematically shown relative to the windshield.

[0078] Figure 9 This is a schematic diagram of auxiliary enhanced display of the third area in some examples of this application.

[0079] Figure 10 This is a schematic diagram of auxiliary enhanced display of the fourth area in some examples of this application.

[0080] Figure 11 This is a schematic diagram of the auxiliary enhanced display of the fifth area in some examples of this application.

[0081] Figure 12 Schematic diagram of the HUD display device module in some examples of this application.

[0082] Figure 13 This is a schematic diagram of the composition of the HUD display device in some examples of this application. DETAILED DESCRIPTION

[0083] The following will describe the present application in detail with reference to the accompanying drawings, but the description is merely some examples recorded in the present application and does not limit the present application. Any changes in structure, method or function made by ordinary technicians in this field based on these examples are included in the scope of protection of the present application.

[0084] It should be noted that the same reference numbers or indicia may be used in different examples, but these do not represent absolute structural or functional connections. Furthermore, the terms "first," "second," and so on, which may be mentioned in various examples, are merely for descriptive convenience and do not represent absolute structural or functional distinctions. They should not be construed as indicating or implying relative importance or the number of corresponding objects. Unless otherwise specified, the term "at least one" in the description refers to one or more, and "a plurality" refers to two or more.

[0085] Additionally, when representing features, the character " / " can indicate an OR relationship between the preceding and following objects. For example, heads-up display / head-up display can be represented as heads-up display or heads-up display. When representing operations, the character " / " can indicate a division relationship between the preceding and following objects. For example, magnification M = L / P can be represented as L (virtual image size) divided by P (image source size). Furthermore, the "and / or" in different examples is simply to describe the relationship between the preceding and following objects. This relationship can include three situations. For example, a concave mirror and / or a convex mirror can be represented as the concave mirror alone, the convex mirror alone, or the concave and convex mirrors simultaneously.

[0086] HUD projection display mainly uses the principle of optical reflection to reflect the imaging light to be displayed through a transparent surface into the viewer's eyes. The human eye can see the virtual image information along the opposite direction of the light. Accordingly, the transparent surface can be the windshield of the vehicle, and the windshield can be used as a display screen to display the navigation instructions of the vehicle, the vehicle's driving speed, etc. Figure 1As shown, the HUD display device may include at least an optical engine 1, a first reflector 2, and a second reflector 3. The optical engine 1 includes a backlight source and an image source (not shown). The backlight source is used to provide illumination and adjust the brightness of the illumination light according to control. For example, the backlight source may be an LED (Light Emitting Diode) or a laser. Under the illumination provided by the backlight source, the image source adjusts the corresponding display content according to control and projects the display light from the surface of the image source. For example, the image source may be an LCD (Liquid Crystal Display), a DMD (Digital Micromirror Device), a MEMS (Micro-Electro-Mechanical System) micromirror, or an LCOS (Liquid Crystal on Silicon). The first reflector 2 and the second reflector 3 can project the display light projected by the optical machine 1 onto the windshield 4, realizing customization of the optical path in a smaller space while meeting different projection display requirements. The first reflector 2 and the second reflector 3 can be set to a concave mirror, a convex mirror, a concave lens, a convex lens, etc. according to the requirements of optical planning, and the surface shape of the lens can be a free-form surface. Optionally, at least one of the first reflector 2 and the second reflector 3 can also be adjusted to a certain degree of angle, thereby changing the projection position of the display light on the windshield 4 to meet the needs of viewers of different heights. The display light of the optical machine 1 is finally reflected on the windshield 4 of the vehicle to form a virtual image 5. When the human eye 6 observes the virtual image 5 facing the windshield 4, it can feel a certain sense of depth, just like looking at a real object at a specific distance outside the windshield. The virtual image 5 can be the navigation instructions content, vehicle speed, etc. as described above. It should be added that, according to the characteristics of different optical machines, the HUD display device can also be provided with a diffuser. In some examples, the HUD display device can also include Fresnel lenses, waveguide optical devices, diffraction optical devices, holographic optical devices, tapered optical fibers, etc.

[0087] As mentioned above, the HUD display device can be integrated into the vehicle to display virtual image information at a front position outside the windshield, such as Figure 2 、 Figure 3As shown, the HUD display device 11 can be specifically integrated into the center console 10 of the vehicle and directly opposite the driver's seat. The HUD display device 11 projects the display light onto the inner surface of the windshield 4 through the projection window, and reflects it accordingly, forming a projection area 50 corresponding to a virtual image outside the vehicle windshield 4. The information to be displayed is projected within the projection area 50, and the position of the projection area 50 can also be adjusted as needed, so as to have a fitting relationship with different positions outside the windshield. At the same time, as the design value of FOV increases, the projection area 50 can also cover more areas in front of the windshield, and its enhanced display freedom is also enhanced. Figure 2 As shown, for W-HUD (Windshield HUD), the projection area 50 mainly displays basic vehicle driving status information, such as vehicle speed, gear position, etc. Its display function is consistent with the instrument panel display function, mainly presenting conventional vehicle driving status information directly in front of the driver's field of vision, reducing the frequency of the driver looking down to check information. Figure 3 As shown, in addition to displaying vehicle driving status information, the AR-HUD (Augmented Reality HUD) displays content within projection area 50 that integrates virtual and real information with the road ahead. For example, specific road signs can be displayed in close proximity to specific road signs. This makes navigation information easier to understand than traditional map navigation. However, in the above example, the content displayed within projection area 50 emphasizes the presentation and location of information. This means that the projected content often originates from the cockpit equipment itself and lacks a connection to the vehicle's surroundings. This single-directional output of information makes it difficult for the driver to obtain more effective external information. For example, when making a right-angle turn in a narrow space or parallel parking on a curb, the driver's view is easily obstructed by the hood, making it difficult to accurately determine the relative position of the vehicle's body, tires, and other external objects, which can easily lead to collisions. Consequently, auxiliary information needs to be projected onto corresponding external locations to aid the driver's judgment. This auxiliary information is based on the actual external environment and is not pre-prepared content presented directly at a specific location.

[0088] In some examples, the projection function of the HUD display device can be used to provide auxiliary enhanced display of the external environment. The auxiliary enhancement mainly focuses on content that the driver cannot directly determine through his own judgment of the external environment. Furthermore, based on the projection mechanism, the projection area of ​​the HUD display device can be set to a specific location that requires auxiliary enhancement. In this example, the auxiliary enhanced display of the hood and the surrounding area of ​​the hood can be strengthened, such as Figure 4As shown, the hood 41 is the engine cover at the front of the vehicle body, which can also be called the engine cover for gasoline vehicles. Generally, the front wheels of a vehicle are directly below the hood and are in the blind spot of the cockpit. The driver cannot see the front wheels at all, and unlike the rear wheels of the vehicle, they cannot be observed through the rearview mirror. At the same time, the hood 41 will also block part of the surrounding environment of the front of the vehicle. Therefore, when the vehicle is moving forward, it is impossible to intuitively judge the relative distance between the front of the vehicle and the object in front. Accordingly, for the driver in the cockpit, the relationship between the line of sight of his human eyes 6 and the hood determines that most of the visible range is the real scene in front of the vehicle, and the visible area 42 of the hood can be observed by the human eyes 6 through the lower part of the windshield. As shown Figure 5 As shown, when looking out from the cockpit, the visible area 42 of the hood is visible, while the rest of the hood is not normally visible. The hood blocks the surrounding environment closest to the front of the vehicle, and the front wheels are particularly obscured. It should be noted that the size of the visible area 42 of the hood is also related to the height of the human eye. When the driver raises their eye level, the visible area 42 increases accordingly. For a HUD display device integrated into the vehicle, its projection area 50 can be adjusted directly in front of the lower portion of the windshield, so that it can at least partially overlap with the visible area 42 of the hood. Therefore, the visible area 42 of the hood can serve as a background for the projection display. The information displayed in the overlapping area of ​​the projection area 50 can also coordinate with the visible area 42 to achieve the same effect as the hood itself. Accordingly, the overlapping area of ​​the projection area 50 can be adjusted according to the height of the human eye. Optionally, if the projection area 50 supports FOV expansion or projection position adjustment, auxiliary enhancement information corresponding to the display position can also be fitted on the outer edge of the visible area 42 of the hood to increase the richness of the real-scene enhanced display, which will be described in detail below.

[0089] In some examples, such as Figure 6 As shown, the projection area 50 is divided into a first area 501 and a second area 502. The projection area 50 is generally a rectangular display range according to the FOV setting. There is no obvious display dividing line between the first area 501 and the second area 502. It is determined by the edge contour of the hood superimposed thereon. Therefore, the boundary between the first area 501 and the second area 502 is an arc. Accordingly, the division between the first area 501 and the second area 502 is determined by the projection position of the projection area 50. The first area 501 is set opposite and overlaps with the hood, that is, it can be Figure 4 、 Figure 5The intersection of the visible area 42 and the projection area 50 is shown in Figure 5. The second area 502 can be positioned directly opposite the real scene outside the hood, that is, it can be the intersection of the road ahead of the vehicle and the projection area 50. Therefore, the information displayed in the first area 501 can be displayed in a manner that is consistent with the hood, while the information displayed in the second area 502 can be displayed in a manner that is consistent with the road ahead. In some examples, the projection area 50 can display the first and second areas 501, 502 as a whole. For example, conventional vehicle driving status information can be displayed in this manner, with the vehicle driving status information uniformly displayed in the middle or bottom of the projection area 50, which is particularly suitable for normal driving conditions. When auxiliary enhanced display is required, the first and second areas 501, 502 can be displayed functionally separately. This not only improves the utilization of the projection area 50, but also allows the first area 501, which is displayed in close proximity to the hood, to display information that assists the driver in determining the surrounding environment. Optionally, the relative position of the hood can be obtained using a camera to divide the display distribution between the first and second areas 501, 502. In some examples, the projection display can switch between the two aforementioned states to meet different scenario requirements and further enhance the richness of the information displayed in projection area 50. In some examples, when a vehicle is turning, it can be determined based on sensor information such as the steering wheel that the vehicle's turn poses a high potential collision risk, especially in a confined parking environment with a very close distance to the vehicle ahead. This triggers the projection area 50 to independently display the first and second areas 501, 502, and display auxiliary enhanced display information in the first area 501. Furthermore, when the vehicle switches from turning to normal straight driving, the projection area 50 can be switched back to the overall distributed display mode, i.e., without distinguishing between the first and second areas 501, 502. In some examples, if the front camera performs image recognition and detects the presence of an object in close proximity ahead and poses a collision risk, the auxiliary enhanced display function is activated, displaying specific environmental enhancement information in the first area 501. This not only helps the driver make accurate driving decisions but also serves as a warning to the driver. Furthermore, when the camera detects that there are no obstacles that could cause a collision, projection area 50 switches back to the overall distributed display mode. In some examples, the in-vehicle camera can also be used to analyze and judge the driver's behavior. When the driver raises their eye level to a predetermined height, such as above the average height during normal driving, indicating that the driver is attempting to more clearly observe the vehicle ahead, auxiliary information reflecting the surrounding environment of the hood can be displayed in first area 501, significantly improving the driver's driving experience and guiding the driver to correctly avoid obstacles.Optionally, after determining that there is an intention to provide auxiliary enhancement based on the driver's line of sight, the corresponding auxiliary enhancement display information is triggered to be displayed in the first area 501 and maintained for a preset duration. This can ensure that the frequent switching of the display mode in the projection area 50 is reduced when the driver's height is constantly adjusted. If it is confirmed again within the preset duration that there is still an intention to provide auxiliary enhancement, the refresh time will be reset to ensure that the driver can always see specific content in the first area 501 when auxiliary enhancement display information is needed.

[0090] As described above, when the projection area 50 is divided into the first area 501 and the second area 502 for independent display distribution, the first area 501 will be used for auxiliary enhanced display of the hood. Optionally, the projection area 50 can project the entire range on the visible area 42 of the hood (refer to Figure 4 、 Figure 5 ), that is, the entire range of the projection area 50 can be the first area 501, which can increase the space for auxiliary enhanced display of the hood. The specific enhanced auxiliary display information includes a virtual contour line reflecting the shape of the hood and a first image reflecting the real scene blocked by the hood, such as Figure 7As shown, the virtual contour lines are attached to designated locations on the hood, and their positions are controlled based on the actual hood's shape. The virtual contour lines specifically include a first virtual contour line 511, a second virtual contour line 521, and a third virtual contour line 531. Together, the first virtual contour line 511, the second virtual contour line 521, and the third virtual contour line 531 form at least a portion of the three-dimensional structure of the hood. The first virtual contour line 511 coincides with the upper surface of the hood, outlining the shape of the outwardly visible portion of the hood, thereby providing the viewer with a sense of smooth integration between the first virtual contour line 511 and the actual hood. In this example, there are three first virtual contour lines 511. The second virtual contour lines 521 reflect the shape of the front surface of the hood, i.e., the front of the vehicle. Due to visual obstruction, the actual front surface is not visible to viewers inside the vehicle. However, the second virtual contour lines 521 can reproduce the external shape of the front surface of the hood, thereby creating a perspective structure. In this example, there are also three second virtual contour lines 521. Third virtual contour lines 531 represent the internal spatial structure of the hood. Similarly, this internal space is obscured by the upper surface of the hood during actual viewing. These third virtual contour lines provide the viewer with a three-dimensional visual representation of the internal space, collectively forming the perspective structure of the hood. In this example, there are five third virtual contour lines 531. Optionally, the structure formed by first virtual contour lines 511, second virtual contour lines 521, and third virtual contour lines 531 is not necessarily a cube; it can also be constructed into other shapes based on the viewer's viewing experience. Furthermore, the shape design can be based on the size of first area 501. In this way, the coordination of the first virtual contour line 511, the second virtual contour line 521, and the third virtual contour line 531 can transform the opaque hood into a perspective structure. The viewer experiences the sensation of being able to see through the upper surface of the hood and see the entire space. This is achieved by achieving a virtual-real fit between the content displayed in the first area 501 and the visible area of ​​the hood. In a preferred embodiment, the virtual image (e.g., the virtual contour line) displayed in the visible area of ​​the hood should have a distance consistent with the position of the hood, reducing the sense of discomfort caused by the human eye and making it more apparent that the displayed perspective structure is part of the hood. Because the virtual contour line needs to accurately reflect the shape of the hood, it can be projected based on the structural data of the actual hood. For example, during installation and calibration, the HUD display device will be configured with the model of the vehicle to be installed and the structural data corresponding to the model. The virtual contour line will be generated based on the structural data of the hood and the projection position, and will be projected at a specified location in the visible area of ​​the hood, so that it can be connected to the actual shape of the hood. Optionally, in order to further enhance the realism of the fusion, the color of the virtual contour line is the same color as the hood or a brighter color. Specifically, the corresponding color can be pre-configured according to the vehicle model.

[0091] The fitting display of the virtual contour line can provide the viewer with accurate information about the boundary of the hood, so that the relative position relationship between the hood and the surrounding environment can be judged through the perspective structure. Figure 7 In the example, the first virtual surface 541 and the second virtual surface 551, respectively formed by virtual contour lines, can simulate the situation where the hood is in a transparent state and can see through the surrounding environment. The first virtual surface 541 can represent the invisible front surface of the hood, and the second virtual surface 551 can represent the invisible bottom surface of the interior space of the hood. They are the surfaces closest to the surrounding environment. In this example, the images of the surrounding environment visible from the front and bottom surfaces of the hood can be projected onto the first virtual surface 541 and the second virtual surface 551, thereby simulating a true perspective effect. The images displayed on the first virtual surface 541 and the second virtual surface 551 can be derived from the real-time shooting content of the vehicle's front camera. Specifically, the vehicle's front camera captures the front image, including the environment obscured by the hood, and then determines the required first image based on the requirements for displaying on the first virtual surface 541 and the second virtual surface 551. Optionally, the first image obtained through image conversion not only achieves cropping within a specific range but also can be processed to account for lighting, perspective, and other factors. The converted first image is displayed on the first virtual surface 541 and the second virtual surface 551, thereby reproducing the real scene obscured by the hood. From the viewer's perspective, the scene appears as if seen through the hood. As the vehicle moves, the front camera continuously captures new content, and the first image displayed on the first virtual surface 541 and the second virtual surface 551 is updated in real time, allowing the viewer to see the actual surrounding environment. In some examples, to provide a realistic sense of depth between the first image and the virtual contour line, dynamic adjustments are made based on the dynamic parallax between the relative position of the real scene obscured by the hood and the hood as the line of sight changes. That is, the overlap between the first image and the virtual contour line can change as the viewer's viewpoint changes. Optionally, the cropping range of the first image based on the content captured by the front camera can also be adjusted based on the line of sight of the human eye, allowing the human eye to perceive the front-to-back distance relationship between the front of the vehicle and the obscured real scene. In order to further improve the intuitiveness of the viewer's judgment of the front and rear distance, a distance mark can be set between the real scene of the hood obstruction in the first image and the hood represented by the virtual outline. The distance mark can be a connecting line between the two, and the actual distance value can be accurately displayed on the connecting line. In this way, the driver as the viewer can slowly control the movement of the vehicle according to the accurate distance value, and the distance value on the connecting line will also be continuously updated in real time according to the corresponding sensor, providing the driver with real-time data reference.

[0092] like Figure 8As shown, after configuring the virtual contour line and the first image as described above for projection in the first area 501, the driver in the car can not only see the unobstructed upper body 71 of the pedestrian above the hood, but can also see part of the lower body 72 of the pedestrian through the projected first image when observing the pedestrian in front of the car. At the same time, through the coordination between the lower body 72 and the virtual contour line, such as the overlapping position change under dynamic parallax, the front and rear distance between the specific vehicle and the pedestrian can be judged to determine the possibility that the vehicle may hit the pedestrian. In some examples, a second image reflecting the environment next to the real scene obstructed by the hood can also be displayed in the second area 502, that is, the real scene above the hood that can be seen by the human eye. The second image can also be captured by the front camera of the vehicle and cropped according to the position corresponding to the second area 502, so as to be displayed on the second area 502. Figure 6-Figure 8 First area 501 and second area 502 are located adjacent to each other, with second area 502 directly facing the outer edge of the hood. Through precise control of the projection position, the projected second image can be precisely superimposed on the corresponding real scene, thus blending seamlessly with the surrounding real scene. More importantly, the second image can be continuously spliced ​​with the first image, maintaining uniform lighting and perspective between the first and second images, creating a smooth transition between the real scene and the virtual image. This consistently reproduces the adjacent area of ​​the hood, minimizing distraction to the driver caused by projection inconsistencies and improving the clarity and viewing experience of the driver's observation of the surrounding environment.

[0093] In some examples, when the vehicle is parking sideways, it is crucial for the driver to accurately judge the steering angle of the wheels and the relative position relationship with obstacles such as the surrounding road shoulders. In this example, the projection display reproduces the left and right sides of the hood of the vehicle in front of the windshield to assist the driver in observing the situation on both sides of the vehicle. Specifically, the projection area corresponding to the HUD display device also includes a third area corresponding to the position of the vehicle's front wheels, such as Figure 9As shown, taking the left front wheel as an example, since the left front wheel is located on the lower left side of the hood and is not in the view of the viewer inside the vehicle, the simulated wheel state cannot be directly reproduced through projection on the hood. Accordingly, the third area 503 can be configured to be projected directly above the vehicle's left front wheel. This allows the driver to roughly determine the position of the wheel on the road by simply moving it downward. Optionally, the state of the vehicle's actual wheel can be represented in the third area 503 using a steering diagram 513. The steering diagram 513 can determine its displayed structural dimensions and wheel appearance based on the vehicle model, maintaining the same visual experience as the actual wheel. At the same time, the steering diagram 513 can also adjust the display angle based on the vehicle's actual steering direction, which can be specifically determined based on the vehicle's steering wheel control data. Optionally, a guide arrow 533 can be projected in the direction of the steering diagram 513 pointing to the actual wheel. The guide arrow 533 can assist the driver in determining the actual wheel position. Furthermore, to more intuitively display the environment surrounding the left front wheel, a third image 523 is projected next to the steering model 513. Similarly, third image 523 can be obtained by capturing the environment near the vehicle's front wheel using the vehicle's integrated camera and updated in real time. Through this coordinated display, viewers can understand the distance relationship between the actual wheel and obstacles such as the roadside shoulder. Optionally, the relative positional relationship between the steering model 513 and the obstacle in the third image 523 can be altered based on dynamic parallax determined by the driver's viewpoint, thereby providing viewers with a visual sense of realistic distance. Alternatively, a distance marker can be placed directly between the steering model 513 and the obstacle in the third image 523. The distance marker can be a connecting line between the two, accurately displaying the actual distance between the two. This allows the driver to promptly detect and accurately perceive the distance when the wheel approaches an obstacle, allowing them to change their trajectory and avoid collisions with the obstacle. In some examples, the content projection in the third area 503 is not a permanent display function, because permanent display may bring unnecessary information burden to the driver. It may be triggered in response to the vehicle's turning to display the corresponding turning schematic model 513 and the third image 523, etc., and when the vehicle is in a normal driving state such as straight driving, the projected content in the third area 503 will be automatically hidden to reduce interference to the driver.

[0094] In some examples, such as Figure 10As shown, to further provide the driver with multi-dimensional enhanced display assistance, a driving trajectory 514 based on the vehicle's front wheel steering angle and current speed is also displayed on the road ahead. This is specifically displayed via a projected fourth region 504. The projection configuration of fourth region 504 allows for excellent alignment with the road ahead at a specific distance. Specifically, the virtual image distance of the focal plane of fourth region 504 coincides with the specific distance to the road ahead. When the vehicle is traveling straight, driving trajectory 514 follows a straight path along the road ahead. When the vehicle is turning, driving trajectory 514 follows a curved path along the road ahead. When the projection range of fourth region 504 is sufficiently large, driving trajectory 514 can also extend from the edge of the hood all the way forward, enhancing the completeness of the vehicle's path prediction display. Driving trajectory 514 allows the driver to determine the vehicle's likely next location and, if there are obstacles on the road ahead that could affect the tires' ability to pass, can be assisted in avoiding them in a timely manner. Optionally, the predicted position of the vehicle's front wheel 524 will also be marked on the driving trajectory 514. The marked vehicle's front wheel 524 can be a black shadow that matches the actual wheel cross-sectional size. The predicted position can be the position that the front wheel will pass after a predetermined time is determined based on the vehicle's front wheel steering angle and the vehicle's current speed. For example, the vehicle's front wheel 524 displayed in the fourth area 504 coincides with a specific position on the road ahead, and this specific position is the position that the vehicle's tire will pass after 3 seconds. This allows the driver to have a more accurate judgment of the position where the wheel passes.

[0095] In some examples, such as Figure 11 As shown, the projection area corresponding to the HUD display device also includes a fifth area 505 displayed on the hood. Optionally, the fifth area 505 can at least partially overlap with the first area or completely belong to the same range. Projected on the fifth area 505 are reference point marks displayed on the hood. The reference point marks are located at specific positions on the hood. These positions serve as aiming points for estimating the distance between the vehicle and the roadside. The driver can use these reference point marks to find objects on the road that are in a straight line with the human eye. In more examples, the reference point marks can be displayed at five positions on the hood, including the left top, left third, center, right third, and right top of the hood. Using these five reference point marks, the driver can more easily estimate the distance between the vehicle and the roadside, especially in complex driving scenarios such as parking on a slope, making right-angle turns, and parallel parking. The reference point marks can help the driver control the vehicle to the exact target position. For example, when parking on a slope, the vehicle can be parked 30 cm away from the roadside. Figure 11In the example, a first reference point marker 515, a second reference point marker 525, and a third reference point marker 535 are respectively arranged in the fifth area 505. These reference point markers may be used to target different road locations in different driving scenarios. For example, targeting the second reference point marker 525 can help estimate the position where the right front wheel has passed, so the driver can target different locations according to different needs. Furthermore, the HUD display device can also highlight specific reference point markers based on different driving scenarios. For example, if the vehicle is determined to be driving straight and the driver intends to observe the right front wheel, the color of the second reference point marker 525 can be changed to be different from the colors of the first reference point marker 515 and the third reference point marker 535. For example, if all reference point markers are originally black, the color of the second reference point marker 525 can be changed to red and highlighted. Optionally, a prompt message for targeting the reference point marker can be displayed in the projection area. This can be displayed in the second area of ​​the above example or directly in the fifth area, such as through text with an arrow pointing to the highlighted reference point marker. In some examples, the reference point markers in fifth area 505 can be displayed on demand. For example, only highlighted reference point markers can be projected onto the hood, while other reference point markers remain unprojected, reducing the information burden on the driver. In some examples, the distance between the vehicle and the target object can be displayed in the second area in conjunction with the highlighted reference point markers. Optionally, the corresponding value can be displayed above the edge of the hood to enhance the aesthetics of the layout.

[0096] It should be noted that the auxiliary enhanced display information in the above examples can be displayed simultaneously and in combination as needed, or can be displayed individually at a certain moment when a trigger condition is met. Accordingly, the diversity of the auxiliary enhanced display needs to be determined by the size of the projection area. Furthermore, the multiple auxiliary enhanced display information in the above examples can be projected on the same focal plane, or can be projected on focal planes with different virtual image distances based on the capabilities of the optical hardware and the actual location distribution.

[0097] When the HUD display device that implements the display method in the above example is applied to a vehicle, it can provide auxiliary enhanced display of the hood and surrounding environment. When the driver is driving the vehicle, he can see the environmental information that cannot be directly seen, so as to make accurate driving decisions. Figure 12As shown, the HUD display device integrated in the vehicle can be powered and data-generated by the vehicle computer 92, or the HUD display device itself can provide power and generate data. The HUD display device may include a processor 91, an Ethernet interface 901, a CAN (Controller Area Network) interface 902, a power management module 903, a running memory 904, a storage memory 905, a temperature detection 906, a motor 907, a backlight 908, an image source 909, a positioning module 910, a radar 911, a camera 912, etc. It should be noted that Figure 12 The modules listed in the description are merely exemplary and do not constitute any limitation. In some examples, the HUD display device may further include other modules. In addition, the modules described above may be implemented in one or more hardware components in different examples, or a single module may be implemented by a combination of multiple hardware components.

[0098] Processor 91, serving as the control center of the HUD display device, includes one or more processing units of any type, including but not limited to a microcontroller, a microcontroller, a DSP (Digital Signal Processor), or any combination thereof. Processor 91 is used to generate operational control signals based on a computer program to control other modules and collaborate with corresponding modules to process acquired or inherent data and instructions.

[0099] The Ethernet interface 901 is a network data connection port for local area network communication, which defines a series of software and hardware standards. Multiple electronic devices can be connected together through the Ethernet interface 901. In this example, the processor 91 can exchange information with the vehicle computer 92 through the Ethernet interface 901, such as sending data to the vehicle computer 92 or receiving data sent by the vehicle computer 92.

[0100] CAN interface 902 is a network data connection port for the controller area network, providing a standard bus for the vehicle's internal control system and embedded industrial control, enabling communication and interaction between control nodes. In this example, processor 91 can also exchange information with vehicle computer 92 via CAN interface 902. Optionally, processor 91 can also connect to other external devices via CAN interface 902. In some examples, processor 91 may also be provided with a GPIO (General-purpose input / output) interface to improve compatibility with peripheral connections.

[0101] The power management module 903 is connected to the vehicle computer 92 and can receive the power provided by the vehicle computer 92 to provide a regulated power supply for each module of the HUD display device, ensuring that the processor 91 and each module operate under normal voltage supply and avoid damage due to overvoltage.

[0102] The running memory 904 is used to store computer programs executed by the processor 91, as well as temporarily stored operation data, data exchanged with the storage memory, etc. The running memory 904 can be a memory such as SDRAM (Synchronous Dynamic Random-access Memory).

[0103] The storage memory 905 is used to store resources such as the display content of the HUD display device, as well as long-term storage of running programs and data. The storage memory 905 can be a memory such as Flash. In some examples, the processor 91 can also provide an interface to access external memory.

[0104] Temperature detection 906 is used to detect the temperature within the HUD display device. Specifically, it may include multiple temperature sensors. Because the resistance of a temperature sensor changes with temperature, the processor 91 can determine the resistance of each temperature sensor at a corresponding temperature based on the voltage change between each temperature sensor and the voltage divider resistor under a fixed power supply voltage, thereby reversely inferring the temperature at the location of the temperature sensor. In some examples, the processor 91 can control multiple temperature sensors via the GPIO interface. Multiple temperature sensors can be located at different locations within the HUD display device. The processor 91 can use time-sharing detection to obtain the temperature values ​​fed back by multiple temperature sensors.

[0105] The motor 907 is used to drive the optical lens in the HUD display device to rotate under the control of the processor 91, thereby realizing the change of the corresponding optical path. For example, when the backflow of sunlight causes the temperature of the image source surface to rise, the motor can be used to drive the optical lens to prevent external sunlight from reaching the image source surface. In some examples, the processor 91 can also drive the fan provided on the HUD display device through the motor 907 to increase the speed of air exchange between the inside and outside of the HUD display device to achieve heat dissipation. Specifically, the motor 907 is connected to the processor 91 through a motor driver chip. The motor driver chip provides high-performance power output for the motor 907, and can also communicate and control with the processor 91 through interfaces such as SPI (Serial Peripheral Interface).

[0106] Backlight source 908 is used to provide illumination and adjust its brightness according to the control of processor 91, thereby adjusting the projection display brightness of the entire HUD display device. Backlight source 908 works in conjunction with image source 909 to implement the primary function of optical projection display. Backlight source 908 can be an LED (Light Emitting Diode), laser, or other device. Specifically, backlight source 908 is connected to processor 91 via a backlight driver chip. The backlight driver chip provides driving voltage for backlight source 908 and controls its brightness based on the pulse width signal output by processor 91.

[0107] Image source 909 is used to display an image of corresponding content and project display light corresponding to the image under the control of processor 91. Image source 909 can be an LCD (Liquid Crystal Display), a DMD (Digital Micromirror Devices), a MEMS (Micro-Electro-Mechanical System) micromirror, or an LCOS (Liquid Crystal on Silicon).

[0108] The positioning module 910 is used to monitor the position of the HUD display device and the corresponding vehicle. The positioning module 910 can be a global navigation satellite system such as the GPS (Global Positioning System) and the Beidou satellite navigation system. By measuring the distance between the satellite and the receiver on the positioning module 910 at different locations, the corresponding position and orientation data are determined. In some examples, the positioning module 910 may also include an inertial navigation system. Based on Newton's laws of mechanics, the acceleration of the positioning module 910 in the inertial reference system is measured, integrated over time, and transformed into a navigation coordinate system to obtain data such as speed, yaw angle, and position in the navigation coordinate system. Optionally, the inertial navigation system can assist the global navigation satellite system in achieving more accurate positioning and provide the processor 91 with corresponding position information.

[0109] The radar 911 is used to determine the position of a target object through electromagnetic waves, and can usually determine the distance of the target object from the vehicle where the radar 911 is located.

[0110] Camera 912 includes a vehicle body camera and an in-vehicle camera. The vehicle body camera is used to determine the location of a target object through visual recognition. The vehicle body camera can be a monocular camera or a binocular camera. The main difference between a monocular camera and a binocular camera is that a binocular camera can capture images from two different perspectives, thereby obtaining distance information in three-dimensional space. The in-vehicle camera is used to identify the behavior of the driver and passengers in the vehicle, including fatigue detection, distraction detection, expression recognition, gesture recognition, and gaze tracking. In this example, the in-vehicle camera can also specifically implement eye tracking.

[0111] In some examples, the positioning module 910, radar 911 and camera 912 can also be directly connected to the vehicle computer 92, and are not directly connected to the processor 91 of the HUD display device. For example, the vehicle computer 92 itself integrates a positioning module for position tracking and a radar and camera for automatic driving. The HUD display device can obtain the collected data of the positioning module, radar and camera in real time through communication with the vehicle computer 92.

[0112] In some examples, such as Figure 13 As shown, the HUD display device that implements the above-mentioned display method may specifically include a processor 931, a memory 932, an input device 933, and an output device 934, wherein the input device 933 may include an operation button integrated on the display device, etc., and the display device may receive input control instructions and data through the input device 933. The output device 934 may include an image source integrated on the display device, etc., and the display device may output corresponding instructions or data to the output device 934. Furthermore, the memory 932 stores a computer program running on the processor 931, and when the processor 931 executes the computer program, the display method of the above-mentioned example is implemented. In some examples, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by the processor, the display method of the above-mentioned example is implemented.

[0113] Reference Figure 2-Figure 5 、 Figures 8-11A vehicle can be equipped with the aforementioned HUD display device. Specifically, the HUD display device 11 is integrated within the center console 10, for example, in front of the steering wheel. The HUD display device 11 projects corresponding display light onto the vehicle's windshield 4 through its projection window. Viewers viewing the windshield 4 from the cockpit directly see a corresponding virtual image. Specifically, the corresponding projection area 50 on the windshield 4 includes display elements such as basic display information (vehicle speed, gear position, etc.) and extended display information (navigation information, etc.). More importantly, corresponding auxiliary enhanced display information can also be displayed on the hood, providing real-time information about the vehicle's surroundings, particularly areas obscured by the hood, to help the driver avoid potential obstacles. In some examples, the vehicle can also distribute a program for obtaining the display method described in the aforementioned examples via the aforementioned computer-readable storage medium, enabling convenient updates and upgrades to the vehicle's HUD display device. It should be noted that the above-mentioned vehicles are not limited to cars as a means of transportation, but may also include buses, trucks, excavators, motorcycles, trains, high-speed trains, ships, yachts, airplanes, spacecraft, etc. The projected windshield is not limited to the front windshield of a car, but may also be a transparent surface in other locations.

[0114] In conjunction with the above examples, the technical solutions involved in this application can be directly embodied as hardware, a software module executed by a control unit, or a combination of the two, that is, one or more steps and / or one or more step combinations, which can correspond to various software modules of a computer program flow, or to various hardware modules, such as ASICs (Application Specific Integrated Circuits), FPGAs (Field-Programmable Gate Arrays), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, or any appropriate combination thereof. For the convenience of description, the above description is divided into various modules and described separately according to their functions. Of course, when implementing this application, the functions of each module can be implemented in the same or multiple software and / or hardware.

[0115] Through the description of the above examples, those skilled in the art can clearly understand that the present application can be implemented by means of software plus the necessary general-purpose hardware platform. Based on this understanding, the technical solution involved in this application, or the part that contributes to the existing technology, can be embodied in the form of a software product. The software is executed by a microcontroller unit and, depending on the required configuration, can include one or more microcontroller units of any type, including but not limited to a microcontroller unit, a microcontroller, a DSP (Digital Signal Processor), or any combination thereof. The software is stored in a memory, such as a volatile memory (such as a random access memory), a non-volatile memory (such as a read-only memory, a flash memory, etc.), or any combination thereof.

[0116] In summary, this application implements an auxiliary enhanced display by at least partially superimposing the projection area of ​​a HUD display device on the hood. By projecting a virtual outline reflecting the hood's shape and an image of the front of the vehicle captured by the vehicle's integrated camera onto the physical hood, the forward environment obscured by the hood is intuitively displayed, providing the driver with an experience of seeing through the hood to view the vehicle's surroundings. This application can enrich the auxiliary enhanced display capabilities of the HUD display device, helping the driver accurately judge the vehicle's surroundings and avoiding unnecessary scratches on the vehicle.

[0117] It should be understood that although this specification includes some examples, none of these examples constitutes a single independent technical solution. This description is provided for clarity purposes only. Those skilled in the art should consider this specification as a whole. The technical solutions in the various examples may be appropriately combined to form other implementations that are understandable to those skilled in the art.

[0118] The series of detailed descriptions listed above are merely specific descriptions of feasible implementation methods of the present application. They are not intended to limit the scope of protection of the present application. Any equivalent implementation methods or modifications that do not deviate from the teachings of the present application should be included in the scope of protection of the present application.

Claims

1. A display method, characterized in that: include: At least a first area of ​​the HUD display device projection is displayed in close contact with the hood of the vehicle; The first area is configured to display a virtual contour line reflecting the shape of the hood and a first image reflecting the actual scene blocked by the hood, wherein the virtual contour line is connected to the actual shape of the hood, and the first image is displayed in conjunction with the virtual contour line based on the relative positional relationship between the actual scene blocked by the hood and the hood; The virtual contour lines are the perspective structure of the hood within the first area, and the virtual contour lines include a first virtual contour line that coincides with the upper surface of the hood and a second virtual contour line that reflects the outer shape of the front surface of the hood. The first virtual contour line is used to outline the shape of the outwardly visible surface of the hood, and the second virtual contour line is used to present the outer shape of the obscured front surface of the hood, so as to create a visual effect of converting the opaque hood into a perspective structure. The first image is a photographic image corresponding to the first area by a vehicle-integrated camera, and is projected onto at least a virtual surface formed by the second virtual outline to display an image of the surrounding environment as seen from the front surface of the hood; The coordination relationship between the first image and the virtual contour line is adjusted according to the viewpoint position of the driver, so that the overlapping position between the first image and the virtual contour line changes.

2. The display method according to claim 1, wherein: The display method further includes: The HUD display device projects a second area, which is adjacent to the first area and located at the outer edge of the hood. The second area is configured to display a second image reflecting the environment next to the real scene blocked by the hood. The second image is the shooting content of the vehicle integrated camera corresponding to the range of the second area, and the first image and the second image form a continuous splicing.

3. The display method according to claim 1, wherein: The display method further includes: At least a fifth area projected by the HUD display device is displayed in close contact with the hood of the vehicle; The fifth area is configured to display a reference point mark for assisted driving at a specific position on the hood. The reference point mark is used to assist in determining the position of the relationship between the vehicle and the road, so that the driver can aim at the reference point mark to find objects on the road that are in a straight line with the human eye.

4. The display method according to claim 1, wherein: The first image is captured by the vehicle integrated camera corresponding to the first area and includes: Acquiring an image of the front of the vehicle hood captured by the vehicle integrated camera; The image in front of the hood is converted into the first image according to the position of the first area.

5. The display method according to claim 1, wherein: The first area is configured to display a virtual outline reflecting the shape of the hood and a first image reflecting the real scene blocked by the hood, including: In response to the driver raising his or her sight line so that the eye position reaches a predetermined height, the virtual contour line and the first image are projected and displayed in the first area.

6. The display method according to claim 1, wherein: The display method further includes: The HUD display device projection has a third area, and the third area is located directly above the front wheels of the vehicle; The third area is configured to display the status of the front wheels of the vehicle.

7. The display method according to claim 6, wherein: The third area is configured to display the status of the front wheels of the vehicle including: A schematic steering model of the vehicle's front wheels and a third image of a real scene next to the vehicle's front wheels are displayed, where the third image is the vicinity of the vehicle's front wheels captured by the vehicle's integrated camera.

8. A display device, characterized in that: The display method comprises a memory, a processor, and a computer program stored in the memory and running on the processor, wherein the processor implements the steps of the display method according to any one of claims 1 to 7 when executing the computer program.

9. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the display method according to any one of claims 1 to 7 are implemented.

10. A means of transport, characterized in that: Includes the display device according to claim 8 or the computer-readable storage medium according to claim 9.

Citation Information

Patent Citations

  • Anzeige system and program

    CN101327763A

  • Apparatus and method for displaying information

    CN106163872A