Display method, display device, storage medium and vehicle

Abstract

The invention relates to the technical field of projection display, in particular to a display method, display equipment, a storage medium and a vehicle. According to the method and the device, the display elements are gradually filled, so that the display elements presented after projection adopt different brightness information at different positions on the premise of keeping smooth impression, and the correspondence between the display parameters of the ghosting elements and the display elements is utilized; brightness information which is darker than that of the first end far away from the ghosting element is adopted at the second end, close to the ghosting element, of the display element, so that the split feeling of the junction of the display element and the ghosting element is reduced. The information projection effect of the HUD display device is not affected by ghosting, and the watching experience of a user can be optimized.

Description

Technical Field

[0001] The present application relates to the field of projection display technology, and in particular to a display method, a display device, a storage medium and a vehicle. Background Art

[0002] HUD (Head Up Display) is a new way to realize in-vehicle display by reflection on the vehicle windshield. Specifically, the display light is emitted by the optical machine of the HUD display device, and is projected on the windshield through the corresponding optical lens to produce a corresponding virtual image, which forms an enhanced display effect with the real world outside the windshield. However, due to the thickness of the windshield, the display light emitted by the optical machine will be reflected once on the front and back surfaces of the windshield after reaching the windshield, and two non-overlapping virtual images may be formed accordingly, that is, the projected display content has double images, which greatly affects the user's viewing experience. Summary of the invention

[0003] The purpose of the present application is to provide a display method, a display device, a storage medium and a vehicle, which solve the technical problem in the prior art that the virtual image projected by the HUD display device has ghosting, resulting in poor display effect and affecting the user's viewing experience.

[0004] In order to solve the above technical problems, this application adopts the following technical solutions.

[0005] In a first aspect, the present application provides a display method, comprising: The HUD display device projects display light that reflects on a transparent surface to form a display element viewed by a user, and a ghost element corresponding to the display element; The display element includes a first end away from the ghost element and a second end close to the ghost element, and the interior of the display element is configured to be filled with a gradient from light to dark from the first end to the second end.

[0006] In an optional implementation of the first aspect, the direction from the first end to the second end is determined according to an offset direction of the ghost element relative to the display element.

[0007] According to the above description, in an optional implementation manner, the ghost element formed by the projection will also gradually change from light to dark along the gradient direction of the display element, that is, it will reach its darkest part where the ghost element exceeds the display element, and maintain the same visual perception between the second end of the display element, thereby reducing the visibility of the ghost element.

[0008] In an optional implementation of the first aspect, the display element is a separate block surrounded by a closed line outline, and the line outline and the block are configured to be filled with a consistent color gradient from light to dark.

[0009] According to the above description, the optional implementation method ensures that the display elements are displayed in the form of color blocks, reduces the proportion of the part of the ghost element that exceeds the display element to the entire display element, improves the visual effect of the entire display element, and weakens the ghost element.

[0010] In an optional implementation manner of the first aspect, the interior of the display element is configured to be filled with a gradient from light to dark from the first end to the second end, including: This is achieved by adjusting the transparency from the first end to the second end.

[0011] According to the above description, an optional implementation manner makes the first end presenting the bright part more prominent and the second end presenting the dark part more consistent with the background environment in the projection presentation through the setting of transparency, so that the human eye pays more attention to the area near the first end where there is no ghost element, while the difference between the second end and the part beyond the ghost element is also reduced.

[0012] In an optional implementation manner of the first aspect, the interior of the display element is configured to be filled with a gradient from light to dark from the first end to the second end, including: Use linear gradient method.

[0013] In an optional implementation manner of the first aspect, the interior of the display element is configured to be filled with a gradient from light to dark from the first end to the second end, including: Use non-linear gradient method.

[0014] In an optional implementation manner of the first aspect, the interior of the display element is configured to be filled with a gradient from light to dark from the first end to the second end, including: The gradient speed is determined according to the tones configured at the first end and the second end.

[0015] According to the above description, the gradient filling effect of the display element in the optional implementation manner can satisfy the sense of coordination in the visual state, avoid the sense of conflict caused by the color tone jump, and further form a smooth transition with the combination of the ghosting elements.

[0016] In an optional implementation manner of the first aspect, the interior of the display element is configured to be filled with a gradient from light to dark from the first end to the second end, including: The difference between the hue of the ghost element beyond the display element and the hue of the second end is smaller than a first threshold.

[0017] According to the above description, an optional implementation method utilizes that the hue of the ghosting element will have a certain decay based on the display element, thereby eliminating the obvious hue boundary at the junction of the second end of the display element, making it difficult for users to distinguish the difference between the display element and the ghosting element, thereby weakening the impact of the ghosting element.

[0018] In an optional implementation manner of the first aspect, the interior of the display element is configured to be filled with a gradient from light to dark from the first end to the second end, including: A first filling region close to the first end and a second filling region close to the second end are arranged between the first end and the second end, and a gradual change speed of the first filling region is different from a gradual change speed of the second filling region.

[0019] According to the above description, the optional implementation method ensures that the filling gradient effect of the display element is continuous, so that the entire display element has more bright areas, and the second end of the display element can be well connected with the color tone of the ghost element.

[0020] In an optional implementation of the first aspect, the size distribution of the first filling area and the second filling area is determined according to the size of the ghost element exceeding the display element.

[0021] According to the above description, an optional implementation method determines the decay of the ghost element under a specific mapping at the junction of the second end of the display element according to the degree of positional offset between the ghost element and the display element in the actual projection, thereby using matching gradient parameters to satisfy a smooth transition between the display element and the ghost element.

[0022] In an optional implementation of the first aspect, the display method further includes: The display element and the ghost element are offset in at least a first direction and a second direction, and the first direction is inconsistent with the second direction; The first corner of the display element is chamfered, and the first corner of the display element corresponds to the second corner of the ghost element, and the second corner of the ghost element is at least a portion that exceeds the display element.

[0023] In an optional implementation of the first aspect, the inclination angle of the chamfer is determined according to the degree of offset between the display element and the ghost element in the first direction and the second direction.

[0024] According to the above description, the optional implementation reduces the abruptness between the bending angle of the display element and the bending angle of the ghost element, making the overall formation between the display element and the ghost element smoother.

[0025] In an optional implementation of the first aspect, the display element presents a position displacement and / or fade-in and fade-out animation when being projected.

[0026] According to the above description, an optional implementation manner may distract the user from the subtle ghosting through a dynamic animation, making the ghosting almost invisible, thereby improving the user's viewing experience.

[0027] In a second aspect, the present application provides a display device, comprising a memory, a processor, and a computer program stored in the memory and running on the processor, wherein the processor implements the steps of the display method described in the first aspect when executing the computer program.

[0028] In a third aspect, the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the display method described in the first aspect are implemented.

[0029] In a fourth aspect, the present application provides a vehicle comprising the display device described in the second aspect or the computer-readable storage medium described in the third aspect.

[0030] Compared with the prior art, the present application performs gradient filling on the display elements so that the display elements presented after projection use different brightness information for different positions while maintaining a smooth look and feel, and uses the correspondence between the display parameters of the ghost element and the display element, and uses darker brightness information at the second end of the display element close to the ghost element than at the first end far from the ghost element, so as to reduce the sense of separation at the junction of the display element and the ghost element. The effect of projecting information by the HUD display device of the present application is not affected by ghosting, and can optimize the user's viewing experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0031] In order to more clearly illustrate the technical solution of the present application, the following is a brief introduction to the drawings required for use in the description of the technical solution. Obviously, the drawings described below are only some examples recorded in the present application, and a person of ordinary skill in the art can obtain other drawings based on these drawings without creative work.

[0032] Figure 1 Schematic diagram of HUD projection display in some examples of this application.

[0033] Figure 2 Schematic diagram of the formation of double images projected onto the windshield in some examples of the present application.

[0034] Figure 3 Schematic diagram showing the superposition of display elements and ghost elements in some examples of the present application.

[0035] Figure 4 Schematic diagram of color block filled display elements and ghosting elements in some examples of this application.

[0036] Figure 5 This is a schematic diagram of the positional relationship between display elements and ghost elements in some examples of this application.

[0037] Figure 6 Schematic diagrams showing elements before and after gradient filling in some examples of this application.

[0038] Figure 7 Schematic diagrams showing elements before and after gradient filling in some examples of this application.

[0039] Figure 8 Schematic diagram of the gradient configuration of display elements in some examples of this application.

[0040] Fig. 9 Schematic diagram of the gradient configuration of display elements in some examples of this application.

[0041] Fig.10 Schematic diagrams showing elements before and after gradient filling in some examples of this application.

[0042] Fig.11 Schematic diagrams showing elements before and after gradient filling in some examples of this application.

[0043] Fig.12 Schematic diagram of HUD display device module in some examples of this application.

[0044] Fig.13 This is a schematic diagram of the composition of the HUD display device in some examples of this application.

[0045] Fig.14 This is a schematic diagram of projection display in a vehicle in some examples of the present application. DETAILED DESCRIPTION

[0046] The present application will be described in detail below in conjunction with the accompanying drawings, but the content of the description is merely some examples recorded in the present application and does not limit the present application. Changes in structure, method, function, etc. made by ordinary technicians in this field based on these examples are included in the protection scope of the present application.

[0047] It should be noted that the same reference numerals or marks may be used in different examples, but these do not represent an absolute connection in structure or function. In addition, the "first", "second", etc. mentioned in each example are only for the convenience of description, and do not represent an absolute distinction in structure or function, nor can they be understood as indicating or implying the relative importance or the number of corresponding objects. Unless otherwise specified, the "at least one" that may be involved in the description refers to one or more, and "more than one" refers to two or more.

[0048] In addition, when expressing a feature, the character " / " can indicate that there is an or relationship between the front and back associated objects. For example, head-up display / head-up display can be expressed as head-up display or head-up display. When expressing an operation, the character " / " can indicate that there is a division relationship between the front and back associated objects. For example, the magnification M=L / P can be expressed as L (virtual image size) divided by P (image source size). Moreover, the "and / or" in different examples is only to describe the association relationship between the front and back associated objects. This association relationship can include three situations. For example, a concave mirror and / or a convex mirror can be expressed as the existence of a concave mirror alone, the existence of a convex mirror alone, and the existence of both a concave mirror and a convex mirror.

[0049] HUD projection display mainly uses the optical reflection principle to reflect the imaging light to be displayed through a transparent surface into the viewer's eyes. The human eye can see the virtual image information in the opposite direction of the light. Correspondingly, the transparent surface can be the windshield of the vehicle, and the windshield can be used as a display screen to display the navigation instructions of the vehicle, the vehicle's driving speed, etc. Figure 1As shown, the HUD display device may include at least an optical machine 1, a first reflector 2, a second reflector 3, etc., wherein the optical machine 1 includes a backlight source and an image source (not shown), the backlight source is used to provide illumination light and adjust the brightness of the illumination light according to control, for example, the backlight source may be an LED (Light Emitting Diode), a laser, etc. Under the illumination light provided by the backlight source, the image source adjusts the corresponding display content according to control and projects the display light from the surface of the image source, for example, the image source may be an LCD (Liquid Crystal Display), a DMD (Digital Micromirror Devices), a MEMS (Micro-Electro-Mechanical System) micromirror, a LCOS (Liquid Crystal on Silicon), etc. The first reflector 2 and the second reflector 3 can project the display light projected by the optical machine 1 onto the windshield 4, so as to customize the optical path in a smaller space and meet different projection display requirements. The first reflector 2 and the second reflector 3 can be set as a concave mirror, a convex mirror, a concave lens, a convex lens, etc. according to the requirements of optical planning, and the surface shape of the lens can adopt a free-form surface. Optionally, at least one of the first reflector 2 and the second reflector 3 can also be adjusted to a certain degree of angle, so as to change the projection position of the display light on the windshield 4 to meet the needs of viewers of different heights. The display light of the optical machine 1 is finally reflected on the windshield 4 of the vehicle to form a virtual image 5. When the human eye 6 observes the virtual image 5 facing the windshield 4, it can feel a certain sense of depth, just like watching a real object at a specific distance outside the windshield. The virtual image 5 can be the navigation instruction content, vehicle speed, etc. as described above. It should be added that, according to the characteristics of different optical machines, the HUD display device can also be provided with a diffuser. In some examples, the HUD display device can also include Fresnel lenses, waveguide optical devices, diffractive optical devices, holographic optical devices, tapered optical fibers, etc.

[0050] As described above, for the display light projected by the HUD display device, based on the principle of light reflection on the windshield 4, a virtual image corresponding to the display content on the image source display surface will be equivalently formed on the other side of the windshield 4 relative to the HUD display device, that is, the position of the virtual image perceived by the human eye 6 is directly in front of the outside of the windshield 4. Figure 2As shown, the windshield onto which the display light is projected often has a certain thickness, including an inner surface 41 facing the HUD display device and an outer surface 42 facing the outside. For the display light reaching the windshield, in actual light transmission, it will first be reflected on the inner surface 41, and part of the display light will be transmitted from the inner surface 41 to the outer surface 42. Its transmission path may also be accompanied by a certain angle of refraction. The light reaching the outer surface 42 will be reflected again. The thickness of the windshield makes the light paths reflected by the two surfaces not overlap, which makes the human eye 6 see two virtual images. Most of the virtual images overlap, and a small part will exceed. This is the ghosting phenomenon perceived by the human eye 6. Figure 3 As shown, if the target projected display element is a line type, since the line type design has very clear edge lines and its own visual lightness, the display element occupies a small area and is not easy to contrast with the generated ghosting elements. At the same time, the ghosting elements need to transmit a certain path on the windshield, which causes more light decay. Therefore, although the ghosting elements and display elements are derived from the display light provided by the optical machine, the ghosting elements are relatively dimmer than the display elements. This will make the human eye clearly feel the difference between the display elements and the ghosting elements, affecting the viewing experience. In some examples, such as Figure 4 As shown, the display element can be configured to be displayed in a color block type, that is, the enclosed block can be filled on the basis of the line type to make the overall shape of the display element thicker and larger, so that most of the ghost element will be blocked by the display element, and the part of the ghost element that exceeds the display element will not account for a large proportion of the overall display element, and the relative visual experience will be better. Optionally, the edge width of the part directly opposite to the ghost element that exceeds the display element can be thickened to Figure 4 For example, since the entire optical system of the HUD display device causes the ghosting elements to shift downward along the display elements, the width direction of the display elements can be thickened, thereby directionally reducing the visibility of the ghosting elements. However, the overly thick color block design of the display elements will also have a significant negative impact on the overall UI perception, and other methods need to be used to get rid of the simple thickening design. The following will detail further improvements based on the filling.

[0051] Reference Figure 2, the formation mechanism of ghosting elements determines that once the optical hardware of the HUD display device is determined, its offset direction relative to the display element is relatively fixed, but the final projection hue of the display element and the ghosting element can be changed by the actual display parameters on the image source display surface. Accordingly, the ghosting element can be understood as the effect of the display element being decayed under a specific mapping, that is, the ghosting element can be adjusted along with the display element to adjust the display effect, and the outline of the display element can also be changed. It should be noted that the hue here is mainly manifested as whether it is easy to be observed by the human eye. It can be that the application uses unified brightness information to evaluate the visual impact of different hues, brightness, saturation, and color temperature in different areas of the display element on the user, that is, it can be brightness information expressed by different hues, brightness, saturation, and color temperature. The brightness information can be the brightness value of the pixel area photographed under specific exposure parameters, and the specific exposure parameters can be to ensure that there is no overexposure or underexposure. Specifically, different hues determine that the brightness information they show is different. For display elements, in order to change the brightness information of a specific position, it can be achieved by adjusting the hue, brightness, saturation, and color temperature of the specific position. In some examples, in order to avoid complex color matching effects of display elements, the display elements are generally filled with the same hue, and the brightness information adjustment of light and dark is achieved through transparency. Optionally, it can also be adjusted in combination with corresponding brightness parameters, which will be described in detail below.

[0052] like Figure 5As shown, display element 510 and ghost element 520 are the effects observable by the human eye after projection. The projection result can be divided into three areas according to the relative position relationship between display element 510 and ghost element 520. Area 531 is the first end position close to display element 510, and it does not overlap with the ghost element. Area 532 is the overlapping area between display element 510 and ghost element 520. In this area, since the brightness information of the display element is much higher than the brightness information of the ghost element, the ghost part is not easily perceived by the human eye. Area 533 is the excess part of ghost element 520 relative to display element 510, and the excess area is related to the degree of offset between the two. The visual impact brought by ghosting is not only related to the excess area, but also to the color difference between area 533 and area 532, which is also the key to adjusting to weaken the perception of ghosting. Accordingly, the main factors that affect the visual experience of ghosting are: Factor 1, the absolute value of the visible brightness of area 533, the brighter the area, the greater the impact on its visual experience; Factor 2, the ratio of the brightness of area 533 to the brightness of area 532, the greater the difference, the greater the impact on its visual experience; Factor 3, the ratio of area 533 to the area of ​​display element 510, the larger the excess part, the greater the impact on its visual experience. As mentioned above, the optical hardware of the HUD display device determines that factor 3 cannot be changed at will, so the impact of ghosting can be weakened by changing factors 1 and 2, which will be detailed below.

[0053] In some examples, such as Figure 6 As shown, the ghost element 520 is offset up and down relative to the display element 510, and the portion of it that exceeds the display element 510 is L. As mentioned above, its L value is determined by the optical system and cannot be adjusted by software. The larger L is, the more obvious the ghosting effect is. Accordingly, the upper edge of the display element 510 is defined as the first end, and the lower edge that is directly opposite to the portion that exceeds the ghost element 520 is defined as the second end. Since the brightness information of the second end is significantly higher than the brightness information of the ghost element, the dividing line between the display element 510 and the ghost element 520 can be clearly seen. It should be noted that Figure 6The black in the figure represents a specific filling color, which is not the transparent color that is displayed after projection when the image source display surface is filled with black in reality. The legend is only for the convenience of expression. The darker the color, the greater the brightness information, and the grayer and lighter the color, the lower the brightness information. In this example, the effect of the display element after projection is adjusted by improving the filling color of the display element configured on the image source display surface, that is, the display element to be displayed is not filled with a pure color but with a gradient, so as to ensure that the color filling of the entire display element is relatively continuous. The display element 510 after projection will also be presented in a gradient manner, and the ghost element 520 will also be presented in a gradient manner due to the same imaging principle, but its brightness information has undergone a certain corresponding decay. That is, the display element 510 will be distributed from bright to dark from the first end to the second end, and the ghost element 520 will also be distributed from bright to dark from the upper edge (basically blocked by the display element 510) to the lower edge. With the influence of decay, the brightness information of the lower edge of the ghost element 520 will be slightly lower than the brightness information of the second end of the display element 510. In the ghost element 520, based on the gradient distribution, the brightness information from the lower edge to the second end of the display element will show a trend of gradually becoming brighter, until at the junction of the display element 510 and the ghost element 520, the difference in brightness information between the two is not large. If it is less than a specific first threshold, the human eye cannot easily perceive it. Figure 6 As shown, since the brightness information of the part of the ghost element 520 that exceeds the display element 510 is not very prominent, and the difference between the display element 510 and the ghost element 520 is not large, it is difficult to distinguish the actual outline of the ghost element 520. There is only a faint color jump line at the junction between the display element 510 and the ghost element 520, which is difficult to detect without careful observation.

[0054] In some examples, such as Figure 7As shown, the ghost element 520 is diagonally offset relative to the display element 510. As mentioned above, the direction of the offset is determined by the optical system. Due to the difference in color tone between the display element 510 and the ghost element 520, the excess of the lower edge and the right edge of the ghost element 520 can be clearly seen, which affects the viewing experience to a certain extent. Accordingly, the gradient filling of the display element on the image source display surface will be realized. In this example, since the ghost element 520 after projection is offset to the lower right corner relative to the display element 510, the upper left corner of the display element 510 is defined as the first end, and the lower right corner of the display element 510 close to the ghost element 520 is defined as the second end. The gradient direction from the first end to the second end is to fill from the upper left corner of the display element 510 to the lower right corner in a light-to-dark manner, so that when the lower right corner contacts the excess part of the ghost element 520, it shows lower brightness information. The ghost element 520 will also show a gradual change from the upper left corner to the lower right corner. The brightness information of the upper left corner of the ghost element 520 is lower than the brightness information of the upper left corner of the display element 510 (the upper left corner of the ghost element 520 overlaps with the display element 510, and the difference in perception is basically negligible), and the brightness information of the lower right corner of the ghost element 520 is lower than the brightness information of the lower right corner of the display element 510. Similarly, since the brightness difference at the junction between the display element 510 and the ghost element 520 is small, for example, less than the first threshold, the human eye will easily perceive the projection-formed display element 510 and the ghost element 520 as a whole. In some examples, Figure 6 , Figure 7 The gradient fill in the example uses a linear gradient to ensure the smoothness of the tone of the element content, or a nonlinear gradient to specifically match the positional relationship between the display element 510 and the ghost element 520 to ensure the coordination of the tone overlay effect in the overlapping area between the display element 510 and the ghost element 520.

[0055] Furthermore, for the configuration of the gradient, different brightness information can be configured at the first end and the second end respectively. Since it is a decreasing method from light to dark, the brightness information at the first end should be set higher than the brightness information at the second end. If a linear gradient method is selected, the brightness information between the first end and the second end will be automatically filled at a uniform gradient speed after the two ends are determined, that is, starting from the first end, the brightness information gradually decreases. Due to the influence of decay, the brightness information of the corresponding position of the first end of the corresponding ghost element will also be higher than the brightness information of the corresponding position of the second end. In this way, it is ensured that the brightness information of the superimposed area of ​​the display element and the ghost element also maintains a decreasing trend, so that the overall brightness information tends to be coherent. Optionally, if a nonlinear gradient method is selected, the brightness information between the first end and the second end of the display element will also be filled in a gradually decreasing distribution method, but the gradient speed of different areas is different, thereby ensuring the coordination between the superimposed area and the non-superimposed area and ensuring the continuity of the overall change. In some examples, after calibrating the projection effect of the HUD display device, for example, determining the offset direction, offset degree and other parameters between the projected display elements and the corresponding ghosting elements, the display elements to be projected can be filled in a manner configured according to the parameters obtained through calibration. Specifically, the display elements to be projected can be adjusted in the graphics processing software. First, the overall shape of the display elements can be appropriately thickened, especially the width of the color blocks opposite to the ghosting elements. More importantly, the color blocks presented by the display elements can be configured using a gradient fill method, such as Figure 8 As shown, after selecting the color block corresponding to the display element, the gradient bar 110 in the gradient fill tool can be used to adjust the gradient parameters, and the slider 111 and the slider 112 are set on the gradient bar 110. By adjusting the positions of the sliders 111 and 112 on the gradient bar 110, the corresponding configuration positions in the display element can be controlled. Correspondingly, by dragging the slider 111 to the left end of the gradient bar 110, the brightness information of the first end of the display element can be adjusted, and by dragging the slider 112 to the right end of the gradient bar 113, the brightness information of the second end of the display element can be adjusted. Since the first end is the end away from the ghost element, the brightness information configured by the slider 111 will be higher, and the second end is the end close to the ghost element, so the brightness information configured by the slider 112 will be lower. After setting a specific gradient type (such as linear gradient or nonlinear gradient), the gradient bar 110 will automatically fill the color tone between the slider 111 and the slider 112, that is, the gradient filling inside the display element is completed. In more examples, the sliders 111 and 112 are set to specific colors, and the color setting will take into account the influence of the superposition between the display element and the ghost element, especially Figure 5In order to achieve the transition effect between the middle area 532 and the area 533, it is not advisable to set the brightness information in the slider 112 too high, reduce the gradient that is too high when superimposed in the area 532, and the brightness information difference between the slider 111 and the slider 112 should also be kept within a reasonable range to avoid the overall effect being inconsistent due to excessive gradient speed. Optionally, the settings of the sliders 111 and 112 may also include additional settings of parameters such as transparency and brightness to achieve a reasonable brightness information setting. Optionally, parameters such as the overall smoothness may be adjusted to make the gradient effect more natural, and parameters such as the gradient direction may be fine-tuned to make the direction from the first end to the second end consistent with the offset direction of the ghosting, so that the boundary where the display element and the ghosting element meet the trend requirement of decreasing brightness information.

[0056] In some examples, such as Fig. 9 As shown, sliders other than sliders 111 and 112 may be added to the gradient bar 110, such as slider 113 in the figure. It should be noted that, in order to optimize the gradient effect, more sliders may be added to correspond to different positions between the first end and the second end of the display element. In this example, the position of slider 113 is set between slider 111 and slider 112, that is, a partition is inserted in the middle position between the first end and the second end of the display element, so that a first filling area is formed between the first end and the middle partition, and a second filling area is formed between the middle partition and the second end. The gradient filling of the first filling area is determined according to the settings of sliders 111 and 113, and the gradient filling of the second filling area is determined according to the settings of sliders 113 and 112. Accordingly, different filling areas also have different smoothness, transparency, brightness and other parameter adjustments. Figure 6For example, the first end of the display element is the upper edge, and the position of the ghost element corresponding to the first end is superimposed on the display element. Since the brightness near the first end is relatively high, it may not be sensitive to the effect of gradient reduction. At this time, the gradual decrease can be achieved at a lower gradient speed, that is, the first filling area is close to the first end, and the brightness difference between the slider 111 and the slider 113 can be set to be smaller accordingly, and the position distance between the slider 111 and the slider 113 can also be smaller, so that the gradient speed will be smaller and the color change therein will be more stable. The second filling area is close to the second end, and the superposition effect between the display element and the ghost element and the continuity with the tail of the ghost element must be taken into account. Therefore, the brightness information set by the slider 112 is relatively different from that of the slider 113, and the position distance between the slider 113 and the slider 112 will be larger accordingly, so the gradient speed will be larger, ensuring that the color change at the junction is not a sudden change and is basically consistent with the previous gradient speed. Through the common configuration of sliders 111, 112, and 113, the interior of the display element is automatically divided into two filling modes with different gradient speeds according to the first filling area and the second filling area, and the setting value of slider 113 is smaller than that of slider 111, and the setting value of slider 112 is smaller than that of slider 113, so the gradient within the entire color block still maintains a trend from light to dark, and the first filling area and the second filling area are coherent, so that the human eye can pay more attention to the bright area near the first end. In some examples, the setting position of slider 113 can be determined according to the size of the ghost element exceeding the display element, that is, Figure 5 The size of the area 533 in the display element is determined by the size of the area 533. Preferably, the position of the slider 113 is set in the left half between the sliders 111 and 112, that is, the first filling area occupies at most half of the display element. As the excess portion of the ghost element increases, the setting of the slider 113 will move toward the slider 111 to reduce the area of ​​the first filling area. For example, the ratio of the slider 113 moving from the middle position between the sliders 111 and 112 toward the slider 111 is consistent with the ratio of the excess portion of the ghost element to the area of ​​the display element.

[0057] In some examples, when the offset of the ghost element relative to the display element includes not only up and down offset but also left and right offset, that is, the display element and the ghost element may be offset in at least the first direction and the second direction, the first direction is inconsistent with the second direction, the first direction may be the up and down direction, and the second direction may be the left and right direction, the display element will make fine adjustments to its shape based on the gradient fill to adapt to the relative position relationship between the display element and the ghost element. Figure 7When there are offsets in multiple directions between the display element 510 and the ghost element 520, the corners between the display element 510 and the ghost element 520 will have jagged shapes formed by the excess parts outside the overlap, which will also affect the user's visual experience, that is, the first corner at the lower left corner or upper right corner of the display element 510 and the second corner at the lower left corner or upper right corner of the ghost element 520. In this example, since the ghost element 520 corresponding to the display element 510 is offset to the lower right, the second corner at the lower left corner or upper right corner corresponding to the ghost element 520 does not completely overlap with the display element 510, resulting in the first corner and the second corner being exposed and easily perceived by the human eye. At this time, if the first corner and the second corner are right angles, an obvious grid-like gap will be formed between the two, which is inconsistent with the style of the display element 510 and the ghost element 520 as a whole. Fig.10 As shown, the corners of the display element 510 can be chamfered, for example, the first corner is chamfered with a rounded corner instead of a right-angled corner. In this example, in order to unify the style, all corners of the display element 510 are uniformly chamfered, and the radius of the rounded corners is also adjusted according to the offset between the display element 510 and the ghost element 520. After the chamfering and gradient processing, the display element 510 and the ghost element 520 can form a good whole. Without careful observation, it is difficult to identify the existence of the ghost element 520. Fig.11 As shown, the chamfering of the first corner can be extended to the tilt angle of the length of the sides. For example, the offset between the display element 510 and the ghost element 520 is large, and the distance between the corners is relatively large. The rounded corners may still have a certain sawtooth shape. In this example, since the ghost element 520 is offset to the lower right corner relative to the display element 510, the tilt angle of the length of the left and right sides of the display element 510 can be adjusted, and the tilt angle can be consistent with the offset angle of the ghost element 520 relative to the display element 510, that is, the tilt angle of the chamfer is determined according to the offset degree of the display element 510 and the ghost element 520 in the first direction (left and right direction). Optionally, the tilt angle of the upper and lower sides of the display element 510 can also be adjusted, and the tilt angle of the chamfer is determined according to the offset degree of the display element 510 and the ghost element 520 in the second direction (up and down direction). In this way, the chamfered effect of the display element 510 will be exactly the same as that of the ghosting element 520, and there will be no protruding parts on the left and right sides or the upper and lower sides, and the two can be perfectly integrated to avoid the abrupt feeling caused by the protruding bending angle.

[0058] In some examples, Figure 4 For example, after the actual display element is filled with color blocks, the proportion of the excess part of the ghosting element can be compressed to reduce a certain degree of ghosting effect. Figure 6-11 The gradient processing of the example can further reduce the impact of projection ghosting on the user viewing the projection information. The above fusion method mainly depends on the offset degree between the display element and the ghosting element obtained by calibration, but the ghosting reduction effect may also depend on the tone decay relationship of the ghosting element relative to the display element. Figure 8 , Fig. 9 In addition to controlling the gradient of the gradient by setting the parameters in the slider, the example also allows the projection display elements to be animated to divert the user's attention from the ghosting. Figure 4 The four rightward prompts will move rightward cyclically, which can not only express the meaning of rightward more intuitively, but also prevent the eyes from locking on the part beyond the ghost element for a long time. Optionally, the rightmost prompt will fade out after moving to a certain distance to the right, and fade in from a specific position on the left, repeating the process of rotating and moving the prompts. In this way, even if there is a certain jump line between the display element and the ghost element, it is easy for the user's line of sight to be distracted and ignored.

[0059] In some examples, the filling and / or shape processing of the display elements is automatically implemented according to the actual situation of the ghosting elements. Compared with manual processing of display elements, it is necessary to control the materials displayed on the image source display surface, that is, engineers are required to adaptively adjust the display element materials to be displayed, optionally with the help of certain material processing software. The automatic processing method is automatically executed based on certain calibration data in advance. For example, according to the offset angle and offset degree of the ghosting element relative to the display element, the gradient parameters and shape fine-tuning parameters of the display element are automatically calculated. In actual use, the HUD display device can adjust the corresponding gradient parameters and / or shape fine-tuning parameters according to the input standard display elements, and automatically input the processed display elements to the image source for display. The image source will be projected on the specified transparent surface according to a fixed optical system. The display elements and ghosting elements reflected on the transparent surface will have a good fusion effect, and engineers at the application layer do not need to pay attention to the impact of optics on the projection display when designing.

[0060] When the HUD display device implementing the display method in the above example is applied to the vehicle, the ghosting effect of the projection effect can be optimized. The HUD display device outputs projection display elements that adapt to the ghosting formation situation, strengthens the display attention of the display elements, and thus weakens the visual presence of the ghosting elements. Fig.12As shown, the HUD display device integrated in the vehicle can be powered and data by the vehicle computer 92, or the HUD display device itself can provide power and generate data. The HUD display device can specifically include a processor 91, an Ethernet interface 901, a CAN (Controller Area Network) interface 902, a power management module 903, a running memory 904, a storage memory 905, a temperature detection 906, a motor 907, a backlight source 908, an image source 909, a positioning module 910, a radar 911, a camera 912, etc. It should be noted that Fig.12 The modules listed in the description are merely exemplary and do not constitute any limitation. In some examples, the HUD display device may further include other modules. In addition, the above modules may be implemented in one or more hardware in different examples, or a single module may be implemented by a combination of multiple hardware.

[0061] The processor 91 serves as the control center of the HUD display device, and includes one or more processing units of any type, including but not limited to a microcontroller, a microcontroller, a DSP (Digital Signal Processor) or any combination thereof. The processor 91 is used to generate operation control signals according to a computer program, realize the control of other modules, and cooperate with corresponding modules to process the acquired or inherent data, instructions, etc.

[0062] The Ethernet interface 901 is a network data connection port for local area network communication, which defines a series of software and hardware standards. Multiple electronic devices can be connected together through the Ethernet interface 901. In this example, the processor 91 can exchange information with the vehicle computer 92 through the Ethernet interface 901, such as sending data to the vehicle computer 92 or receiving data sent by the vehicle computer 92.

[0063] The CAN interface 902 is a network data connection port of the controller area network, which provides a standard bus for the control system and embedded industrial control inside the car, and realizes the communication interaction between the control nodes. In this example, the processor 91 can also exchange information with the vehicle computer 92 through the CAN interface 902. Optionally, the processor 91 can also connect to other external devices through the CAN interface 902. In some examples, the processor 91 can also be provided with a GPIO (General-purpose input / output) interface to improve the compatibility of peripheral connections.

[0064] The power management module 903 is connected to the vehicle computer 92 and can receive the power provided by the vehicle computer 92 to provide a regulated power supply for each module of the HUD display device, thereby ensuring that the processor 91 and each module operate under normal voltage supply and avoid damage due to overvoltage.

[0065] The running memory 904 is used to store computer programs executed by the processor 91, temporarily stored calculation data, data exchanged with the storage memory, etc. The running memory 904 can be a memory such as SDRAM (Synchronous Dynamic Random-access Memory).

[0066] The storage memory 905 is used to store resources such as display content related to the HUD display device, and long-term storage of running programs and data, etc. The storage memory 905 can be a memory such as Flash (flash memory). In some examples, the processor 91 can also provide an interface to access an external memory.

[0067] Temperature detection 906 is used to detect the temperature inside the HUD display device, and may specifically include several temperature sensors. Since the resistance value of the temperature sensor changes with the change of temperature, the processor 91 can determine the resistance value of the temperature sensor at the corresponding temperature according to the voltage change between each temperature sensor and the voltage divider resistor under a fixed power supply voltage, thereby reversely deducing the temperature at the location of the temperature sensor. In some examples, the processor 91 can control several temperature sensors through the GPIO interface, and several temperature sensors can be set at different locations inside the HUD display device. The processor 91 can use time-sharing detection to obtain the temperature values ​​fed back by several temperature sensors respectively.

[0068] Motor 907 is used to drive the optical lens in the HUD display device to rotate under the control of processor 91, so as to achieve the change of the corresponding optical path. For example, when the backflow of sunlight causes the temperature rise on the surface of the image source, the motor can be used to drive the optical lens to prevent the external sunlight from reaching the surface of the image source. In some examples, the processor 91 can also drive the fan provided on the HUD display device through motor 907 to increase the speed of air exchange between the inside and outside of the HUD display device to achieve heat dissipation. Specifically, the motor 907 is connected to the processor 91 through a motor driver chip, and the motor driver chip provides high-performance power output for the motor 907, and can also communicate and control with the processor 91 through interfaces such as SPI (Serial Peripheral Interface).

[0069] The backlight source 908 is used to provide illumination light and adjust the brightness of the illumination light according to the control of the processor 91, so as to adjust the projection display brightness of the entire HUD display device. The backlight source 908 cooperates with the image source 909 to realize the main function of optical machine projection display. The backlight source 908 can be an LED (Light Emitting Diode), a laser, etc. Specifically, the backlight source 908 is connected to the processor 91 through a backlight driver chip, and the backlight driver chip provides a driving voltage for the backlight source 908 and controls the brightness of the backlight source 908 under the pulse width signal output by the processor 91.

[0070] The image source 909 is used to display an image of corresponding content and project the display light corresponding to the image according to the control of the processor 91. The image source 909 can be an LCD (Liquid Crystal Display), a DMD (Digital Micromirror Devices), a MEMS (Micro-Electro-Mechanical System) micromirror, a LCOS (Liquid Crystal on silicon), etc.

[0071] The positioning module 910 is used to monitor the position of the HUD display device and the corresponding vehicle. The positioning module 910 can be a global navigation satellite system such as GPS (Global Positioning System) and Beidou Satellite Navigation System. By measuring the distance between the satellite and the receiver on the positioning module 910 at different positions, the corresponding position and orientation data are determined. In some examples, the positioning module 910 may also include an inertial navigation system, which is based on Newton's laws of mechanics. By measuring the acceleration of the positioning module 910 in the inertial reference system, integrating it over time, and transforming it into the navigation coordinate system, the speed, yaw angle, and position data in the navigation coordinate system are obtained. Optionally, the inertial navigation system can assist the global navigation satellite system to achieve more accurate positioning and provide the processor 91 with corresponding position information.

[0072] The radar 911 is used to determine the position of a target object through electromagnetic waves, and can usually determine the distance of the target object from the vehicle where the radar 911 is located.

[0073] Camera 912 includes a vehicle body camera and an in-vehicle camera, wherein the vehicle body camera is used to determine the position of the target object through visual recognition, and the vehicle body camera can be a monocular camera or a binocular camera. The biggest difference between a monocular camera and a binocular camera is that a binocular camera can capture images from two different perspectives, thereby obtaining distance information in three-dimensional space. The in-vehicle camera is used to identify the behavior status of the driver and passengers in the vehicle, including fatigue detection, distraction detection, expression recognition, gesture recognition, sight tracking, etc. In this example, the in-vehicle camera can also implement eye tracking.

[0074] In some examples, the positioning module 910, radar 911 and camera 912 can also be directly connected to the vehicle computer 92, and are not directly connected to the processor 91 of the HUD display device. For example, the vehicle computer 92 itself is integrated with a positioning module for position tracking and a radar and camera for automatic driving. The HUD display device can obtain the collected data of the positioning module, radar and camera in real time through communication with the vehicle computer 92.

[0075] In some examples, such as Fig.13 As shown, the HUD display device implementing the above display method may specifically include a processor 931, a memory 932, an input device 933 and an output device 934, wherein the input device 933 may include an operation button integrated on the display device, etc., and the display device may receive input control instructions and data through the input device 933. The output device 934 may include an image source integrated on the display device, etc., and the display device may output corresponding instructions or data to the output device 934. Further, the memory 932 stores a computer program running on the processor 931, and the processor 931 implements the display method of the above example when executing the computer program. In some examples, a computer-readable storage medium, a computer-readable storage medium stores a computer program, and the computer program implements the display method of the above example when executed by the processor.

[0076] like Fig.14As shown, the vehicle can be provided with the above-mentioned HUD display device. Specifically, the HUD display device is integrated inside the center console 10, such as in front of the steering wheel. The corresponding display light is projected onto the opposite vehicle windshield 4 through the projection window 102 of the HUD display device. The effect of the viewer observing the windshield 4 from the cockpit is that the corresponding virtual image can be directly seen. Although the virtual image has a double image, it is not easy to be observed relative to the target projection virtual image, thus overcoming the optical defect of non-re-adjustable. In some examples, the vehicle can also distribute the program of obtaining the display method in the above example through the computer-readable storage medium of the above example, so that the vehicle-mounted HUD display device can be conveniently updated and upgraded. It should be noted that the above-mentioned vehicle is not limited to a car as a means of transportation, but can also include a bus, a truck, an excavator, a motorcycle, a train, a high-speed rail, a ship, a yacht, an airplane, a spacecraft, etc. The projected windshield is not limited to the front windshield of the car, but can also be a transparent surface at other positions.

[0077] In combination with the above examples, the technical solutions involved in the present application can be directly embodied as hardware, a software module executed by a control unit, or a combination of the two, that is, one or more steps and / or one or more step combinations, which can correspond to various software modules of a computer program flow, or to various hardware modules, such as ASIC (Application Specific Integrated Circuit), FPGA (Field-Programmable Gate Array) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, or any appropriate combination thereof. For the convenience of description, the above description is divided into various modules and described separately according to their functions. Of course, when implementing the present application, the functions of each module can be implemented in the same or more software and / or hardware.

[0078] Through the description of the above examples, those skilled in the art can clearly understand that the present application can be implemented by means of software plus a necessary general hardware platform. Based on this understanding, the technical solution involved in the present application can be essentially or partly contributed to the prior art in the form of a software product. The software is executed by a microcontroller unit and, depending on the required configuration, may include one or more microcontroller units of any type, including but not limited to a microcontroller unit, a microcontroller, a DSP (Digital Signal Processor) or any combination thereof. The software is stored in a memory, such as a volatile memory (such as a random access memory, etc.), a non-volatile memory (such as a read-only memory, a flash memory, etc.) or any combination thereof.

[0079] In summary, the present application performs gradient filling on the display elements so that the display elements presented after projection use different brightness information for different positions while maintaining a smooth look and feel, and uses the correspondence between the display parameters of the ghosting elements and the display elements, and uses darker brightness information at the second end of the display element close to the ghosting element than at the first end far from the ghosting element, so as to reduce the sense of separation at the junction of the display element and the ghosting element. The effect of projecting information by the HUD display device of the present application is not affected by ghosting, and can optimize the user's viewing experience.

[0080] It should be understood that although this specification includes some examples, none of these examples contains only one independent technical solution, and this description of the specification is only for the purpose of clarity. A person skilled in the art should take the specification as a whole, and the technical solutions in each example can also be appropriately combined to form other implementation methods that can be understood by a person skilled in the art.

[0081] The series of detailed descriptions listed above are only specific descriptions of feasible implementation methods of the present application. They are not intended to limit the scope of protection of the present application. All equivalent implementation methods or modifications that do not deviate from the teachings of the present application should be included in the scope of protection of the present application.

Claims

1. A display method, characterized in that: include: The HUD display device projects display light that reflects on a transparent surface to form a display element viewed by a user, and a ghost element corresponding to the display element; The display element includes a first end away from the ghost element and a second end close to the ghost element, and the interior of the display element is configured to be filled with a gradient from light to dark from the first end to the second end.

2. The display method according to claim 1, characterized in that: The display element is a separate block surrounded by a closed line outline, and the line outline and the block are configured to be filled with a consistent color gradient from light to dark.

3. The display method according to claim 1, characterized in that: The interior of the display element is configured to be filled with a gradient from light to dark from the first end to the second end, including: The difference between the hue of the ghost element beyond the display element and the hue of the second end is smaller than a first threshold.

4. The display method according to claim 1, characterized in that: The interior of the display element is configured to be filled with a gradient from light to dark from the first end to the second end, including: A first filling region close to the first end and a second filling region close to the second end are arranged between the first end and the second end, and a gradual change speed of the first filling region is different from a gradual change speed of the second filling region.

5. The display method according to claim 4, characterized in that: The size distribution of the first filling area and the second filling area is determined according to the size of the ghost element exceeding the display element.

6. The display method according to claim 1, characterized in that: The display method further includes: The display element and the ghost element are offset in at least a first direction and a second direction, and the first direction is inconsistent with the second direction; The first corner of the display element is chamfered, and the first corner of the display element corresponds to the second corner of the ghost element, and the second corner of the ghost element is a portion that exceeds the display element.

7. The display method according to claim 1, characterized in that: When the display element is projected, it presents an animation of position displacement and / or fading in and out.

8. A display device, characterized in that: The method comprises a memory, a processor and a computer program stored in the memory and running on the processor, wherein the processor implements the steps of the display method according to any one of claims 1 to 7 when executing the computer program.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the display method according to any one of claims 1 to 7 are implemented.

10. A means of transport, characterized in that: Includes the display device of claim 8 or the computer-readable storage medium of claim 9.

Images