A display method of a head-up display device, a head-up display system, and a vehicle

Abstract

The application provides a display method of a head-up display device, a head-up display system and a carrier. The display method comprises the following steps: obtaining a gaze point position of both eyes in a virtual image display area; determining a gaze area in the virtual image display area according to the gaze point position; and performing blur processing on at least part of a target 3D information image if the target 3D information image is located outside the gaze area. The embodiment of the application can reduce the vergence-accommodation conflict and the visual separation of a user, thereby improving the visual comfort of the user and reducing the fatigue of the user.

Description

Technical Field

[0001] This invention relates to the field of display technology, and in particular to a display method, a head-up display system, and a carrier for a head-up display device. Background Technology

[0002] When a user observes the images projected by the head-up display on the windshield (such as pedestrian warning symbols, lane departure warning symbols, navigation prompt symbols, etc.), these images appear within the user's field of vision and will present different depth effects due to binocular parallax, thus creating a 3D visual effect.

[0003] However, the human eye can usually only focus on one object at a time, and can only focus on one image and perceive it as a 3D effect. If multiple 3D images appear simultaneously within the user's field of vision, the human eye can only select one image to focus on. That is to say, only the image focused by the eye undergoes convergence accommodation and merges with the slightly different images received by the left and right eyes to form a 3D effect. The other 3D images that the eyes do not focus on still exist within the user's field of vision, and the eyes may attempt to converge on them, leading to convergence conflict, visual separation, visual discomfort or fatigue, which in turn affects the driver's attention and judgment, and affects the user's driving safety. Summary of the Invention

[0004] The present invention provides a display method, a head-up display system and a carrier for a head-up display device, so as to reduce the user's convergence conflict and visual separation, thereby improving the user's visual comfort and reducing user fatigue.

[0005] In a first aspect, embodiments of the present invention provide a display method for a head-up display device, comprising: Obtain the gaze points of both eyes within the virtual image display area; Based on the location of the gaze point, determine the gaze area within the virtual image display area; If the target 3D information image is located outside the gaze area, at least a portion of the target 3D information image is blurred.

[0006] Optionally, after determining the gaze region within the virtual image display area based on the gaze point position, the method further includes: If the target 3D information image is entirely located within the gaze area, the stereoscopic display state of the target 3D information image is maintained.

[0007] Optionally, the fixation point positions of both eyes within the virtual image display area are obtained, including: Obtain the position of both eyes and the direction of their gaze; The fixation point position is determined based on the position of both eyes and the direction of their gaze.

[0008] Optionally, the head-up display device includes an image source; Blurring at least a portion of the target 3D information image includes: The display brightness of the image source corresponding to the area outside the gaze region is controlled to be less than the display brightness of the image source corresponding to the area within the gaze region.

[0009] Optionally, the head-up display device further includes a plurality of cylindrical lenses disposed on the light-emitting side of the image source, the image source including a plurality of sub-pixels; Along the width direction of the cylindrical lens, among the multiple sub-pixels covered by one cylindrical lens, the number of sub-pixels lit outside the gaze area is controlled to be M1, and the number of sub-pixels lit within the gaze area is M2, where M1 is less than M2. Specifically, the number of lit sub-pixels in the left eye visual area outside the gaze area is less than the number of lit sub-pixels in the left eye visual area within the gaze area; and the number of lit sub-pixels in the right eye visual area outside the gaze area is less than the number of lit sub-pixels in the right eye visual area within the gaze area.

[0010] Optionally, the values ​​of M1 and M2 are obtained based on the ambient brightness, HUD adaptive brightness, and / or the blurring degree of the target 3D information image.

[0011] Optionally, at least a portion of the target 3D information image is blurred, including: The control elements of at least a portion of the target 3D information image at the image level are altered, and at least a portion of the target 3D information image is blurred.

[0012] Optionally, the control elements include image brightness and / or image transparency.

[0013] Optionally, modifying at least a portion of the control elements at the image level of the target 3D information image includes: The average brightness is obtained by weighting the ambient brightness and the HUD adaptive brightness. Based on the average brightness value, control elements at least a portion of the target 3D information image are modified at the image level.

[0014] Optionally, when the control element includes image brightness, the hue and / or saturation of at least a portion of the target 3D information image are adjusted.

[0015] In a second aspect, embodiments of the present invention provide a head-up display system, including a head-up display device, an eye-tracking device, and a processing device; The head-up display device is used to generate an image beam; the head-up display device includes an image source and a lenticular grating disposed on the light-emitting side of the image source, the lenticular grating being used to split the image beam to form a naked-eye 3D display; The eye-tracking device is used to obtain the position of both eyes; The processing device includes a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement the method as described in the first aspect.

[0016] Thirdly, embodiments of the present invention provide a vehicle including the head-up display system described in the second aspect.

[0017] The display method provided by this invention obtains the gaze point positions of both eyes within the virtual image display area. Based on the gaze point positions, the gaze region located within the virtual image display area is obtained. If the target 3D information image is located outside the gaze region, at least a portion of the target 3D information image is blurred. The region outside the gaze region corresponds to the area of ​​non-clear vision for the human eye, and the target 3D information image located outside the gaze region is an image not observed by the eye. By blurring the target 3D information image located outside the gaze region, the perception of the unobserved image outside the gaze region is reduced, thus reducing the salience of the image outside the gaze region. This reduces convergence conflict and visual dissociation, thereby improving the user's visual comfort and reducing user fatigue. It also prevents dizziness caused by multiple 3D effect images, providing the user with a more comfortable visual experience. Attached Figure Description

[0018] Figure 1 A schematic diagram of a vehicle provided in an embodiment of the present invention; Figure 2 This is a schematic diagram of a virtual image display area and a gaze area provided in an embodiment of the present invention; Figure 3 A flowchart illustrating a display method for a head-up display device provided in an embodiment of the present invention; Figure 4 This is a schematic diagram of another virtual image display area and gaze area provided in an embodiment of the present invention; Figure 5 This is a schematic diagram of another virtual image display area and gaze area provided in an embodiment of the present invention; Figure 6 This is a schematic diagram of another virtual image display area and gaze area provided in an embodiment of the present invention; Figure 7 This is a schematic diagram of another virtual image display area and gaze area provided in an embodiment of the present invention; Figure 8 This is a schematic diagram of the light emission state when different sub-pixels are lit, provided as an embodiment of the present invention; Figure 9 This is a schematic diagram illustrating the image content displayed on an image source when different sub-pixels are lit, according to an embodiment of the present invention. Figure 10 This is a schematic diagram of an unblurred augmented reality image provided in an embodiment of the present invention; Figure 11 This is a schematic diagram of an augmented reality image after blurring, provided as an embodiment of the present invention. Figure 12 This is a structural block diagram of a head-up display system provided in an embodiment of the present invention; Figure 13 This is a schematic diagram of the structure of a processing device provided in an embodiment of the present invention. Detailed Implementation

[0019] The present invention will now be described in further detail with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and not intended to limit it. Furthermore, it should be noted that, for ease of description, the accompanying drawings show only the parts relevant to the present invention, and not all of the structures.

[0020] Figure 1 A schematic diagram of a vehicle provided in an embodiment of the present invention; see reference. Figure 1 The vehicle can be a car, ship, or airplane. Taking a car as an example, the head-up display system 100 is installed inside the car, providing enhanced display. Drivers no longer need to look down at the dashboard to obtain vehicle status information while driving, effectively preventing traffic accidents. The head-up display system 100 includes a head-up display device. The image beam emitted from the head-up display device is projected onto the windshield 300, reflected by the windshield 300, and enters the user's field of vision, forming a virtual image of the target in front of the user's field of vision.

[0021] Figure 2 This is a schematic diagram of a virtual image display area and a gaze area provided in an embodiment of the present invention; see reference. Figure 1 and Figure 2 The area where the target virtual image is located is the virtual image display area 410. The virtual image display area 410 is determined by the optical system in the head-up display device. The virtual image display area 410 is the maximum static display area at a specific virtual image distance (VID). It represents the largest virtual screen that the head-up display device can project. No matter how the user's (e.g., the driver's) eyes move, the content projected by the head-up display device will only be displayed within the virtual image display area 410. The part outside the virtual image display area is not visible to the human eye.

[0022] Figure 3A flowchart illustrating a display method for a head-up display device according to an embodiment of the present invention; see reference. Figures 1-3 The display method of the head-up display device includes the following steps: S101. Obtain the gaze point position of both eyes within the virtual image display area.

[0023] Here, "both eyes" includes the left eye and the right eye. The gaze point position 430 refers to the two-dimensional coordinates of the user's gaze point within the virtual image plane containing the target virtual image. In other words, the gaze point position 430 refers to the position of the user's gaze point within the virtual image display area 410.

[0024] Although humans have two eyes, a left and a right, during normal fixation, the lines of sight from both eyes converge at the same point, which is called the fixation point. Corresponding to this fixation point, there is a fixation point position 430 within the virtual image display area 410, rather than having one fixation point position for the left eye and another for the right eye.

[0025] S102. Determine the gaze area within the virtual image display area based on the gaze point location.

[0026] For example, the fixation point 430 is located at the center of the fixation area 420, and the fixation area 420 is defined within the virtual image display area 410 with the fixation point 430 as the center. The fixation area 420 is the area within the virtual image display area 410 corresponding to the clear field of vision of the human eye. In other embodiments, the fixation point 430 may not be located at the center of the fixation area 420, that is, the fixation point 430 may be offset by a certain distance relative to the center of the fixation area 420.

[0027] Regardless of whether the fixation point 430 is located at the center of the fixation area 420, the fixation point 430 is always located within the fixation area 420.

[0028] S103. If the target 3D information image is located outside the gaze area, at least a portion of the target 3D information image is blurred.

[0029] The target 3D information image is a specific 3D information image that is pre-displayed. Figure 4 This is a schematic diagram of another virtual image display area and gaze area provided in an embodiment of the present invention; see reference. Figure 4 The first 3D information image 510 is entirely located outside the gaze area 420. The first 3D information image 510 is the target 3D information image to be processed. The first 3D information image 510 is blurred.

[0030] In the display method provided by this invention, the gaze point positions of both eyes within the virtual image display area are obtained. Based on the gaze point positions, the gaze area located within the virtual image display area is obtained. If the target 3D information image is located outside the gaze area, at least a portion of the target 3D information image is blurred. The area outside the gaze area 420 corresponds to the area of ​​non-clear vision for the human eye, and the target 3D information image located outside the gaze area 420 is an image not observed by the eye. By blurring the target 3D information image located outside the gaze area 420, the perception of the unobserved image outside the gaze area 420 is reduced, thus reducing the salience of the image outside the gaze area 420. This reduces convergence conflict and visual dissociation, thereby improving the user's visual comfort and reducing user fatigue. It also prevents dizziness caused by multiple 3D effect images, providing the user with a more comfortable visual experience.

[0031] Optionally, after step S102 above, the display method of the head-up display device further includes step S11: if the entire target 3D information image is located within the gaze area, maintain the stereoscopic display state of the target 3D information image. That is, display the target 3D information image in stereo.

[0032] Furthermore, before steps S103 and S11, there may be a judgment step, which includes: judging whether the target 3D information image is entirely located within the gaze area; if yes, then execute step S11; if no, then execute step S103.

[0033] Optionally, step S101 above can be further refined into the following steps: S21. Obtain the position of both eyes and the direction of their gaze.

[0034] The position of both eyes includes the position of the left eye and the position of the right eye, which can be represented by three-dimensional coordinates in space. Eye-tracking devices detect the position of the user's eyes and the direction of their gaze. The direction of gaze can be obtained, for example, by tracking the position of the pupils and the position of reflective points on the cornea using eye-tracking devices, and then calculating the direction of gaze based on these positions.

[0035] S22. Determine the fixation point location based on the position of both eyes and the direction of their gaze.

[0036] Optionally, step S22 includes: Obtain the center point position of both eyes and the actual fixation point position of both eyes.

[0037] For example, based on the positions of both eyes, the average of the left and right eye positions is used as the center point. The midpoint between the left and right eye positions is used as the reference point, that is, the midpoint between the three-dimensional coordinates of the left and right eyes is used as the reference point. Figure 5 This is a schematic diagram of another virtual image display area and gaze area provided in an embodiment of the present invention; see reference. Figure 5 This reference point is named center point location A, which serves as the benchmark for subsequent calculations.

[0038] The actual fixation position is determined based on the position of both eyes and the direction of their gaze.

[0039] The actual gaze position is the location of the target as seen by both eyes; it is the actual gaze position of the eyes. When both eyes observe the content displayed in the virtual image display area 410 at a specific virtual image distance (VID), that is, when both eyes observe the content on the virtual screen projected by the head-up display device, the actual gaze position is located within the virtual image display area 410. The lines of sight of both eyes converge at a certain point within the virtual image display area 410.

[0040] It is understandable that the actual gaze position may not be located within the virtual image display area 410. In this case, the user's eyes observe content outside the virtual image display area 410, such as observing objects in the real world, such as roads, trees, etc.

[0041] The gaze point position is obtained based on the center point position, the actual gaze position, and the virtual image display area.

[0042] refer to Figure 5 The intersection of the straight line containing the center point A and the actual gaze position B with the plane containing the virtual image display area 410 is taken as the gaze point position 430. The point corresponding to the gaze point position 430 is located within the virtual image display area 410. The actual gaze position B can be located on the side of the virtual image display area 410 away from the center point A, or it can be located on the side of the virtual image display area 410 facing the center point A. When both eyes observe the content on the virtual screen projected by the head-up display device, the actual gaze position B and the gaze point position 430 coincide, and the actual gaze position B is located within the virtual image display area 410.

[0043] Figure 6 This is a schematic diagram of another virtual image display area and gaze area provided in an embodiment of the present invention; see reference. Figure 6 A portion of the second 3D information image 520 is located within the gaze region 420, and another portion of the second 3D information image 520 is located outside the gaze region 420. The second 3D information image 520 is the target 3D information image to be processed. The portion of the second 3D information image 520 located within the gaze region 420 is displayed in stereo, and the portion of the second 3D information image 520 located outside the gaze region 420 is blurred.

[0044] Figure 7This is a schematic diagram of another virtual image display area and gaze area provided in an embodiment of the present invention; see reference. Figure 7 The field of view 440 extends beyond the virtual image display area 410, and the intersection of the field of view 440 and the virtual image display area 410 is defined as the viewing area 420. It is understood that as the viewing point position 430 moves, the field of view 440 moves accordingly. Even if the projection area of ​​the field of view 440 on the screen containing the virtual image display area 410 is small, it is possible for the field of view 440 to extend beyond the virtual image display area 410. This application aims to determine the positional relationship between the target 3D information image and the viewing area 420 based on the changing viewing point position 430 and the viewing area 420, and accordingly determine whether to blur at least a portion of the target 3D information image. The field of view may not extend beyond the virtual image display area 410, such as... Figure 2 As shown, the gaze area 420 coincides with the projection of the field of view onto the screen where the virtual image display area 410 is located.

[0045] Optionally, the head-up display device includes an image source 110 that generates an image beam. The step S103 above, which blurs at least a portion of the target 3D information image, includes controlling the display brightness of the image source 110 outside the viewing area 420 to be less than the display brightness of the image source 110 within the viewing area 420. This embodiment of the invention controls the illumination state of different areas in the image source 110, adjusting the brightness of the virtual image outside the unviewed viewing area 420. This ensures that when the user views the image, the brightness of the image within the viewing area 420 is normal, while the brightness of the image outside the unviewed viewing area 420 is reduced, thus achieving the effect of blurring the virtual image area outside the viewing area 420.

[0046] The head-up display device also includes multiple cylindrical lenses disposed on the light-emitting side of the image source 110. The multiple cylindrical lenses form a cylindrical lens grating 140, which is used to split the left-eye image beam and the right-eye image beam. Thus, the left-eye image beam is ultimately projected onto the user's left eye, and the right-eye image beam is ultimately projected onto the user's right eye.

[0047] Figure 8 This is a schematic diagram illustrating the light emission state when different sub-pixels are lit, provided as an embodiment of the present invention; Reference Figure 8 Image source 110 includes multiple sub-pixels; the multiple sub-pixels include, for example, Figure 8The diagram illustrates R, G, and B subpixels. R subpixels emit red light, G subpixels emit green light, and B subpixels emit blue light. By controlling the brightness of these subpixels, image source 110 can achieve color display. Along the width of the cylindrical lens, among the multiple subpixels covered by a single cylindrical lens, the number of subpixels illuminated outside the viewing area 420 is M1, and the number of subpixels illuminated within the viewing area 420 is M2, where M1 is less than M2. M1 and M2 are positive integers. The number of illuminated subpixels in the left-eye visual area outside the viewing area 420 is less than the number of illuminated subpixels in the corresponding left-eye visual area within the viewing area 420; similarly, the number of illuminated subpixels in the right-eye visual area outside the viewing area 420 is less than the number of illuminated subpixels in the corresponding right-eye visual area within the viewing area 420. Once the user's viewing area is determined, that area is the viewing area 420. Illuminate the corresponding sub-pixels within the gaze area 420. For the ungazetted areas, which are the areas outside the gaze area 420, the brightness of the areas outside the gaze area 420 can be reduced by illuminating a smaller number of sub-pixels per unit area, thereby reducing the brightness of the virtual image area outside the gaze area 420.

[0048] refer to Figure 8 ON indicates that the sub-pixel is lit, and OFF indicates that the sub-pixel is off. For example, ON pointing to R means that sub-pixel R is lit; OFF pointing to R means that sub-pixel R is off.

[0049] Figure 9 This is a schematic diagram illustrating the image content displayed on an image source when different sub-pixels are illuminated, according to an embodiment of the present invention; see reference. Figure 9 L represents the left-eye visual area sub-pixel, and the content displayed in the left-eye visual area sub-pixel is projected onto the left eye. A left-eye visual area sub-pixel can include an R sub-pixel, a G sub-pixel, or a B sub-pixel. R represents the right-eye visual area sub-pixel, and the content displayed in the right-eye visual area sub-pixel is projected onto the right eye. A right-eye visual area sub-pixel can include an R sub-pixel, a G sub-pixel, or a B sub-pixel. Figure 9 The L and R symbols without gray fill indicate the lit state. Figure 9 The L and R pixels filled with medium gray represent the off-light state, in which the sub-pixels do not emit light. By controlling the light emission state of each sub-pixel in the image source 110 and the image content displayed by the image source 110, the brightness of at least a portion of the target 3D information image outside the gaze area 420 is reduced, thereby reducing the human eye's perception of at least a portion of the target 3D information image outside the gaze area 420 that is not being gazed upon.

[0050] refer to Figure 8 and Figure 9A cylindrical lens covers 8 sub-pixels, and the eyebox is divided into 8 viewing areas: 4 areas visible to the left eye and 4 areas visible to the right eye. For example, Figure 8 and Figure 9 The "4" in the context refers to the fact that all four sub-pixels in the left eye's visual area and the four sub-pixels in the right eye's visual area covered by a cylindrical lens are lit up. The total number of sub-pixels covered by a single cylindrical lens that is lit up is eight. Figure 8 and Figure 9 The "3" in the context refers to the fact that all three left-eye and three right-eye sub-pixels covered by a cylindrical lens are lit, while one left-eye and one right-eye sub-pixel are not lit. The number of sub-pixels covered by a lit cylindrical lens is six. Figure 8 and Figure 9 The "2" in the context refers to the fact that the two left-eye visual area sub-pixels and the two right-eye visual area sub-pixels covered by a cylindrical lens are both lit, while the two left-eye visual area sub-pixels and the two right-eye visual area sub-pixels are not lit. The number of sub-pixels covered by a single cylindrical lens that are lit is four. Figure 8 and Figure 9 One pixel in the context refers to one left-eye visual area sub-pixel and one right-eye visual area sub-pixel covered by a cylindrical lens being lit, while three left-eye visual area sub-pixels and three right-eye visual area sub-pixels are not lit. The number of sub-pixels covered by a lit cylindrical lens is two.

[0051] For example, the number of sub-pixels illuminated within the gaze region 420, M2, is 8, and the number of sub-pixels illuminated outside the gaze region 420, M1, can be 6, 4, or 2. That is, the image source 110 illuminates all sub-pixels within the gaze region 420 without turning them off, while in the area outside the gaze region 420, some sub-pixels are turned off to prevent them from illuminating. Alternatively, the number of sub-pixels illuminated within the gaze region 420, M2, is 6, and the number of sub-pixels illuminated outside the gaze region 420, M1, can be 4 or 2. Or, the number of sub-pixels illuminated within the gaze region 420, M2, is 4, and the number of sub-pixels illuminated outside the gaze region 420, M1, can be 2. That is, both the area within the gaze region 420 and the area outside the gaze region 420 of the image source 110 have some sub-pixels turned off, with a greater number of sub-pixels turned off in the area outside the gaze region 420. By reducing the number of sub-pixels emitting light, the brightness of the virtual image area outside the gaze area 420 can be reduced.

[0052] It should be noted that eye tracking, data transmission, image rendering, and projection imaging by the head-up display device all require a certain amount of time, i.e., there is a certain delay. If the image is only displayed within the gaze area 420, and no image is displayed in the virtual image display area 410 but outside the gaze area 420, then the latency requirements for the head-up display system are much higher, requiring extremely low latency. Additionally, the tracking accuracy of the head-up display system must be extremely high; otherwise, problems such as blank screens, image lag, or incomplete information will occur, resulting in a poor user experience. In this embodiment, the target 3D information image located outside the gaze area 420 is displayed in a planar manner and / or blurred, rather than completely turned off. Users can still see the corresponding image information in the non-gaze area (i.e., the area outside the gaze area 420), thus improving the user experience.

[0053] Optionally, the values ​​of M1 and M2 are obtained based on ambient brightness, HUD adaptive brightness, and / or the blurriness of the target 3D information image. Ambient brightness refers to the brightness of the environment in which the head-up display system is located, such as the lighting inside a vehicle. HUD adaptive brightness is the target display brightness value automatically adjusted by the head-up display system according to environmental conditions, including ambient brightness and potentially driving mode. Blurriness is a quantitative indicator representing the degree to which the visual significance of the image outside the viewing area 420 is significantly reduced compared to the clear image within the viewing area 420. If, under strong light, the brightness of the non-viewing area is reduced below the human eye's perception threshold, then when the user glances at that area with their peripheral vision, they may miss crucial warning information, creating a safety hazard. In this embodiment of the invention, based on ambient brightness, HUD adaptive brightness, and the blurriness of the target 3D information image, the number of sub-pixels lit in the area within the viewing area 420 corresponding to the image source 110, and the number of sub-pixels lit in the area outside the viewing area 420 corresponding to the image source 110, are obtained. This ensures that the user can normally view the image projected by the head-up display device. It also maintains the visibility of the image in areas outside the gaze zone of 420°, improving user experience and driving safety.

[0054] Optionally, the step of blurring at least a portion of the target 3D information image in step S103 above includes: changing the control elements of at least a portion of the target 3D information image at the image level to blur at least a portion of the target 3D information image. That is, changing the control elements of the blurred portion at the image level to blur the blurred portion; wherein, the blurred portion is the part of the target 3D information image located outside the gaze area 420. In other words, the image level refers to the digital image data, and the control elements are the parameters in the digital image data. By adjusting the parameters on the digital image data, the visual presentation effect of the image is changed, and the blurred portion is blurred. This allows the user to normally view the image projected by the head-up display device, and maintains the visibility of the image in the area outside the gaze area 420, improving user experience and driving safety.

[0055] Optionally, the control element includes image brightness. Brightness is a physical property, referring to the overall luminous intensity of ambient light. Image brightness is a color attribute (B in HSB) of a digital image, controlling the brightness of pixels. Image brightness represents the lightness or darkness of a color, directly affecting its visibility. Increasing brightness makes colors brighter in dark environments, while decreasing brightness makes colors less glaring in bright environments. This embodiment of the invention achieves the effect of blurring the target 3D information image in the area outside the viewing area 420 by reducing the image brightness in that area.

[0056] Optionally, control elements may also include hue and saturation. When image brightness is included as a control element, the hue and / or saturation of the blurred portion are adjusted. Hue is the color attribute of a digital image (H in HSB). In head-up display systems, high-contrast hues are typically chosen to ensure clear visibility of information, such as using red and / or green to represent warnings or important information. Saturation is the color attribute of a digital image (S in HSB). Also known as color saturation, higher saturation results in more vibrant colors. Reducing saturation can soften colors, reducing eye strain while maintaining visibility in both bright and dark environments. Human color perception is complex. The human eye's ability to distinguish images is difficult to describe with a single parameter. Reducing brightness can make an image appear dull and difficult to discern. By appropriately adjusting hue and reducing saturation, the readability and visual comfort of the target 3D information image can be improved while maintaining blurriness in areas outside the gaze area of ​​420°.

[0057] Optionally, control elements include image transparency, which controls the visibility of the image. Image transparency refers to the alpha channel value of the image, controlling the degree of blending between the image and the background. The higher the transparency, the smaller the alpha channel value, the more the background shows through, and the less obvious the image becomes. Image transparency values ​​are typically between 0% (completely opaque) and 100% (completely transparent). Increasing the image transparency value makes the 3D information image of the target outside the viewing area 420 less obvious, achieving the effect of blurring the 3D information image of the target in the area outside the viewing area 420.

[0058] In some implementations, the control elements include image brightness and image transparency, and it is also possible to change both the image brightness and the image transparency of the blurred portion.

[0059] Optionally, the step of altering at least a portion of the control elements at the image level of the target 3D information image includes: S31. Obtain the average brightness value based on the weighted average of ambient brightness and HUD adaptive brightness.

[0060] Both the areas within and outside the gaze region 420 can adaptively adjust the image based on the ambient brightness within the gaze region 420. The brightness of the areas outside the gaze region 420 is adjusted independently, using the brightness within the gaze region 420 as a reference.

[0061] For example, ambient brightness can be given a higher weight and HUD adaptive brightness a lower weight; or, ambient brightness can be given a lower weight and HUD adaptive brightness a higher weight. The average brightness is the weighted average of ambient brightness and HUD adaptive brightness.

[0062] S32. Based on the average brightness, change the control elements of the blurred part at the image level.

[0063] For example, the control elements of the blurred portion at the image level are automatically changed based on the average brightness value or based on user input instructions.

[0064] For example, if at least a portion of the target 2D information image is located outside the gaze region, the portion of the target 2D information image located outside the gaze region is blurred. That is, not only can the target 3D information image located outside the gaze region be blurred, but the target 2D information image located outside the gaze region can also be blurred. The method for blurring the target 2D information image located outside the gaze region can be referenced to the method for blurring the target 3D information image located outside the gaze region, and will not be described further here.

[0065] Figure 10This is a schematic diagram of an unblurred augmented reality image provided in an embodiment of the present invention; Figure 11 This is a schematic diagram of an augmented reality image after blurring, provided as an embodiment of the present invention; Reference Figure 10 and Figure 11 The AR area is the region where the target virtual image is located, i.e., the AR area is the virtual image display area 410. The tree and background in the image are the real driving environment, not the content displayed by the head-up display (HUD). The navigation arrows and warning icons are the content displayed by the HUD. Warning icons include vehicle warning icons and pedestrian warning icons. The area within the solid circle is the gaze area, i.e., the area corresponding to the gaze area 420, and the area within the dashed circle is the non-gaze area, i.e., the area outside the gaze area 420. By blurring the 3D information image in the non-gaze area, such as reducing the brightness of the vehicle warning icons and pedestrian warning icons in the non-gaze area, the perception of the image in the non-gaze area is reduced, and the salience of the image in the non-gaze area is reduced. This reduces the user's convergence conflict and visual separation, thereby improving the user's visual comfort and reducing user fatigue. It also prevents dizziness caused by multiple 3D effect images, providing the user with a more comfortable visual experience.

[0066] Figure 12 This is a structural block diagram of a head-up display system provided in an embodiment of the present invention; Figure 13 This is a schematic diagram of the structure of a processing device provided in an embodiment of the present invention; see reference. Figure 12 and Figure 13 The head-up display system 100 includes a head-up display device 210, an eye-tracking device 200, and a processing device 60. The head-up display device 210 generates an image beam and includes an image source 110 and a lenticular lens grating 140 disposed on the light-emitting side of the image source 110. The lenticular lens grating 140 is used to split the image beam to form a naked-eye 3D display. The head-up display device 210 is communicatively connected to the processing device 60. The eye-tracking device 200 is used to acquire the position of both eyes and is communicatively connected to the processing device 60. The processing device 60 includes a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the program, it implements the method provided in any of the above embodiments.

[0067] refer to Figure 13 The processing device 60 includes a memory 602, a processor 601, and a computer program stored in the memory 602 and executable on the processor. When the processor 601 executes the program, it implements the method described in the above embodiments. Figure 13 A block diagram of an exemplary processing apparatus suitable for implementing embodiments of the present invention is shown. Figure 13 The processing device 60 shown is merely an example and should not be construed as limiting the functionality and scope of the embodiments of the present invention. Figure 13 As shown, the processing device 60 is presented in the form of a general-purpose computing device. The components of the processing device 60 may include, but are not limited to: one or more processors 601, system memory 602, and bus 603 connecting different system components (including system memory 602 and processor 601).

[0068] Bus 603 represents one or more of several bus architectures, including a memory bus or memory controller, a peripheral bus, a graphics acceleration port, a processor, or a local bus using any of the various bus architectures. For example, these architectures include, but are not limited to, the Industry Standard Architecture (ISA) bus, the Micro Channel Architecture (MAC) bus, the Enhanced ISA bus, the Video Electronics Standards Association (VESA) local bus, and the Peripheral Component Interconnect (PCI) bus.

[0069] Processing device 60 typically includes a variety of computer system readable media. These media can be any available media that can be accessed by processing device 60, including volatile and non-volatile media, removable and non-removable media.

[0070] System memory 602 may include computer system readable media in the form of volatile memory, such as random access memory (RAM) 604 and / or cache memory 605. Processing device 60 may further include other removable / non-removable, volatile / non-volatile computer system storage media. By way of example only, storage system 606 may be used to read and write non-removable, non-volatile magnetic media (… Figure 13 Not shown; usually referred to as a "hard drive"). Although Figure 13 As not shown, a disk drive for reading and writing to a removable non-volatile disk (e.g., a "floppy disk") and an optical disk drive for reading and writing to a removable non-volatile optical disk (e.g., a CD-ROM, DVD-ROM, or other optical media) may be provided. In these cases, each drive may be connected to bus 603 via one or more data media interfaces. System memory 602 may include at least one program product having a set (e.g., at least one) of program modules configured to perform the functions of the embodiments of the present invention.

[0071] A program / utility 608 having a set (at least one) of program modules 607 may be stored, for example, in system memory 602. Such program modules 607 include, but are not limited to, an operating system, one or more application programs, other program modules, and program data. Each or some combination of these examples may include an implementation of a network environment. Program modules 607 typically perform the functions and / or methods described in the embodiments of the present invention.

[0072] The processing device 60 can also communicate with one or more external devices 609 (e.g., keyboard, pointing device, display 610, etc.), and with one or more devices that enable user interaction with the device, and / or with any device that enables the processing device 60 to communicate with one or more other computing devices (e.g., network interface card, modem, etc.). This communication can be performed via the input / output (I / O) interface 611. Furthermore, the processing device 60 can also communicate with one or more networks (e.g., local area network (LAN), wide area network (WAN), and / or public networks, such as the Internet) via the network adapter 612. Figure 13 As shown, network adapter 612 communicates with other modules of processing device 60 via bus 603. It should be understood that, although not shown in the figure, other hardware and / or software modules may be used in conjunction with processing device 60, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

[0073] The processor 601 executes various functional applications and data processing by running programs stored in the system memory 602.

[0074] refer to Figure 1 This invention provides a vehicle comprising a head-up display system 100 and a windshield 300 as described in the previous embodiment. An image beam emitted from the head-up display system 100 is projected onto the windshield 300 and, after reflection, enters the user's eye box area, forming a virtual image of the target in front of the user's eye box area. A detection beam emitted from an eye-tracking device 200 is projected onto the user's eye box area, and the eye-tracking device 200 obtains the position of both eyes based on the reflected signal beam.

[0075] For example, refer to Figure 1 The head-up display device 210 includes an image source 110, at least one reflector, and a lenticular lens grating 140. The lenticular lens grating 140 is located on the light-emitting display side of the image source 110. The image source 110 generates an image beam, which includes a left-eye image beam and a right-eye image beam. The lenticular lens grating 140 includes multiple lenticular lenses and is used to split the left-eye and right-eye image beams. This ensures that the left-eye image beam is ultimately projected onto the user's left eye, and the right-eye image beam is ultimately projected onto the user's right eye. The at least one reflector includes a plane mirror 120 and a curved mirror 130. In other embodiments, the plane mirror 120 can be replaced with another curved mirror, or the plane mirror 120 can be removed, using only the curved mirror 130 as the intermediate reflector.

[0076] Note that the above description is merely a preferred embodiment of the present invention and the technical principles employed. Those skilled in the art will understand that the present invention is not limited to the specific embodiments described herein, and various obvious changes, readjustments, combinations, and substitutions can be made without departing from the scope of protection of the present invention. Therefore, although the present invention has been described in detail through the above embodiments, the present invention is not limited to the above embodiments, and may include many other equivalent embodiments without departing from the concept of the present invention, the scope of which is determined by the scope of the appended claims.

Claims

1. A display method for a head-up display device, characterized in that, include: Obtain the gaze points of both eyes within the virtual image display area; Based on the location of the gaze point, determine the gaze area within the virtual image display area; If the target 3D information image is located outside the gaze area, at least a portion of the target 3D information image is blurred.

2. The display method according to claim 1, characterized in that, After determining the gaze region within the virtual image display area based on the gaze point position, the method further includes: If the target 3D information image is entirely located within the gaze area, the stereoscopic display state of the target 3D information image is maintained.

3. The display method according to claim 1, characterized in that, Obtain the gaze point positions of both eyes within the virtual image display area, including: Obtain the position of both eyes and the direction of their gaze; The fixation point position is determined based on the position of both eyes and the direction of their gaze.

4. The display method according to claim 1, characterized in that, The head-up display device includes an image source; Blurring at least a portion of the target 3D information image includes: The display brightness of the image source corresponding to the area outside the gaze region is controlled to be less than the display brightness of the image source corresponding to the area within the gaze region.

5. The display method according to claim 4, characterized in that, The head-up display device further includes a plurality of cylindrical lenses disposed on the light-emitting side of the image source, the image source including a plurality of sub-pixels; Along the width direction of the cylindrical lens, among the multiple sub-pixels covered by one cylindrical lens, the number of sub-pixels lit outside the gaze area is controlled to be M1, and the number of sub-pixels lit within the gaze area is M2, where M1 is less than M2. Specifically, the number of lit sub-pixels in the left eye visual area outside the gaze area is less than the number of lit sub-pixels in the left eye visual area within the gaze area; and the number of lit sub-pixels in the right eye visual area outside the gaze area is less than the number of lit sub-pixels in the right eye visual area within the gaze area.

6. The display method according to claim 5, characterized in that, The values ​​of M1 and M2 are obtained based on the ambient brightness, HUD adaptive brightness, and / or the blurring degree of the target 3D information image.

7. The display method according to claim 1, characterized in that, Blurring at least a portion of the target 3D information image includes: The control elements of at least a portion of the target 3D information image at the image level are altered, and at least a portion of the target 3D information image is blurred.

8. The display method according to claim 7, characterized in that, The control elements include image brightness and / or image transparency.

9. The display method according to claim 7, characterized in that, Modifying at least a portion of the image-level control elements of the target 3D information image includes: The average brightness is obtained by weighting the ambient brightness and the HUD adaptive brightness. Based on the average brightness value, control elements at least a portion of the target 3D information image are modified at the image level.

10. The display method according to claim 7, characterized in that, When the control element includes image brightness, adjust the hue and / or saturation of at least a portion of the target 3D information image.

11. A head-up display system, characterized in that, This includes head-up displays, eye-tracking devices, and processing equipment; The head-up display device is used to generate an image beam; the head-up display device includes an image source and a lenticular grating disposed on the light-emitting side of the image source, the lenticular grating being used to split the image beam to form a naked-eye 3D display; The eye-tracking device is used to obtain the position of both eyes; The processing device includes a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement the method as described in any one of claims 1-10.

12. A vehicle, characterized in that, Includes the head-up display system as described in claim 11.

Images