Brightness compensation in waveguide head-up displays

By introducing components such as lasers, spatial light modulators, exit pupil replicators, and diffusers into the HUD system, combined with position correction technology for cameras and controllers, the problem of uneven brightness in the eye box has been solved, improving the consistency of image brightness and the driver's visual experience.

CN116794835BActive Publication Date: 2026-11-17GM GLOBAL TECHNOLOGY OPERATIONS LLC
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202211288839.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2022-03-15
Filing Date
2022-10-20
Publication Date
2026-11-17
Estimated Expiration
2042-10-20

AI Technical Summary

Technical Problem

Existing HUD systems cannot effectively measure or compensate for brightness unevenness across the eye box, resulting in differences in image brightness or intensity at different locations, which affects the driver's visual experience.

Method used

The system, consisting of a laser, a spatial light modulator, an exit pupil replicator, a diffuser, and a controller, combines a camera to obtain the driver's eye position and adjusts the intensity, color grayscale level, and gamma curve of the projected image to correct the brightness.

Benefits of technology

This achieves uniform brightness across different driver eye positions, improving the image quality of the HUD system and the driver's visual experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116794835B_ABST
    Figure CN116794835B_ABST
Patent Text Reader

Abstract

The present invention relates to a head-up display system, comprising a laser adapted to project a holographic image; a spatial light modulator; an exit pupil replicator; a diffuser adapted to be positioned in an x-y plane at the center point of a vehicle eye ellipse, the holographic projector being adapted to project a dot matrix pattern onto the diffuser; and a controller adapted to characterize the intensity distribution of the dot matrix pattern, store the intensity distribution therein, acquire the position of the driver's eyes, map the position of the driver's eyes to the intensity distribution of the dot matrix pattern, and perform correction actions based on the intensity distribution at the position of the driver's eyes.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This disclosure relates to a head-up display, and more specifically, to a system and method for compensating for brightness variations across the eyebox in a waveguide-based holographic head-up display. Background Technology

[0002] Head-up displays (HUDs) have become commonplace in modern cars. HUDs project useful information, such as speed and navigation information, into the driver's field of vision. This avoids forcing the driver to look down at the dashboard gauges, reducing driver distraction and keeping their eyes on the road.

[0003] Existing HUD systems cannot measure or compensate for brightness inhomogeneities across the eyebox. When brightness inhomogeneities occur, the brightness or intensity of the image may vary at different locations within the eyebox. New HUD systems may include projected augmented reality images, such as optimal driving paths or navigation arrows, to provide an image that appears to be on a real road surface. In such systems, a perfect waveguide-based exit pupil replicator can provide accurate reflectivity or diffraction efficiency specifications with each replication, ultimately providing a uniform brightness distribution across the eyebox. However, manufacturing limitations of such systems result in brightness inhomogeneities.

[0004] Therefore, a new and improved method for calibrating augmented reality HUD systems is needed to ensure that image intensity is consistent across all driver eye positions across the eye box. Summary of the Invention

[0005] According to several aspects of this disclosure, the head-up display system includes a laser adapted to project a holographic image; a spatial light modulator; an exit pupil replicator; a diffuser adapted to be positioned in an xy-plane at the center point of a vehicle eye ellipse, the holographic projector adapted to project a dot matrix pattern onto the diffuser; and a controller adapted to characterize the intensity distribution of the dot matrix pattern, store the intensity distribution therein, acquire the position of the driver's eyes, map the position of the driver's eyes to the intensity distribution of the dot matrix pattern, and perform correction actions based on the intensity distribution at the position of the driver's eyes.

[0006] According to another aspect, the system also includes a camera that communicates with the controller and is adapted to capture a dot pattern and use the controller to characterize the intensity distribution of the dot pattern.

[0007] On the other hand, the camera is also suitable for obtaining the position of the driver's eyes.

[0008] According to another aspect, when performing a correction action based on the intensity distribution at the driver's eye position, the controller is also adapted to compare the intensity of the dot pattern at the driver's eye position with the intensity of the dot pattern at the nominal position of the driver's eye, and to perform a correction action when the intensity of the dot pattern at the driver's eye position is different from the intensity of the dot pattern at the nominal position of the driver's eye.

[0009] According to another aspect, when a correction action is performed, the controller is also adapted to adjust the intensity of the projected image at the driver's eye position to match the intensity of the projected image at the nominal position of the driver's eye.

[0010] On the other hand, when adjusting the intensity of the projected image at the driver's eye position, the controller is also adapted to adjust the power of the laser holographic projector.

[0011] On the other hand, when adjusting the intensity of the projected image at the driver's eye position, the controller is also adapted to adjust the grayscale level of the colors projected by the laser holographic projector.

[0012] On the other hand, when adjusting the intensity of the projected image at the driver's eye position, the controller is also adapted to adjust the gamma curve of the primary colors projected by the holographic projector.

[0013] On the other hand, the controller is adapted to selectively and automatically perform corrective actions based on the intensity distribution at the driver's eye position, and also allows the driver to perform corrective actions manually.

[0014] According to several aspects of this disclosure, a method for calibrating a head-up display system for an automobile includes placing a diffuser aligned with an xy-plane at the center point of the vehicle's eye ellipse; projecting a dot pattern onto the diffuser using the head-up display system; capturing the dot pattern using a camera of a driver monitoring system in communication with a controller; characterizing the intensity distribution of the dot pattern using the controller; storing the intensity distribution within the controller; acquiring the position of the driver's eyes using the camera; mapping the position of the driver's eyes to the intensity distribution of the dot pattern using the controller; and performing a correction action using the controller based on the intensity distribution at the driver's eye position, including comparing the intensity of the dot pattern at the driver's eye position with the intensity of the dot pattern at a nominal position of the driver's eyes. When the intensity of the dot pattern at the driver's eye position differs from the intensity of the dot pattern at the nominal position of the driver's eye, a correction action is performed. This correction action includes adjusting the intensity of the projected image at the driver's eye position by one of the following methods: adjusting the power of the system's holographic projector; adjusting the grayscale level of the colors projected by the holographic projector; adjusting the gamma curve of the primary colors projected by the holographic projector; and maintaining color harmony at a specific eye position for projected images of the three primary colors with known intensity differences by adjusting the grayscale level of each primary color and adjusting the power of the holographic projector. The controller is adapted to selectively and automatically perform the correction action based on the intensity distribution at the driver's eye position and allows the driver to manually perform the correction action.

[0015] Other areas of applicability will become apparent from the description provided herein. It should be understood that the descriptions and specific examples are intended for illustrative purposes only and are not intended to limit the scope of this disclosure.

[0016] The present invention also includes the following technical solutions.

[0017] Technical Solution 1. A method for compensating for brightness intensity non-uniformity in a head-up display system for automobiles, comprising: Place the diffuser, aligned with the xy plane, at the center point of the vehicle's eye ellipse; The head-up display system is used to project a dot matrix graphic onto the diffuser; The intensity distribution of the dot matrix pattern is characterized using a controller; The intensity distribution is stored in the controller; Obtain the position of the driver's eyes; The controller is used to map the position of the driver's eye to the intensity distribution of the dot matrix pattern; and The controller performs a correction action based on the intensity distribution at the location of the driver's eye.

[0018] Technical Solution 2. The method as described in Technical Solution 1 further includes using a camera to capture the dot pattern and using the controller to characterize the intensity distribution of the dot pattern.

[0019] Technical solution 3. The method as described in technical solution 2 further includes using the camera to obtain the position of the driver's eyes.

[0020] Technical Solution 4. The method described in Technical Solution 3, wherein the camera is a camera of a driver monitoring system.

[0021] Technical Solution 5. The method as described in Technical Solution 4, wherein the correction action based on the intensity distribution at the location of the driver's eye further includes: The intensity of the dot pattern at the driver's eye position is compared with the intensity of the dot pattern at the nominal position of the driver's eye; and A correction action is performed when the intensity of the dot pattern at the location of the driver's eyes is different from the intensity of the dot pattern at the nominal location of the driver's eyes.

[0022] Technical Solution 6. The method as described in Technical Solution 5, wherein the correction action further includes adjusting the intensity of the projected image at the location of the driver's eye to match the intensity of the projected image at the nominal location of the driver's eye.

[0023] Technical Solution 7. The method as described in Technical Solution 6, wherein adjusting the intensity of the projected image at the position of the driver's eyes includes adjusting the power of the holographic projector of the system.

[0024] Technical Solution 8. The method as described in Technical Solution 6, wherein adjusting the intensity of the projected image at the position of the driver's eyes includes adjusting the grayscale level of the color projected by the holographic projector.

[0025] Technical Solution 9. The method as described in Technical Solution 6, wherein adjusting the intensity of the projected image at the position of the driver's eyes includes adjusting the gamma curve of the primary color projected by the holographic projector.

[0026] Technical Solution 10. The method of Technical Solution 4, wherein the controller is adapted to selectively and automatically perform correction actions based on the intensity distribution at the location of the driver's eyes, and allows the driver to manually perform correction actions.

[0027] Technical Solution 11. A head-up display system, comprising: At least one laser, said laser being adapted to project holographic images; At least one spatial light modulator; Exit pupil replicator; A diffuser, adapted to be positioned in the xy-plane at the center point of the vehicle eye ellipse, and a holographic projector adapted to project a dot matrix pattern onto the diffuser; and Controller, the controller being adapted to: Characterizing the intensity distribution of the dot matrix pattern; The intensity distribution is stored therein; Obtain the position of the driver's eyes; Mapping the position of the driver's eye to the intensity distribution of the dot matrix pattern; and The correction action is performed based on the intensity distribution at the location of the driver's eye.

[0028] Technical Solution 12. The system of Technical Solution 11 further includes a camera, the camera communicating with the controller and adapted to capture the dot pattern and use the controller to characterize the intensity distribution of the dot pattern.

[0029] Technical Solution 13. The system as described in Technical Solution 12, wherein the camera is further adapted to acquire the position of the driver's eyes.

[0030] Technical Solution 14. The system as described in Technical Solution 13, wherein when a correction action is performed based on the intensity distribution at the location of the driver's eyes, the controller is further adapted to: The intensity of the dot pattern at the driver's eye position is compared with the intensity of the dot pattern at the nominal position of the driver's eye; and A correction action is performed when the intensity of the dot pattern at the location of the driver's eyes is different from the intensity of the dot pattern at the nominal location of the driver's eyes.

[0031] Technical Solution 15. The system of Technical Solution 14, wherein, when a correction action is performed, the controller is further adapted to adjust the intensity of the projected image at the location of the driver's eye to match the intensity of the projected image at the nominal location of the driver's eye.

[0032] Technical Solution 16. The system of Technical Solution 15, wherein when the intensity of the projected image at the position of the driver's eyes is adjusted, the controller is also adapted to adjust the power of the laser holographic projector.

[0033] Technical Solution 17. The system as described in Technical Solution 15, wherein when the intensity of the projected image at the position of the driver's eyes is adjusted, the controller is further adapted to adjust the grayscale level of the color projected by the laser holographic projector.

[0034] Technical Solution 18. The system of Technical Solution 15, wherein when adjusting the intensity of the projected image at the position of the driver's eyes, the controller is further adapted to adjust the gamma curve of the primary color projected by the holographic projector.

[0035] Technical Solution 19. The system of Technical Solution 13, wherein the controller is adapted to selectively and automatically perform correction actions based on the intensity distribution at the location of the driver's eyes, and allows the driver to manually perform correction actions.

[0036] Technical Solution 20. A method for calibrating a head-up display system for automobiles, comprising: Place the diffuser, aligned with the xy plane, at the center point of the vehicle's eye ellipse; The head-up display system is used to project a dot matrix graphic onto the diffuser; The dot pattern is captured using a camera from a driver monitoring system that communicates with the controller; The controller is used to characterize the intensity distribution of the dot matrix pattern; The intensity distribution is stored in the controller; The camera is used to determine the position of the driver's eyes; The controller is used to map the position of the driver's eye to the intensity distribution of the dot matrix pattern; and The controller performs a correction action based on the intensity distribution at the location of the driver's eye, including comparing the intensity of the dot pattern at the location of the driver's eye with the intensity of the dot pattern at the nominal location of the driver's eye, and performing a correction action when the intensity of the dot pattern at the location of the driver's eye differs from the intensity of the dot pattern at the nominal location of the driver's eye. The corrective action includes adjusting the intensity of the projected image at the location of the driver's eye in one of the following ways: Adjust the power of the holographic projector in the system; Adjust the grayscale level of the colors projected by the holographic projector; Adjusting the gamma curve of the primary colors projected by the holographic projector; and The color harmony of the projected image, with known intensity differences among the three primary colors, at a specific eye position is maintained by adjusting either the graphic grayscale level of each primary color or the power of the holographic projector. The controller is adapted to selectively and automatically perform corrective actions based on the intensity distribution at the location of the driver's eyes, and also allows the driver to perform corrective actions manually. Attached Figure Description

[0037] The accompanying drawings described herein are for illustrative purposes only and are not intended to limit the scope of this disclosure in any way.

[0038] Figure 1 This is a schematic diagram of a head-up display system according to an exemplary embodiment; Figure 2 It is a diagrammatic explanation of the diffuser and the vehicle eye ellipse projected onto it by a dot matrix pattern. Figure 3 It is a diagrammatic illustration of a diffuser with a dot matrix pattern projected on it, and a schematic representation of the position of the first driver's eye and the nominal position of the driver's eye; Figure 4 This is a flowchart illustrating a method according to an exemplary embodiment of the present disclosure. Detailed Implementation

[0039] The following description is merely exemplary in nature and is not intended to limit this disclosure, application, or use.

[0040] refer to Figure 1 The head-up display (HUD) system 10 according to this disclosure includes a holographic projector, which includes a laser 12 and a spatial light modulator 18 adapted to project holographic images.

[0041] In an exemplary embodiment, system 10 includes an exit pupil replicator 14. A holographic image is projected into the exit pupil replicator 14, then propagates within it, and is extracted multiple times before being projected upwards onto the inner surface of the windshield 16. The multiple recirculation of light within the exit pupil replicator 14 expands the pupil, allowing an observer to see the holographic image from the expanded eyebox. In addition to expanding the eyebox, the exit pupil replicator 14 also magnifies the original projected image exiting the laser 12.

[0042] Spatial light modulator 18 is located between laser 12 and exit pupil replicator 14. Spatial light modulator 18 is adapted to receive light from laser 12, diffract the laser with an encoded hologram, and transmit the diffracted laser to exit pupil replicator 14. Controller 20 communicates with laser 12 and spatial light modulator 18.

[0043] Controller 20 is a non-general-purpose electronic control device having a pre-programmed digital computer or processor, memory or non-transitory computer-readable medium for storing data such as control logic, software applications, instructions, computer code, data, lookup tables, etc., and a transceiver [or input / output port]. Computer-readable medium includes any type of media that can be accessed by a computer, such as read-only memory (ROM), random access memory (RAM), hard disk drive, optical disc (CD), digital video disc (DVD), or any other type of memory. "Non-transitory" computer-readable medium does not include wired, wireless, optical, or other communication links that transmit temporary electrical or other signals. Non-transitory computer-readable medium includes media that permanently store data and media that store data and can subsequently be rewritten, such as rewritable optical discs or erasable storage devices. Computer code includes any type of program code, including source code, object code, and executable code.

[0044] In the vehicle, controller 20 obtains information about the driver's eye position from a camera located within the vehicle's driver monitoring system. The driver monitoring system uses the camera to recognize the driver's facial features and provides controller 20 with information about the vertical position of the driver's eyes.

[0045] Laser 12, spatial light modulator 18, and exit pupil replicator 14 are adapted to project an image upwards onto the windshield 16 inside the vehicle. The projected image is reflected from the inner surface of the windshield 16 onto an eye box 22. The eye box 22 is a three-dimensional region in which the driver of the vehicle can see the entire projected image from the HUD system. The eye ellipse 24 is a three-dimensional graphic representation of a multivariate normal distribution used to approximate the distribution of the driver's eye positions inside the vehicle. The eye ellipse 24 is represented by two three-dimensional ellipses, one for the right eye and the other for the left eye.

[0046] Downward viewing angle (LDA) is the angle of the driver's eye relative to the virtual image projected onto the driver's eye. Virtual image distance (VID) is the distance between the virtual image perceived by the driver and the driver's eye. To accommodate drivers at different heights, LDA and VID are adjustable to ensure that all drivers can perceive the image projected by the laser holographic projector 12 from the appropriate position.

[0047] In some systems, controller 20 is adapted to determine the distance between the vertical position of the driver's eyes and a predetermined nominal vertical position. Based on the distance between the driver's eyes and the nominal vertical position, spatial light modulator 18 can adjust the LDA of a holographic image projected by a holographic projector, which consists of at least one laser 12 and at least one spatial light modulator 18.

[0048] Refer again Figure 1The diffuser 28 is adapted to be positioned in the xy-plane at the center point 30 of the vehicle eye ellipse 24. (Reference) Figure 2 Laser 12 is adapted to project a dot pattern 32 onto diffuser 28. Diffuser 28 may include an outer bounding box 34 to indicate the outline of eyebox 22. Dot pattern 32 is a two-dimensional array of dots 36. Holographic projector projects an image of dot pattern 32, and exit pupil replicator 14 replicates the projected image into a two-dimensional dot array, wherein the planar wavefront is located in the same plane as the center point 30 of diffuser 28 and vehicle eye ellipse 24.

[0049] The controller 20 is adapted to characterize the intensity distribution of the dot pattern 32. The system 10 includes a camera 40 that communicates with the controller 20. The camera 40 is adapted to capture the dot pattern 32 and to characterize the intensity distribution of the dot pattern 32 using the controller 20. The controller 20 measures the intensity of each of the projection points 36 within the dot pattern 32. The intensity of the projected dot pattern 32 varies across the eyebox 22. This means that any image projected by the laser 12 will display different intensities depending on the location in the eyebox 22 where the image is viewed. For example, in Figure 2 In the image, the first point 48 of the dot pattern 32, located near the center point 30 of the eye ellipse 24, exhibits the desired intensity. The image projected by the laser 12 appears to have the correct intensity characteristics, as shown at 50. Alternatively, the second point 52 of the dot pattern 32, located away from the center point 30, presents a darker image, which is less easily seen and less clear to the driver, as shown at 54.

[0050] The controller 20 uses the camera 40 to collect intensity data at each point 36 of the dot pattern 32 and characterizes the intensity distribution by creating a two-dimensional model of the image intensity distribution across each point 36 location of the dot pattern 32 and the eyebox 22. The controller 20 stores this intensity distribution.

[0051] The laser holographic projector 12 may include a single laser suitable for projecting red, green, and blue light. In an exemplary embodiment, each of the red, green, and blue lasers is individually actuated to create a dot pattern 32, and the camera 40 and controller 20 collect intensity data for each of the red, green, and blue lasers at each of the dot locations 36 in the dot pattern 32.

[0052] Camera 40 is also adapted to acquire the position of the driver's eyes. The camera "finds" the driver's eyes, and once located, controller 20 is adapted to map the position of the driver's eyes onto the intensity distribution of the dot pattern 32. Controller 20 is then adapted to perform correction actions based on the intensity distribution at the position of the driver's eyes.

[0053] refer to Figure 3System 10 is designed for a hypothetical nominal driver 56. The nominal driver 56 is positioned so that his eyes are at a nominal location. As shown, the nominal driver 56's left eye 56L and right eye 56R are located at corresponding points 36LND and 36RND within the dot matrix pattern 32. System 10 is designed such that the intensity at the two points 36LND and 36RND corresponding to the nominal driver 56's left eye 56L and right eye 56R has appropriate desired intensity characteristics. Camera 40 acquires the positions of the actual driver 58's left eye 58L and right eye 58R, and controller 20 maps the positions of the actual driver 58's left eye 58L and right eye 58R to an intensity distribution. As shown, the actual driver 58's left eye 58L and right eye 58R are located at corresponding points 36LAD and 36RAD within the dot matrix pattern 32, separated from the points 36LND and 36RND corresponding to the nominal driver 56's eye positions.

[0054] In an exemplary embodiment, when a correction action is performed based on the intensity distribution at the positions of the actual driver's left eye 58L and right eye 58R, the controller 20 is further adapted to compare the intensity of the dot pattern 32 at the positions of the actual driver's left eye 58L and right eye 58R with the intensity of the dot pattern 32 at the positions of the nominal driver's left eye 56L and right eye 56R. The controller 20 accesses the intensity distribution to compare the previously measured intensity of the projection points 36LND and 36RND at the nominal driver's eye positions 56L and 56R with the previously measured intensity of the projection points 36LAD and 36RAD at the positions of the actual driver's eyes 58L and 58R. If the intensity distribution indicates that the expected intensity of the projected image at the positions of the actual driver's eyes 58L and 58R will differ from the expected intensity at the nominal positions 56L and 56R, the controller 20 will perform a correction action.

[0055] In an exemplary embodiment, when a correction action is performed, the controller 20 is further adapted to adjust the intensity of the projected image at the positions of the driver's eyes 58L and 58R to match the intensity of the projected image at the nominal positions of the driver's eyes 56L and 56R. Figure 3 As shown, for example, the expected intensity of the image at the driver's eye positions 36LAD, 36RAD is lower than the expected (desired) intensity of the image at the nominal driver's eye positions 36LND, 36RND. The controller 20 will adjust the intensity of the image projected onto the driver's eye positions 36LAD, 36RAD to increase the intensity. There are several ways to achieve this. In an exemplary embodiment, when adjusting the intensity of the projected image at the driver's eye positions 58L, 58R, the controller 20 is adapted to adjust the power of the laser holographic projector 12. This may require increasing or decreasing the current applied to the laser holographic projector 12.

[0056] When the laser holographic projector 12 includes a single laser suitable for projecting red, green, and blue light, the controller 20 accesses an intensity distribution to compare previously measured red, green, and blue intensities of the projection point 36 at the nominal driver eye positions 36LND, 36RND with previously measured red, green, and blue intensities of the projection point 36 at the actual driver eye positions 36LAD, 36RAD. If the intensity distribution indicates that the expected intensity of the projected image at the actual driver eye positions 58L, 58R will differ from the expected intensity at the nominal driver eye positions 36LND, 36RND, the controller 20 performs a correction action. In another exemplary embodiment, the controller 20 adjusts the intensity of the projected image by individually adjusting the power of each of the red, green, and blue lasers to individually adjust the intensity of the red, green, and blue light. In another exemplary embodiment, the correction action may include utilizing adaptive gamma curves of the three primary colors (red, green, and blue) based on the eye position by encoding the required current into each laser.

[0057] In yet another exemplary embodiment, the controller 20 adjusts the intensity of the projected image at the actual driver's eye positions 58L, 58R by controlling the grayscale levels of the colors projected by the laser. This is accomplished by adjusting the grayscale level of each color in the image. The corresponding hologram is calculated by the controller 20 and sent to the spatial light modulator 18. The intensity adjustment is performed on the encoded hologram transmitted to the exit pupil replicator 14.

[0058] Other correction actions may include maintaining the color coordinates of the projected image with known intensity differences of the three primary colors at a specific eye position within the eye box 22 by adjusting the image gray levels of the individual primary colors or by adjusting the power level of the laser 12, and adjusting the color contrast at the visible position of the graphic by adjusting the image gray levels of the individual primary colors or by adjusting the power level of the laser 12.

[0059] The advantage of the system 10 disclosed herein is that it adjusts the image not across the entire eye box 22, but only at the positions of the driver's eyes 58L and 58R. This allows the system 10 to adapt to individual drivers more easily and quickly.

[0060] In one exemplary embodiment, the controller 20 is adapted to selectively and automatically perform correction actions based on the intensity distribution at the positions of the driver's eyes 36LAD, 36RAD. The driver may optionally allow automatic adjustment, wherein the system 10 continuously monitors the positions of the driver's eyes 58L, 58R and adjusts the projected image as needed to ensure the driver receives a projected image of the desired intensity. Alternatively and simultaneously, the controller 20 may also be adapted to allow the driver to manually adjust the intensity of the projected image. In this way, the driver can manually adjust the intensity of the projected image at the positions of the driver's eyes 58L, 58R according to the driver's personal preference, so that the projected image appears stronger or less intense to the driver.

[0061] refer to Figure 4 A method 100 for compensating for luminance intensity non-uniformity in a head-up display system 10 for an automobile includes: starting at frame 102, placing a diffuser 28 aligned with the xy-plane at the center point 30 of a vehicle eye ellipse 24; moving to frame 104, projecting a dot pattern 32 onto the diffuser 28 using the head-up display system 10; moving to frame 106, capturing the dot pattern 32 using a camera 40; and moving to frame 108, characterizing the intensity distribution of the dot pattern 32 using a controller 20. Moving to frame 110, the method 100 includes storing the intensity distribution within the controller 20.

[0062] Once the driver is seated in the car, moving to frame 112, method 100 includes using camera 40 to acquire the positions of the driver's eyes 58L, 58R; and moving to frame 114, using controller 20 to map the positions of the driver's eyes 58L, 58R onto the intensity distribution of the dot pattern 32.

[0063] Moving to box 116, method 100 includes using controller 20 to perform a correction action based on the intensity distribution at positions 36LAD, 36RAD of the driver's eyes 58L, 58R. The controller is adapted to selectively and automatically perform the correction action based on the intensity distribution at positions 36LAD, 36RAD of the driver's eyes 58L, 58R, and allows the driver to perform the correction action manually.

[0064] In an exemplary embodiment, the correction action based on the intensity distribution at the driver's eye position at block 116 further includes: moving to block 118 to compare the intensity of the dot pattern 32 at positions 36LAD and 36RAD of the driver's eyes 58L and 58R with the intensity of the dot pattern 32 at positions 36LND and 36RND of the nominal driver's eyes 56L and 56R; and moving to block 120 to perform the correction action when the intensity of the dot pattern 32 at positions 36LAD and 36RAD of the driver's eyes 58L and 58R is different from the intensity of the dot pattern 32 at positions 36LND and 36RND of the nominal driver's eyes 56L and 56R.

[0065] In an exemplary embodiment, performing the correction action at block 120 further includes adjusting the power of the laser holographic projector 12 of the system 10 by moving to block 122, thereby adjusting the intensity of the projected image at positions 36LAD and 36RAD of the driver's eyes 58L and 58R to match the intensity of the projected image at nominal positions 36LND and 36RND of the driver's eyes 56L and 56R. In another exemplary embodiment, performing the correction action at block 120 further includes adjusting the grayscale level of the color projected by the laser holographic projector 12 by moving to block 124, thereby adjusting the intensity of the projected image at positions 36LAD and 36RAD of the driver's eyes 58L and 58R to match the intensity of the projected image at nominal positions 36LND and 36RND of the driver's eyes 56L and 56R.

[0066] In yet another exemplary embodiment, performing the correction action at box 120 further includes moving to box 126 to adjust the gamma curve of the primary colors projected by the holographic projector 12, and in yet another exemplary embodiment, performing the correction action at box 120 further includes moving to box 128 to maintain color harmony of the projected image of the three primary colors having known intensity differences at a specific eye position by adjusting one of the graphic grayscale level of each primary color and adjusting the power of the holographic projector 12.

[0067] The description in this disclosure is merely exemplary in nature, and variations thereof are contemplated within the scope of this disclosure without departing from its spirit and scope. Such variations should not be considered as departing from the spirit and scope of this disclosure.

Claims

1. A method for compensating for luminance intensity non-uniformity in a head-up display system for automobiles, comprising: Place the diffuser, aligned with the xy plane, at the center point of the vehicle's eye ellipse; The head-up display system is used to project a dot matrix graphic onto the diffuser; The intensity distribution of the dot matrix pattern is characterized using a controller; The intensity distribution is stored in the controller; Obtain the actual position of the driver's eyes; The controller is used to map the actual position of the driver's eyes onto the intensity distribution of the dot matrix pattern; as well as Using the controller to perform a correction action on the intensity distribution at the actual position of the driver's eyes, including: Access intensity distribution; The intensity of the dot pattern at the actual location of the driver's eye is compared with the intensity of the dot pattern at the nominal location of the driver's eye; and A correction action is performed when the intensity of the dot pattern at the actual position of the driver's eyes differs from the intensity of the dot pattern at the nominal position of the driver's eyes.

2. The method of claim 1, further comprising capturing the dot pattern using a camera and characterizing the intensity distribution of the dot pattern using the controller.

3. The method of claim 2, further comprising using the camera to obtain the actual position of the driver's eyes.

4. The method of claim 3, wherein, The camera in question is part of the driver monitoring system.

5. The method of claim 4, wherein, The correction of the intensity distribution at the actual location of the driver's eye also includes: The intensity of the dot pattern at the actual location of the driver's left and right eyes was previously measured to be the intensity of the dot pattern at the nominal location of the driver's left and right eyes.

6. The method of claim 5, wherein, The correction action also includes adjusting the intensity of the projected image at the actual position of the driver's eye to match the intensity of the projected image at the nominal position of the driver's eye.

7. The method of claim 6, wherein, Adjusting the intensity of the projected image at the actual position of the driver's eyes includes adjusting the power of the holographic projector in the head-up display system.

8. The method of claim 6, wherein, Adjusting the intensity of the projected image at the actual position of the driver's eyes includes adjusting the grayscale level of the colors projected by the holographic projector.

9. The method of claim 6, wherein, Adjusting the intensity of the projected image at the actual position of the driver's eyes includes adjusting the gamma curve of the primary colors projected by the holographic projector.

10. The method of claim 4, wherein, The controller is adapted to selectively and automatically perform correction actions based on the intensity distribution at the actual location of the driver's eyes, and allows the driver to perform correction actions manually.

11. A head-up display system, comprising: At least one laser, said laser being adapted to project holographic images; At least one spatial light modulator; Exit pupil replicator; A diffuser, the diffuser being adapted to be positioned in the xy plane at the center point of the vehicle eye ellipse, and the laser being adapted to project a dot pattern onto the diffuser; and Controller, the controller being adapted to: Characterizing the intensity distribution of the dot matrix pattern; The intensity distribution is stored therein; Obtain the actual position of the driver's eyes; Mapping the actual position of the driver's eyes to the intensity distribution of the dot matrix pattern; as well as Performing a correction action on the intensity distribution at the actual position of the driver's eyes includes: Access intensity distribution; The intensity of the dot pattern at the actual location of the driver's eye is compared with the intensity of the dot pattern at the nominal location of the driver's eye; and A correction action is performed when the intensity of the dot pattern at the actual position of the driver's eyes differs from the intensity of the dot pattern at the nominal position of the driver's eyes.

12. The system of claim 11, further comprising a camera, the camera communicating with the controller and adapted to capture the dot pattern and to characterize the intensity distribution of the dot pattern using the controller.

13. The system of claim 12, wherein, The camera is also adapted to acquire the actual position of the driver's eyes.

14. The system of claim 13, wherein, When performing a correction action on the intensity distribution at the actual position of the driver's eye, the controller is further adapted to: The intensity of the dot pattern at the actual location of the driver's left and right eyes was previously measured to be the intensity of the dot pattern at the nominal location of the driver's left and right eyes.

15. The system of claim 14, wherein, When a correction action is performed, the controller is also adapted to adjust the intensity of the projected image at the actual position of the driver's eye to match the intensity of the projected image at the nominal position of the driver's eye.

16. The system of claim 15, wherein, When adjusting the intensity of the projected image at the actual position of the driver's eyes, the controller is also adapted to adjust the power of the laser.

17. The system of claim 15, wherein, When adjusting the intensity of the projected image at the actual position of the driver's eyes, the controller is also adapted to adjust the grayscale level of the color projected by the laser.

18. The system of claim 15, wherein, When adjusting the intensity of the projected image at the actual position of the driver's eyes, the controller is also adapted to adjust the gamma curve of the primary color projected by the laser.

19. The system of claim 13, wherein, The controller is adapted to selectively and automatically perform correction actions based on the intensity distribution at the actual location of the driver's eyes, and allows the driver to perform correction actions manually.

20. A method for calibrating a head-up display system for an automobile, comprising: Place the diffuser, aligned with the xy plane, at the center point of the vehicle's eye ellipse; The head-up display system is used to project a dot matrix graphic onto the diffuser; The dot pattern is captured using a camera from a driver monitoring system that communicates with the controller; The controller is used to characterize the intensity distribution of the dot matrix pattern; The intensity distribution is stored in the controller; The camera is used to obtain the actual position of the driver's eyes; The controller is used to map the actual position of the driver's eyes onto the intensity distribution of the dot matrix pattern; as well as The controller is used to perform a correction operation on the intensity distribution at the actual position of the driver's eyes, including comparing the intensity of the dot pattern at the actual position of the driver's eyes with the intensity of the dot pattern at the nominal position of the driver's eyes, and performing a correction operation when the intensity of the dot pattern at the actual position of the driver's eyes differs from the intensity of the dot pattern at the nominal position of the driver's eyes. The correction action includes adjusting the intensity of the projected image at the actual position of the driver's eye in one of the following ways: Adjust the power of the holographic projector in the head-up display system; Adjust the grayscale level of the colors projected by the holographic projector; Adjust the gamma curve of the primary colors projected by the holographic projector; as well as The color harmony of the projected image, with known intensity differences between the three primary colors, at a specific eye position is maintained by adjusting either the graphic grayscale level of the three primary colors or the power of the holographic projector. The controller is adapted to selectively and automatically apply corrections to the intensity distribution at the actual location of the driver's eyes, and also allows the driver to apply corrections manually.

Citation Information

Patent Citations

  • projection display system and method of operating a projection display system

    DE102016223908A1

  • Dynamic illumination control for depth determination

    US11195291B1