Head-up display system

Abstract

To provide a head-up display system which can make a driver appropriately recognize a virtual image.SOLUTION: An AR-HUD system 1 includes an AR-HUD device 40, and a visual line detector 20. The AR-HUD device 40 is provided on a vehicle, irradiates a transparent front glass with display light, and displays a virtual image. The visual line detector 20 detects a visual line of a driver of the vehicle. The AR-HUD device 40 changes a display mode of displaying the virtual image according to the position of the visual line of the driver detected by the visual line detector 20.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present invention relates to a head-up display system. [Background technology]

[0002] Conventionally, as a head-up display system, for example, Patent Document 1 describes a vehicle display device that displays a virtual image superimposed on an object. This vehicle display device displays an object in a first display mode that allows the driver to recognize the attribute of the object, or in a second display mode that allows the driver to notice the presence of the object, and when the display position of the virtual image is in a first region that is a field of view in which the driver can easily obtain information, the virtual image is displayed in the first display mode, while when the display position of the virtual image is in a second region that is a region outside the first region, the virtual image is displayed in the second display mode. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2017-170949 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, in the vehicle display device described in the above-mentioned Patent Document 1, for example, when a virtual image is displayed in a first region, if the driver's line of sight is located in a second region, the virtual image may not be recognized.

[0005] Therefore, the present invention has been made in consideration of the above, and has an object to provide a head-up display system that allows the driver to properly recognize a virtual image. [Means for solving the problem]

[0006] In order to solve the above-mentioned problems and achieve the objective, the head-up display system of the present invention comprises a head-up display device that displays a virtual image by irradiating display light toward a transparent reflective member provided in a vehicle, and a gaze detector that detects the gaze of the driver of the vehicle, and is characterized in that the head-up display device changes the display mode for displaying the virtual image depending on the position of the driver's gaze detected by the gaze detector. Effect of the Invention

[0007] The head-up display system according to the present invention can display a virtual image according to the position of the driver's line of sight, and therefore can allow the driver to properly recognize the virtual image. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a schematic diagram illustrating a configuration example of an AR-HUD system according to an embodiment. [Diagram 2] FIG. 2 is a block diagram illustrating an example of the configuration of the AR-HUD system according to the embodiment. [Diagram 3] FIG. 3 is a diagram showing a central region, an effective region, and a guidance region according to the embodiment. [Figure 4] FIG. 4 is a flowchart illustrating an operation example of the AR-HUD system according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] The form (embodiment) for carrying out the present invention will be described in detail with reference to the drawings. The present invention is not limited to the contents described in the following embodiment. Furthermore, the components described below include those that a person skilled in the art can easily imagine and those that are substantially the same. Furthermore, the configurations described below can be appropriately combined. Furthermore, various omissions, substitutions, or modifications of the configurations can be made without departing from the gist of the present invention.

[0010] [Embodiment] An AR-HUD system 1 according to an embodiment will be described with reference to the drawings. The AR-HUD system 1 is an example of a head-up display system, which is provided in a vehicle, irradiates display light toward a windshield W serving as a reflective member having transparency, and displays a virtual image S reflected by the windshield W toward a viewing position EP by superimposing it on an object. As shown in FIG. 1, the AR-HUD system 1 includes a camera 10, a gaze detector 20, an illuminance sensor 30, and an AR-HUD device 40 serving as a head-up display device. The camera 10, the gaze detector 20, the illuminance sensor 30, and the AR-HUD device 40 are connected to each other so as to be able to communicate with each other.

[0011] The camera 10 captures an image. The camera 10 is provided in a vehicle, and is disposed, for example, with a camera lens facing forward of the vehicle. The camera 10 captures an image of the background in front of the vehicle on which the virtual image S is superimposed, and outputs the captured background image to the AR-HUD device 40.

[0012] Next, the gaze detector 20 will be described. The gaze detector 20 detects the driver's gaze. The gaze detector 20 is provided in a vehicle, and is arranged, for example, with a camera lens facing the driver. The gaze detector 20 detects the driver's gaze by a well-known gaze detection method. The gaze detector 20 detects the driver's gaze, for example, based on the position of the pupil of the eyeball in the face image of the driver. In this case, the gaze detector 20 compares a predetermined eye image with the face image of the driver, and detects the position of the driver's pupil from the face image of the driver. The control unit 22 detects the driver's gaze from the detected position of the driver's pupil. The gaze detector 20 outputs gaze information representing the detected gaze to the AR-HUD device 40.

[0013] Next, the illuminance sensor 30 will be described. The illuminance sensor 30 is a sensor that detects the degree of brightness (illuminance). The illuminance sensor 30 is provided in the vehicle, for example, on the upper surface of the instrument panel. The illuminance sensor 30 detects illuminance, and outputs illuminance information indicating the detected illuminance to the AR-HUD device 40.

[0014] Next, the AR-HUD device 40 will be described. The AR-HUD device 40 displays a virtual image S. The AR-HUD device 40 is provided in a vehicle, and is arranged, for example, inside an instrument panel of the vehicle. The AR-HUD device 40 irradiates display light toward a windshield W, and displays a virtual image S reflected by the windshield W toward a viewing position EP by superimposing it on an object. The AR-HUD device 40 displays the virtual image S based on, for example, a background image output from the camera 10, line-of-sight information output from the line-of-sight detector 20, and illuminance information output from the illuminance sensor 30. As shown in FIG. 1, the AR-HUD device 40 includes a reflector 41 and a display device 42.

[0015] The reflecting unit 41 reflects the display light emitted from the display device 42 toward the windshield W. The reflecting unit 41 includes a first intermediate mirror 411, a second intermediate mirror 412, and a final mirror 413. The first intermediate mirror 411 totally reflects the display light emitted from the display device 42 toward the second intermediate mirror 412. The second intermediate mirror 412 totally reflects the display light emitted from the display device 42 and reflected by the first intermediate mirror 411 toward the final mirror 413. The final mirror 413 totally reflects the display light emitted from the display device 42 and reflected by the first intermediate mirror 411 and the second intermediate mirror 412 toward the windshield W.

[0016] Next, the display device 42 will be described. The display device 42 irradiates display light, and irradiates the display light to the windshield W via the reflector 41. As shown in Fig. 2, the display device 42 includes a processing unit 421, an image generating unit 422, and a brightness adjusting unit 423. The processing unit 421, the image generating unit 422, and the brightness adjusting unit 423 are connected to each other so as to be able to communicate with each other.

[0017] The processing unit 421 performs display processing of the virtual image S. For example, the processing unit 421 detects an object (for example, a person, another vehicle, a sign, etc.) on which the virtual image S is to be superimposed from a background image output from the camera 10, and superimposes the virtual image S on the detected object. The processing unit 421 also changes the display mode for displaying the virtual image S based on the line-of-sight information output from the line-of-sight detector 20. For example, as shown in FIG. 3, the processing unit 421 changes the display mode for displaying the virtual image S according to the position of the driver's line of sight with respect to the central area P1, the effective area P2, and the guidance area P3.

[0018] Here, the central area P1 is a preset area, which is provided inside the effective area P2 and corresponds to the central visual field based on the visual axis of the driver. For example, the central area P1 is an area corresponding to within a range of 0° to ±5° with respect to the visual axis of the driver when the driver sits in the driver's seat and faces forward. In other words, the central area P1 is an area corresponding to within a range of 0° to ±5° in the vertical direction and 0° to ±5° in the horizontal direction with respect to the visual axis of the driver. When the driver's line of sight is located in the central area P1, the driver can clearly recognize the virtual image S displayed in the central area P1.

[0019] The effective area P2 is a preset area that is provided outside the central area P1 and corresponds to the effective visual field of the driver. The effective area P2 is, for example, an area that corresponds to within a range of ±5° to ±30° with respect to the visual axis of the driver when the driver is seated in the driver's seat and facing forward. In other words, the effective area P2 is an area that corresponds to within a range of ±5° to ±30° in the vertical direction and ±5° to ±30° in the horizontal direction with respect to the visual axis of the driver. When the line of sight is located in the effective area P2, the driver can recognize the existence of the virtual image S displayed in the central area P1 to a degree that allows the driver to confirm it.

[0020] The guidance area P3 is a preset area that is provided outside the effective area P2 and corresponds to the driver's guidance visual field. The guidance area P3 is, for example, an area that corresponds to within a range of ±30° to ±100° with respect to the driver's visual axis when the driver sits in the driver's seat and faces forward. That is, the guidance area P3 is an area that corresponds to within a range of ±30° to ±100° in the vertical direction and ±30° to ±100° in the horizontal direction with respect to the driver's visual axis. When the driver's line of sight is located in the guidance area P3, it is difficult for the driver to recognize the presence of the virtual image S displayed in the central area P1.

[0021] At least a portion of the central area P1, the effective area P2, and the guidance area P3 overlaps with the windshield W when viewed from the driver seated in the driver's seat. A display range Q in which a virtual image S is displayed through the windshield W is a range that overlaps with at least the central area P1, and in this example, as shown in Fig. 3, is a range that overlaps with a portion of the effective area P2 and a portion of the guidance area P3 centered on the central area P1.

[0022] The processing unit 421 determines whether the driver's line of sight is located in the central area P1, the effective area P2, or the guidance area P3, based on the line of sight information output from the line of sight detector 20. Then, the processing unit 421 changes the display mode for displaying the virtual image S, based on the result of this determination. The processing unit 421 includes a normal processing unit 421a, an emphasis processing unit 421b, and a guidance processing unit 421c as processing units for changing the display mode.

[0023] The normal processing unit 421a changes the display mode to a normal display mode in which the virtual image S is normally displayed in a predetermined normal display manner. Here, the predetermined display manner of the virtual image S is a manner in which pattern information, text information, and the like are displayed without deformation (highlighting, enlarging, etc.). When the virtual image S is displayed in a range overlapping with the central region P1 of the display range Q, if the driver's line of sight is located in the central region P1, the normal processing unit 421a changes the display mode to the normal display mode and processes the virtual image S to be normally displayed in a predetermined normal display manner. Since the driver's line of sight is directed toward the central region P1, the driver can clearly recognize the virtual image S displayed in the central region P1 in the normal display mode.

[0024] Next, the emphasis processing unit 421b will be described. The emphasis processing unit 421b changes to an emphasis display mode in which the virtual image S is highlighted in an emphasis display mode that is more highlighted than the normal display mode. When the driver's line of sight is located in the effective region P2 when the virtual image S is displayed in a range overlapping the central region P1 of the display range Q, the emphasis processing unit 421b changes to the emphasis display mode, and processes to highlight the virtual image S in an emphasis display mode more than when the driver's line of sight is located in the central region P1. Here, the emphasis display mode of the virtual image S is a display mode in which the size of the virtual image S is increased, the virtual image S is displayed in a highly eye-catching color (e.g., red, yellow, etc.), the virtual image S is blinked, or the luminance of the virtual image S is relatively increased, compared to the display mode of the virtual image S that is predetermined in the normal display mode. When the emphasis display mode is changed to the emphasis display mode, the driver's line of sight is directed toward the effective region P2, but since the virtual image S is highlighted in the emphasis display mode, the driver can recognize the presence of the virtual image S displayed in the central region P1.

[0025] Next, the guidance processing unit 421c will be described. The guidance processing unit 421c changes the guidance display mode to guide the driver's line of sight from the guidance area P3 side to the central area P1 side. When the virtual image S is displayed in a range overlapping the central area P1 of the display range Q, if the driver's line of sight is located in the guidance area P3, the guidance processing unit 421c changes the mode to the guidance display mode, displays a virtual image for guidance in a portion including at least a part of the outer frame Qa of the display range Q, and performs processing to guide the driver's line of sight from the guidance area P3 side to the central area P1 side. The virtual image for guidance is a virtual image different from the virtual image S superimposed on the detected object, and is displayed in a portion including at least a part of the outer frame Qa of the display range Q. The virtual image for guidance is displayed, for example, in a display mode that displays only the outer frame Qa of the entire display range Q, a display mode that displays the entire display range Q including the inside, a display mode that displays a symbol for guidance in a portion including a part of the outer frame Qa near the driver's line of sight position, or the like. In these display modes, the guiding virtual image may be applied with a highly eye-catching color (e.g., red, yellow, etc.), a blinking display, relatively high brightness, etc. When the guidance display mode is changed to, the driver's line of sight is directed toward the guidance region P3, but since the guiding virtual image is displayed, the driver's line of sight is guided from the guidance region P3 side to the central region P1 side by the guiding virtual image, and thus the driver can recognize the virtual image S displayed in the central region P1.

[0026] Next, the image generating unit 422 will be described. The image generating unit 422 generates an image for displaying the virtual image S based on the processing result processed in each mode of the processing unit 421. For example, in the normal display mode, the image generating unit 422 generates an image for normally displaying the virtual image S in a predetermined normal display mode. In the highlight display mode, the image generating unit 422 generates an image for highlighting the virtual image S in a highlight display mode. In the guidance display mode, the image generating unit 422 generates an image for normally displaying the virtual image S in a predetermined normal display mode and also generates an image for displaying a guidance virtual image.

[0027] Next, the brightness adjustment unit 423 will be described. The brightness adjustment unit 423 adjusts the brightness of the image. The brightness adjustment unit 423 adjusts the brightness of the image generated by the image generation unit 422 based on the illuminance information output from the illuminance sensor 30. For example, when the illuminance information indicates a relatively high illuminance, the brightness adjustment unit 423 relatively increases the brightness of the image generated by the image generation unit 422, and when the illuminance information indicates a relatively low illuminance, the brightness adjustment unit 423 relatively decreases the brightness of the image generated by the image generation unit 422. The AR-HUD device 40 irradiates the display light including the image whose brightness has been adjusted by the luminance adjustment unit 423 toward the windshield W, and displays the virtual image S or a virtual image for guidance in front of the vehicle.

[0028] Next, an example of the operation of the AR-HUD device 40 will be described with reference to a flowchart. In the AR-HUD device 40, the gaze detector 20 detects the gaze of the driver (step S1). The gaze detector 20 detects the gaze of the driver based on, for example, the position of the pupil of the eyeball of the face image of the driver. Next, the processing unit 421 determines whether or not the gaze of the driver is located in the central region P1 (step S2). If the gaze of the driver is located in the central region P1 (step S2; Yes), the processing unit 421 changes the display mode to the normal display mode (step S3). For example, the processing unit 421 performs processing by the normal processing unit 421a so as to normally display the virtual image S in a predetermined normal display mode (step S3). In the above-mentioned step S2, if the gaze of the driver is not located in the central region P1 (step S2; No), the processing unit 421 determines whether or not the gaze of the driver is located in the effective region P2 (step S4). When the line of sight of the driver is located in the effective region P2 (step S4; Yes), the processing unit 421 changes the display mode to the highlight display mode (step S5). For example, the processing unit 421 processes the virtual image S to be displayed in a more emphasized manner than when the line of sight of the driver is located in the central region P1 by the highlight processing unit 421b. Specifically, the highlight processing unit 421b increases the size of the virtual image S, displays the virtual image S in a highly eye-catching color (for example, red, yellow, etc.), blinks the virtual image S, or relatively increases the luminance of the virtual image S. In the above-mentioned step S4, when the line of sight of the driver is not located in the effective region P2 (step S4; No), the processing unit 421 changes the display mode to the guidance display mode (step S6). For example, the processing unit 421 processes the guidance processing unit 421c to display a guidance virtual image in a portion including at least a part of the outer frame Qa of the display range Q to guide the line of sight of the driver from the guidance region P3 side to the central region P1 side. After the processes of steps S3, S5, and S6 described above, the AR-HUD device 40 ends the display process of the virtual image S.

[0029] As described above, the AR-HUD system 1 according to the embodiment includes the AR-HUD device 40 and the line-of-sight detector 20. The AR-HUD device 40 is provided in a vehicle and irradiates a display light toward a windshield W having transparency to display a virtual image S. The line-of-sight detector 20 detects the line of sight of the driver of the vehicle. Then, the AR-HUD device 40 changes a display mode for displaying the virtual image S according to the position of the driver's line of sight detected by the line-of-sight detector 20. With this configuration, the AR-HUD system 1 can display the virtual image S according to the position of the driver's line of sight, and therefore allows the driver to properly recognize the virtual image S.

[0030] In the above-mentioned AR-HUD system 1, the AR-HUD device 40 changes the display mode according to the position of the line of sight relative to the central area P1, the effective area P2, and the guidance area P3. Here, the central area P1 is a preset area corresponding to the central visual field based on the visual axis of the driver. The effective area P2 is a preset area provided outside the central area P1 and corresponding to the effective visual field of the driver. The guidance area P3 is a preset area provided outside the effective area P2 and corresponding to the guidance visual field of the driver. The display range Q in which the virtual image S is displayed is a range that overlaps at least the central area P1. When the driver's line of sight is located in the central area P1 when the virtual image S is displayed in the display range Q, the AR-HUD device 40 changes to a normal display mode in which the virtual image S is normally displayed in a predetermined normal display mode. Furthermore, when the driver's line of sight is located in the effective region P2, the AR-HUD device 40 changes to an emphasis display mode in which the virtual image S is highlighted in an emphasis display mode that is more emphasized than the normal display mode when the driver's line of sight is located in the central region P1. Furthermore, when the virtual image S is displayed in the display range Q, if the driver's line of sight is located in the guidance region P3, the AR-HUD device 40 changes to a guidance display mode in which the virtual image S is displayed in a portion including at least a part of the outer frame Qa of the display range Q to guide the driver's line of sight from the guidance region P3 side to the central region P1 side. With this configuration, the AR-HUD system 1 can appropriately display the virtual image S according to the region in which the driver's line of sight is located. For example, when the driver's line of sight is located in the central region P1, the AR-HUD device 40 can make the driver clearly recognize the virtual image S displayed in the central region P1. Furthermore, when the driver's line of sight is located in the effective region P2, the AR-HUD system 1 can make the driver recognize the presence of the virtual image S displayed in an emphasis manner in the central region P1. That is, when the driver's line of sight is located in the effective area P2, the AR-HUD system 1 can make the driver aware of the presence of the virtual image S displayed in an emphasized manner in the central area P1. Also, when the driver's line of sight is located in the guidance area P3, the AR-HUD system 1 can guide the driver's line of sight from the guidance area P3 side to the central area P1 side by a virtual image for driving guidance, thereby making the driver aware of the virtual image S displayed in the central area P1.

[0031] In the above description, the head-up display device has been described using an AR-HUD device (augmented reality head-up display device) 40 as an example, but is not limited to this and may be, for example, a HUD device that is not an augmented reality type.

[0032] An example has been described in which the display range Q for displaying the virtual image S overlaps with the central region P1, part of the effective region P2, and part of the guidance region P3, but this is not limited to this, and for example, the display range Q may overlap with the central region P1 and the effective region P2 but not with the guidance region P3.

[0033] Although an example in which the AR-HUD device 40 changes the display mode according to the position of the line of sight relative to the central region P1, the effective region P2, and the guidance region P3 has been described, the present invention is not limited thereto, and for example, the display mode may be changed according to the position of the line of sight relative to the central region P1 and the effective region P2 without using the guidance region P3. In this case, the AR-HUD device 40 changes the display mode according to the position of the line of sight relative to the central region P1 and the effective region P2, and when the virtual image S is displayed in the display range Q, if the driver's line of sight is located in the central region P1, the display mode is changed to a normal display mode in which the virtual image S is normally displayed in a predetermined normal display mode. In addition, if the driver's line of sight is located in the effective region P2, the AR-HUD device 40 changes to an emphasis display mode in which the virtual image S is highlighted in an emphasis display mode that is more highlighted than the normal display mode when the driver's line of sight is located in the central region P1. With this configuration, the AR-HUD system 1 can, for example, allow the driver to clearly recognize the virtual image S displayed in the central region P1 when the driver's line of sight is located in the central region P1. Furthermore, when the driver's line of sight is located in the effective area P2, the AR-HUD system 1 can make the driver aware of the virtual image S displayed in an emphasized manner in the central area P1 to the extent that the driver can confirm the presence of the image.

[0034] In the guidance display mode, the processing unit 421 may display a virtual image S with a relatively high priority in the display range Q. Then, when the driver views the virtual image S, the processing unit 421 may delete the viewed virtual image S. [Explanation of symbols]

[0035] 1 AR-HUD system (head-up display system) 20 Line of Sight Detector 40 AR-HUD device (head-up display device) P1 central area P2 Effective area P3 induction region Q Display range Qa Outer frame S Virtual Image W Windshield (reflective material)

Claims

1. a head-up display device that is provided in a vehicle and projects a display light toward a reflective member having transparency to display a virtual image; a gaze detector for detecting a gaze of a driver of the vehicle, the head-up display device changes a display mode in which the virtual image is displayed according to a position of the line of sight relative to a predetermined central area, which is a central field of vision of the driver based on the visual axis of the driver when the driver is seated in the driver's seat of the vehicle and has his / her line of sight directed forward, a predetermined effective area that is provided outside the central area and corresponds to the effective field of vision of the driver, and an induction area that is a predetermined area that is provided outside the effective area and corresponds to the induction field of vision of the driver, A display range in which the virtual image is displayed overlaps at least the central region, The head-up display system is characterized in that, when the virtual image is displayed in the display range and the driver's line of sight is located in the guidance area, the head-up display device changes to a guidance display mode in which a guidance virtual image, which is a virtual image different from the virtual image displayed in the display range, is displayed in a portion including at least a part of the outer frame of the display range, thereby guiding the driver's line of sight from the guidance area side to the central area side.

2. the head-up display device changes the display mode depending on a position of the line of sight relative to the central area and the effective area, when the line of sight of the driver is located in the central region when the virtual image is displayed in the display range, the head-up display device changes to a normal display mode in which the virtual image is normally displayed in a predetermined normal display manner, 2. The head-up display system according to claim 1, wherein when the driver's line of sight is located in the effective area, the display mode is changed to an emphasis display mode in which the virtual image is highlighted in an emphasis display manner that is more emphasized than the normal display manner when the driver's line of sight is located in the central area.

Images