Vehicle display device

Abstract

Provided is a vehicle display device that, if switching between and displaying a virtual image and a real image, allows a viewer to easily recognize the positions of the individual display images. The present invention is provided with: a first HUD device (100) that switches between and displays a first image (S1) and a second image (S2), the first image (S1) being visually recognized by an occupant (DR) as a first virtual image (VI1) at a first display site (X1) frontwards of a windshield (WS1) of a vehicle (C), and the second image (S2) being visually recognized by the occupant (DR) as a real image (RI) at a second display site (X2) rearwards from the windshield (WS1); a second HUD device (200) that displays a third image (S3) visually recognized at a third display site (X3) at a position in the visual field of the occupant (DR) between the first display site (X1) and the second display site (X2) and below the first display site (X1) and the second display site (X2); and a third control unit (300). The third control unit (300) executes a third image display process for displaying the third image (S3) in a prescribed period including a timing at which the displaying of the first image (S1) and the displaying of the second image (S2) are switched between.

Description

Display device for vehicle

[0001] The present invention relates to a head-up display device that performs desired display while switching between a virtual image and a real image for a viewer.

[0002] Conventionally, for example, a head-up display device described in Patent Document 1 is known. This head-up display device has a configuration in which a display image displayed on a screen by light from a display is reflected to a translucent member, and changes the front-rear positional relationship between the optical focal point of an imaging optical system and the screen. Accordingly, display switching is performed between a state where a virtual image is visually recognized outside the translucent member (outside the vehicle) and a state where a real image is visually recognized inside the translucent member (inside the vehicle).

[0003] Japanese Unexamined Patent Publication No. 2011-70074

[0004] However, when a virtual image is visually recognized outside the vehicle and a real image is visually recognized inside the vehicle, both are visually recognized in the air as viewed from the viewer, so when the respective display images are switched, Although the viewer notices the change of the display image, there has been a problem that it is difficult to instantly recognize at which position the display image is displayed, including whether the position is inside or outside.

[0005] Therefore, the present invention has been made in view of the above problems, and an object of the present invention is to provide a display device for a vehicle that allows a viewer to easily recognize the position of each display image when switching between a virtual image and a real image for display.

[0006] The present invention relates to a first display unit 100 provided in a vehicle C, which emits image light L toward a light-transmitting member WS1 of the vehicle C, thereby switching between displaying a first image S1, which is perceived as a virtual image VI1 by the occupant DR in a first display area X1 located in front of the vehicle C relative to the light-transmitting member WS1, and a second image S2, which is perceived as a real image RI by the occupant DR in a second display area X2 located in rear of the vehicle C relative to the light-transmitting member WS1; and a third display area X3 provided in the vehicle C, located between the first display area X1 and the second display area X2 in the occupant DR's field of view and below each of them. The system includes a second display unit 200 that displays a third image S3 visible to the user, and a third control unit 300 that controls the first display unit 100 and the second display unit 200 in coordination. The third control unit 300 is characterized by performing a display switching process that switches the display so that the first image S1 is displayed in a predetermined first state and the second image S2 is displayed in a predetermined second state, and a third image display process that displays the third image S3 for a predetermined period including the timing of the switch between the display of the first image S1 and the display of the second image S2 as a result of the display switching process.

[0007] According to the present invention, a third image is displayed during a predetermined period that includes the timing of the switch between the display of a first image, which is perceived as a virtual image, and a second image, which is perceived as a real image, making it easier to recognize the display positions of the first and second images.

[0008] A diagram showing the configuration when a virtual image is displayed in a vehicle display device according to the first embodiment of the present invention. A diagram showing the configuration when a real image is displayed in a vehicle display device according to the first embodiment of the present invention. A schematic diagram showing the structure of the PGU in the vehicle display device. A functional block diagram showing the functional configuration of the third control unit. A diagram explaining how the first and second images appear when the seat changes from a driving position to a relaxed position. A diagram explaining how the first and second images appear when the seat remains in the driving position and does not change. A diagram showing the display state of the first image. A diagram showing the display state of the third image. A diagram showing the display state of the second image. A diagram showing the state in which the third image of Figure 6B and the second image of Figure 6C are displayed simultaneously. A diagram showing the case where the shadow of the object to be displayed in the second image is displayed in the third image. A diagram showing the case where a base that supported the object to be displayed in the second image is displayed in the third image. A diagram showing the case where the audio subtitles of the character in the second image are displayed in the third image. A first diagram showing how the character displayed as the second image slides in from bottom to top into the area of ​​the second display part. The second figure shows how the character displayed as the second image slides in from bottom to top within the area of ​​the second display part. The third figure shows how the character displayed as the second image slides in from bottom to top within the area of ​​the second display part. A flowchart showing the operation of the vehicle display device according to the first embodiment of the present invention. The first figure shows an example of the display mode of the third image in the vehicle display device according to the second embodiment of the present invention. The second figure shows an example of the display mode of the third image, showing the display state immediately before the second image is displayed when the third image is displayed after the first image is displayed and then the second image is displayed. The second figure shows an example of the display mode of the third image, showing a display state in which the third image is displayed in the upper area of ​​the third display part with a reduced image size at the timing when the seat is in a relaxed position, or around that timing. The third figure shows an example of the display mode of the third image. The fourth figure shows an example of the display mode of the third image. The first figure shows the process of transitioning from the display state of the first image to the display state of the second image in the vehicle display device according to the third embodiment of the present invention.The second figure shows the process of transitioning from the display state of the first image to the display state of the second image, and the first figure shows the process of the first image becoming hidden. The second figure shows the process of transitioning from the display state of the first image to the display state of the second image, and the second figure shows the process of the first image becoming hidden. The third figure shows the process of transitioning from the display state of the first image to the display state of the second image. The fourth figure shows the process of transitioning from the display state of the first image to the display state of the second image. The fifth figure shows the process of transitioning from the display state of the first image to the display state of the second image, and the first figure shows the process of the second image becoming displayed. The fifth figure shows the process of transitioning from the display state of the first image to the display state of the second image, and the second figure shows the process of the second image becoming displayed. The sixth figure shows the process of transitioning from the display state of the first image to the display state of the second image.

[0009] (First Embodiment of the Present Invention) Hereinafter, a first embodiment of the present invention will be described with reference to the drawings. Figure 1 is a diagram showing the configuration when a virtual image is displayed in the vehicle display device according to this embodiment, and Figure 2 is a diagram showing the configuration when a real image is displayed in the vehicle display device according to this embodiment.

[0010] In Figures 1 and 2, the vehicle display device 1 comprises a first head-up display device (hereinafter referred to as the first HUD device) 100, which is a first display; a second head-up display device (hereinafter referred to as the second HUD device) 200, which is a second display; and a third control unit 300 that controls these in coordination.

[0011] The first HUD device 100 comprises a light source 11 that emits white light, which is made of a light-emitting diode that emits visible wavelength light mounted on a wiring board, for example, and a first display unit 12 that generates display light L (in the case of Figure 1, display light L1 representing the display image of the first virtual image VI1, which is the first image S1; in the case of Figure 2, display light L2 representing the display image of the real image RI, which is the second image S2) (image light) with light incident from the light source 11, and displays by switching the polarization of the emitted light between a first polarization and a second polarization which are different from each other.

[0012] Furthermore, the first HUD device 100 includes a reflecting unit 13 that reflects the display light L emitted from the PGU 10 toward the window shield WS1 (light-transmitting member), and a first control unit 15 that controls the content of the display light L (content of the first virtual image VI1, content of the real image RI) generated by at least the first display unit 12 of the PGU 10, and controls the switching between the first polarization and the second polarization. The PGU 10, the reflecting unit 13, and the first control unit 15 are housed in a housing 16. The housing 16 is provided with an opening 17 (emission port) from which the display light L is emitted, and a cover glass 18 is placed in the opening 17 to protect the inside. The window shield WS1 is an example of a light-emitting member.

[0013] The first HUD device 100 is positioned below the windshield WS1 of the vehicle C (for example, inside the instrument panel (hereinafter referred to as the instrument panel IP)) and emits display light L (L1, L2) to irradiate the windshield WS1. The display light L is generated in the PGU 10 inside the first HUD device 100. The display light L emitted from the PGU 10 travels through the reflector 13 and is irradiated onto the windshield WS1 through the cover glass 18 from the opening 17 of the housing 16.

[0014] The occupant DR of vehicle C can perceive, by viewing the display light L reflected from the windshield WS1, a first image S1 which is perceived as a first virtual image VI1 as shown in Figure 1 at a first display area X1 located in front of the vehicle C (outside the vehicle C) relative to the windshield WS1, and a second image S2 which is perceived as a real image RI as shown in Figure 2 at a second display area X2 located behind the vehicle C (inside the vehicle C) relative to the windshield WS1.

[0015] The first image S1, which is perceived as the first virtual image VI1 shown in Figure 1, displays information that is highly necessary to draw the attention of the occupant DR, such as vehicle information like the vehicle's speed and engine RPM, remaining energy, route guidance displays such as turn-by-turn directions and maps, blind spot indicators, and warning displays such as speed limit exceeding warnings, on the other side of the windshield WS1 (outside of vehicle C) from the occupant DR's perspective. The second image S2, which is perceived as the real image RI shown in Figure 2, displays information such as entertainment content, assistants and agents that support the occupant DR, characters representing them, information about autonomous / manual driving, and opening effects when the engine starts, on the in front of the windshield WS1 (inside of vehicle C) from the occupant DR's perspective.

[0016] The display of the first image S1 and the second image S2 as described above provides a driving environment that reduces the need for viewpoint movement and adjustment of the eye's focal length. In addition to the text and icons indicating the above information, the first image S1 and the second image S2 also include a background area, which, in a plan view from the occupant driver's view (DR), forms a roughly rectangular shape.

[0017] Here, the configuration of the PGU 10, which consists of a light source 11 and a first display unit 12, will be described. Figure 3 is a schematic diagram showing the structure of the PGU 10 in the vehicle display device 1 according to this embodiment. As shown in Figure 3, in the PGU 10, the first display unit 12 is provided on the exit side along the optical path from the light source 11. The first display unit 12 includes, for example, a TFT (Thin Film Transistor) type display element 121 and a switching element 122 provided on the exit side along the optical path from the display element 121, which switches the polarization of the emitted display light L between a first polarization and a second polarization that are different from each other.

[0018] For example, the first polarization may be S-polarized and the second polarization may be P-polarized, or vice versa. Furthermore, it is not limited to S-polarized or P-polarized light; it is sufficient if the polarization angles of the first and second polarizations are different, and it is desirable that the polarization angles differ by at least 22.5 degrees.

[0019] Furthermore, as shown in Figures 1 and 2, it is desirable that the first display unit 12 be positioned at an angle with respect to the optical axis direction of the display light L in order to take measures to exclude stray light (light leaking from the light source 11) and ambient light (light coming in from outside) from the optical path of the display light L.

[0020] The display element 121 is connected to the display control unit 43, which will be described later in Figure 4, and forms light representing a figure of any shape according to the signal sent from the display control unit 43. The switching element 122 extracts only the light rays with specific polarizations, specifically the first and second polarizations mentioned above, from the light rays emitted from the display element 121, and performs a process to switch them. The switching element 122 is connected to the switching processing unit 42, which will be described later in Figure 4, and switches the polarization according to the signal sent from the switching processing unit 42.

[0021] The polarization switching by the switching element 122 may be performed by electrical processing, or the polarization may be switched by physically rotating a polarizing plate or waveplate on the output side of the display element 121 at a predetermined angle with respect to the central axis, with the optical axis direction as the central axis direction. In either case, the polarization switching is performed by the control of the display unit drive unit 126.

[0022] The reflective section 13 includes a first mirror 131, a second mirror 132, and a third mirror 133, each having a concave shape. The first mirror 131 reflects the first polarized display light L1 and transmits the second polarized display light L2. The second mirror 132 is a mirror that reflects the display light L2 that passes through the first mirror 131. The display lights L1 and L2 reflected by the first mirror 131 and the second mirror 132 are guided to the third mirror 133, reflected by the third mirror 133, and projected onto the windshield WS1, allowing the occupant DR to view the respective display images.

[0023] Although the first display unit 12 actually emits countless rays of light, for the sake of simplicity, the light emitted from the center of the first display unit 12 and passing through the center of the eye box will be referred to as the representative ray and represented by the symbol L.

[0024] Furthermore, as shown in Figure 2, since the first mirror 131 is a mirror that transmits display light L2, the display light L2 reflected by the second mirror 132 can naturally also be transmitted from the back side where the second mirror 132 is located to the front side. That is, as shown in Figure 2, the display light L2 that has passed through the first mirror 131 is reflected by the second mirror 132 and then passes through the first mirror 131 again to be guided to the third mirror 133. As a result, it is possible to place the second mirror 132 close to the back side of the first mirror 131, thereby preventing the housing 16 from becoming larger.

[0025] Here, for example, the first polarization is S-polarized (S-polarized relative to the first mirror 131), and the second polarization is P-polarized (P-polarized relative to the first mirror 131). The first mirror 131 is a mirror that reflects S-polarized light rays and transmits P-polarized light rays relative to the first mirror 131, and the second mirror 132 is a mirror that reflects P-polarized light rays and transmits S-polarized light rays relative to the first mirror 131. In this configuration, the display light L1, which is S-polarized, is reflected by the first mirror 131 and guided to the third mirror 133. The display light L2, which is P-polarized, is transmitted through the first mirror 131, reflected by the second mirror 132, and guided to the third mirror 133. By configuring the reflective section 13 in this way and setting the polarization of the display lights L1 and L2, it becomes possible to generate different display images with each of the display lights L1 and L2.

[0026] The display image represented by the display light L1 in Figure 1 and the display image represented by the display light L2 in Figure 2 will be explained in detail. As shown in Figure 1, when the display light L1, which is first polarized (here referred to as S-polarized) light, is emitted to the first mirror 131, the first mirror 131, the third mirror 133, and the windshield WS1 are considered as a single imaging optical system, and its combined focal point F is positioned in front of the PGU 10. In this arrangement, the display light L1 is imaged on the outside of the vehicle C, with the windshield WS1 in between, and the first image S1, which is viewed by the occupant DR as the first virtual image VI1, is displayed on the distant first display area X1.

[0027] On the other hand, as shown in Figure 2, when display light L2, which is second polarization (here referred to as P polarization), is emitted to the second mirror 132, and the second mirror 132, the third mirror 133, and the windshield WS1 are considered as a single imaging optical system, its combined focal point F is positioned after the PGU 10. In this arrangement, the display light L2 is imaged on the inside of the vehicle C with the windshield WS1 in between, and the second image S2, which is viewed by the occupant DR as a real image RI, is displayed in the second display area X2 directly in front of the occupant DR.

[0028] In other words, for example, if it is desired to display a first image S1 that is visible as a first virtual image VI1 on the outside of the windshield WS1 from the perspective of the crew DR, the switching element 122 of the first display unit 12 switches the display light L to emit display light L1 which is S-polarized, and the imaging optical system composed of the first mirror 131, the third mirror 133, and the windshield WS1 displays the display image represented by the display light L1 on the windshield WS1. Also, for example, if it is desired to display a second image S2 that is visible as a real image RI on the inside of the windshield WS1 from the perspective of the crew DR, the switching element 122 of the first display unit 12 switches the display light L to emit display light L2 which is P-polarized, and the imaging optical system composed of the second mirror 132, the third mirror 133, and the windshield WS1 displays the display image represented by the display light L2 on the windshield WS1.

[0029] The second HUD device 200 comprises a light source 21 that emits white light, for example, from a light-emitting diode mounted on a wiring board that emits light in the visible wavelength range; a second display unit 22 that generates display light L3 from the light incident from the light source 21 and has, for example, a TFT-type display element; and a second control unit 25 that controls the content of the display light L3, the ejection position and ejection timing, etc. Here, the second display unit 22 may be arranged in parallel in the left-right direction of the vehicle C as needed. The light source 21, the second display unit 22 and the second control unit 25 are housed in a housing 26. The housing 26 is provided with an opening 27 (ejector) from which the display light L3 is ejected, and a cover glass 28 is placed in the opening 27 to protect the inside.

[0030] The second HUD device 200 is positioned inside the instrument panel IP below the black ceramic portion WS2 (hereinafter referred to as the black ceramic portion WS2) (opaque portion) of the windshield WS1 of the vehicle C, and emits display light L3, which is irradiated onto the black ceramic portion WS2. The display light L3 is generated in the second display unit 22 inside the second HUD device 200. The display light L3 emitted from the second display unit 22 is irradiated onto the black ceramic portion WS2 through the cover glass 28 from the opening 27 of the housing 26.

[0031] The occupant DR of vehicle C can see the display light L3 reflected from the black ceramic part WS2, thereby seeing the third image S3, which is perceived as a second virtual image VI2 as shown in Figures 1 and 2, at the third display area X3 located in front of the vehicle C (outside the vehicle C) from the black ceramic part WS2. The second virtual image VI2 is formed near the windshield WS1 on the outside of the vehicle C, depending on the distance from the second display unit 22 to the black ceramic part WS2. That is, the third display area X3 on which the third image S3 perceived as a second virtual image VI2 is displayed is located between the first display area X1 on which the first image S1 perceived as a first virtual image VI1 is displayed and the second display area X2 on which the second image S2 perceived as a real image RI is displayed, with respect to the front-rear direction of vehicle C. Furthermore, since the third display area X3 is closer to the light-transmitting member WS1 (black ceramic part WS2) than the first display area X1, it is perceived by the occupant DR as if it were displayed at the position of the black ceramic part WS2. Moreover, as shown in Figures 1 and 2, the second HUD device 200 is positioned so that the third image S3 is displayed at the lower black ceramic part WS2 of the windshield WS1. Therefore, the third display area X3 on which the third image S3 is displayed is located below the first display area X1 and the second display area X2 in the height direction.

[0032] The third image S3, which is perceived as the second virtual image VI2, displays information that is highly relevant to the second image S2, which is perceived as the real image RI (details will be described later), as well as information that is an iconized version of the information displayed in the second image S2, or information that represents only some functions, is reduced in size, or is omitted. By displaying the third image S3 at the timing of switching from the display of the first image S1 to the display of the second image S2, a driving environment is provided that reduces the need for viewpoint movement and adjustment of the eye's focal length.

[0033] Although countless rays of light actually emanate from the second display unit 22, for the sake of simplicity, the light emitted from the center of the second display unit 22 and passing through the center of the eye box will be referred to as the representative ray and represented by the symbol L.

[0034] As shown in Figures 1 and 2, when the second display unit 22 emits display light L3, and the second display unit 22 and the black ceramic unit WS2 are considered as a single imaging optical system, the combined focal point F is positioned in front of the second display unit 22. In this arrangement, the display light L3 is imaged on the outside of the vehicle C, with the black ceramic unit WS2 in between, and a third image S3, which is viewed by the occupant DR as a second virtual image VI2, is visible at the third display area X3 near the black ceramic unit WS2.

[0035] The third control unit 300 works in conjunction with the first control unit 15 and the second control unit 25 to control the first HUD device 100 and the second HUD device 200. The configuration and functions of the third control unit 300 will be described in detail below. Each of the control units of the first control unit 15, the second control unit 25, and the third control unit 300 is composed of a computer equipped with a CPU that executes various programs stored in advance while utilizing the temporary storage function of memory, a memory consisting of a storage device with RAM and ROM, and an IC chip suitable for controlling display devices, etc.

[0036] The third control unit 300, in cooperation with the first control unit 15 of the first HUD device 100, performs at least the switching control of the PGU 10 on / off, the control of the display content on the first display unit 12, and the switching control of the first and second polarizations by the switching element 122. Furthermore, the third control unit 300, in cooperation with the second control unit 25 of the second HUD device 200, performs at least the switching control of the second display unit 22 on / off, and the control of the display content on the second display unit 22.

[0037] Figure 4 is a functional block diagram showing the functional configuration of the third control unit 300 in the vehicle display device 1 according to this embodiment. The third control unit 300 includes a detection unit 41 that detects the switching between automatic driving mode and manual driving mode of the vehicle C, a switching processing unit 42 that switches the display of a first image S1 that is perceived as a first virtual image VI1 and a second image S2 that is perceived as a real image RI according to the detection result of the detection unit 41, a black ceramic image display processing unit 44 that displays a third image S3 that is perceived as a second virtual image VI2 in conjunction with the switching of the display of the first image S1 and the second image S2, and a display control unit 43 that controls the display content of the first image S1, the second image S2, and the images displayed on the black ceramic unit WS2 (including the third image S3 and other images described later).

[0038] The detection unit 41 acquires information regarding the position or orientation of the seat 50 (seat), which is switched in response to the switching between the manual driving mode and the automatic driving mode of the vehicle C (for example, the reclining angle of the backrest 52 described later, the front-to-back sliding position of the seat 51, etc.), from the measurement sensor 40 as external information 45, and detects the timing of the switch between the automatic driving mode and the manual driving mode. This process performed by the detection unit 41 is an example of angle detection processing.

[0039] In addition to information on the position or orientation of the seat 50, the detection unit 41 may also acquire and detect external information 45, such as the driver mode switch operated by the occupant driver (DR), whether the vehicle is traveling on a highway or on a regular road, or whether it is stopped or moving.

[0040] The switching processing unit 42 switches the display state from the first image S1 to the second image S2 based on the detection information from the detection unit 41 (i.e., switches the display light L emitted by the PGU 10 from S-polarized display light L1 to P-polarized display light L2), or switches the display state from the second image S2 to the first image S1 (i.e., switches the display light L emitted by the PGU 10 from P-polarized display light L2 to S-polarized display light L1). This process performed by the switching processing unit 42 is an example of a display switching process.

[0041] Here, the state of the seat 50 when switching from the display of the first image S1 to the display of the second image S2 will be explained using Figures 5A and 5B. Figures 5A and 5B are diagrams illustrating how the first image S1 and the second image S2 appear depending on the state of the seat 50. Figure 5A shows how the first image S1 and the second image S2 appear when the seat 50 changes from the driving position (seat state during normal driving) (first predetermined state) to the relaxation position (a state in which the reclining angle of the backrest 52 is greater than that of the driving position, or the seat 51 is moved backward, or both) (second predetermined state), and Figure 5B shows how the first image S1 and the second image S2 appear when the seat 50 remains in the driving position and does not change.

[0042] As shown in Figure 5A, as the seat 50 changes from the driving position to the relaxation position, the driving mode of the vehicle C switches from manual driving mode to automatic driving mode, and the display state changes from the first image S1 to the second image S2. In this case, in the relaxation position, the occupant DR's line of sight is upward, so the second image S2 is displayed at a higher position than the first image S1. Therefore, even if the second image S2 is displayed while the first image S1 is displayed, they will not overlap.

[0043] On the other hand, as shown in Figure 5B, when the seat 50 remains in the driving position and the driving mode of the vehicle C switches from manual driving mode to automatic driving mode, and the display state changes from the first image S1 to the second image S2, the position of the occupant DR's line of sight does not change, so the first image S1 and the second image S2 may overlap.

[0044] That is, when the position of the seat 50 changes between the display state of the first image S1 and the display state of the second image S2, there may be a display mode in which the first image S1 and the second image S2 are displayed simultaneously. When the position of the seat 50 does not change between the display state of the first image S1 and the display state of the second image S2, it is preferable not to adopt a display mode in which the first image S1 and the second image S2 are displayed simultaneously.

[0045] In the present embodiment, the position of the seat 50 changes between the display state of the first image S1 and the display state of the second image S2. The detection unit 41 detects the state of the seat 50, and switching processing by the switching processing unit 42 is executed based on the detection result of the detection unit 41.

[0046] The black cell image display processing unit 44 controls such that, in a predetermined period including the timing of switching between the display of the first image S1 and the display of the second image S2 by the switching processing unit 42, the second display unit 22 of the second HUD device 200 displays a third image S3 (which includes other images described later, and is referred to as the third image S3 in the present embodiment) visually recognized as the second virtual image VI2. That is, control is performed such that switching from the state in which the first image S1 is displayed to the display of the second image S2 is performed via the display of the third image S3 on the black cell portion WS2 (specific details of the display transition will be described later). Note that the switching processing unit 42 and the black cell image display processing unit 44 cooperate with each other, thereby enabling control while associating the display / non-display of each of the first image S1, the second image S2, and the third image S3. The processing performed by this black cell image display processing unit 44 is an example of third image display processing.

[0047] The display control unit 43 controls the display content of the PGU 10 of the first HUD device 100 and the second display unit 22 of the second HUD device 200 based on information input from various devices 46 including a memory and the like. Specifically, the display control unit 43 uses information sent from various devices 46 such as a vehicle speed sensor, a navigation device, RADAR (Radio Detecting and Ranging), LiDAR (Light Detection and Ranging, Laser Imaging Detection and Ranging) and content information registered in advance in a memory or the like, and outputs control signals to the PGU 10 and the second display unit 22 to generate image light representing a graphic of any shape. Then, the PGU 10 and the second display unit 22 generate and emit display light L that forms a desired display image (the first virtual image VI1, the second virtual image VI2, the real image RI).

[0048] Hereinafter, the processing of the switching processing unit 42 and the black cellera image display processing unit 44 performed by the third control unit 300 will be specifically described. FIGS. 6A to 6C are schematic diagrams showing display states when switching from the display of the first image S1 visually recognized as the first virtual image VI1 to the display of the second image S2 visually recognized as the real image RI. FIG. 6A shows the display state of the first image S1, FIG. 6B shows the display state of the third image S3, and FIG. 6C shows the display state of the second image S2. As described above, when the seat 50 changes from the driving position to the relaxed position, the driving mode of the vehicle C is switched from the manual driving mode to the automatic driving mode, and accordingly, the display state transitions from the display state of FIG. 6A through the display state of FIG. 6B to the display state of FIG. 6C.

[0049] In Figure 6A, S-polarized display light L1 is emitted from the PGU 10 toward the windshield WS1, and a first image S1, which is perceived as a first virtual image VI1, is displayed on the first display area X1 located in front of (outside of) the windshield WS1 of the vehicle C (in Figure 6A, speed information is displayed as the first image S1). When the detection unit 41 detects a change in the position of the seat 50, the switching processing unit 42 issues a command to the first control unit 15 of the first HUD device 100 to switch the S-polarized display light L1 emitted from the PGU 10 to P-polarized display light L2. At this time, if the display light L emitted from the PGU 10 is switched instantaneously from S-polarized display light L1 to P-polarized display light L2, it becomes difficult for the occupant DR to recognize the display position of the second image S2. Therefore, as will be described later, the PGU 10 is controlled based on the command of the switching processing unit 42 so that there is a period of time during which the third image S3 by the second HUD device 200 is displayed.

[0050] At this switching timing, the black ceramic image display processing unit 44 issues a command to the second control unit 25 of the second HUD device 200 to display the third image S3 on the third display area X3 of the black ceramic part WS2 using the second virtual image VI2 formed by the display light L3 emitted from the second display unit 22 (in Figure 6B, the time is displayed as the third image S3). Then, after a predetermined time has elapsed (for example, several seconds to tens of seconds), the black ceramic image display processing unit 44 issues a command to the second control unit 25 of the second HUD device 200 to turn off the display light L3 emitted from the second display unit 22, and the switching processing unit 42 issues a command to the first control unit 15 of the first HUD device 100 to display the second image S2 on the second display area X2 using a real image RI generated by the display light L2 emitted from the PGU 10 (in Figure 6C, the second image S2 is displayed as an icon representing the virtual personal assistant (VPA) that supports the occupant DR on the left and a pattern indicating that it is in automatic driving mode on the right). This completes the switch from the display of the first image S1 to the display of the second image S2 via the display of the third image S3.

[0051] Furthermore, there may be a period during which the display of the third image S3 in Figure 6B and the display of the second image S2 in Figure 6C are displayed simultaneously. Figure 7 shows a state in which the third image S3 in Figure 6B and the second image S2 in Figure 6C are displayed simultaneously. As shown in Figure 7, the switching processing unit 42 may issue a command to control the second display unit 22 and the PGU 10 so that the display of the second image S2 in Figure 6C is started while the third image S3 in Figure 6B is being displayed. Also, the timing for hiding the third image S3 is arbitrary; for example, it may be hidden immediately after a predetermined time has elapsed as described above, or the third image S3 may be displayed simultaneously with the second image S2 at least while the second image S2 is being displayed. In other words, the third image S3 is displayed during a predetermined period that includes the timing when the display of the first image S1 and the display of the second image S2 switch.

[0052] Furthermore, it is desirable that the third image S3, which is displayed under the control of the second control unit 25 in the second HUD device 200, is related to the display content of the second image S2, which is displayed under the control of the first control unit 15 in the first HUD device 100. For example, as shown in Figures 8A to 8C, if an arbitrary display object is displayed in the second image S2, the third image S3 may display an image of the shadow of that display object (see Figure 8A) or an image of a base that supported the display object (see Figure 8B). In addition to this, for example, if a predetermined person or character is displayed in the second image S2, the third image S3 may display an image of their audio subtitles (see Figure 8C) or an image of information about that person or character (such as their name or profile). When representing the shadow of a display object in the third image S3, it may be represented as a schematic shadow of the display object displayed in the second image S2 (a shadow simplified into a simple shape such as an ellipse as shown in Figure 8A), or it may be represented as a realistic shadow that looks like the display object displayed in the second image S2 projected downwards. Regarding the display of shadows in the third image S3, the display object may be displayed as a shadow with a color tone that is like the object color of the display object shown in the second image S2 mixed with black.

[0053] Furthermore, as shown in Figures 9A to 9C, for example, when the PGU 10 displays a second image S2, which is visually perceived as a real image RI, on the second display area X2 under the control of the first control unit 15 in the first HUD device 100, it is desirable that the PGU 10 displays the second image S2 so that it slides in upward from the third display area X3, which is located below the second display area X2. In the example shown in Figures 9A to 9C, from Figure 9A to Figure 9C, the character displayed as the second image S2 on the second display area X2 appears sliding in upward from below within the area of ​​the second display area X2.

[0054] Furthermore, although the above describes a configuration in which the third image S3, which is perceived as the second virtual image VI2, is displayed by the second HUD device 200, it is also possible to directly install, for example, a TFT-type second display unit 22 on the third display area X3 where the third image S3 is to be displayed, without using a HUD device. In that case, the display image perceived by the occupant DR will not be the second virtual image VI2, but the display image directly displayed on the second display unit 22.

[0055] Furthermore, although the above describes a configuration in which the third image S3 is displayed on the third display area X3 of the black ceramic part WS2 located at the lower end of the windshield WS1, the third display area X3 may be provided at any location between the first display area X1 where the first image S1 is displayed and the second display area X2 where the second image S2 is displayed in the front-rear direction of the vehicle C, and below each of the display areas in the height direction of the vehicle C.

[0056] Furthermore, in order to avoid hindering the visibility of the second image S2, which is perceived as a real image RI, it is desirable that the third image S3 be displayed with at least lower brightness, lower saturation, or lower lightness than the second image S2.

[0057] Next, the operation of the vehicle display device 1 according to this embodiment will be described. Figure 10 is a flowchart showing the operation of the vehicle display device 1 according to this embodiment. First, when the vehicle C is started and driving in manual driving mode begins, the first control unit 15 of the first HUD device 100 controls the PGU 10 based on a command from the third control unit 300 to display the first image S1, which is perceived as the first virtual image VI1, on the first display area X1 (S1). The detection unit 41 determines whether it has detected a change in the position of the seat 50 in accordance with the change in driving mode (S2). If it has not detected a change, it returns to S1 and the display of the first image S1 continues. If it has detected a change, the first control unit 15 of the first HUD device 100 controls the PGU 10 to hide the first image S1 based on a command from the switching processing unit 42 of the third control unit 300 (S3).

[0058] The black ceramic image display processing unit 44, at the timing when the first image S1 is hidden, issues a command to the second control unit 25 in the second HUD device 200 to control the second display unit 22 and display the third image S3, which is perceived as the second virtual image VI2, in the third display area X3 (S4). Then, based on the command from the switching processing unit 42, while the third image S3 is displayed, or when the third image S3 is hidden, the first control unit 15 in the first HUD device 100 controls the PGU 10 to display the second image S2, which is perceived as the real image RI, in the second display area X2 (S5). In this case, if the second image S2 is displayed while the third image S3 is displayed, the third image S3 may be hidden at any timing after the second image S2 is displayed, or the third image S3 may be displayed simultaneously at least while the second image S2 is displayed (these display transitions will be described in detail later in the second and third embodiments).

[0059] The detection unit 41 determines whether it has detected a change in the seat position 50 in accordance with the change in driving mode (S6). If it has not detected a change, the process returns to S5 and the display of the second image S2 continues. If it has detected a change, the first control unit 15 in the first HUD device 100 controls the PGU 10 to hide the second image S2 (S7) based on a command from the switching processing unit 42 of the third control unit 300, and the process returns to S1 to display the first image S1. The above process is repeated until the engine of vehicle C is stopped or the power supply is cut off.

[0060] In the above description, a configuration was explained in which the first control unit 15 controls the PGU 10 of the first HUD device 100, the second control unit 25 controls the second display unit 22 of the second HUD device 200, and the third control unit 300 controls the entire vehicle display device 1 in cooperation with the first control unit 15 and the second control unit 25. However, the hardware configuration of the control unit only needs to be such that at least one control unit controls both the first HUD device 100 and the second HUD device 200, or that a control unit in one of the HUD devices controls the other device as well.

[0061] Furthermore, in the second HUD device 200, if a plurality of second display units 22 are installed in the width direction of the vehicle C, each may have its own control unit, and these units may work together to control the plurality of second display units 22, or a single control unit may control the plurality of second display units 22.

[0062] As described above, the vehicle display device 1 according to this embodiment includes a first HUD device 100 that is installed in a vehicle C and emits display light L toward the windshield WS1 of the vehicle C, thereby switching and displaying a first image S1 which is perceived by the occupant DR as a first virtual image VI1 in a first display area X1 located in front of the vehicle C beyond the windshield WS1, and a second image S2 which is perceived by the occupant DR as a real image RI in a second display area X2 located in rear of the vehicle C beyond the windshield WS1, and a HUD device 100 installed in the vehicle C that displays the position between the first display area X1 and the second display area X2 in the field of view of the occupant DR. The system includes a second HUD device 200 which displays a third image S3, which is perceived as a second virtual image VI2, in a third display area X3 located below each of the first HUD devices 100 and the second HUD device 200, and a third control unit 300 which controls the first HUD device 100 and the second HUD device 200 in coordination. The third control unit 300 performs a display switching process which switches the display so that it displays a first image S1 in manual driving mode and a second image S2 in automatic driving mode, and a black ceramic image display process which displays the third image S3 for a predetermined period including the timing of the switch between the display of the first image S1 and the display of the second image S2 due to the display switching process.

[0063] In this way, the third image S3, which is perceived as the second virtual image VI2, is displayed between the first image S1, which is perceived as the first virtual image VI1, and the second image S2, which is perceived as the real image RI. This causes the occupant DR's line of sight to move from the first display area X1 to the third display area X3, which is located between the first and second display areas X1 and below each of them, and then to the second display area X2. This makes it easier for the occupant DR to recognize that the first image S1 is in the background and the second image S2 is in the foreground. In other words, when displaying the second image S2, emphasizing a sense of floating or depth in the area near the second display area X2 makes it easier for the occupant DR to recognize the display position of the second image S2.

[0064] Furthermore, if necessary, the third control unit 300 executes display switching processing and black ceramic image display processing so that the display of the second image S2 starts when the third image S3 is displayed as if it were displayed at the position of the black ceramic part WS2, making it easier for the occupant DR to perceive the proximity and interior of the second image S2.

[0065] Furthermore, if necessary, the second HUD device 200 emits display light L3 toward the black ceramic portion WS2 of the windshield WS1 to display a third image S3 that is perceived as a second virtual image VI2 by the occupant DR at the third display area X3 located in front of the vehicle C, relative to the windshield WS1. Thus, the second HUD device 200 displays the third image S3 that is perceived as a second virtual image VI2 using the same principle as the first HUD device 100, making the perceived value of the third image S3 the same as that of the first image S1 and the second image S2, thereby preventing the occupant DR from feeling any discomfort.

[0066] Furthermore, if necessary, the third control unit 300 controls the second HUD device 200 in the black ceramic image display processing so that the occupant DR can view the third image S3 with the black ceramic portion WS2 located at the end of the windshield WS1 as the background, thereby improving the visibility of the third image S3 and making it easier to distinguish it from the first image S1 and the second image S2.

[0067] Furthermore, if necessary, the third control unit 300 controls the second HUD device 200 in the black ceramic image display processing so that the third image S3 is displayed with lower brightness, lower saturation, or lower lightness than the second image S2. This ensures that displaying the third image S3 does not visually interfere with the display of the first image S1 or the second image S2. In addition, it is possible to make the second image S2 stand out and draw attention to it in particular.

[0068] Furthermore, if necessary, the third control unit 300 controls the second HUD device 200 in the black ceramic image display processing so that the third image S3 displays information related to the second image S2, thereby helping the third image S3 to understand the content of the second image S2. In particular, in the case of text, the third image S3 is easier to see when displayed on the black ceramic section WS2, which has a black background.

[0069] Furthermore, if necessary, when the third control unit 300 displays the second image S2 in the display switching process so that it is visible to the second display area X2, it slides the second image S2 upward from the third display area X3, which is located below the second display area X2, thereby clarifying the relationship between the second image S2 and the third image S3, and allowing the occupant driver (DR) to view them as a series of images.

[0070] (Second Embodiment of the Invention) A second embodiment of the invention will be described with reference to Figures 11 to 14. In this embodiment, with respect to the vehicle display device 1 described in the first embodiment, the display mode of the third image S3 displayed on the black ceramic part WS2 is made variable, thereby improving the visibility for the occupant DR, who is the viewer. In this embodiment, explanations that overlap with the first embodiment will be omitted.

[0071] In the vehicle display device 1 according to this embodiment, as described in the first embodiment, the display switches from the first image S1 to the second image S2 via the third image S3 at the timing when the driving mode of the vehicle C switches from manual driving mode to automatic driving mode, that is, when the seat 50 changes from the driving position to the relaxed position. In the following description of this embodiment, assuming that the third image S3 continues to be displayed even after the second image S2 is displayed, the patterns of the display of the third image S3 will be described with specific examples.

[0072] Figure 11 is a first diagram showing an example of the display mode of the third image S3 in the vehicle display device 1 according to this embodiment. The detection unit 41 of the third control unit 300 acquires information regarding the position or posture of the seat 50 measured by the measurement sensor 40 shown in Figure 5. When the detection unit 41 detects an increase in the reclining angle of the backrest 52 or a rearward slide of the seat 51 (i.e., a switch from the driving position to the relaxation position), the switching processing unit 42 controls the PGU 10 so that the first image S1 is not displayed, and the black ceramic image display processing unit 44 controls the second display unit 22 so that the third image S3 is displayed. At this time, as shown in Figure 11, the black ceramic image display processing unit 44 controls the second display unit 22 so that the third image S3 is biased to display in the upper region R1 of the upper region R1 and lower region R2 included in the third display area X3.

[0073] In this case, as shown in Figure 11, the entire third image S3 may be displayed so that it fits within the upper region R1, or a part of it (for example, at least less than the lower half of the third image S3) may extend into the lower region R2.

[0074] Furthermore, the detection unit 41 of the third control unit 300 may detect a relatively small tilt angle (first tilt angle) of the backrest 52 from the measurement sensor 40 when the driving mode of the vehicle C is manual driving mode, and detect a relatively large tilt angle (second tilt angle) of the backrest 52 from the measurement sensor 40 when the driving mode of the vehicle C is automatic driving mode. In other words, the switching of the driving mode of the vehicle C may be determined according to the angle of the backrest 52 measured by the measurement sensor 40.

[0075] Figures 12A and 12B are second diagrams showing an example of the display mode of the third image S3 in the vehicle display device 1 according to this embodiment. As shown in Figure 11, when the black ceramic image display processing unit 44 displays the third image S3, it controls the second display unit 22 to display the third image S3 biased towards the upper region R1 of the upper region R1 and lower region R2 included in the third display area X3. At this time, as shown in Figures 12A and 12B, the second display unit 22 is controlled so that the image size of the third image S3 becomes smaller than before it was biased towards the upper region R1.

[0076] More specifically, for example, when switching from the state where the first image S1 is displayed in manual driving mode to automatic driving mode (i.e., when the reclining angle of the backrest 52 of the seat 50 gradually increases), as described above, the third image S3 is displayed first, and then the second image S2 is displayed. The state immediately before the display of this second image S2 is the display state shown in Figure 12A. Then, at the timing when the reclining angle of the backrest 52 increases to a relaxed position, or at the timing before or after that, the third image S3 is displayed in the upper area R1 of the third display area X3 with a reduced image size, taking into consideration the visibility of the occupant DR and ensuring that the view is not obstructed by the instrument panel IP, etc., as shown in Figure 12B.

[0077] Figure 13 is a third diagram showing an example of the display mode of the third image S3 in the vehicle display device 1 according to this embodiment. In Figure 13, three third images S3 are displayed in the third display area X3. As shown in Figures 11 and 12, all of the third images S3 are displayed in the upper area R1.

[0078] Here, the third image S31 displayed at the position of the third display unit X3 opposite the second display unit X2 (first position) (center position in Figure 13) is information that is of high importance, such as information that is required to be displayed by law or the speedometer. On the other hand, the third images S32 and S33 displayed at the position of the third display unit X3 that is not opposite the second display unit X2 (second position) (left and right positions in Figure 13) are information that is of relatively lower importance compared to the central third image S31 opposite the second display unit X2, such as an icon representing VPA or a design indicating that it is in automatic driving mode.

[0079] In other words, the black ceramic image display processing unit 44 issues commands to control the second display unit 22 so that the third image S31, which contains relatively more important information, is displayed closer to the first display area X1 and the second display area X2.

[0080] In Figure 13, the state in which three third images S31, S32, and S33 are displayed in the upper region R1 of the third display area X3 is shown. However, when two or more third images S3 are displayed, the third images S3 representing relatively more important information may be displayed closer to the first display area X1 or the second display area X2. In this case, each third image S3 (for example, third images S31, S32, and S33) does not necessarily have to be displayed biased towards the upper region R1 of the third display area X3.

[0081] Figure 14 is a fourth diagram showing an example of the display mode of the third image S3 in the vehicle display device 1 according to this embodiment. In Figure 13, the third image S31 containing information of high importance is positioned opposite the second display area X2 below, and the third images S32 and S33 containing information of low importance are placed to its left and right. In Figure 14, however, the second display unit 22 is controlled to display the third image S31 containing relatively high-importance information in the upper area R1 of the third display area X3, and the third image S32 containing relatively low-importance information in the lower area R2. In this case, it is desirable that the third images S31 and S32 be displayed opposite the second display area X2 below.

[0082] While Figures 11 to 14 mainly describe the display mode of the third image S3 in the third display area X3 in the relaxed position corresponding to the automatic driving mode, the second display unit 22 may be controlled so that the third image S3 is displayed in the third display area X3 in the driving position corresponding to the manual driving mode, spanning the upper area R1 and the lower area R2 substantially evenly (i.e., at a central position in the vertical direction).

[0083] As described above, the vehicle display device 1 according to this embodiment includes a first HUD device 100 that is installed in a vehicle C having a seat 50 comprising a seat portion 51 and a backrest portion 52, and emits display light L toward the windshield WS1 of the vehicle C, thereby switching and displaying a first image S1 that is perceived by the occupant DR as a first virtual image VI1 in a first display area X1 located in front of the vehicle C beyond the windshield WS1, and a second image S2 that is perceived by the occupant DR as a real image RI in a second display area X2 located in rear of the vehicle C beyond the windshield WS1; a second HUD device 200 installed in the vehicle C that displays a third image S3 that is perceived in a third display area X3 located below the first display area X1 and below the second display area X2 in the field of view of the occupant DR; and the first HUD device 100 and the second HUD The system includes a third control unit 300 that controls the device 200 in conjunction with it. The third control unit 300 performs a display image switching process that switches between displaying a first image S1 in the manual driving mode of the vehicle C and displaying a second image S2 in the automatic driving mode of the vehicle C, an angle detection process that detects the reclining angle of the backrest 52 of the vehicle C, and a black ceramic image display process that displays the third image S3 for a predetermined period including the timing of the switch between displaying the first image S1 and the second image S2 due to the display image switching process. If the angle detection process detects that the reclining angle has increased, the black ceramic image display process controls the second HUD device 200 to bias the display of the third image S3 towards the upper region R1 of the upper region R2 included in the third display area X3.

[0084] In this way, when an increase in the reclining angle of the backrest 52 is detected, the third image S3 is biased and displayed in the upper region R1 of the upper region R2 included in the third display area X3. Therefore, when the backrest 52 is in a relaxed position with a large reclining angle, the instrument panel IP and other parts do not obstruct the view, making it easier for the occupant DR to see the third image S3.

[0085] Furthermore, if necessary, the third control unit 300 can detect a first tilt angle, which is a relatively small reclining angle, in the angle detection process when in manual operation mode, and a second tilt angle, which is a relatively large reclining angle, when in automatic operation mode, thereby detecting the change in the reclining angle associated with switching between manual operation mode and automatic operation mode.

[0086] Furthermore, if necessary, the third control unit 300 controls the second HUD device 200 to display the third image S3 with a smaller image size than before it was shifted to the upper region R1 when detecting an increase in the reclining angle during the black ceramic image display processing. By reducing the size of the third image S3 itself, all information can be displayed sufficiently even when the display is shifted to the upper region R1.

[0087] Furthermore, if necessary, the third control unit 300 controls the second HUD device 200 in the black ceramic image display processing to display information of high importance from the third image S3 at a first position in the upper region R1 that faces below the second display area X2, and to display images of low importance at a second position in the upper region R1 that does not face below the second display area X2, to the left or right of the first position. By displaying the third image S31, which is of high importance from the third image S3, in a position close to the first image S1 and the second image S2, the visibility of each image can be further improved.

[0088] Furthermore, if necessary, the third control unit 300 controls the second HUD device 200 in the black ceramic image display process to display the third image S3 spanning substantially equally across the upper region R1 and the lower region R2 included in the third display area X3, in the angle detection process if it does not detect an increase in the reclining angle, thereby ensuring good visibility of the third image S3 when in the driving position, which is the manual driving mode.

[0089] Furthermore, if necessary, the third control unit 300 controls the second HUD device 200 in the black ceramic image display process to display information of high importance from the third image S3 in the upper region R1 and images of low importance in the lower region R2, thereby making the images of high importance from the third image S3 easier to see.

[0090] (Third Embodiment of the Invention) A third embodiment of the invention will be described with reference to Figures 15 to 20. In this embodiment, with respect to the vehicle display device 1 described in the first embodiment, the first image S1, the second image S2, and the third image S3 are displayed in conjunction with each other, and supplementary images are displayed to further improve the visibility for the occupant DR, who is the viewer. In this embodiment, explanations that overlap with the above embodiments will be omitted.

[0091] In the vehicle display device 1 according to this embodiment, when the driving mode of vehicle C switches from manual driving mode to automatic driving mode, the display switches from the first image S1 to the second image S2 via the third image S3. Conversely, when the driving mode of vehicle C switches from automatic driving mode to manual driving mode, the display switches from the second image S2 to the first image S1 via the third image S3. At this time, assuming that the third image S3 continues to be displayed even after the second image S2 or the first image S1 has been displayed, when either the second image S2 or the first image S1 is displayed, a related image SN (fourth image) representing information related to the content represented by the other image is displayed in the third display area X3.

[0092] In manual driving mode, if the first image S1 is displayed in the first display area X1 and the second image S2 is not displayed in the second display area X2, then an automatic driving related image SN1 (fourth image) representing information related to the content of the undisplayed second image S2 is displayed in the third display area X3. In automatic driving mode, if the first image S1 is not displayed in the first display area X1 and the second image S2 is displayed in the second display area X2, then a manual driving related image SN2 (fourth image) representing information related to the content of the undisplayed first image S1 is displayed.

[0093] The autonomous driving-related image SN1 and the manual driving-related image SN2 are both images displayed by the second HUD device 200 and are perceived as the second virtual image VI2. The process of displaying the autonomous driving-related image SN1 and the manual driving-related image SN2 (fourth image display process) is performed based on the control of the black ceramic image display processing unit 44 in the third control unit 300.

[0094] Furthermore, the above-mentioned related image SN (fourth image) shall include the concepts of both the autonomous driving related image SN1 and the manual driving related image SN2.

[0095] The display transition state when switching from the display of the first image S1 to the display of the second image S2 will be specifically explained with reference to Figures 15 to 20. Figures 15 to 20 show the process of transitioning from the display state of the first image S1 to the display state of the second image S2 in the vehicle display device 1 according to this embodiment. Figure 15 shows the state in which the driving mode of the vehicle C has been switched to manual driving mode, and the third image S3 is displayed even after the first image S1 has been displayed. As described above, in this embodiment, in addition to the third image S3, a related image SN is displayed as a fourth image in the third display area X3.

[0096] In Figure 15, since the driving mode of vehicle C is manual driving mode, the first image S1 displayed on the first display unit X1 is vehicle speed information (hereinafter referred to as SP), which is important when driving in manual driving mode and which the occupant DR needs to check relatively frequently. In addition, in the third display unit X3, the third image S3 is displayed in a position opposite to the first display unit X1 below, and its display content is information such as warning lights and operating lights (hereinafter referred to as WA), which is important information for driving. Furthermore, next to the third image S3, an automated driving-related image SN1, which is perceived as the second virtual image VI2, is displayed, and its display content is information related to the content that the second image S2 would display if it were in automated driving mode. Specifically, it is a two-dimensional icon (hereinafter referred to as VPA) which is a simplified three-dimensional figure representing a virtual personal assistant that performs functions such as assistants and agents, which are displayed in the second image S2 when it is in automated driving mode.

[0097] In Figure 15, the display positions of the third image S3 and the autonomous driving-related image SN1 displayed in the third display area X3 may be reversed, but it is preferable that the autonomous driving-related image SN1, which is highly related to the content of the second image S2 that is not displayed, be placed in a position below the first display area X1 that does not face it.

[0098] In this state, the detection unit 41 of the third control unit 300 acquires information regarding the position or posture of the seat 50 measured by the measurement sensor 40 shown in Figure 5. If the detection unit 41 detects an increase in the reclining angle of the backrest 52 or a rearward slide of the seat 51 (i.e., a switch from the driving position to the relaxation position), the switching processing unit 42 controls the PGU 10 so that the first image S1 is hidden.

[0099] Figures 16A and 16B show the process by which the first image S1 becomes invisible. As shown in Figure 16A, the SP of the first image S1 gradually disappears as it moves from the first display area X1 towards the third display area X3 below, and the second display unit 22 displays the third image S3 and the autonomous driving-related image SN1 in the third display area X3 to move to either the left or the right (to the right in Figure 16A). In other words, the third image S3 and the autonomous driving-related image SN1 move to the left or right to create space for the first image S1 as it moves downward and gradually disappears. Then, as shown in Figure 16B, the manual driving-related image SN2, which represents information related to the content of the first image S1 (SP with the same content as the first image S1 in Figure 16B), is displayed in the space created by the left or right movement of the third image S3 and the autonomous driving-related image SN1. In other words, the third control unit 300 controls the PGU 10 in the first HUD device 100 to hide the first image S1, and controls the second display unit 22 in the second HUD device 200 to display SP, which was displayed as the first image S1, as a manual operation related image SN2 in the third display area X3.

[0100] Subsequently, the third control unit 300 (or the second control unit 25 in the second HUD device 200) controls the second display unit 22 to swap the display positions of the WA of the third image S3 and the SP of the manual driving related image SN2 with the VPA of the automatic driving related image SN1, as shown in Figure 17.

[0101] Next, the third control unit 300 (or the second control unit 25 in the second HUD device 200) controls the second display unit 22 to deform the display of the VPA of the autonomous driving-related image SN1 into a shadow or base (in the case of Figure 18, a shadow) as shown in Figures 8A and 8B, as shown in Figure 18.

[0102] Next, based on a command from the switching processing unit 42 of the third control unit 300, the second display unit 22 of the second HUD device 200 displays the second image S2 on the second display area X2. Figures 19A and 19B show the process of the second image S2 being displayed. In Figure 19A, the VPA of the autonomous driving-related image SN1, before deformation in Figure 18, slides in and appears, moving from the third display area X3 towards the upper second display area X2. In other words, it appears as if the VPA is popping out from the deformed shadow in Figure 18 and sliding into the second display area X2. The VPA that appears here is the information that formed the basis of the two-dimensional icon in the VPA of the autonomous driving-related image SN1, and specifically, it is a three-dimensional figure that embodies the two-dimensional icon of the virtual personal assistant. Then, as shown in Figure 19B, the second image S2 is displayed on the second display area X2. In other words, once the transformation of the autonomous driving-related image SN1 in Figure 18 is complete, the third control unit 300 controls the PGU 10 of the first HUD device 100, and the PGU 10 displays the VPA (three-dimensional figure) as the second image S2.

[0103] Then, as shown in Figure 20, the third control unit 300 controls the second display unit 22 of the second HUD device 200 so as to hide the automatic driving-related image SN1, which was distorted into a shadow in Figure 18, after a predetermined time has elapsed, and to appropriately change the display positions of the third image S3 and the manual driving-related image SN2. At this time, either the WA of the third image S3 or the SP of the manual driving-related image SN2 may be displayed in opposing positions below the second display unit X2, but it is preferable to display the manual driving-related image SN2, which has a high correlation with the content of the undisplayed first image S1 (in this case, the same SP), in a non-opposing position below the second display unit X2.

[0104] In subsequent automated driving modes, as described in the second embodiment, the display mode of the third image S3 and the manual driving-related image SN2 in the third display area X3 is varied to improve visibility for the occupant DR, who is the viewer.

[0105] The series of display transitions shown in Figures 15 to 20 describe the case when switching from manual driving mode to automatic driving mode, but the display transition when switching from automatic driving mode to manual driving mode basically follows the same pattern. That is, when a switch from automatic driving mode to manual driving mode is detected, the second image S2 moves downward and becomes invisible, and the third image S3 and manual driving related image SN2 of the third display area X3 move left and right to make space. The two-dimensional icon of the VPA in the second image S2 is displayed in the empty space as the automatic driving related image SN1. The display positions of the third image S3 and manual driving related image SN2 and the automatic driving related image SN1 are swapped. Then, the manual driving related image SN2 is transformed into a shadow or base. The SP of the manual driving related image SN2 slides in from below the first display area X1 and is displayed as the first image S1.

[0106] Regardless of the display transition, the first image S1 displayed in the first display area X1 will be displayed in the third display area X3 as the relevant manual driving-related image SN2, and the second image S2 displayed in the second display area X2 will be displayed in the third display area X3 as the relevant automated driving-related image SN1. In other words, simply switching between the first image S1 and the second image S2 will only display information from one of them, and it will not be possible to check the information from the other. However, by displaying the other relevant information in the third display area X3, it becomes possible to always present sufficient information to the occupant DR.

[0107] Furthermore, in Figure 20, it was explained that after a predetermined time has elapsed since the second image S2 was displayed, the autonomous driving-related image SN1, which was distorted into a shadow in Figure 18, is hidden. However, in cases where the second image S2 is not to be displayed in the second display area X2 (including cases where the occupant DR does not want it to be displayed), control may be performed to gradually slide out the second image S2 while moving downward within the second display area X2 until it is hidden, and to replace the autonomous driving-related image SN1, which was distorted into a shadow in Figure 18, with the second image S2 that has moved from the second display area X2.

[0108] Furthermore, in any of the display embodiments shown in Figures 15 to 20, detailed information may be displayed in the first image S1 in the first display area X1 and the second image S2 in the second display area X2, while simplified information may be displayed in the third image S3 and related image SN in the third display area X3.

[0109] Furthermore, among the information displayed in the third display area X3, information related to vehicle C may be displayed in a position that aligns vertically with the first image S1, while information not directly related to vehicle C (such as signs) may be displayed in a position that does not align vertically with the first image S1.

[0110] As described above, the vehicle display device 1 according to this embodiment includes: a first HUD device 100 provided on the vehicle C, which emits display light L1 toward the windshield WS1 of the vehicle C, and switches between displaying a first image S1 which is perceived by the occupant DR as a first virtual image VI1 in a first display area X1 located in front of the vehicle C beyond the windshield WS1, and a second image S2 which is perceived by the occupant DR as a real image RI in a second display area X2 located in rear of the vehicle C beyond the windshield WS1; and a second HUD device 200 provided on the vehicle C, which emits display light L2 toward the windshield WS1, and displays a third image S3 which is perceived by the occupant DR as a second virtual image VI2 in a third display area X3 located in front of the windshield WS1, below the first display area X1 and below the second display area X2 in the occupant DR's field of view; and the first HUD device 100 and the second HUD device 200 The system includes a third control unit 300 that controls the system in conjunction with the system, and the third control unit 300 performs the following actions: a display switching process that switches the display so that a first image S1 is displayed in manual driving mode and a second image S2 is displayed in automatic driving mode; a black ceramic image display process (third image display process) that displays a third image S3 for a predetermined period including the timing of the switch between the display of the first image S1 and the display of the second image S2 by the display switching process; and a black ceramic image display process (fourth image display process) that controls the second HUD device 200 to display a related image SN (fourth image) that represents information related to the content represented by the other image, when either the first image S1 visible in the first display area X1 or the second image S2 visible in the second display area X2 is displayed, and which is made visible to the occupant DR as a second virtual image VI2 in the third display area X3.

[0111] Thus, for example, when switching from the display state of the first image S1 in the first display area X1 to the display state of the second image S2 in the second display area X2, even if the first image S1 is no longer displayed in the first display area X1, the related image SN in the third display area X3 makes it possible to display information equivalent to the information content that was displayed in the first image S1.

[0112] Furthermore, when switching from the display of the first image S1 in the first display area X1 to the display of the second image S2 in the second display area X2, the distance between the first display area X1 and the third display area X3 is shorter than the distance between the first display area X1 and the second display area X2. Therefore, by displaying the related image SN, the sense of distance during eye movement can be reduced.

[0113] Furthermore, by displaying, for example, a character in the related image SN, a sense of reassurance can be provided through the presence of that character. Similarly, the same effect can be obtained when switching from the display state of the second image S2 in the second display area X2 to the display state of the first image S1 in the first display area X1.

[0114] Furthermore, if necessary, the third control unit 300 controls the second HUD device 200 to display a simplified image of the second image S2 as the automatic driving related image SN1 in the related image SN during the black ceramic image display processing (fourth image display processing). By simplifying the automatic driving related image SN1, the space required to display information on the third display area X3 can be reduced, and the ease of positioning the automatic driving related image SN1 can be improved.

[0115] Furthermore, if necessary, the third control unit 300 controls the second HUD device 200 in the black ceramic image display processing (fourth image display processing) to display the related image SN in the third display area X3 at a position that does not face downwards to either the first display area X1 or the second display area X2, thereby preventing the information content of the related image SN from visually interfering with the display of the first image S1 or the second image S2.

[0116] Furthermore, if necessary, the third control unit 300 controls the second HUD device 200 in the black ceramic image display processing (fourth image display processing) to move the related image SN from the first display area X1 or the second display area X2 and display it in the third display area X3. This makes it easier to recognize that information equivalent to the information content of the first image S1 or the second image S2 has moved to a different area, the third display area X3, and also makes it easier to guide the occupant DR's gaze to the third display area X3 and focus on it.

[0117] 1 Vehicle display device 10 PGU 11 Light source 12 First display unit 13 Reflector 15 First control unit 16 Housing 17 Aperture 18 Cover glass 21 Light source 22 Second display unit 25 Second control unit 26 Housing 27 Aperture 28 Cover glass 40 Measurement sensor 41 Detection unit 42 Switching processing unit 43 Display control unit 44 Black ceramic image display processing unit 45 External information 46 Various devices 50 Seat 51 Seat part 52 Backrest part 100 First HUD device 121 Display element 122 Switching element 131 First mirror 132 Second mirror 133 Third mirror 200 Second HUD device 300 Third control unit C Vehicle DR Occupant F Composite focus IP Instrument panel L (L1-L3) Display light RI Real image R1 Upper region R2 Lower region S1 First image S2 Second image S3 Third image S31-S33 Third image SN Related images SN1 Autonomous driving related image SN2 Manual driving related image VI1 First virtual image VI2 Second virtual image WS1 Windshield WS2 Black ceramic part X1 First display area X2 Second display area X3 Third display area

Claims

1. A vehicle display device comprising: a first display unit provided on a vehicle, which emits image light toward a light-transmitting member of the vehicle, thereby switching between displaying a first image that is perceived as a virtual image by the occupant at a first display unit located in front of the vehicle relative to the light-transmitting member, and a second image that is perceived as a real image by the occupant at a second display unit located behind the vehicle relative to the light-transmitting member; a second display unit provided on the vehicle, which displays a third image that is perceived at a third display unit located between the first display unit and the second display unit in the occupant's field of view and below each of them; and a control unit that controls the first display unit and the second display unit in coordination, wherein the control unit performs a display switching process to switch the display so as to display the first image in a predetermined first predetermined state and to display the second image in a predetermined second predetermined state; and a third image display process to display the third image for a predetermined period including the timing of the switch between the display of the first image and the display of the second image by the display switching process.

2. The vehicle display device according to claim 1, characterized in that the control unit performs the display switching process and the third image display process so that the display of the second image is started when the third image is displayed as if it were displayed at the position of the third display area.

3. The vehicle display device according to claim 1, characterized in that the second display unit emits image light toward the light-transmitting member to display the third image which is perceived as a virtual image by the occupant at the third display portion located in front of the light-transmitting member.

4. The vehicle display device according to claim 1, characterized in that the control unit controls the second display device in the third image display processing so that the occupant views the third image with the opaque portion located at the end of the light-transmitting member as the background.

5. The vehicle display device according to claim 1, characterized in that the control unit controls the second display device in the third image display process so that the third image is displayed with lower brightness, lower saturation, or lower lightness than the second image.

6. The vehicle display device according to claim 1, characterized in that the control unit controls the second display device in the third image display process so that the third image displays a representation related to the second image.

7. The vehicle display device according to claim 1, characterized in that when the control unit displays the second image so that it is visible in the second display area during the display switching process, it slides the second image upward from the third display area located below the second display area.

Images