Display system

Abstract

To reduce a user's burden when the user views different virtual images.SOLUTION: A display system 10 includes: a first display device 100 which projects a first virtual image 101 to an area located in front of a user in a vehicle; and a second display device 200 which projects a second virtual image 201 to an area located in front of the user and below the first virtual image. A lower end of the first virtual image 101 and an upper end of the second virtual image 201 are disposed in a circle C with a diameter equivalent to a length of the second virtual image 201 in a side view.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to display systems. [Background technology]

[0002] Patent Document 1 discloses a display system that projects a first virtual image and a second virtual image at approximately the same distance in front of a user so that the user can easily view the first virtual image and the second virtual image. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2015-146012 Summary of the Invention [Problem to be solved by the invention]

[0004] In recent years, there has been a demand for reducing the burden on users when viewing different virtual images.

[0005] Therefore, an object of the present disclosure is to provide a display system that can reduce the burden on a user when viewing different virtual images. [Means for solving the problem]

[0006] A display system according to one aspect of the present disclosure comprises a first display device that projects a first virtual image in front of a user riding in a vehicle, and a second display device that projects a second virtual image in front of the user and below the first virtual image, wherein the lower end of the first virtual image and the upper end of the second virtual image are arranged within a circle whose diameter is the length of the second virtual image in a side view. [Effects of the Invention]

[0007] According to the present disclosure, a display system can be provided that can reduce the burden on the user when viewing different virtual images. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a schematic diagram showing a state in which a display system according to the first embodiment is installed in a vehicle. [Figure 2] FIG. 2 is a schematic cross-sectional view showing the first display device according to the first embodiment. [Figure 3] FIG. 3 is a schematic cross-sectional view showing the second display device according to the first embodiment. [Figure 4] FIG. 4 is a schematic diagram showing a display system according to the second embodiment. [Figure 5] FIG. 5 is a schematic cross-sectional view showing a third display device according to the second embodiment. [Figure 6] FIG. 6 is a schematic diagram showing a third display device of Modification 1 according to Embodiment 2. In FIG. [Figure 7] FIG. 7 is a schematic diagram showing a third display device of Modification 2 according to Embodiment 2. In FIG. [Figure 8] FIG. 8 is a schematic diagram showing a second display device according to the third embodiment. [Figure 9] FIG. 9 is an explanatory diagram showing a display example of the display element according to the third embodiment. [Figure 10] FIG. 10 is a schematic diagram showing a first display device according to the third embodiment. [Figure 11] FIG. 11 is a schematic diagram showing a second display device according to the fourth embodiment. [Figure 12] FIG. 12 is a schematic diagram showing a first display device according to the fifth embodiment. [Figure 13] FIG. 13 is a schematic diagram showing a second display device according to the fifth embodiment. [Figure 14A] FIG. 14A is an explanatory diagram illustrating an example of the arrangement of the first virtual image and the second virtual image according to the sixth embodiment. [Figure 14B] FIG. 14B is an explanatory diagram illustrating an example of the arrangement of the first virtual image and the second virtual image according to the sixth embodiment. [Figure 14C] FIG. 14C is an explanatory diagram illustrating an example of the arrangement of the first virtual image and the second virtual image according to the sixth embodiment. [Figure 15] FIG. 15 is a schematic diagram showing a first display device corresponding to Arrangement Example 3 of Embodiment 6. In FIG. [Figure 16] FIG. 16 is a schematic diagram showing a first display device according to the seventh embodiment. [Figure 17] FIG. 17 is a schematic diagram showing a first display device and a second display device according to the eighth embodiment. [Figure 18] FIG. 18 is an explanatory diagram showing the first virtual image and the second virtual image at the reference position in the display system according to the eighth embodiment. [Figure 19] FIG. 19 is an explanatory diagram showing the first virtual image and the second virtual image at the reference position as seen by the driver in the eighth embodiment. [Figure 20] FIG. 20 is an explanatory diagram showing a state in which the driver is changed to a larger driver and the first display position and the second display position are adjusted in the eighth embodiment. [Figure 21A] FIG. 21A is an explanatory diagram showing the first virtual image and the second virtual image obtained by simply adjusting the first display position in the eighth embodiment. [Figure 21B] FIG. 21B is an explanatory diagram showing the first virtual image and the second virtual image when the first display position is adjusted and the coordinates of the first virtual image are also adjusted in the eighth embodiment. [Figure 22] FIG. 22 is a schematic diagram showing a state in which a display system according to the ninth embodiment is installed in a vehicle. [Figure 23] FIG. 23 is an explanatory diagram showing a display example of notification information according to the ninth embodiment. [Figure 24] FIG. 24 is a schematic diagram showing a display system according to the tenth embodiment. [Figure 25] FIG. 25 is a schematic diagram showing a display system according to the eleventh embodiment. [Figure 26] FIG. 26 is a schematic diagram showing a display system according to the twelfth embodiment. [Figure 27] FIG. 27 is an explanatory diagram illustrating a display example of notification information according to the thirteenth embodiment. [Figure 28] FIG. 28 is an explanatory diagram showing another example of display of the mark according to the thirteenth embodiment. [Figure 29] FIG. 29 is an explanatory diagram showing another display example of the notification information according to the thirteenth embodiment. [Figure 30] FIG. 30 is an explanatory diagram showing a display example of notification information according to the fourteenth embodiment. [Figure 31] FIG. 31 is an explanatory diagram showing a display example of notification information according to the fifteenth embodiment. [Figure 32] FIG. 32 is an explanatory diagram showing another display example of the notification information according to the fifteenth embodiment. [Figure 33] FIG. 33 is a schematic diagram showing a display system according to the sixteenth embodiment. [Figure 34] FIG. 34 is an explanatory diagram showing a display example on the second display device according to the sixteenth embodiment. [Figure 35] FIG. 35 is an explanatory diagram showing an example of a video display according to the sixteenth embodiment. [Figure 36] FIG. 36 is an explanatory diagram showing another display example according to the sixteenth embodiment. [Figure 37] FIG. 37 is a schematic diagram showing a display system according to the seventeenth embodiment. [Figure 38] FIG. 38 is a schematic diagram showing a display system according to the eighteenth embodiment. [Figure 39] FIG. 39 is an explanatory diagram showing a display example of notification information according to the eighteenth embodiment. [Figure 40] FIG. 40 is an explanatory diagram showing another display example of the notification information according to the eighteenth embodiment. [Figure 41] FIG. 41 is an explanatory diagram showing another display example of the notification information according to the eighteenth embodiment. [Figure 42] FIG. 42 is a schematic diagram showing another example of the display system according to the eighteenth embodiment. [Figure 43] FIG. 43 is a schematic diagram showing a display system according to the nineteenth embodiment. [Figure 44] FIG. 44 is a schematic diagram showing a display system according to the twentieth embodiment. [Figure 45] FIG. 45 is a schematic diagram showing a display system according to the twentieth embodiment. [Figure 46] FIG. 46 is a schematic diagram showing a display system according to the twentieth embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0009] A display system according to one aspect of the present disclosure comprises a first display device that projects a first virtual image in front of a user riding in a vehicle, and a second display device that projects a second virtual image in front of the user and below the first virtual image, wherein the lower end of the first virtual image and the upper end of the second virtual image are arranged within a circle whose diameter is the length of the second virtual image in a side view.

[0010] According to this, the lower end of the first virtual image and the upper end of the second virtual image are disposed within a circle whose diameter is the length of the second virtual image in a side view, so that the lower end of the first virtual image and the upper end of the second virtual image can be disposed close to each other in the vertical direction. This reduces the vertical and horizontal gaps between the lower end of the first virtual image and the upper end of the second virtual image, thereby reducing the burden on the user due to movement of the viewpoint and focus when switching between the first virtual image and the second virtual image.

[0011] Furthermore, a difference between a first depression angle to the lower end of the first virtual image and a second depression angle to the upper end of the second virtual image based on the user's viewpoint may be within 12°.

[0012] With this, the difference between the first depression angle to the bottom end of the first virtual image and the second depression angle to the second virtual image based on the user's viewpoint is within 12°, which further reduces the gap in the vertical direction between the bottom end of the first virtual image and the top end of the second virtual image, thereby further reducing the burden on the user due to viewpoint and focus movement when switching between viewing the first virtual image and the second virtual image.

[0013] The device may also include a third display device that projects a third virtual image in front of the user, the third virtual image being positioned at a viewing distance within 0.25 diopters of the viewing distance of the second virtual image.

[0014] This arrangement reduces the horizontal gap between the second and third virtual images because the third virtual image is positioned at a viewing distance within 0.25 diopters of the second virtual image, thereby reducing the burden on the user due to shifts in viewpoint and focus when switching between the second and third virtual images.

[0015] At least one of the first virtual image projected by the first display device and the second virtual image projected by the second display device may be displayed in multiple layers.

[0016] According to this, at least one of the first virtual image and the second virtual image is displayed in multiple layers, so that different displays can be produced for each layer, enabling a variety of content representations.

[0017] The second display device may also include a display element that irradiates image light to form the second virtual image, and an optical system that projects the image light from the display element as the second virtual image, and the optical system may include a concave mirror that ultimately reflects the image light.

[0018] According to this, the second virtual image is formed by the image light finally being reflected and converged by the concave mirror, which makes it easier to ensure the viewing distance of the second virtual image.

[0019] At least one of the first display device and the second display device may include an adjustment unit for adjusting a viewing distance of the first virtual image and a viewing distance of the second virtual image.

[0020] According to this, at least one of the first display device and the second display device is provided with an adjustment unit for adjusting the viewing distance of the first virtual image and the viewing distance of the second virtual image, so that the viewing distance of at least one of the first virtual image and the second virtual image can be adjusted. This allows the adjustment unit to adjust the viewing distance of at least one of the first virtual image and the second virtual image in accordance with various conditions, enabling more diverse content representation.

[0021] The display device may further include a control unit that controls the display content of the first display device and the display content of the second display device.

[0022] According to this, the control unit controls the display content of the first display device and the display content of the second display device, so that the control unit can collectively control the display content of the first display device (display content of the first virtual image) and the display content of the second display device (display content of the second virtual image), which makes it easier to link the contents of the first virtual image and the second virtual image.

[0023] At least one of the first display device and the second display device may include an optical system including a hologram element.

[0024] According to this, since at least one of the first display device and the second display device is equipped with an optical system including a hologram element, it is possible to make the optical system of at least one of the first display device and the second display device thin.

[0025] The display system may also include a first position adjustment unit that adjusts a first display position in the vertical direction of the first virtual image, a second position adjustment unit that adjusts a second display position in the vertical direction of the second virtual image, and a coordinate change unit that changes the coordinates of the first virtual image within the displayable range of the first virtual image based on the first display position and the second display position after the adjustment.

[0026] According to this, since the display system is provided with the first position adjustment unit, the second position adjustment unit, and the coordinate change unit, even if the driver's viewpoint position changes, the first display position of the first virtual image and the second display position of the second virtual image can be adjusted, and the coordinates of the first virtual image within the displayable range can also be adjusted. Therefore, the first virtual image and the second virtual image can be displayed appropriately for different drivers.

[0027] Furthermore, the first display device may include a first reflecting section that reflects image light that forms the first virtual image, the second display device may include a second reflecting section that reflects image light that forms the second virtual image, the first position adjustment section may adjust the first display position in the first virtual image by adjusting at least one of the attitude and position of the first reflecting section, and the second position adjustment section may adjust the first display position in the second virtual image by adjusting at least one of the attitude and position of the second reflecting section.

[0028] According to this, the first position adjustment unit adjusts the first display position of the first virtual image by adjusting at least one of the attitude and position of the first reflecting unit, so the first display position can be adjusted with a simple structure. Meanwhile, the second position adjustment unit adjusts the second display position of the second virtual image by adjusting the attitude and position of the second reflecting unit, so the second display position can be adjusted with a simple structure. As a result, the first virtual image and the second virtual image can be displayed appropriately for different drivers.

[0029] The device may also include a head imaging unit that images the user's head, an estimation unit that estimates the user's viewpoint position based on the image captured by the head imaging unit, and an adjustment control unit that controls the first position adjustment unit and the second position adjustment unit based on the estimated user's viewpoint position.

[0030] According to this, the estimation unit estimates the user's viewpoint position based on the image captured by the head imaging unit, and the adjustment control unit controls the first position adjustment unit and the second position adjustment unit based on the estimated viewpoint position, so that the first display position and the second display position can be adjusted automatically.

[0031] The vehicle may also include a first imaging unit that images the surroundings of the vehicle, and a control unit that controls the first display device, the second display device, and the first imaging unit, and when displaying notification information for the user on the first display device and the second display device, the control unit may adjust at least one of the brightness, size, and chromaticity of the notification information displayed together with the vehicle surroundings information obtained from the first imaging unit between the first display device and the second display device.

[0032] According to this, when the notification information is displayed on the first display device and the second display device, at least one of the luminance, size, and chromaticity of the notification information displayed together with the vehicle surroundings information obtained from the first imaging unit is adjusted between the first display device and the second display device. This makes it possible to visually uniformize the notification information displayed on the first display device and the notification information displayed on the second display device. This reduces the sense of discomfort felt by the user when visually viewing the notification information in the first virtual image and the notification information in the second virtual image.

[0033] The first imaging unit captures an image of a scene ahead of the vehicle, and the control unit calculates a luminance of the first virtual image when the first virtual image is superimposed on a background based on the vehicle surroundings information, and Based on this, the brightness of the notification information may be adjusted between the first display device and the second display device.

[0034] According to this, the luminance of the first virtual image when the first virtual image is superimposed on the background is calculated based on the vehicle surroundings information, and the luminance of the notification information is adjusted between the first display device and the second display device based on the calculation result. This allows the influence of the background on the luminance of the first virtual image to be reflected in the luminance of the notification information, making it possible to present information more naturally.

[0035] The control unit may adjust the brightness of the notification information between the first display device and the second display device so that the brightness of the notification information in the first virtual image and the brightness of the notification information in the second virtual image are approximately equal.

[0036] This makes the luminance of the notification information in the first virtual image and the luminance of the notification information in the second virtual image approximately equal, thereby reducing the difference in luminance between the notification information in the first virtual image and the notification information in the second virtual image, thereby further reducing the sense of discomfort felt by the user when visually recognizing the notification information in the first virtual image and the notification information in the second virtual image.

[0037] The control unit may adjust the brightness of the notification information between the first display device and the second display device so that the brightness of the notification information in the first virtual image is greater than the brightness of the notification information in the second virtual image.

[0038] This makes the luminance of the notification information in the first virtual image greater than the luminance of the notification information in the second virtual image, making the notification information in the first virtual image, which is positioned above the second virtual image, more noticeable, thereby making it easier for the user to recognize the notification information in the first virtual image.

[0039] The control unit may adjust the brightness of the notification information between the first display device and the second display device so that the brightness of the notification information in the first virtual image is smaller than the brightness of the notification information in the second virtual image.

[0040] This makes the brightness of the notification information in the first virtual image smaller than the brightness of the notification information in the second virtual image, making it possible to make the notification information stand out in the second virtual image, which is positioned below the first virtual image and where the user's line of sight is lowered.

[0041] The display system may include a second imaging unit that captures images of the user's surroundings, and the control unit may adjust the brightness of the notification information between the first display device and the second display device based on the user surroundings information obtained from the second imaging unit.

[0042] This allows the second imaging unit to acquire user surroundings information, and the user's viewpoint position can be accurately determined based on this user surroundings information. This allows the brightness perceived by the user from the viewpoint position to be accurately determined, and this brightness can be reflected in the brightness of the notification information. Therefore, information notification can be more natural.

[0043] The display system may include an illuminance sensor that detects the illuminance near the second display device, and the control unit may adjust the brightness of the notification information between the first display device and the second display device based on the detection result of the illuminance sensor.

[0044] In this way, the brightness of the notification information is adjusted based on the detection result of the illuminance sensor, so that the illuminance in the vicinity of the second display device can be reflected in the brightness of the notification information, thereby enabling information notification that feels more natural.

[0045] The display system may include a second imaging unit that captures images of the user's surroundings, and the control unit may adjust the size of the notification information between the first display device and the second display device based on the user surroundings information obtained from the second imaging unit.

[0046] This allows the second imaging unit to acquire user surroundings information, and the user's viewpoint position can be accurately determined based on this user surroundings information. This allows the size of the notification information that the user sees from the viewpoint position to be adjusted with precision. This makes it possible to notify information more naturally.

[0047] The first imaging unit may capture an image of the area in front of the vehicle, and the control unit may calculate the chromaticity of the first virtual image when the first virtual image is superimposed on a background based on the vehicle surroundings information, and based on the calculation result, adjust between the first display device and the second display device so that the chromaticity of the notification information in the first virtual image and the chromaticity of the notification information in the second virtual image are approximately equal.

[0048] According to this, the chromaticity of the first virtual image when the first virtual image is superimposed on a background is calculated based on the vehicle surroundings information, and the chromaticity of the notification information in the first virtual image and the chromaticity of the notification information in the second virtual image are made substantially equal based on the calculation result. This makes it possible to adjust the chromaticity of the notification information in the first virtual image and the chromaticity of the notification information in the second virtual image to be substantially equal, taking into account the influence of the background of the first virtual image, thereby enabling information notification that feels more natural.

[0049] The control unit may keep the chromaticity of the notification information in the second virtual image constant and adjust the chromaticity of the notification information in the first virtual image.

[0050] This allows the chromaticity of the notification information in the first virtual image to be adjusted while the chromaticity of the notification information in the second virtual image remains constant, making the notification information in the first virtual image easier to see.

[0051] The control unit may keep the chromaticity of the notification information in the first virtual image constant and make the chromaticity of the notification information in the second virtual image approximately equal to the chromaticity of the notification information in the first virtual image.

[0052] According to this, the chromaticity of the notification information in the first virtual image remains constant, while the chromaticity of the notification information in the second virtual image is made approximately equivalent to the chromaticity of the notification information in the first virtual image, so that the chromaticity of the notification information in the first virtual image is less likely to change, thereby reducing the burden on the user when looking ahead.

[0053] The display system may include a second imaging unit that captures images of the user's surroundings, and the control unit may adjust the chromaticity of the notification information between the first display device and the second display device based on the user surroundings information obtained from the second imaging unit.

[0054] This allows the second imaging unit to acquire user surroundings information, and the user's viewpoint position can be accurately determined based on this user surroundings information. This allows the chromaticity perceived by the user from the viewpoint position to be accurately determined, and this chromaticity can be reflected in the chromaticity of the notification information. This allows for more natural information notification.

[0055] The control unit may display the notification information based on a display reference point set within a first display area of ​​the first display device, and if the object of the notification information is within the first display area, the control unit may set the object to the display reference point, and if the object of the notification information is outside the first display area, the control unit may set the display reference point on a center line in the width direction of the first display area.

[0056] According to this, when the target of the notification information is within the first display area, the notification information is displayed with the target as the display reference point, so that the user can recognize the target by visually checking the notification information. On the other hand, when the target of the notification information is outside the first display area, the notification information is displayed at the display reference point set on the center line in the width direction of the first display area. In other words, when the target is not within the first display area, the notification information is positioned on the center line of the first display area, so that the user can more reliably visually check the notification information.

[0057] The control unit may be configured to arrange the notification information displayed on the first display device and the notification information displayed on the second display device on a straight line including the display reference point.

[0058] According to this, the notification information displayed on the first display device and the notification information displayed on the second display device are arranged on a straight line including the display reference point, so that the user can move their gaze linearly toward each piece of notification information, thereby reducing the burden caused by moving their gaze.

[0059] The control unit may cause the notification information displayed on the first display device and the notification information displayed on the second display device to be displayed consecutively.

[0060] This allows the notification information displayed on the first display device and the notification information displayed on the second display device to be displayed consecutively, making it easier for the user to recognize the positional relationship between the notification information.

[0061] The control unit may display the notification information displayed on the first display device and the notification information displayed on the second display device so as to move from a first display area of ​​the first display device to a second display area of ​​the second display device.

[0062] This makes it easier to guide the user's gaze, as the notification information displayed on the first display device and the notification information displayed on the second display device are displayed so as to move from the first display area to the second display area.

[0063] The control unit may cause the second display device to display the image captured by the first imaging unit.

[0064] According to this, the image captured by the first imaging unit is displayed on the second display device, and the image captured by the first imaging unit and the notification information on the second display device can be displayed superimposed on each other, thereby allowing the notification information to be displayed on a clear image in a manner that is easy for the user to understand.

[0065] The display system may include a third imaging unit that captures images of the surrounding area to the side of the vehicle, and the control unit may superimpose a pseudo image that simulates the interior of the vehicle as a blind spot seen by the user onto the image captured by the third imaging unit and display it on the second display device.

[0066] According to this, a pseudo image simulating the interior of the vehicle as a blind spot seen from the user is displayed on the second display device superimposed on the image captured by the third imaging unit. The user can view the pseudo image displayed on the display unit and the image captured by the third imaging unit. This allows the user to recognize the situation to the sides of the vehicle and blind spots, and to grasp the situation around the vehicle.

[0067] The display system may be equipped with a tilt sensor that acquires the tilt of the vehicle, and the control unit may correct the image captured by the third imaging unit based on the detection result of the tilt sensor and display it on the second display device.

[0068] According to this, an image corrected based on the detection result of the tilt sensor is displayed on the second display device, so the user can more accurately grasp the situation around the vehicle.

[0069] The display system may include a generating unit that generates sound or vibration, and the control unit may cause the generating unit to generate sound or vibration based on the display timing of the notification information.

[0070] According to this, the generating unit generates a sound or vibration based on the timing of displaying the notification information, so that the user can more reliably grasp the notification information through the sound or vibration.

[0071] The first display device may include an augmented reality head-up display that projects a part of the first virtual image, and a head-up display that projects another part of the first virtual image.

[0072] According to this, since the first virtual image is formed by the augmented reality head-up display and the head-up display, it is possible to express a wider variety of things with the first virtual image.

[0073] (Embodiment) Hereinafter, the embodiments will be described in detail with reference to the drawings. Note that each of the embodiments described below represents a specific example of the present disclosure. The numerical values, shapes, materials, components, component placement and connection configurations, steps, and step order shown in the following embodiments are merely examples and are not intended to limit the present disclosure. Furthermore, among the components in the following embodiments, components that are not described in an independent claim that represents a superordinate concept will be described as optional components.

[0074] In the following embodiments, expressions indicating the relative attitude of two directions, such as "parallel" and "orthogonal," may be used, but these expressions also include cases where the attitude is not strictly that. For example, when two directions are said to be parallel, unless otherwise specified, it does not only mean that the two directions are completely parallel, but also that the directions are substantially parallel, that is, that there is a difference of, for example, a few percent. The optical paths illustrated in the drawings in the following embodiments are intended to illustrate the principle and do not necessarily reflect the actual optical paths.

[0075] [Embodiment 1] Fig. 1 is a schematic diagram showing a state in which a display system 10 according to the first embodiment is installed in a vehicle 1. In Fig. 1, the vehicle 1 is shown in cross section.

[0076] As shown in FIG. 1 , the display system 10 includes a first display device 100, a second display device 200, and a control unit 500. The first display device 100 and the second display device 200 are disposed, for example, on the dashboard of the vehicle 1. The first display device 100 and the second display device 200 display, for example, vehicle information related to the vehicle 1 as a first virtual image 101 and a second virtual image 201. Examples of the vehicle information include the speed of the vehicle 1, the engine RPM, detection results of objects approaching the vehicle 1, navigation information from the current location of the vehicle 1 to a destination, and image information captured by a camera capturing images of the rear and surrounding areas of the vehicle 1. Note that FIG. 1 illustrates an example in which the first display device 100 and the second display device 200 are disposed on the dashboard. However, the installation locations of the first display device 100 and the second display device 200 are not limited thereto. For example, the first display device 100 and the second display device 200 may be disposed near the top of the windshield 2, in the center console, or the like.

[0077] [First display device] The first display device 100 is an AR-HUD (Augmented Reality Head-up Display). The first display device 100 projects light onto an area D1 of a windshield (front glass) 2, which is a display medium. The projected light is reflected by the windshield 2. This reflected light is directed toward the eyes of the driver sitting in the driver's seat, who is the user of the first display device 100. The driver perceives the reflected light that has entered their eyes as a first virtual image 101 that appears on the opposite side of the windshield 2 (outside the vehicle) against the background of actual objects visible through the windshield 2.

[0078] Next, the configuration of the first display device 100 will be described with reference to Fig. 2. Fig. 2 is a schematic cross-sectional view showing the first display device 100 according to the first embodiment.

[0079] 2, the first display device 100 includes a housing 110, a cover 120, a display element 130, a first optical element 140, and a second optical element 150. The first optical element 140 and the second optical element 150 form an optical system for projecting image light from the display element 130 as a first virtual image 101.

[0080] The housing 110 is a box-shaped body made of light-blocking resin or metal. Specifically, the housing 110 has a substantially rectangular parallelepiped shape, and an opening 111 is formed in the upper part thereof. The opening 111 is closed by the cover part 120. A display element 130, a first optical element 140, and a second optical element 150 are housed in the internal spaces of the housing 110 and the cover part 120.

[0081] The cover portion 120 is a curved plate made of, for example, a light-transmitting resin or glass. Specifically, the cover portion 120 has a shape that is convex downward as a whole.

[0082] Display element 130 is, for example, a liquid crystal panel, and when irradiated with light from a light source (not shown), irradiates first optical element 140 with image light that becomes first virtual image 101. Display element 130 may be an organic EL panel. Display element 130 is formed in a rectangular shape in a plan view and is disposed in an orientation that is inclined with respect to the horizontal plane.

[0083] The first optical element 140 is disposed on the optical path of the image light emitted from the display element 130, and is an optical element that reflects the image light toward the second optical element 150. The first optical element 140 is a convex mirror formed in a rectangular shape in a plan view. The first optical element 140 is disposed in an orientation that is tilted with respect to a vertical plane. The reflective surface of the first optical element 140 faces the display element 130 and the second optical element 150. In other words, the reflective surface of the first optical element 140, which is the mirror surface of the convex mirror, faces inward of the housing 110, and the concave surface faces outward of the housing 110.

[0084] The second optical element 150 is disposed on the optical path of the image light that has passed through the first optical element 140 and is an optical member that reflects the image light reflected by the first optical element 140 toward the opening 111. Specifically, the second optical element 150 is a concave mirror formed in a rectangular shape in a plan view. The second optical element 150 faces the reflective surface side of the first optical element 140 and is disposed in an orientation that is inclined with respect to the vertical plane of the housing 110. The reflective surface of the second optical element 150 faces the first optical element 140 and the cover unit 120. In other words, the reflective surface of the second optical element 150, which is the mirror surface of the concave mirror, faces inward of the housing 110, and the convex surface faces outward of the housing 110. The image light reflected by the second optical element 150 is projected onto the windshield 2 through the opening 111. This reflection causes the image light to be directed toward the eyes of the driver sitting in the driver's seat, forming a first virtual image 101. FIG. 1 illustrates the position of the first virtual image 101 as seen from the driver's viewpoint. This position can be set by adjusting the viewing distance of the image light emitted from the display element 130 of the first display device 100. The viewing distance is the distance from the driver's viewpoint to the imaging position of a virtual image (e.g., the first virtual image 101). The driver's viewpoint is, for example, a reference eye point. The reference eye point is a point that represents the position of the driver's eyes in a normal driving state.

[0085] [Second display device] 1, the second display device 200 projects image light toward the driver. The driver perceives the image light entering his or her eyes as a second virtual image 201 projected at a distance through an opening 221 (see FIG. 3) of the second display device 200.

[0086] Next, the configuration of second display device 200 will be described with reference to Fig. 3. Fig. 3 is a schematic cross-sectional view showing second display device 200 according to embodiment 1. As shown in Fig. 3, second display device 200 includes a housing 220, a display element 230, a polarizing half mirror 240, a first reflecting mirror 250, and a second reflecting mirror 260. Polarizing half mirror 240, first reflecting mirror 250, and second reflecting mirror 260 form an optical system for projecting image light from display element 230 as second virtual image 201.

[0087] Housing 220 is a box-shaped body made of light-blocking resin or metal. An opening 221 facing rearward is formed at the upper end of the rear portion of housing 220 (the right direction in FIG. 3 is defined as the rear or rear). Image light that becomes second virtual image 201 is projected from opening 221. A display element 230, a polarizing half mirror 240, a first reflecting mirror 250, and a second reflecting mirror 260 are housed in the internal space of housing 220.

[0088] The display element 230 is, for example, a liquid crystal panel, and when irradiated with light from a light source (not shown), irradiates the polarizing half mirror 240 with image light that becomes the second virtual image 201. The display element 230 may be an organic EL panel. The display element 230 is disposed with its display surface facing backward. Although not shown, a λ / 4 retardation plate (hereinafter abbreviated as λ / 4 plate) is laminated on the display surface of the display element 230. The λ / 4 plate is a λ / 4 retardation plate that imparts a phase difference of ¼ of the wavelength λ to light incident on the λ / 4 plate. For example, when the light emitted from the display surface is linearly polarized S-polarized light, it is converted into circularly polarized light by passing through the λ / 4 plate.

[0089] The polarizing half mirror 240 is configured to reflect P-polarized light and transmit S-polarized light, and a reflective polarizing plate is disposed on a flat glass substrate. Furthermore, a λ / 4 plate is laminated on the surface of the polarizing half mirror 240. The polarizing half mirror 240 is disposed in a position facing the display element 230 and the first reflecting mirror 250. The S-polarized image light emitted from the display element 230 is converted into circularly polarized light by the λ / 4 plate laminated on the display element 230 and proceeds to the polarizing half mirror 240. This circularly polarized image light is converted into P-polarized light by the λ / 4 plate laminated on the polarizing half mirror 240 and reflected by the reflective polarizing plate of the polarizing half mirror 240. The reflected P-polarized image light is converted into circularly polarized light by passing through the λ / 4 plate again. Therefore, the polarized half mirror 240 is positioned in such a way that the image light incident as circularly polarized light is reflected as circularly polarized light toward the first reflecting mirror 250 by the λ / 4 plate and the reflective polarizing plate stacked on the polarized half mirror 240.

[0090] The first reflecting mirror 250 is a concave mirror and is disposed below the polarizing half mirror 240 in Fig. 3. The first reflecting mirror 250 is disposed with its concave reflective surface facing upward. The circularly polarized image light reflected by the polarizing half mirror 240 is reflected by the first reflecting mirror 250 as it is, remaining circularly polarized, and travels back toward the polarizing half mirror 240. The image light incident on the polarizing half mirror 240 is converted into S-polarized light by a λ / 4 plate laminated on the polarizing half mirror 240, passes through the reflective polarizer of the polarizing half mirror 240, and travels upward in Fig. 3.

[0091] The second reflecting mirror 260 is a flat mirror and is disposed above the polarizing half mirror 240. Therefore, the image light that passes through the polarizing half mirror 240 and travels upward is reflected by the second reflecting mirror 260. The second reflecting mirror 260 is disposed in an orientation that reflects the image light toward the opening 221. That is, the image light reflected by the second reflecting mirror 260 travels through the opening 221 toward the eyes of the driver sitting in the driver's seat, and becomes the second virtual image 201. FIG. 1 illustrates the position of the second virtual image 201 as seen from the driver's viewpoint. This position can be set by adjusting the imaging position of the image light irradiated from the display element 230 of the second display device 200.

[0092] [Control Unit] 1, the control unit 500 is electrically connected to the first display device 100 and the second display device 200, and collectively controls the display content of each of the display elements 130 and 230. Specifically, the control unit 500 includes a CPU, RAM, ROM, etc., and the CPU executes each process by expanding a program in the ROM into the RAM and executing it.

[0093] [Positional relationship between the first and second virtual images] Next, the positional relationship between the first virtual image 101 and the second virtual image 201 will be described. As shown in Fig. 1, the first virtual image 101 is formed in an attitude inclined with respect to the horizontal plane when the vehicle 1 is viewed from the side. Specifically, the first virtual image 101 is disposed so that the bottom end of the first virtual image 101 is at the rearmost position in the traveling direction of the vehicle 1 and the top end is at the frontmost position in the traveling direction of the vehicle 1.

[0094] The second virtual image 201 is disposed below the first virtual image 101 when the vehicle 1 is viewed from the side. The second virtual image 201 is formed in an orientation parallel to the vertical plane of the vehicle 1. The lower end of the first virtual image 101 and the upper end of the second virtual image 201 are disposed within a circle C having a diameter equal to the length of the second virtual image 201 when viewed from the side. The length of the second virtual image 201 is the overall length of the second virtual image 201 when the vehicle 1 is viewed from the side. In this embodiment, the second virtual image 201 is disposed parallel to the vertical plane, and therefore the length of the second virtual image 201 is the length in the vertical direction (up and down direction).

[0095] In this way, the lower end of the first virtual image 101 and the upper end of the second virtual image 201 are disposed within the circle C in a side view, which can reduce the vertical gap and the horizontal gap D between the lower end of the first virtual image 101 and the upper end of the second virtual image 201. Here, the horizontal direction refers to the horizontal direction when the vehicle 1 is viewed from the side, that is, the front-to-rear direction of the vehicle 1.

[0096] Here, if the difference Δθ between the first depression angle θ1 to the lower end of the first virtual image 101 based on the driver's viewpoint and the second depression angle θ2 to the upper end of the second virtual image 201 is within 12°, the lower end of the first virtual image 101 and the upper end of the second virtual image 201 will be positioned within circle C in side view, and the vertical gap between the lower end of the first virtual image 101 and the upper end of the second virtual image 201 can be further reduced.

[0097] In order to further reduce the gap between the lower end of the first virtual image 101 and the upper end of the second virtual image 201 in the vertical direction, the difference Δθ is preferably within 10°, and more preferably within 6°.

[0098] [Effects, etc.] As described above, according to the present embodiment, the lower end of the first virtual image 101 and the upper end of the second virtual image 201 are disposed within a circle C having a diameter equal to the length of the second virtual image 201 in a side view, so that the lower end of the first virtual image 101 and the upper end of the second virtual image 201 can be disposed close to each other in the vertical direction. This reduces the vertical and horizontal gaps D between the lower end of the first virtual image 101 and the upper end of the second virtual image 201, thereby reducing the burden on the driver due to movement of the viewpoint and focus when switching between the first virtual image 101 and the second virtual image 201. From the viewpoint of reducing the gaps, the diameter of the circle C is preferably ½ of the entire length of the second virtual image 201, and more preferably ¼ of the entire length.

[0099] Furthermore, since the difference Δθ between the first depression angle θ1 to the lower end of the first virtual image 101 based on the driver's viewpoint and the second depression angle θ2 to the second virtual image 201 is within 12°, it is possible to further reduce the gap in the vertical direction between the lower end of the first virtual image 101 and the upper end of the second virtual image 201. Therefore, it is possible to further reduce the burden on the driver due to the movement of the viewpoint and the movement of the focus when switching between viewing the first virtual image 101 and the second virtual image 201.

[0100] Furthermore, since the control unit 500 controls the display content of the first display device 100 and the display content of the second display device 200, the control unit 500 can collectively control the display content of the first display device 100 (the display content of the first virtual image 101) and the display content of the second display device 200 (the display content of the second virtual image 201). This makes it easier to link the contents of the first virtual image 101 and the second virtual image 201.

[0101] [Embodiment 2] A description will be given of embodiment 2. In the following description, the same parts as those in embodiment 1 will be given the same reference numerals, and the description thereof may be omitted.

[0102] Fig. 4 is a schematic diagram showing a display system 10A according to embodiment 2. As shown in Fig. 4, the display system 10A further includes a third display device 300 that projects a third virtual image 301 in front of the driver. The third display device 300 is disposed near the upper end of the windshield 2 and functions as an electronic inner mirror that can display a camera image of the area behind the vehicle as the third virtual image 301.

[0103] 5 is a schematic cross-sectional view showing a third display device 300 according to Embodiment 2. As shown in FIG. 5, the third display device 300 includes a housing 320, a display element 330, a polarizing half mirror 340, and a reflecting mirror 350.

[0104] Housing 320 is a box-shaped body made of light-blocking resin or metal. An opening 321 facing backward (defined as the right side in FIG. 5) is formed in the upper end (defined as the upper side in FIG. 5) of the rear part (defined as the right side in FIG. 5) of housing 320. Image light that becomes third virtual image 301 is projected from opening 321. A display element 330, a polarizing half mirror 340, and a reflecting mirror 350 are housed in the internal space of housing 320.

[0105] The display element 330 is, for example, a liquid crystal panel, and when irradiated with light from a light source (not shown), irradiates the polarizing half mirror 340 with image light that becomes the third virtual image 301. The display element 330 may be an organic EL panel. The display element 330 is disposed with its display surface facing upward (defined as the upper side in FIG. 5). Although not shown, a λ / 4 plate is laminated on the display surface of the display element 330.

[0106] The polarizing half mirror 340 reflects S-polarized light and transmits P-polarized light. Specifically, the polarizing half mirror 340 is configured by arranging a reflective polarizing plate on a flat glass substrate. The polarizing half mirror 340 is positioned so as to reflect the image light emitted from the display element 330 toward the reflecting mirror 350. Although not shown in the figures, a λ / 4 plate is laminated on the surface of the polarizing half mirror 340 facing the display element 330.

[0107] The reflecting mirror 350 is a concave mirror and is disposed in front of the polarizing half mirror 340. The reflecting mirror 350 is disposed in a position where its concave reflective surface faces backward. The reflecting mirror 350 is disposed in a position where it reflects the image light that has passed through the polarizing half mirror 340 toward the opening 321.

[0108] P-polarized image light emitted from display element 330 enters a λ / 4 plate and is converted into circularly polarized light before traveling toward polarizing half mirror 340. The image light then enters a λ / 4 plate on polarizing half mirror 340, where it is converted into S-polarized light, and is then reflected by polarizing half mirror 340. The image light then enters a λ / 4 plate on polarizing half mirror 340, where it is converted into circularly polarized light, before traveling toward reflecting mirror 350, where it is reflected. Next, the image light enters a λ / 4 plate on polarizing half mirror 340, where it is converted into P-polarized light, before passing through polarizing half mirror 340 and traveling toward opening 321. The image light that passed through opening 321 travels toward the eyes of the driver sitting in the driver's seat, becoming third virtual image 301 (see FIG. 4).

[0109] Here, when the third virtual image 301 is positioned at a viewing distance within 0.25 diopters of the viewing distance of the second virtual image 201, the horizontal gap between the second virtual image 201 and the third virtual image 301 can be reduced. Therefore, the burden on the driver caused by moving the viewpoint and the focus when switching between viewing the second virtual image 201 and the third virtual image 301 can be reduced. Note that a diopter is defined as the absolute value of the difference between the reciprocal of the distance from the viewpoint to the left end of the second virtual image 201 and the reciprocal of the distance from the viewpoint to the right end of the third virtual image 301.

[0110] Fig. 6 is a schematic diagram showing a third display device 300a of Modification 1 according to Embodiment 2. As shown in Fig. 6, the third display device 300a is disposed near the center of the lower end of the windshield 2, and functions as a car navigation device that displays car navigation information and the like as a third virtual image 301a.

[0111] Fig. 7 is a schematic diagram showing a third display device 300b of Modification 2 according to Embodiment 2. As shown in Fig. 7, the third display device 300b is disposed at each end of the lower edge of the windshield 2, and functions as an electronic inner mirror capable of displaying a camera image of the area behind the vehicle 1 as a third virtual image 301b.

[0112] [Embodiment 3] A third embodiment will be described. Fig. 8 is a schematic diagram showing a second display device 200B according to the third embodiment. As shown in Fig. 8, the second display device 200B includes three first reflecting mirrors 250b. The three first reflecting mirrors 250b are arranged along the longitudinal direction of the display element 230 (the normal direction to the paper surface). Of the three first reflecting mirrors 250b, the middle first reflecting mirror 250b is arranged at the bottom in Fig. 8, and the other two first reflecting mirrors 250b are arranged above the middle first reflecting mirror 250b in Fig. 8 and at the same position as the middle first reflecting mirror 250b in a side view.

[0113] FIG. 9 is an explanatory diagram showing a display example of the display element 230 according to the third embodiment. As shown in FIG. 9, the display element 230 is divided into three sections in the longitudinal direction, and each section forms a different image G1, G2, or G3. The central image G2 (e.g., showing the state of the vehicle's cruise control) corresponds to the central first reflecting mirror 250b, and the other two images G1 and G3 (e.g., showing a speedometer and an engine tachometer) correspond to the other two first reflecting mirrors 250b. In FIG. 8, the image light of the central image G2 is indicated by a dashed line, and the image light of the other two images G1 and G3 are indicated by a dot-dash line. Because the central first reflecting mirror 250b and the other two first reflecting mirrors 250b are disposed at different positions, the viewing distance of the second virtual image formed by the image G2 differs from the viewing distance of the second virtual images formed by the images G1 and G3. Specifically, the viewing distance of the second virtual image formed by the image G2 is longer than the viewing distance of the second virtual images formed by the images G1 and G3. In other words, from the driver's perspective, the second virtual image formed by the image G2 appears farther away than the second virtual images formed by the images G1 and G3. In this way, the second display device 200B displays multiple layers of second virtual images as seen by the driver, enabling a variety of content to be displayed.

[0114] Note that the first virtual image may also be displayed in multiple layers in the first display device. FIG. 10 is a schematic diagram showing a first display device 100B according to embodiment 3. As shown in FIG. 10, the first display device 100B includes multiple (for example, two) display elements 131b and 132b. The display element 131b is disposed closer to the first optical element 140 than the display element 132b. Therefore, the viewing distance of the first virtual image formed by the display element 131b is shorter than the viewing distance of the first virtual image formed by the display element 132b. As a result, the first virtual image formed by the display element 131b and the first virtual image formed by the display element 132b are displayed in multiple layers as seen by the driver.

[0115] [Embodiment 4] A fourth embodiment will be described. FIG. 11 is a schematic diagram showing a second display device 200C according to the fourth embodiment. As shown in FIG. 11, the second reflecting mirror 260c of the second display device 200C is a concave mirror. As such, in the optical system provided in the second display device 200C, the second reflecting mirror 260c that ultimately reflects the image light is a concave mirror. Since the image light is ultimately reflected and converged by the concave mirror to form the second virtual image, it is easy to ensure the viewing distance of the second virtual image.

[0116] [Embodiment 5] A fifth embodiment will be described. FIG. 12 is a schematic diagram showing a first display device 100D according to the fifth embodiment. As shown in FIG. 12, the first display device 100D has an adjustment unit 190 for adjusting the viewing distance of the first virtual image 101. The adjustment unit 190 is a device for moving the display element 130 in the optical axis direction (the normal direction to the display surface of the display element 130). The adjustment unit 190 includes a drive source and a movement mechanism for reciprocating the display element 130 in the optical axis direction based on power from the drive source. In other words, the adjustment unit 190 adjusts the viewing distance of the first virtual image 101 by adjusting the position of the display element 130 with respect to the optical axis direction.

[0117] FIG. 13 is a schematic diagram showing a second display device 200D according to the fifth embodiment. As shown in FIG. 13, the second display device 200D has an adjustment unit 290 for adjusting the viewing distance of the second virtual image 201. The adjustment unit 290 is a device for moving the first reflecting mirror 250 in the optical axis direction of the image light reflected by the first reflecting mirror 250. The adjustment unit 290 includes a drive source and a movement mechanism for reciprocating the first reflecting mirror 250 in the optical axis direction based on power from the drive source. That is, the adjustment unit 290 adjusts the viewing distance of the second virtual image 201 by adjusting the position of the first reflecting mirror 250 with respect to the optical axis direction.

[0118] In this way, the first display device 100D and the second display device 200D are provided with the adjustment units 190 and 290, respectively, so that the viewing distances of the first virtual image 101 and the second virtual image 201 can be adjusted. This allows the adjustment units 190 and 290 to adjust the viewing distances of the first virtual image 101 and the second virtual image 201 according to various conditions, enabling more diverse content representation. Note that the adjustment units 190 and 290 may be provided in at least one of the first display device 100D and the second display device 200D.

[0119] [Embodiment 6] A sixth embodiment will be described. In the first embodiment described above, as shown in FIG. 1, a case has been exemplified in which the first virtual image 101 is disposed at an angle with respect to the horizontal plane of the vehicle 1, and the second virtual image 201 is disposed parallel to the up-down direction of the vehicle 1. In this sixth embodiment, another example of the arrangement of the first virtual image and the second virtual image will be described. FIGS. 14A to 14C are explanatory diagrams showing an example of the arrangement of the first virtual image and the second virtual image according to the sixth embodiment.

[0120] 14A, the first virtual image 101e1 and the second virtual image 201e1 are both arranged parallel to each other in the vertical direction of the vehicle 1 and are arranged flush with each other. In this case, too, the lower end of the first virtual image 101e1 and the upper end of the second virtual image 201e1 are arranged within the circle C.

[0121] 14B, the first virtual image 101e2 and the second virtual image 201e2 are both tilted relative to the horizontal plane of the vehicle 1 so that their upper ends are higher than their lower ends. Furthermore, the first virtual image 101e2 and the second virtual image 201e2 are flush with each other. In this case, too, the lower end of the first virtual image 101e2 and the upper end of the second virtual image 201e2 are located within the circle C.

[0122] 14C , the first virtual image 101e3 is arranged such that a first portion 101e31, which is the lower end portion, is parallel to the vertical direction of the vehicle 1, and a second portion 101e32, which is above the first portion 101e31, is inclined relative to the horizontal plane so as to be upward toward the front of the vehicle 1. The second virtual image 201e3 is arranged parallel to the horizontal plane of the vehicle 1 and flush with the first portion 101e31 of the first virtual image 101e3. In this case as well, the lower end of the first virtual image 101e3 and the upper end of the second virtual image 201e3 are arranged within the circle C.

[0123] Fig. 15 is a schematic diagram showing a first display device 100E corresponding to Arrangement Example 3 of Embodiment 6. As shown in Fig. 15, the first display device 100E includes a plurality of (e.g., two) display elements 131e and 132e. The display elements 131e and 132e are arranged in different orientations. The display element 131e forms a first portion 101e31 of a first virtual image 101e3, and the display element 132e forms a second portion 101e32 of the first virtual image 101e3.

[0124] In this way, in either arrangement example, the vertical and horizontal gaps between the bottom end of the first virtual image and the top end of the second virtual image can be suppressed, thereby reducing the burden on the driver caused by moving their viewpoint and focus when switching between the first virtual image and the second virtual image.

[0125] [Embodiment 7] A seventh embodiment will be described. In the above-described first embodiment, a case where the first display device 100 and the second display device 200 each include a reflective optical system has been exemplified. However, at least one of the first display element and the second display element may include an optical system including a hologram element. In this seventh embodiment, a case where the first display device includes an optical system including a hologram element will be described.

[0126] Fig. 16 is a schematic diagram showing a first display device 100F according to Embodiment 7. As shown in Fig. 16, the first display device 100F includes an image generating device 155f and a light guide 160f.

[0127] Image generating device 155f is a device that emits image light to light guide 160f. Light guide 160f is an optical system including a hologram element, and in this embodiment is a hologram light guide. Light guide 160f is optically transparent, and magnifies the image light emitted by image generating device 155f, and emits it toward windshield 2. Light guide 160f has light-transmitting light guide section 161f and multiple hologram elements 162f.

[0128] The light guiding section 161f has an incident surface 163f facing the image generating device 155f and an exit surface 164f facing the windshield 2. The light guiding section 161f is made of a light-transmitting material such as glass or a resin material.

[0129] A plurality of hologram elements 162f are provided inside the light guiding unit 161f. The plurality of hologram elements 162f are light-transmitting optical elements that diffract and emit light propagating through the light guiding unit 161f. The plurality of hologram elements 162f are contained within the light guiding unit 161f in an orientation substantially parallel to the entrance surface and exit surface of the light guiding unit 161f. The plurality of hologram elements 162f are made of a light-transmitting material. The plurality of hologram elements 162f include a first hologram element 165f, a second hologram element 166f, and a third hologram element 167f.

[0130] First hologram element 165f is an incident hologram element onto which the image light emitted from image generating device 155f is incident. First hologram element 165f outputs the incident image light toward second hologram element 166f. Specifically, first hologram element 165f deflects the image light by diffraction in accordance with the diffraction efficiency of first hologram element 165f, and outputs the deflected image light toward second hologram element 166f.

[0131] Second hologram element 166f is a folded hologram element that diffracts the image light from first hologram element 165f and outputs the image light toward third hologram element 167f. Specifically, second hologram element 166f deflects the image light by diffraction in accordance with the diffraction efficiency of second hologram element 166f and outputs the image light toward third hologram element 167f.

[0132] Third hologram element 167f diffracts the image light from second hologram element 166f and emits the image light from emission surface 164f to the outside of light guide 160f. Specifically, third hologram element 167f deflects the image light by diffraction in accordance with the diffraction efficiency of third hologram element 167f and emits the image light from emission surface 164f to the outside.

[0133] As described above, since the first display device 100F includes an optical system (light guide 160f) including a hologram element, it is possible to make the optical system of the first display device 100F thin.

[0134] [Embodiment 8] An eighth embodiment will be described. In the first embodiment, the first display position of the first virtual image 101 and the second display position of the second virtual image 201 are fixed. However, the first display position of the first virtual image and the second display position of the second virtual image may be movable.

[0135] Fig. 17 is a schematic diagram showing a display system 10G according to embodiment 8. Fig. 18 is an explanatory diagram showing a first virtual image 101g and a second virtual image 201g at reference positions in the display system 10G according to embodiment 8. Strictly speaking, Fig. 18 shows a displayable range R1g of the first virtual image 101g and a displayable range R2g of the second virtual image 201g. The displayable range refers to an area in which a virtual image can be displayed.

[0136] As shown in FIG. 17, a display system 10G includes a first position adjustment unit 171g and a second position adjustment unit 172g, which are electrically connected to and controlled by a control unit 500g.

[0137] The first position adjustment unit 171g is provided in the housing 110 of the first display device 100G and adjusts the first display position of the first virtual image 101g in the up-down direction. Specifically, the first position adjustment unit 171g includes a rotation mechanism and a drive motor for adjusting the attitude (tilt) of the second optical element 150g. The second optical element 150g is an example of a first reflecting unit that reflects the image light that forms the first virtual image 101g. The second optical element 150g rotates clockwise or counterclockwise, for example, around the center of the reflecting surface. This swing is performed by the rotation mechanism and drive motor provided in the first position adjustment unit 171g. This causes the attitude of the second optical element 150g to change. By changing the attitude of the second optical element 150g, the optical path of the image light that forms the first virtual image 101g also changes, and the first display position of the first virtual image 101g is adjusted.

[0138] The second position adjustment unit 172g is provided on the housing 220 of the second display device 200G and adjusts the second display position of the second virtual image 102g in the up-down direction. Specifically, the second position adjustment unit 172g includes a rotation mechanism and a drive motor for adjusting the attitude (tilt) of the second reflecting mirror 260g. The second reflecting mirror 260g is an example of a second reflecting unit that reflects the image light that forms the second virtual image 201g. The second reflecting mirror 260g rotates clockwise or counterclockwise, for example, around the center of the reflecting surface. This swing is performed by the rotation mechanism and drive motor provided in the second position adjustment unit 172g. This causes the attitude of the second reflecting mirror 260g to change. By changing the attitude of the second reflecting mirror 260g, the optical path of the image light that forms the second virtual image 201g also changes, and the second display position of the second virtual image 201g is adjusted.

[0139] Furthermore, as shown in FIG. 18, display system 10G includes head imaging unit 175g that captures an image of the driver's head. Head imaging unit 175g is a camera located near the top of windshield 2 inside vehicle 1 and captures images of the interior of the vehicle. Head imaging unit 175g is connected to control unit 500g and outputs the captured image to control unit 500g. Control unit 500g detects the driver's head position from the image captured by head imaging unit 175g and estimates the driver's viewpoint position based on the detected head position. In other words, control unit 500g is an example of an estimation unit that estimates the driver's viewpoint position based on the image captured by head imaging unit 175g.

[0140] The control unit 500g controls the first position adjustment unit 171g and the second position adjustment unit 172g based on the estimated driver's viewpoint position. In this way, the control unit 500g is an example of an adjustment control unit. Through this control, the first display position and the second display position can be adjusted to positions corresponding to the driver's viewpoint position.

[0141] Next, the control unit 500g changes the coordinates of the first virtual image 101g within the displayable range R1g of the first virtual image 101g based on the adjusted first display position and second display position, thereby making it possible to display the first virtual image 101g and the second virtual image 201g without causing discomfort to the driver.

[0142] The following will specifically describe the differences between the first virtual image 101g and the second virtual image 201g before and after the adjustment of the first display position and the second display position.

[0143] FIG. 19 is an explanatory diagram showing the first virtual image 101g and the second virtual image 201g at the reference position as viewed from the driver in the eighth embodiment. As shown in FIG. 19, the displayable range R1g of the first virtual image 101g is indicated by a dashed line, and the displayable range R2g of the second virtual image 201g is indicated by a dashed line. The first virtual image 101g is a hatched area within the displayable range R1g. The second virtual image 201g is a hatched area within the displayable range R2g. The second virtual image 201g is disposed over the entire displayable range R2g. The lower end of the displayable range R1g overlaps with the displayable range R2g, and the first virtual image 101g is not displayed in the overlapping portion. In other words, the first virtual image 101g and the second virtual image 201g are displayed without any gaps in the vertical direction. Therefore, the first virtual image 101g and the second virtual image 201g appear as one unit to the driver, which makes it less likely that the driver will feel uncomfortable.

[0144] Next, let us consider a case where a driver is replaced by a larger driver. Fig. 20 is an explanatory diagram showing a state in which a driver is replaced by a larger driver and the first display position and the second display position are adjusted in the eighth embodiment. Fig. 20 corresponds to Fig. 18.

[0145] As shown in FIG. 20, since the driver has been handed over to a larger driver, the viewpoint position also moves upward (from "viewpoint before the change" to "viewpoint after the change" in FIG. 20). Controller 500g detects the driver's head position based on the image obtained by head imaging unit 175g and estimates the driver's viewpoint position based on the detected head position. Controller 500g then controls first position adjustment unit 171g and second position adjustment unit 172g based on the estimated driver's viewpoint position. This adjusts the first display position and the second display position to positions corresponding to the driver's viewpoint position. In this embodiment, the first display position is raised without moving the second display position. This raises displayable range R1g to a position where it does not overlap with displayable range R2g. At this time, the smaller the gap between the bottom edge of displayable range R1g and the top edge of displayable range R2g, the better.

[0146] Fig. 21A is an explanatory diagram showing the first virtual image 101g and the second virtual image 201g when the first display position is simply adjusted in the eighth embodiment. Fig. 21A corresponds to Fig. 19. As shown in Fig. 21A, simply raising the first display position causes a gap to appear between the first virtual image 101g and the second virtual image 201g because the coordinates of the first virtual image 101g within the displayable range R1g remain constant.

[0147] Therefore, the control unit 500g changes the coordinates of the first virtual image 101g within the displayable range R1g of the first virtual image 101g based on the adjusted first display position and second display position. Specifically, the control unit 500g displays the first virtual image 101g at coordinates within the displayable range R1g that are closer to the displayable range R2g than before the change. More preferably, the control unit 500g displays the first virtual image 101g at coordinates where the bottom edge of the first virtual image 101g overlaps the bottom edge of the displayable range R1g.

[0148] FIG. 21B is an explanatory diagram showing the first virtual image 101g and the second virtual image 201g when the first display position is adjusted and the coordinates of the first virtual image 101g are adjusted in the eighth embodiment. FIG. 21B corresponds to FIG. 21A. As shown in FIG. 21B, the coordinates of the first virtual image 101g within the displayable range R1g are adjusted as described above, thereby reducing the gap between the first virtual image 101g and the second virtual image 201g. Therefore, the first virtual image 101g and the second virtual image 201g appear as a single unit to the driver, which reduces the sense of incongruity.

[0149] As described above, the display system 10G includes the control unit 500g, which is a coordinate changing unit, the first position adjusting unit 171g, and the second position adjusting unit 172g. Therefore, even if the driver's viewpoint position changes, the display system 10G can adjust the first display position of the first virtual image 101g and the second display position of the second virtual image 201g, and also adjust the coordinates of the first virtual image 101g within the displayable range R1g. Therefore, the first virtual image 101g and the second virtual image 201g can be displayed appropriately for different drivers.

[0150] Furthermore, the first position adjustment unit 171g adjusts the first display position of the first virtual image 101g by adjusting the attitude (tilt) of the second optical element 150g, so the first display position can be adjusted with a simple structure. On the other hand, the second position adjustment unit 172g adjusts the second display position of the second virtual image 201g by adjusting the attitude (tilt) of the second reflecting mirror 260g, so the second display position can be adjusted with a simple structure. As a result, the first virtual image 101g and the second virtual image 201g can be displayed appropriately for different drivers.

[0151] Furthermore, the control unit 500g estimates the driver's viewpoint position based on the image captured by the head imaging unit 175g, and controls the first position adjustment unit 171g and the second position adjustment unit 172g based on the estimated viewpoint position, thereby automatically adjusting the first display position and the second display position.

[0152] In the present embodiment, the first position adjustment unit 171g adjusts the first display position by adjusting the attitude of the second optical element 150g. However, the first position adjustment unit 171g may adjust the first display position by adjusting the position of the second optical element 150g. Furthermore, as long as the first position adjustment unit 171g can adjust the first display position, it may adjust at least one of the attitude and position of other optical elements (such as the display element 130 and the first optical element 140) or adjust the attitude and position of the entire first display device 100G. The same applies to the second position adjustment unit 172g.

[0153] Although the present embodiment illustrates an example in which the control unit 500g automatically adjusts the first display position and the second display position, these adjustments may also be performed manually. Specifically, the display system 10G may be equipped with a controller for inputting operational instructions to the first position adjustment unit 171g and the second position adjustment unit 172g. For example, when a user operates the controller to adjust the first display position and the second display position, the control unit 500g controls the first display device 100G and the second display device 200G to display the first virtual image 101g and the second virtual image 201g for testing. Furthermore, when the user inputs an operational instruction to the controller to move the first display position and the second display position, the control unit 500g operates the first position adjustment unit 171g and the second position adjustment unit 172g based on the operational instruction. This allows the first display position and the second display position to be adjusted to the user's intended location. In this case as well, the control unit 500g changes the coordinates of the first virtual image 101g within the displayable range R1g of the first virtual image 101g based on the adjusted first display position and second display position.

[0154] [Embodiment 9] Fig. 22 is a schematic diagram showing a state in which a display system A10 according to the ninth embodiment is installed in a vehicle A1. Fig. 22 shows the vehicle A1 in cross section. Here, the user of the display system A10 is the driver of the vehicle A1.

[0155] As shown in FIG. 22, the display system A10 includes a first display device A100, a second display device A200, a first imaging unit A400, and a control unit A500. The first display device A100 and the second display device A200 are disposed, for example, in a dashboard A4 (see FIG. 23) of the vehicle A1. The first display device A100 and the second display device A200 display, for example, vehicle information related to the vehicle A1 as a first virtual image A101 and a second virtual image A201. Examples of the vehicle information include the vehicle speed of the vehicle A1, the engine speed, detection results of objects approaching the vehicle A1, navigation information from the current location of the vehicle A1 to a destination, image information captured by a camera capturing an image of the rear of the vehicle A1, and notification information for the driver. The notification information is information indicating that an object AP (see FIG. 23) is present in the image captured by the first imaging unit A400. For example, the object AP is a moving object (pedestrian, animal, vehicle other than vehicle A1 (car, motorcycle, kick scooter, etc.)) existing around vehicle A1. In other words, the notification information is information for notifying the driver of vehicle A1 that a moving object is approaching vehicle A1.

[0156] Note that Figure 22 illustrates an example in which the first display device A100 and the second display device A200 are placed inside the dashboard A4, but the installation locations of the first display device A100 and the second display device A200 are not limited to this. For example, the first display device A100 may be placed near the top end of the windshield A2, and the second display device A200 may be placed in the center console, etc.

[0157] The first display device A100 is a transmissive display such as an AR-HUD (Augmented Reality Head-up Display). The first display device A100 projects light onto a windshield (front glass) A2, which is a display medium. The projected light is reflected by the windshield A2. This reflected light is directed toward the eyes of a driver sitting in the driver's seat. The driver perceives the reflected light as a first virtual image A101 that appears on the opposite side of the windshield A2 (outside the vehicle) against a background of actual objects visible through the windshield A2. FIG. 22 illustrates an example of the position of the first virtual image A101 as seen from the driver's viewpoint. This position can be set by adjusting the imaging position of the image light irradiated from the first display device A100. The driver's viewpoint is, for example, a reference eye point. The reference eye point is a point that represents the position of the driver's eyes during normal driving conditions.

[0158] The second display device A200 is a non-transmissive display. The second display device A200 projects image light toward the driver. The driver perceives the image light entering his / her eyes as a second virtual image A201 projected at a distance on the second display device A200. That is, the image light emitted from the second display device A200 is directed toward the eyes of the driver sitting in the driver's seat and becomes the second virtual image A201. FIG. 22 illustrates an example of the position of the second virtual image A201 as seen from the driver's viewpoint. The second display device A200 may be a transmissive display such as a HUD (Head-up Display).

[0159] Next, the positional relationship between the first virtual image A101 and the second virtual image A201 will be described. As shown in Fig. 22, the first virtual image A101 is formed in a position parallel to the vertical plane when the vehicle A1 is viewed from the side.

[0160] The second virtual image A201 is disposed below the first virtual image A101 when the vehicle A1 is viewed from the side. The second virtual image A201 is formed in a position parallel to the vertical plane. The lower end of the first virtual image A101 and the upper end of the second virtual image A201 are disposed close to each other. Specifically, the lower end of the first virtual image A101 and the upper end of the second virtual image A201 are disposed within a circle AC whose diameter is the length of the second virtual image A201 when viewed from the side. The length of the second virtual image A201 is the overall length of the second virtual image A201 when viewed from the side. In this embodiment, the second virtual image A201 is disposed parallel to the vertical plane, and therefore the length of the second virtual image A201 is the length in the vertical direction (up and down direction).

[0161] In this way, since the lower end of the first virtual image A101 and the upper end of the second virtual image A201 are positioned close to each other, the vertical and horizontal gaps between the lower end of the first virtual image A101 and the upper end of the second virtual image A201 can be reduced.

[0162] The first imaging unit A400 is a camera that captures images of the surroundings of the vehicle A1. Specifically, the first imaging unit A400 captures images of the area ahead of the vehicle A1. The first imaging unit A400 is disposed in front of the driver sitting in the driver's seat. Specifically, the first imaging unit A400 is disposed at the front end of the vehicle A1. Therefore, it is possible for the first imaging unit A400 to capture an image of an object AP that is in a blind spot as seen from the driver.

[0163] The control unit A500 is disposed in the dashboard A4 and controls the first display device A100, the second display device A200, and the first imaging unit A400. Because the single control unit A500 controls the first display device A100, the second display device A200, and the first imaging unit A400, the control configuration of the entire system can be simplified and power consumption can be reduced.

[0164] Specifically, the control unit A500 includes a CPU, RAM, ROM, etc., and executes various processes by the CPU expanding a program stored in the ROM into the RAM and executing it. For example, the control unit A500 performs image processing on image data captured by the first imaging unit A400 to recognize at least one object AP in the image data and detect its position coordinates, size, etc. The control unit A500 also performs image processing on the image data to recognize structures (buildings, walls, etc.) included in the image data and detect their position coordinates, size, etc. The control unit A500 extracts objects AP that are in a blind spot due to structures when viewed from the driver's viewpoint (reference eye point), creates notification information AY110 and AY210 (see FIG. 23 ) based on the position coordinates, size, etc. of the extracted objects AP, and displays them on the first display device A100 and the second display device A200.

[0165] [Display example] Display examples of the notification information AY110 and AY210 will be described below. Fig. 23 is an explanatory diagram showing a display example of the notification information AY110 and AY210 according to the ninth embodiment. In the display example shown in Fig. 23, the first display area A102 of the first virtual image A101 displayed by the first display device A100 has a first display area A102 whose upper half overlaps the windshield A2 and whose remaining portion overlaps the hood A3 of the vehicle A1. The second display area A202 of the second virtual image A201 displayed by the second display device A200 overlaps the dashboard A4.

[0166] The control unit A500 controls the first display device A100 to display notification information AY110 as an arrow in the first display area A102 as a first virtual image A101. Meanwhile, the control unit A500 controls the second display device A200 to display the image captured by the first imaging unit A400 as a second virtual image A201 in the entire second display area A202, and to display notification information AY210 as an arrow in the second display area A202 as the second virtual image A201. That is, in the second display area A202, the notification information AY210 is displayed superimposed on the image captured by the first imaging unit A400. Here, the image captured by the first imaging unit A400 is an example of vehicle surroundings information. The vehicle surroundings information is information indicating the situation around the vehicle A1, and in this embodiment, it is an image of the area ahead of the vehicle A1 captured by the first imaging unit A400. The vehicle surroundings information may be a navigation image linked to the video captured by the first imaging unit A400, or a combination of the video and the navigation image. When displaying the notification information AY110, AY210 on the first display device A100 and the second display device A200, the control unit A500 adjusts at least one of the brightness, size, and chromaticity of the notification information AY110, AY210 together with the vehicle surroundings information obtained from the first imaging unit A400 and displays them. These adjustments will be described in detail later.

[0167] The notification information AY110 and AY210 are graphics that guide the driver's line of sight to the object AP. In the present embodiment, the notification information AY110 and AY210 are arrows, but may be other graphics.

[0168] To enhance the visual guidance effect, the notification information AY110, AY210 may be displayed for at least a certain period of time (for example, 0.2 seconds or more). The notification information AY110, AY210 may flash alternately. The flashing cycle is, for example, 0.5 seconds or more and 1 second or less. The flashing cycle may be different for attention and warning. For example, a sense of vigilance can be expressed by making the flashing cycle for warnings shorter than the flashing cycle for attention. Also, one of the notification information AY110, AY210 may be kept lit while the other flashes.

[0169] Although the object AP is not visible from the driver's viewpoint due to being in a blind spot of the wall AW, it is captured by the first imaging unit A400 and therefore appears in the image captured by the first imaging unit A400. The control unit A500 extracts the object AP in this blind spot and places the notification information AY110 and AY210 on a line AL connecting the coordinate position of the object AP and the display reference point APS. The line AL is a virtual line set across the first display area A102 and the second display area A202, and although it is not displayed in the first display area A102 or the second display area A202 in FIG. 23, it may be displayed.

[0170] In this embodiment, since the object AP is located outside the first display region A102, the display reference point APS is set on the center line ALc in the width direction (vehicle width direction) of the first display region A102. The display reference point APS may be located either inside or outside the first display region A102. Furthermore, the display reference point APS may be located at a vanishing point as seen by the driver. In this case, the driver is likely to notice the notification information AY110 when looking ahead.

[0171] [Brightness adjustment] When displaying the notification information AY110, AY210 on the first display device A100 and the second display device A200, the control unit A500 may adjust the brightness of the notification information AY110, AY210 between the first display device A100 and the second display device A200 based on vehicle surrounding information.

[0172] Specifically, the control unit A500 calculates the luminance of the background from the image (vehicle surroundings information) of the area ahead of the vehicle A1 captured by the first imaging unit A400. The control unit A500 calculates the luminance of the first virtual image A101 when the first virtual image A101 is superimposed on the background based on the luminance of the background. That is, when the luminance of the background is high, such as during the daytime, the control unit A500 calculates the luminance of the first virtual image A101, particularly the notification information AY110, to be high enough to be visible to the driver. Conversely, when the luminance of the background is low, such as during the nighttime, the control unit A500 calculates the luminance of the first virtual image A101, particularly the notification information AY110, to be low enough so as not to dazzle the driver. Based on the calculation results, the control unit A500 adjusts the luminance of the notification information AY110 and AY210 between the first display device A100 and the second display device A200.

[0173] For example, the control unit A500 may adjust the luminance of the notification information AY110 and AY210 between the first display device A100 and the second display device A200 so that the luminance of the notification information AY110 in the first virtual image A101 and the luminance of the notification information AY210 in the second virtual image A201 are approximately equal. This reduces the difference in luminance between the notification information AY110 in the first virtual image A101 and the notification information AY210 in the second virtual image A201. This further reduces the sense of discomfort felt by the user when visually recognizing the notification information AY110 in the first virtual image A101 and the notification information AY210 in the second virtual image A201. The difference in luminance of the notification information AY110 from the luminance of the notification information AY210 may be within 20%, and preferably within 10%.

[0174] Furthermore, the control unit A500 may adjust the luminance of the notification information AY110 and AY210 between the first display device A100 and the second display device A200 so that the luminance of the notification information AY110 in the first virtual image A101 is greater than the luminance of the notification information AY210 in the second virtual image A201. This makes the luminance of the notification information AY110 in the first virtual image A101 greater than the luminance of the notification information AY210 in the second virtual image A201, thereby making the notification information AY110 in the first virtual image A101, which is positioned above the second virtual image A201, more noticeable. This makes it easier for the driver to recognize the notification information AY110 in the first virtual image A101. It is preferable that the difference in luminance of the notification information AY110 with respect to the luminance of the notification information AY210 be 20% or more.

[0175] Furthermore, the control unit A500 may adjust the luminance of the notification information AY110 and AY210 between the first display device A100 and the second display device A200 so that the luminance of the notification information AY110 in the first virtual image A101 is lower than the luminance of the notification information AY210 in the second virtual image A201. This makes the luminance of the notification information AY110 in the first virtual image A101 lower than the luminance of the notification information AY210 in the second virtual image A201, making the notification information AY210 stand out in the second virtual image A201, which is positioned below the first virtual image A101 and where the driver's line of sight is lowered. It is preferable that the difference in luminance of the notification information AY110 be 20% or more compared to the luminance of the notification information AY210.

[0176] In addition, if the user has set a brightness upper limit for the first display device A100 in advance, it is preferable that the control unit A500 adjusts the brightness of the notification information AY110 so that the brightness of the first display device A100 does not exceed the brightness upper limit.

[0177] [Scale] The control unit A500 may adjust the sizes of the notification information AY110 and AY210 between the first display device A100 and the second display device A200. Specifically, the control unit A500 adjusts the widths of the notification information AY110 and AY210 between the first display device A100 and the second display device A200 so that the width of the arrow of the notification information AY110 and the width of the arrow of the notification information AY210 shown in Fig. 23 are approximately equal. It is preferable that the difference between the width of the notification information AY110 and the width of the notification information AY210 is within 10%.

[0178] [Chromaticity adjustment] When the control unit A500 displays the notification information AY110, AY210 on the first display device A100 and the second display device A200, the control unit A500 may adjust the chromaticity of the notification information AY110, AY210 between the first display device A100 and the second display device A200 based on vehicle surrounding information.

[0179] Specifically, the control unit A500 calculates the chromaticity of the background from the image (vehicle surroundings information) of the area ahead of the vehicle A1 captured by the first imaging unit A400. The control unit A500 calculates the chromaticity of the first virtual image A101 when the first virtual image A101 is superimposed on the background, based on the chromaticity of the background. Based on the calculation result, the control unit A500 adjusts the chromaticity between the first display device A100 and the second display device A200 so that the chromaticity of the notification information AY110 in the first virtual image A101 and the chromaticity of the notification information AY210 in the second virtual image A201 are approximately equal. For example, when the background is mainly green, such as when driving in a mountainous area, the notification information AY110 will not stand out if it is made green. Therefore, the chromaticity of the notification information AY110 may be adjusted so that the notification information AY110 appears red, which is the complementary color of green. Therefore, by making the notification information AY110 purple, it blends with the green background and appears red to the driver, making it easy to understand. In this case, the notification information AY210 of the second display device A200 can be made red. Here, the difference (color difference ΔE*) between the chromaticity of the notification information AY110 and the chromaticity of the notification information AY210 is preferably 6.5 or less, and more preferably 3.2 or less.

[0180] The control unit A500 may also keep the chromaticity of the notification information AY210 in the second virtual image A201 constant and adjust the chromaticity of the notification information AY110 in the first virtual image A101, thereby making the notification information AY110 in the first virtual image A101 more visible.

[0181] Furthermore, the control unit A500 may keep the chromaticity of the notification information AY110 in the first virtual image A101 constant and make the chromaticity of the notification information AY210 in the second virtual image A201 approximately equal to the chromaticity of the notification information AY110 in the first virtual image A101. This makes it difficult for the chromaticity of the notification information AY110 in the first virtual image A101 to change, thereby reducing the burden on the driver when viewing the road ahead.

[0182] [Effects, etc.] As described above, according to the present embodiment, when the notification information AY110 and AY210 are displayed on the first display device A100 and the second display device A200, at least one of the luminance, size, and chromaticity of the notification information AY110 and AY210 displayed together with the vehicle surroundings information obtained from the first imaging unit A400 is adjusted between the first display device A100 and the second display device A200. This makes it possible to visually uniformize the notification information AY110 displayed on the first display device A100 and the notification information AY210 displayed on the second display device A200. This reduces the sense of discomfort felt by the driver when visually recognizing the notification information AY110 in the first virtual image A101 and the notification information AY210 in the second virtual image A201.

[0183] The first display device A100 projects the first virtual image A101, and the second display device A200 projects the second virtual image A201, so that when the notification information AY110 in the first virtual image A101 and the notification information AY210 in the second virtual image A201 are viewed from a distance, reducing the driver's sense of discomfort.

[0184] Since the lower end of the first virtual image A101 and the upper end of the second virtual image A201 are disposed close to each other, it is possible to reduce gaps in the vertical direction and the horizontal direction between the lower end of the first virtual image A101 and the upper end of the second virtual image A201. This reduces the burden on the driver caused by movement of the viewpoint and focus when visually recognizing from the first virtual image A101 to the second virtual image A201 or from the second virtual image A201 to the first virtual image A101.

[0185] The luminance of the first virtual image A101 when the first virtual image A101 is superimposed on the background is calculated based on the vehicle surroundings information, and based on the calculation result, the luminance of the notification information AY110 and AY210 is adjusted between the first display device A100 and the second display device A200. This allows the influence of the background on the luminance of the first virtual image A101 to be reflected in the luminance of the notification information AY110 and AY210, making it possible to present information more naturally.

[0186] Since the luminance of the notification information AY110 in the first virtual image A101 and the luminance of the notification information AY210 in the second virtual image A201 are approximately equal, the difference in luminance between the notification information AY110 in the first virtual image A101 and the notification information AY210 in the second virtual image A201 can be reduced. Therefore, the discomfort felt by the driver when visually recognizing the notification information AY110 in the first virtual image A101 and the notification information AY210 in the second virtual image A201 can be further reduced.

[0187] The luminance of the notification information AY110 in the first virtual image A101 is greater than the luminance of the notification information AY210 in the second virtual image A201, so that the notification information AY110 in the first virtual image A101, which is positioned above the second virtual image A201, can be made more noticeable. This makes it easier for the driver to recognize the notification information AY110 in the first virtual image A101.

[0188] Since the brightness of the notification information AY110 in the first virtual image A101 is smaller than the brightness of the notification information AY210 in the second virtual image A201, the notification information AY210 can be made to stand out in the second virtual image A201, which is positioned below the first virtual image A101 and where the driver's line of sight is lowered.

[0189] Since the size of the notification information AY110, AY210 is adjusted between the first display device A100 and the second display device A200, the sense of incongruity in the size of the notification information AY110, AY210 between the first display device A100 and the second display device A200 can be reduced.

[0190] The chromaticity of the first virtual image A101 when the first virtual image A101 is superimposed on the background is calculated based on the vehicle surroundings information, and based on the calculation result, the chromaticity of the notification information AY110 in the first virtual image A101 and the chromaticity of the notification information AY210 in the second virtual image A201 are made substantially equal. This allows the chromaticity of the notification information AY110 in the first virtual image A101 and the chromaticity of the notification information AY210 in the second virtual image A201 to be adjusted to be substantially equal, taking into account the influence of the background of the first virtual image A101, thereby enabling information notification that feels more natural.

[0191] Since the chromaticity of the notification information AY110 in the first virtual image A101 is adjusted while the chromaticity of the notification information AY210 in the second virtual image A201 remains constant, the notification information AY110 in the first virtual image A101 can be more easily viewed.

[0192] The chromaticity of the notification information AY110 in the first virtual image A101 remains constant, and the chromaticity of the notification information AY210 in the second virtual image A201 is made approximately equal to the chromaticity of the notification information AY110 in the first virtual image A101, so the chromaticity of the notification information AY110 in the first virtual image A101 is less likely to change, thereby reducing the burden on the driver when viewing the road ahead.

[0193] When the object AP is outside the first display region A102, the notification information AY110 is displayed at a display reference point APS set on the center line ALc in the width direction of the first display region A102. In other words, when the object AP is not within the first display region A102, the notification information AY110 is positioned on the center line ALc of the first display region A102, so that the driver can more reliably view the notification information AY110.

[0194] The notification information AY110 displayed on the first display device A100 and the notification information AY210 displayed on the second display device A200 are arranged on a straight line AL including the display reference point APS, so that the driver's line of sight can be moved linearly toward each piece of notification information AY110, AY210, thereby reducing the burden caused by line of sight movement.

[0195] Since the image captured by the first imaging unit A400 is displayed on the second display device A200, the image captured by the first imaging unit A400 and the notification information AY210 on the second display device A200 can be displayed superimposed on each other. This allows the notification information AY210 to be displayed on a clear image, enabling easy-to-understand presentation for the driver.

[0196] [Embodiment 10] A tenth embodiment will be described. FIG. 24 is a schematic diagram showing a display system A10A according to the tenth embodiment. As shown in FIG. 24, the display system A10A further includes a first imaging unit A400a that captures an image of the area ahead of the vehicle A1. The first imaging unit A400a is disposed near the upper end of the windshield A2 inside the vehicle A1 and captures an image of the area ahead of the vehicle A1 through the windshield A2. The control unit A500 calculates the luminance and chromaticity of the background from the image of the area ahead of the vehicle A1 captured by the first imaging unit A400a (vehicle surroundings information). That is, in the tenth embodiment, the first imaging unit A400 is an imaging unit dedicated to capturing an image of the area ahead of the vehicle A1 and displaying the image on the second display device A200, and the first imaging unit A400a is an imaging unit dedicated to calculating the luminance and chromaticity of the background. In this way, the provision of the first imaging unit A400a dedicated to calculating the luminance and chromaticity of the background makes it possible to further improve the accuracy of the luminance adjustment and the chromaticity adjustment. In particular, since the first imaging unit A400a captures the view in front of the vehicle A1 from inside the vehicle through the windshield A2, the brightness and chromaticity of the background as seen from inside the vehicle can be reflected in the brightness and chromaticity adjustments, which is advantageous.

[0197] [Embodiment 11] An eleventh embodiment will be described. FIG. 25 is a schematic diagram showing a display system A10B according to the eleventh embodiment. As shown in FIG. 25, the display system A10B further includes a second imaging unit A600b that captures an image of the driver's surroundings. The second imaging unit A600b is disposed near the upper end of the windshield A2 and captures an image of the vicinity of the headrest of the driver's seat. That is, when the driver is seated in the driver's seat, the second imaging unit A600b captures an image of the driver's head. The control unit A500 acquires information about the driver's surroundings (user surroundings information) by performing image processing on the image captured by the second imaging unit A600b. Specifically, the control unit A500 detects the driver's viewpoint position by performing image processing on the image captured by the second imaging unit A600b and acquires the viewpoint position as user surroundings information. The control unit A500 estimates the luminance of the background when the driver views the first virtual image A101 based on the viewpoint position. The control unit A500 reflects this estimation result in adjusting the brightness of the notification information AY110 and AY210, thereby realizing information notification that is more natural.

[0198] The control unit A500 may also adjust the sizes of the notification information AY110 and AY210 between the first display device A100 and the second display device A200 based on the user's surroundings information obtained from the second imaging unit A600b. The control unit A500 estimates a first distance between the driver and the first virtual image A101 and a second distance between the driver and the second virtual image A201 based on the viewpoint position. The control unit A500 reflects the first distance and the second distance in adjusting the sizes of the notification information AY110 and AY210, thereby realizing information notification that feels more natural.

[0199] The control unit A500 may also adjust the chromaticity of the notification information AY110 and AY210 between the first display device A100 and the second display device A200 based on the user surroundings information obtained from the second imaging unit A600b. Specifically, the control unit A500 detects the driver's viewpoint position by performing image processing on the image captured by the second imaging unit A600b and acquires the viewpoint position as the user surroundings information. The control unit A500 estimates the chromaticity of the background when the driver views the first virtual image A101 based on the viewpoint position. The control unit A500 reflects this estimation result in adjusting the chromaticity of the notification information AY110 and AY210, thereby realizing a more natural information notification.

[0200] [Embodiment 12] A twelfth embodiment will be described. FIG. 26 is a schematic diagram showing a display system A10C according to the twelfth embodiment. As shown in FIG. 26, the display system A10C further includes an illuminance sensor A700c that detects illuminance near the second display device A200. Specifically, the illuminance sensor A700c detects illuminance near the exit of the second display device A200 from which image light is emitted. The control unit A500 adjusts the luminance of the notification information AY110 and AY210 between the first display device A100 and the second display device A200 based on the detection result of the illuminance sensor A700c. For example, when the illuminance near the exit of the second display device A200 is high due to direct sunlight from the windshield A2, the luminance of the notification information AY210 is increased so that the notification information AY210 is not difficult to see. The luminance of the notification information AY110 is then adjusted accordingly. This allows the illuminance in the vicinity of the second display device A200 to be reflected in the brightness of the notification information AY110 and AY210. Therefore, it is possible to notify information in a more natural way.

[0201] [Embodiment 13] A thirteenth embodiment will be described. Fig. 27 is an explanatory diagram showing a display example of notification information AY110 and AY210 according to the thirteenth embodiment. In the ninth embodiment described above, the object AP is outside the first display area A102, and therefore the display reference point APS is set on the center line ALc in the width direction of the first display area A102. In this thirteenth embodiment, a case will be described in which the object AP is inside the first display area A102.

[0202] In FIG. 27, the first display region A102d is set to be wider in the vertical and width directions than the first display region A102 in the ninth embodiment, but they may be of the same size. The control unit A500 recognizes at least one object in the image data captured by the first imaging unit A400 by performing image processing on the image data and detects its position coordinates, size, etc. The control unit A500 extracts an object AP that exists within the first display region A102d when viewed from the driver's viewpoint (reference eye point), creates notification information AY110 and AY210 based on the position coordinates, size, etc. of the extracted object AP, and displays the notification information AY110 and AY210 on the first display device A100 and the second display device A200. At this time, because the object AP exists within the first display region A102d, the control unit A500 sets the object AP as the display reference point APS. The control unit A500 displays the notification information AY110 and AY210 on a straight line AL connecting the coordinate position of the object AP in the second display area A202 and the display reference point APS.

[0203] In this way, when the object AP is within the first display area A102d, the notification information AY110 and AY210 are displayed with the object AP as the display reference point APS, so that when the driver visually recognizes the notification information AY110 and AY210, they can also recognize the actual object AP.

[0204] 27, the control unit A500 also displays a mark AM near the display reference point APS in the first display area A102d. This mark AM may be a mark for calling attention or a mark for warning. This mark AM makes it easier for the driver to notice the occurrence of notification information AY110. The display content, display period, etc. of the mark AM can be changed as desired by the driver. Furthermore, the display location of the mark AM is not limited to the top of the object AP and may be any location.

[0205] Fig. 28 is an explanatory diagram showing another display example of the mark AM according to the thirteenth embodiment. As shown in Fig. 28, the second display area A202d may be divided into two, with an image captured by the first imaging unit A400 or the like displayed in one portion and the mark AM displayed in the other portion. In Fig. 28, the object AP is highlighted by displaying a frame AQ around it. This highlighting makes it easier for the driver to notice the object AP.

[0206] FIG. 29 is an explanatory diagram showing another display example of the notification information AY110 and AY210 according to the thirteenth embodiment. FIG. 29 illustrates a case where, for example, when the vehicle starts moving, an object AP is bent forward of the vehicle A1 and is not visible to the driver but is present within the first display region A102. Even in this case, the control unit A500 recognizes the object AP and detects its position coordinates, size, and the like by performing image processing on the image data captured by the first imaging unit A400. The control unit A500 extracts the object AP that is hidden by the hood A3 but is present within the first display region A102 when viewed from the driver's viewpoint (reference eye point). The control unit A500 creates notification information AY110 and AY210 based on the position coordinates, size, and the like of the extracted object AP and displays the information on the first display device A100 and the second display device A200. Since the object AP is present within the first display region A102, the control unit A500 sets the object AP as the display reference point APS. The control unit A500 displays the notification information AY110 and AY210 on a straight line AL connecting the coordinate position of the object AP in the second display area A202 and the display reference point APS.

[0207] In this way, even if there is an object AP that is not visible to the driver but exists within the first display area A102, the driver can be made aware of the object AP by guiding their gaze using the notification information AY110 and AY210.

[0208] [Embodiment 14] A fourteenth embodiment will be described. FIG. 30 is an explanatory diagram showing a display example of the notification information AY110e and AY210e according to the fourteenth embodiment. In the fourteenth embodiment, the control unit A500 continuously displays the notification information AY110e displayed on the first display device A100 and the notification information AY210e displayed on the second display device A200. Specifically, as shown in FIG. 30, the notification information AY110e and the notification information AY210e are represented as a single arrow spanning the first display region A102 and the second display region A202. Since the notification information AY110e and the notification information AY210e are continuously displayed in this manner, the driver can easily recognize the positional relationship between the notification information AY110e and AY210e.

[0209] [Embodiment 15] A description will be given of embodiment 15. Fig. 31 is an explanatory diagram showing a display example of notification information AY110f and AY210f according to embodiment 15. In embodiment 15, the control unit A500 displays the notification information AY110f displayed on the first display device A100 and the notification information AY210f displayed on the second display device A200 so as to move from the first display region A102 toward the second display region A202.

[0210] For example, in the example shown in Fig. 31, first, in the first display area A102, notification information AY110f is displayed along a straight line AL from the display reference point APS as shown in Fig. 31(a). Next, as shown in Fig. 31(b), notification information AY110f moves along the straight line AL toward the second display area A202. Next, as shown in Fig. 31(c), notification information AY110f and AY210f are displayed across the first display area A102 and the second display area A202 along the straight line AL. At this time, notification information AY110f and AY210f are represented as a single continuous arrow.

[0211] In this way, the notification information AY110f displayed on the first display device A100 and the notification information AY210f displayed on the second display device A200 are displayed so as to move from the first display area A102 toward the second display area A202, making it easier to guide the driver's gaze.

[0212] Fig. 32 is an explanatory diagram showing another display example of the notification information AY110f, AY210f according to embodiment 15. In the example shown in Fig. 32, the notification information AY110f, AY210f is represented by a plurality of triangles aligned on a straight line AL. The notification information AY110f, AY210f is displayed so as to gradually move from the first display area A102 to the second display area A202 (transition from the state shown in Fig. 32(a) to the state shown in Fig. 32(b)).

[0213] [Embodiment 16] A sixteenth embodiment will be described. FIG. 33 is a schematic diagram showing a display system A10G according to the sixteenth embodiment. As shown in FIG. 33, the display system A10G further includes a third imaging unit A650g that captures images of the sides of the vehicle A1, and a tilt sensor A670g that detects the tilt of the vehicle A1. The third imaging unit A650g is provided, for example, in each of the left and right side mirrors, and captures images of the left and right sides of the vehicle A1. The control unit A500 controls the second display device A200 to display the images captured by the third imaging unit A650g in the second display area A202.

[0214] FIG. 34 is an explanatory diagram showing a display example on the second display device A200 according to the sixteenth embodiment. As shown in FIG. 34, the control unit A500 causes the second display device A200 to display a pseudo image AG10, which simulates the interior of the vehicle A1 as a blind spot when the driver is looking to the side of the vehicle A1, superimposed on an image AG20 captured by the third imaging unit A650g. The pseudo image AG10 is represented as a see-through image (dot hatching in FIG. 34) so ​​that the image AG20 can be viewed by the driver. This allows the driver to view the pseudo image AG10 and the image AG20 displayed in the second display area A202 of the second display device A200. This allows the driver to recognize the conditions to the side of the vehicle A1 and the blind spot, and to grasp the situation around the vehicle A1.

[0215] Furthermore, the control unit A500 may correct the image AG20 captured by the third imaging unit A650g based on the detection result of the tilt sensor A670g and display the corrected image on the second display device A200. FIG. 35 is an explanatory diagram showing a display example of the image AG20 according to the sixteenth embodiment. In FIG. 35, a black frame indicates the imaging range Ag30 of the third imaging unit A650g, and a dashed frame indicates the display range Ag40 displayed in the second display region 202A of the second display device 200A. For example, if the tilt sensor A670g detects tilt of the vehicle A1 in the roll direction, the control unit A500 corrects the display range Ag40 by moving it up or down within the imaging range Ag30 (see arrow AYg1) based on the detection result. Furthermore, when the tilt sensor A670g detects tilt of the vehicle A1 in the pitch direction, the control unit A500 rotates and corrects the display range Ag40 within the shooting range Ag30 (see arrow AYg2) based on the detection result of the tilt sensor A670g. In this way, the image AG20 corrected based on the detection result of the tilt sensor A670g is displayed on the second display device A200, allowing the driver to more accurately grasp the situation around the vehicle A1.

[0216] Furthermore, the control unit A500 may detect the object AP1 by performing image processing on the image AG20 captured by the third imaging unit A650g. In this case, the control unit A500 may highlight the object AP1.

[0217] FIG. 36 is an explanatory diagram showing another display example according to the sixteenth embodiment. As shown in FIG. 36, the control unit A500 may control the second display device A200 to highlight the object AP1 in the second display region A202 by displaying a frame AQ1 around the object AP1. This highlighting makes it easier for the driver to notice the object AP1. Note that FIG. 36 omits the pseudo image AG10 shown in the second display region A202.

[0218] [Embodiment 17] A seventeenth embodiment will be described. FIG. 37 is a schematic diagram showing a display system A10H according to the seventeenth embodiment. As shown in FIG. 37, the display system A10H further includes a generating unit A690h that generates sound or vibration. Examples of the generating unit A690h that generates sound include a speaker. Examples of the generating unit A690h that generates vibration include a vibration generator that vibrates the steering wheel and a vibration generator that vibrates the driver's seat. The control unit A500 controls the generating unit A690h to generate sound or vibration from the generating unit A690h based on the display timing of the notification information AY110 and AY210. This allows the driver to more reliably understand the notification information AY110 and AY210 through the sound or vibration from the generating unit A690h.

[0219] [Embodiment 18] An eighteenth embodiment will be described. FIG. 38 is a schematic diagram showing a display system A10J according to the eighteenth embodiment. As shown in FIG. 38, a first display device A100j of the display system A10J includes an augmented reality head-up display A110j and a head-up display A120j. That is, a first virtual image A101j displayed on the first display device A100j is formed by the augmented reality head-up display A110j and the head-up display A120j. This enables more diverse expression with the first virtual image A101j.

[0220] Specifically, the augmented reality head-up display A110j displays a portion A111j of the first virtual image A101j. The head-up display A120j displays another portion A121j of the first virtual image A101j. The portion A111j of the first virtual image A101j is disposed at an incline so as to be upwardly directed toward the front of the vehicle A1. The other portion A121j of the first virtual image A101j is disposed below the portion A111j and parallel to the up-down direction of the vehicle A1.

[0221] Fig. 39 is an explanatory diagram showing a display example of notification information AY110j according to the eighteenth embodiment. In Fig. 39, the first display region A102j is divided into two, upper and lower, with the upper region A103j corresponding to a portion A111j of the first virtual image A101j and the lower region A104j corresponding to the other portion A121j of the first virtual image A101j. In Fig. 39, a navigation graphic AY20j is displayed in the portion A111j of the first virtual image A101j. Furthermore, the notification information AY110j is displayed in the other portion A121j of the first virtual image A101j.

[0222] 40 and 41 are explanatory diagrams showing other display examples of the notification information AY110j according to embodiment 18. As shown in Fig. 40, the notification information AY110j displayed on the first display device A100j may be divided into an upper region A103j and a lower region A104j and displayed. In this case, since the object AP is present outside the first display region A102j, the display reference point APS is set on the center line ALc in the width direction (vehicle width direction) of the upper region A103j.

[0223] 41, since the object AP is present in the lower region A104j, the object AP may be used as the display reference point APS and notification information AY110j may be displayed in the lower region A104j. Note that in FIG. 41, the mark AM is shown in the upper region A103j. In this way, the mark M and notification information AY110j may be displayed separately in the upper region A103j and the lower region A104j depending on the position of the object AP.

[0224] Fig. 42 is a schematic diagram showing another example of a display system A10J according to embodiment 18. As shown in Fig. 42, an augmented reality head-up display A110j and a head-up display A120j may be integrated. That is, a portion A111j of a first virtual image A101j and another portion A121j of the first virtual image A101j may be projected from a single device.

[0225] [Embodiment 19] A nineteenth embodiment will be described. FIG. 43 is a schematic diagram showing a display system A10K according to the nineteenth embodiment. As shown in FIG. 43, the first virtual image A101k may be inclined with its upper end facing forward in the traveling direction of the vehicle A1 and its lower end facing backward in the traveling direction of the vehicle A1. That is, the entire first virtual image A101k may be the augmented reality head-up display A110j described in the eighteenth embodiment. This allows the first virtual image A101k to display an image with a sense of depth on the forward side of the vehicle A1 as seen from the driver. Therefore, since notification information can be displayed from the back to the front, visibility for the driver is improved and discomfort can be further reduced.

[0226] [Embodiment 20] A description will be given of embodiment 20. In embodiment 20, modifications of the first display device and the second display device will be described.

[0227] FIG. 44 is a schematic diagram showing a display system A10M according to embodiment 20. As shown in FIG. 44, the first display device A100m is a transmissive display attached to the windshield A2 and displays a first image A101m. The transmissive display is, for example, a transparent organic EL display. The second display device A200m is a liquid crystal display and displays a second image A201m. In this way, the first display device A100m and the second display device A200m may be display devices that do not project virtual images.

[0228] Fig. 45 is a schematic diagram showing a display system A10N according to embodiment 20. As shown in Fig. 45, the first display device A100n is a transmissive display arranged closer to the interior than the windshield A2, and displays a first image A101n. The second display device A200n is a liquid crystal display, and displays a second image A201n. In this way, the first display device A100n and the second display device A200n may be display devices that do not project virtual images.

[0229] Fig. 46 is a schematic diagram showing a display system A10P according to embodiment 20. As shown in Fig. 46, the first display device A100p is a head-up display and projects a first virtual image A101p in front of the vehicle A1. The second display device A200p is a liquid crystal display and displays a second image A201p.

[0230] Note that, contrary to the configuration in Fig. 46, the first display device may be a display that does not project a virtual image, and the second display device may be a display that displays a virtual image. In other words, as described above, at least one of the first display device and the second display device may be a display that projects a virtual image, or both may be displays that do not project a virtual image.

[0231] (others) While the display system according to one or more aspects of the present disclosure has been described above based on the embodiments, the present disclosure is not limited to these embodiments. As long as they do not deviate from the spirit of the present disclosure, various modifications conceivable by those skilled in the art to the present embodiments and configurations constructed by combining components of different embodiments may also be included within the scope of one or more aspects of the present disclosure.

[0232] For example, in the above embodiment, the first imaging unit A400, the first imaging unit A400a, and the third imaging unit A650g are exemplified as imaging units that capture images of the area around the vehicle A1. However, an imaging unit that captures images behind the vehicle A1, a spherical imaging unit attached to the ceiling of the vehicle A1, or a wide-angle imaging unit may also be used. At least two or more of these imaging units may switch images depending on the direction in which the object AP is located. This allows for clearer images to be displayed.

[0233] (Addendum) The above description of the embodiments and the like discloses the following techniques.

[0234] [Technology 1] a first display device that projects a first virtual image in front of a user riding in a vehicle; a second display device that projects a second virtual image in front of the user and below the first virtual image, The lower end of the first virtual image and the upper end of the second virtual image are arranged within a circle having a diameter equal to the length of the second virtual image in a side view. Display system.

[0235] [Technology 2] In the display system described in Technology 1, A difference between a first depression angle to the lower end of the first virtual image and a second depression angle to the upper end of the second virtual image based on the user's viewpoint is within 12°. Display system.

[0236] [Technology 3] In the display system according to Technology 1 or 2, a third display device that projects a third virtual image in front of the user; the third virtual image is disposed at a viewing distance within 0.25 diopters of the viewing distance of the second virtual image; Display system.

[0237] [Technology 4] In the display system according to any one of techniques 1 to 3, At least one of the first virtual image projected by the first display device and the second virtual image projected by the second display device is displayed in multiple layers. Display system.

[0238] [Technology 5] In the display system according to any one of techniques 1 to 4, The second display device is a display element that irradiates image light to form the second virtual image; an optical system for projecting image light from the display element as the second virtual image, The optical system includes a concave mirror that ultimately reflects the image light. Display system.

[0239] [Technology 6] In the display system according to any one of techniques 1 to 5, At least one of the first display device and the second display device includes an adjustment unit for adjusting a viewing distance of the first virtual image and a viewing distance of the second virtual image. Display system.

[0240] [Technology 7] In the display system according to any one of techniques 1 to 6, a control unit that controls the display content of the first display device and the display content of the second display device; Ru, Display system.

[0241] [Technology 8] In the display system according to any one of techniques 1 to 7, At least one of the first display device and the second display device includes an optical system including a hologram element. Display system.

[0242] [Technology 9] In the display system according to any one of techniques 1 to 8, a first position adjustment unit that adjusts a first display position of the first virtual image in a vertical direction; a second position adjusting unit that adjusts a second display position of the second virtual image in a vertical direction; a coordinate change unit that changes coordinates of the first virtual image within a displayable range of the first virtual image based on the adjusted first display position and the adjusted second display position. Display system.

[0243] [Technology 10] In the display system described in Technology 9, the first display device includes a first reflecting unit that reflects image light that forms the first virtual image, the second display device includes a second reflecting unit that reflects image light that forms the second virtual image, the first position adjustment unit adjusts the first display position of the first virtual image by adjusting at least one of an attitude and a position of the first reflecting unit; the second position adjustment unit adjusts the first display position of the second virtual image by adjusting at least one of an attitude and a position of the second reflecting unit. Display system.

[0244] [Technology 11] In the display system according to technique 9 or 10, a head imaging unit that captures an image of the user's head; an estimation unit that estimates a viewpoint position of the user based on an image captured by the head imaging unit; an adjustment control unit that controls the first position adjustment unit and the second position adjustment unit based on the estimated viewpoint position of the user, Display system.

[0245] [Technology 12] In the display system according to any one of techniques 1 to 11, a first imaging unit that images the surroundings of the vehicle; a control unit that controls the first display device, the second display device, and the first imaging unit, When displaying notification information for the user on the first display device and the second display device, the control unit adjusts at least one of luminance, size, and chromaticity of the notification information displayed together with the vehicle surroundings information obtained from the first imaging unit between the first display device and the second display device. Display system.

[0246] [Technology 13] In the display system described in Technology 12, the first imaging unit images a scene ahead of the vehicle; The control unit calculates a luminance of the first virtual image when the first virtual image is superimposed on a background based on the vehicle surrounding information, and adjusts a luminance of the notification information between the first display device and the second display device based on a calculation result. Display system.

[0247] [Technology 14] In the display system according to Technology 12 or 13, The control unit adjusts the luminance of the notification information between the first display device and the second display device so that the luminance of the notification information in the first virtual image and the luminance of the notification information in the second virtual image are substantially equal to each other. Display system.

[0248] [Technology 15] In the display system according to Technology 12 or 13, The control unit adjusts the luminance of the notification information between the first display device and the second display device so that the luminance of the notification information in the first virtual image is greater than the luminance of the notification information in the second virtual image. Display system.

[0249] [Technology 16] In the display system according to Technology 12 or 13, The control unit adjusts the luminance of the notification information between the first display device and the second display device so that the luminance of the notification information in the first virtual image is smaller than the luminance of the notification information in the second virtual image. Display system.

[0250] [Technology 17] In the display system according to any one of techniques 12 to 16, a second imaging unit that captures an image of the user's surroundings; The control unit adjusts the luminance of the notification information between the first display device and the second display device based on user surroundings information obtained from the second imaging unit. Display system.

[0251] [Technology 18] In the display system according to any one of techniques 12 to 16, an illuminance sensor that detects illuminance in the vicinity of the second display device; The control unit adjusts the luminance of the notification information between the first display device and the second display device based on the detection result of the illuminance sensor. Display system.

[0252] [Technology 19] In the display system according to any one of techniques 12 to 18, a second imaging unit that captures an image of the user's surroundings; The control unit adjusts a size of the notification information between the first display device and the second display device based on user surroundings information obtained from the second imaging unit. Display system.

[0253] [Technology 20] In the display system according to any one of techniques 12 to 19, the first imaging unit images a scene ahead of the vehicle; The control unit calculates a chromaticity of the first virtual image when the first virtual image is superimposed on a background based on the vehicle surroundings information, and adjusts the chromaticity of the notification information in the first virtual image and the chromaticity of the notification information in the second virtual image based on the calculation result so that the chromaticity of the notification information in the first virtual image and the chromaticity of the notification information in the second virtual image are approximately equal to each other. Display system.

[0254] [Technology 21] In the display system according to any one of techniques 12 to 19, the control unit keeps the chromaticity of the notification information in the second virtual image constant and adjusts the chromaticity of the notification information in the first virtual image. Display system.

[0255] [Technology 22] In the display system according to any one of techniques 12 to 19, the control unit keeps the chromaticity of the notification information in the first virtual image constant and makes the chromaticity of the notification information in the second virtual image substantially equal to the chromaticity of the notification information in the first virtual image. Display system.

[0256] [Technology 23] In the display system according to any one of techniques 20 to 22, a second imaging unit that captures an image of the user's surroundings; the control unit adjusts the chromaticity of the notification information between the first display device and the second display device based on the user surroundings information obtained from the second imaging unit. Display system.

[0257] [Technology 24] In the display system according to any one of techniques 12 to 23, the control unit displays the notification information based on a display reference point provided in a first display area of ​​the first display device, The control unit When the object of the notification information is in the first display area, the object is displayed in the display area. Set it at the base point, When the target of the notification information is outside the first display area, the display reference point is set on a center line in a width direction of the first display area. Display system.

[0258] [Technology 25] In the display system described in Technology 24, The control unit arranges the notification information displayed on the first display device and the notification information displayed on the second display device on a straight line including the display reference point. Display system.

[0259] [Technology 26] In the display system described in Technology 25, The control unit causes the notification information displayed on the first display device and the notification information displayed on the second display device to be displayed consecutively. Display system.

[0260] [Technology 27] In the display system described in Technology 25, the control unit displays the notification information displayed on the first display device and the notification information displayed on the second display device so as to move from a first display area of ​​the first display device to a second display area of ​​the second display device, Display system.

[0261] [Technology 28] In the display system according to any one of techniques 12 to 27, the control unit causes the second display device to display the image captured by the first imaging unit. Display system.

[0262] [Technology 29] In the display system according to any one of techniques 12 to 28, a third imaging unit that images the surroundings on the side of the vehicle; the control unit causes the second display device to display a pseudo image simulating the interior of the vehicle as a blind spot seen from the user, superimposed on the image captured by the third imaging unit. Display system.

[0263] [Technology 30] In the display system described in Technology 29, a tilt sensor for acquiring the tilt of the vehicle; the control unit corrects the image captured by the third imaging unit based on the detection result of the tilt sensor, and displays the corrected image on the second display device. Display system.

[0264] [Technology 31] In the display system according to any one of techniques 12 to 30, a generating unit that generates sound or vibration; the control unit causes the generation unit to generate a sound or a vibration based on a display timing of the notification information. Display system.

[0265] [Technology 32] In the display system according to any one of techniques 1 to 31, the first display device includes an augmented reality head-up display that projects a part of the first virtual image and a head-up display that projects another part of the first virtual image, Display system. [Industrial Applicability]

[0266] The present disclosure can be used in a display system for displaying images. [Explanation of symbols]

[0267] 1. A1 vehicle 2. A2 windshield A3 bonnet A4 Dashboard 10, 10A, 10G, A10, A10A, A10B, A10C, A10G, A10H, A10J, A10K, A10M, A10N, A10P Display System 100, 100B, 100C, 100D, 100E, 100F, 100G, A100, A100j, A100m, A100n, A100p First display device 101, 101e, 101e1, 101e2, 101e3, 101g, A101, A101j, A101k, A101p First virtual image 101e31 First part 101e32 Second part 110, 220, 320 enclosure 111, 221, 321 openings 120 Cover 130, 131b, 131e, 132e, 230, 330 Display element 140 First Optical Element 150, 150g Second optical element (first reflecting part) 150f image generation device 160f Light guide (optical system) 161f Light guiding part 162f hologram element 163f Entrance plane 164f Output surface 165f First hologram element 166f Second holographic element 167f Third holographic element 171g First position adjustment section 172g Second position adjustment section 175g Head imaging unit 190, 290 adjustment section 200, 200B, 200C, 200D, 200G, A200, A200m, A200n, A200p Second display device 201, 201e1, 201e2, 201e3, 201g, A201 Second virtual image 240, 340 polarized half mirror 250, 250b First reflector 260, 260c, 260g Second reflector (second reflector) 300, 300a, 300b Third display device 301, 301a, 301b Third virtual image 350 Reflector 500, 500g, A500 Control section (estimation section, adjustment section) C circle D Gap D1 area G1, G2, G3 video R1g, R2g display range Δθ difference θ1 First depression angle θ2 Second depression angle A101m, A101n first image A102, A102d, A102j First display area A103j upper area A104j lower area A110j Augmented Reality Head-Up Display A111j part A120j Head-Up Display A121j Other parts A201n, A201m, A201p 2nd image A202, A202d Second display area A400, A400a First Imaging Unit A600b Second Imaging Unit A650g third imaging unit A670g Tilt Sensor A690h Generator A700c Ambient Light Sensor AC Yen Ag30 shooting range Ag40 display range AG10 pseudo image AG20 Video AL straight line ALc center line AM mark AP, AP1 object APS display reference point AQ, AQ1 slots AW Wall AY20j Shapes AY110, AY110e, AY110f, AY110j, AY210, AY210e, AY210f Notification Information AYg1, AYg2 arrows

Claims

1. a first display device that projects a first virtual image in front of a user riding in a vehicle; a second display device that projects a second virtual image in front of the user and below the first virtual image, The lower end of the first virtual image and the upper end of the second virtual image are arranged within a circle having a diameter equal to the length of the second virtual image in a side view. Display system.

2. a difference between a first depression angle to a lower end of the first virtual image and a second depression angle to an upper end of the second virtual image based on the user's viewpoint is within 12°; The display system of claim 1 .

3. a third display device that projects a third virtual image in front of the user; the third virtual image is disposed at a viewing distance within 0.25 diopters of the viewing distance of the second virtual image; 3. A display system according to claim 1 or 2.

4. At least one of the first virtual image projected by the first display device and the second virtual image projected by the second display device is displayed in multiple layers.

3. A display system according to claim 1 or 2.

5. The second display device is a display element that irradiates image light to form the second virtual image; an optical system for projecting image light from the display element as the second virtual image, The optical system includes a concave mirror that ultimately reflects the image light.

3. A display system according to claim 1 or 2.

6. At least one of the first display device and the second display device includes an adjustment unit for adjusting a viewing distance of the first virtual image and a viewing distance of the second virtual image.

3. A display system according to claim 1 or 2.

7. a control unit for controlling the display content of the first display device and the display content of the second display device; 3. A display system according to claim 1 or 2.

8. At least one of the first display device and the second display device includes an optical system including a hologram element.

3. A display system according to claim 1 or 2.

9. a first position adjustment unit that adjusts a first display position of the first virtual image in a vertical direction; a second position adjusting unit that adjusts a second display position of the second virtual image in a vertical direction; a coordinate change unit that changes coordinates of the first virtual image within a displayable range of the first virtual image based on the adjusted first display position and the adjusted second display position.

3. A display system according to claim 1 or 2.

10. the first display device includes a first reflecting unit that reflects image light that forms the first virtual image, the second display device includes a second reflecting unit that reflects image light that forms the second virtual image, the first position adjustment unit adjusts the first display position of the first virtual image by adjusting at least one of an attitude and a position of the first reflecting unit; the second position adjustment unit adjusts the first display position of the second virtual image by adjusting at least one of an attitude and a position of the second reflecting unit. The display system of claim 9.

11. a head imaging unit that captures an image of the user's head; an estimation unit that estimates a viewpoint position of the user based on an image captured by the head imaging unit; an adjustment control unit that controls the first position adjustment unit and the second position adjustment unit based on the estimated viewpoint position of the user, The display system of claim 9.

12. a first imaging unit that images the surroundings of the vehicle; a control unit that controls the first display device, the second display device, and the first imaging unit, When displaying notification information for the user on the first display device and the second display device, the control unit adjusts at least one of luminance, size, and chromaticity of the notification information displayed together with the vehicle surroundings information obtained from the first imaging unit between the first display device and the second display device.

3. A display system according to claim 1 or 2.

13. the first imaging unit images a scene ahead of the vehicle; The control unit calculates a luminance of the first virtual image when the first virtual image is superimposed on a background based on the vehicle surrounding information, and adjusts a luminance of the notification information between the first display device and the second display device based on a calculation result.

13. The display system of claim 12.

14. The control unit adjusts the luminance of the notification information between the first display device and the second display device so that the luminance of the notification information in the first virtual image and the luminance of the notification information in the second virtual image are substantially equal to each other.

13. The display system of claim 12.

15. The control unit adjusts the luminance of the notification information between the first display device and the second display device so that the luminance of the notification information in the first virtual image is greater than the luminance of the notification information in the second virtual image.

13. The display system of claim 12.

16. The control unit adjusts the luminance of the notification information between the first display device and the second display device so that the luminance of the notification information in the first virtual image is smaller than the luminance of the notification information in the second virtual image.

13. The display system of claim 12.

17. a second imaging unit that captures an image of the user's surroundings; The control unit adjusts the luminance of the notification information between the first display device and the second display device based on user surroundings information obtained from the second imaging unit.

13. The display system of claim 12.

18. an illuminance sensor that detects illuminance in the vicinity of the second display device; The control unit adjusts the luminance of the notification information between the first display device and the second display device based on the detection result of the illuminance sensor.

13. The display system of claim 12.

19. a second imaging unit that captures an image of the user's surroundings; The control unit adjusts a size of the notification information between the first display device and the second display device based on user surroundings information obtained from the second imaging unit.

13. The display system of claim 12.

20. the first imaging unit images a scene ahead of the vehicle; The control unit calculates a chromaticity of the first virtual image when the first virtual image is superimposed on a background based on the vehicle surroundings information, and adjusts the chromaticity of the notification information in the first virtual image and the chromaticity of the notification information in the second virtual image based on the calculation result so that the chromaticity of the notification information in the first virtual image and the chromaticity of the notification information in the second virtual image are approximately equal to each other.

13. The display system of claim 12.

21. the control unit keeps the chromaticity of the notification information in the second virtual image constant and adjusts the chromaticity of the notification information in the first virtual image.

13. The display system of claim 12.

22. the control unit keeps the chromaticity of the notification information in the first virtual image constant and makes the chromaticity of the notification information in the second virtual image substantially equal to the chromaticity of the notification information in the first virtual image.

13. The display system of claim 12.

23. a second imaging unit that captures an image of the user's surroundings; the control unit adjusts the chromaticity of the notification information between the first display device and the second display device based on the user surroundings information obtained from the second imaging unit.

23. The display system of claim 22.

24. the control unit displays the notification information based on a display reference point provided in a first display area of ​​the first display device, The control unit If the object of the notification information is within the first display area, the object is set as the display reference point; When the target of the notification information is outside the first display area, the display reference point is set on a center line in a width direction of the first display area.

13. The display system of claim 12.

25. The control unit arranges the notification information displayed on the first display device and the notification information displayed on the second display device on a straight line including the display reference point.

25. The display system of claim 24.

26. The control unit causes the notification information displayed on the first display device and the notification information displayed on the second display device to be displayed consecutively.

26. The display system of claim 25.

27. the control unit displays the notification information displayed on the first display device and the notification information displayed on the second display device so as to move from a first display area of ​​the first display device to a second display area of ​​the second display device, 26. The display system of claim 25.

28. the control unit causes the second display device to display the image captured by the first imaging unit.

13. The display system of claim 12.

29. a third imaging unit that images the surroundings on the side of the vehicle; the control unit causes the second display device to display a pseudo image simulating the interior of the vehicle as a blind spot seen from the user, superimposed on the image captured by the third imaging unit.

13. The display system of claim 12.

30. a tilt sensor for acquiring the tilt of the vehicle; the control unit corrects the image captured by the third imaging unit based on the detection result of the tilt sensor, and displays the corrected image on the second display device.

30. The display system of claim 29.

31. a generating unit that generates sound or vibration; the control unit causes the generation unit to generate a sound or a vibration based on a display timing of the notification information.

13. The display system of claim 12.

32. the first display device includes an augmented reality head-up display that projects a part of the first virtual image and a head-up display that projects another part of the first virtual image, 3. A display system according to claim 1 or 2.

Images