Display system

Abstract

This system provides a display that reduces the burden on users when viewing different virtual images. [Solution] The display system 10 includes a first display device 100 that projects a first virtual image 101 in front of a user riding in a vehicle 1, and a second display device 200 that projects a second virtual image 201 in front of the user. The first display device 100 is a head-up display or an electronic mirror type display device, and the first viewing distance L1 from the user to the first virtual image 101 is smaller than the second viewing distance L2 from the user to the second virtual image 201.

Description

Technical Field

[0001] The present disclosure relates to a display system.

Background Art

[0002] Patent Document 1 discloses a display system in which a first virtual image and a second virtual image are projected in front of a user. In Patent Document 1, the first virtual image is projected by a head-up display, and a second viewing distance between the second virtual image and the user's viewing point is equal to or less than a first viewing distance between the first virtual image and the user's viewing point.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In recent years, there has been a demand for further reducing the burden on a user when visually recognizing different virtual images.

[0005] Therefore, an object of the present disclosure is to provide a display system capable of reducing the burden on a user when visually recognizing different virtual images.

Means for Solving the Problems

[0006] A display system according to an aspect of the present disclosure includes a first display device that projects a first virtual image in front of a user riding in a vehicle, and a second display device that projects a second virtual image in front of the user, wherein the first display device is a head-up display or an electronic mirror-type display device, and a first viewing distance from the user to the first virtual image is smaller than a second viewing distance from the user to the second virtual image.

Effects of the Invention

[0007] According to this disclosure, a display system can be provided that can reduce the burden on users when viewing different virtual images. [Brief explanation of the drawing]

[0008] [Figure 1] Figure 1 is a schematic diagram showing the display system according to Embodiment 1 installed in a vehicle. [Figure 2] Figure 2 is a schematic diagram showing the first display device and the second display device, which are components of the display system according to Embodiment 1. [Figure 3] Figure 3 is an explanatory diagram showing the driver's gaze movement relative to the first virtual image and the second virtual image according to Embodiment 1. [Figure 4] Figure 4 is an explanatory diagram showing a first example of the display of the second virtual image according to Embodiment 1. [Figure 5] Figure 5 is an explanatory diagram showing a second display example of the second virtual image according to Embodiment 1. [Figure 6] Figure 6 is an explanatory diagram showing a third display example of the second virtual image according to Embodiment 1. [Figure 7] Figure 7 is a schematic diagram showing the display system according to Embodiment 2 installed in a vehicle. [Figure 8] Figure 8 is a schematic diagram showing an electronic mirror type display device according to Embodiment 2. [Figure 9] Figure 9 is a schematic diagram showing the display system according to Embodiment 4 installed in a vehicle. [Figure 10] Figure 10 is a schematic diagram showing the display system according to Embodiment 5 installed in a vehicle. [Figure 11A] Figure 11A is an explanatory diagram showing an example of a display according to Embodiment 6. [Figure 11B] Figure 11B is an explanatory diagram showing an example of a display according to Embodiment 6. [Figure 11C] Figure 11C is an explanatory diagram showing an example of a display according to Embodiment 6. [Figure 12] Figure 12 is an explanatory diagram showing an example of a display according to Embodiment 7. [Figure 13] FIG. 13 is an explanatory diagram showing a display example according to Embodiment 8. [Figure 14A] FIG. 14A is an explanatory diagram showing a display example according to Embodiment 9. [Figure 14B] FIG. 14B is an explanatory diagram showing a display example according to Embodiment 9. [Figure 15A] FIG. 15A is an explanatory diagram showing a display example according to Embodiment 10. [Figure 15B] FIG. 15B is an explanatory diagram showing a display example according to Embodiment 10. [Figure 16A] FIG. 16A is an explanatory diagram showing a display example according to Embodiment 11. [Figure 16B] FIG. 16B is an explanatory diagram showing a display example according to Embodiment 11. [Figure 16C] FIG. 16C is an explanatory diagram showing a display example according to Embodiment 11. [Figure 17] FIG. 17 is an explanatory diagram showing another display example according to Embodiment 11. [Figure 18] FIG. 18 is a schematic diagram showing a display system according to Embodiment 12. [Figure 19] FIG. 19 is an explanatory diagram showing a display example according to Embodiment 12. [Figure 20] FIG. 20 is a schematic diagram showing a display system according to Embodiment 13.

Embodiments for Carrying Out the Invention

[0009] (1) A display system according to an aspect of the present disclosure includes a first display device that projects a first virtual image in front of a user riding in a vehicle, and a second display device that projects a second virtual image in front of the user. The first display device is a head-up display or an electronic mirror-type display device, and a first viewing distance from the user to the first virtual image is smaller than a second viewing distance from the user to the second virtual image.

[0010] According to the display system described in (1), the first viewing distance from the user to the first virtual image is smaller than the second viewing distance from the user to the second virtual image. Therefore, when the user views the scenery in front of the vehicle while driving, the direction of focus of the gaze when switching between the first virtual image, the second virtual image, and the foreground is from near to far, making it easier to focus. Consequently, the burden on the user when viewing different virtual images can be reduced.

[0011] (2) According to the display system described in (1) above, the distance between the first virtual image and the second virtual image in a side view of the vehicle may be within 0.25 diopters.

[0012] According to the display system described in (2), the distance between the first virtual image and the second virtual image in the side view of the vehicle is within 0.25 diopters, so the amount of focus adjustment (amount of eye focus adjustment) required when the user switches their gaze from the first virtual image to the second virtual image can be further suppressed.

[0013] (3) In the display system described in (1) or (2) above, the first virtual image and the second virtual image may be positioned below the user's viewpoint, the downward angle of the second virtual image may be greater than the downward angle of the first virtual image, and the positions of the first virtual image and the second virtual image in the front-rear direction of the vehicle may be the same.

[0014] According to the display system described in (3), the positions of the first virtual image and the second virtual image are the same in the front-rear direction of the vehicle, making it possible to easily move the gaze from the first virtual image to the second virtual image.

[0015] (4) In the display system described in any one of (1) to (3) above, the second display device may include instrument information in the second virtual image.

[0016] According to the display system described in (4), even when the second virtual image contains instrument information, focusing can be easily achieved when switching the line of sight in the order of the first virtual image, the second virtual image, and the foreground.

[0017] (5) In the display system described in any one of (1) to (4) above, the second display device may include the rear side image of the vehicle in the second virtual image.

[0018] According to the display system described in (5), even when the rear side view of the vehicle is included in the second virtual image, focusing can be easily achieved when switching the line of sight in the order of the first virtual image, the second virtual image, and the foreground.

[0019] (6) In the display system described in any one of (1) to (5) above, the second display device may include a wide-angle image of the front or rear of the vehicle in the second virtual image.

[0020] According to the display system described in (6), even when a wide-angle image of the front or rear of the vehicle is included in the second virtual image, focusing can be easily achieved when switching the line of sight in the order of the first virtual image, the second virtual image, and the foreground.

[0021] (7) In the display system described in any one of (1) to (6) above, the second display device may include in the second virtual image a blind spot image that is obscured by the pillar of the vehicle.

[0022] According to the display system described in (7), since the blind spot image caused by the vehicle's pillar is included in the second virtual image by the second display device, the blind spot image can be displayed at a lower cost compared to the case where the display unit is installed on the pillar itself.

[0023] (8) In the display system described in any one of (1) to (7) above, the first display device may be a combiner-type head-up display.

[0024] According to the display system described in (8), even when the first display device is a combiner-type head-up display, focusing can be easily achieved when switching the line of sight in the order of the first virtual image, the second virtual image, and the foreground.

[0025] (9) In the display system described in any one of (1) to (8) above, the system includes an imaging unit that images the area around the vehicle, a first detection unit that detects objects around the vehicle, and a control unit that controls the first display device and the second display device, wherein when the first detection unit detects an object, the control unit includes the object imaged by the imaging unit in the second virtual image and projects it onto the second display device, and includes a guidance mark in the first virtual image and the second virtual image to guide the user's gaze toward the object in the second virtual image and projects it onto the first display device and the second display device, wherein the guidance mark is projected to gradually move from the first virtual image toward the object in the second virtual image and gradually decrease in size.

[0026] According to the display system described in (9), when the first detection unit detects an object, the guidance mark is projected so that it gradually moves from the first virtual image towards the object in the second virtual image and gradually decreases in size, thereby guiding the user's gaze from the first virtual image to the object in the second virtual image.

[0027] (10) In the display system described in (9) above, the control unit may include the warning mark together with the guidance mark in the first virtual image and project it onto the first display device, and the warning mark may be erased when the guidance mark moves to the object in the second virtual image.

[0028] According to the display system described in (10), when the first detection unit detects an object, a warning mark is included in the first virtual image along with a guidance mark, so the user is notified by the guidance mark and the warning mark that an object has been detected around the vehicle. This allows the user to recognize the object more quickly. Furthermore, since the warning mark is erased when the guidance mark moves to the object in the second virtual image, excessive projection of the warning mark can be suppressed.

[0029] (11) In the display system described in (9) or (10) above, the control unit may project the second virtual image onto the second display device, including a frame image around the outer periphery of the second virtual image which includes the object.

[0030] According to the display system described in (11), a second virtual image including the object and the frame image is projected, so the user can quickly understand that the object is included in the second virtual image by viewing the frame image.

[0031] (12) In the display system described in (11) above, the control unit may include a part of the frame image in the first virtual image and project it onto the first display device.

[0032] According to the display system described in (12), since a portion of the frame image is included in the first virtual image, the display range of the frame image is expanded. This makes it easier for the user to notice the expanded display range of the frame image. Therefore, the user can more quickly grasp that the object is included in the second virtual image.

[0033] (13) In the display system described in any one of (1) to (8) above, the system includes an imaging unit that images the area around the vehicle, a first detection unit that detects objects around the vehicle, and a control unit that controls the first display device and the second display device, wherein when the first detection unit detects an object, the control unit includes the object imaged by the imaging unit in the second virtual image and projects it onto the second display device, and also includes radial marks originating from the object in the second virtual image in the first virtual image and the second virtual image and projects them onto the first display device and the second display device.

[0034] According to the display system described in (13), when the first detection unit detects an object, radial marks originating from the object in the second virtual image are included in both the first and second virtual images. These radial marks can guide the user's gaze from the first virtual image to the object in the second virtual image.

[0035] (14) In the display system described in any one of (1) to (8) above, the system includes an imaging unit that images the area around the vehicle, a first detection unit that detects objects around the vehicle, and a control unit that controls the first display device and the second display device, wherein when the first detection unit detects an object, the control unit includes the object imaged by the imaging unit in the second virtual image and projects it onto the second display device, and also includes a guidance mark in the first virtual image to guide the user's gaze toward the second virtual image and projects it onto the first display device.

[0036] According to the display system described in (14), when the first detection unit detects an object, a second virtual image containing the object is projected, and a first virtual image containing a guidance mark is also projected, so that the user's gaze can be guided from the first virtual image to the second virtual image.

[0037] (15) In the display system described in (14) above, the control unit may project the second virtual image onto the second display device, including a frame image around the outer periphery of the second virtual image which includes the object.

[0038] According to the display system described in (15), a second virtual image including the object and the frame image is projected, so the user can quickly understand that the object is included in the second virtual image by viewing the frame image.

[0039] (16) In the display system described in any one of (1) to (8) above, the system includes an imaging unit that images the area around the vehicle, a first detection unit that detects objects around the vehicle, and a control unit that controls the first display device and the second display device, wherein when the first detection unit detects an object, the control unit includes the object imaged by the imaging unit in the second virtual image and projects it onto the second display device, and includes a guidance mark in the first virtual image and the second virtual image to guide the user's gaze toward the object in the second virtual image and projects it onto the first display device and the second display device, wherein the guidance mark is projected to move from the edge of the first virtual image toward the center of the first virtual image and then toward the object in the second virtual image.

[0040] According to the display system described in (16), when the first detection unit detects an object, the guidance mark is projected to move from the edge of the first virtual image toward the center of the first virtual image, and then toward the object in the second virtual image, thereby guiding the user's gaze from the first virtual image to the object in the second virtual image.

[0041] (17) A display system according to any one of (1) to (8) above, comprising: an imaging unit that images the area around the vehicle; a first detection unit that detects objects around the vehicle; a second detection unit that detects the user's line of sight; and a control unit that controls the first display device and the second display device, wherein when the first detection unit detects an object, the control unit includes the object imaged by the imaging unit in the second virtual image and projects it onto the second display device, and also projects the first virtual image with a warning mark placed at a position corresponding to the user's line of sight detected by the second detection unit onto the first display device.

[0042] According to the display system described in (17), when the first detection unit detects an object, a second virtual image containing the object is projected, and a second virtual image with a warning mark placed at a position corresponding to the user's line of sight is also projected. Therefore, the user can quickly understand that the object is included in the second virtual image by looking at the warning mark.

[0043] (18) In the display system described in any one of (1) to (8) above, the system includes an imaging unit that images the area around the vehicle, a first detection unit that detects objects around the vehicle, a warning unit that outputs at least one of a warning sound and a warning vibration to the user, and a control unit that controls the first display device, the second display device and the warning unit, wherein when the first detection unit detects an object, the control unit outputs at least one of the warning sound and the warning vibration from the warning unit, and then includes the object imaged by the imaging unit in the second virtual image and projects it onto the second display device.

[0044] According to the display system described in (18), when the first detection unit detects an object, at least one of a warning sound and a warning vibration is output from the warning unit, and then a second virtual image including the object is projected. Therefore, by recognizing at least one of the warning sound and warning vibration, the user can quickly understand that the object is included in the second virtual image.

[0045] (Embodiment) The embodiments will be described in detail below with reference to the drawings. Note that the embodiments described below are all specific examples of this disclosure. The numerical values, shapes, materials, components, arrangement and connection configurations of components, steps, and the order of steps shown in the following embodiments are examples only and are not intended to limit this disclosure. Furthermore, among the components in the following embodiments, those not described in the independent claim representing the highest-level concept will be described as optional components.

[0046] In the following embodiments, expressions indicating the relative orientation of two directions, such as parallel and orthogonal, may be used, but these expressions include cases where the orientation is not strictly accurate. For example, when two directions are said to be parallel, unless otherwise specified, this means not only that the two directions are perfectly parallel, but also that they are substantially parallel, i.e., that they include a difference of, for example, a few percent. The optical paths illustrated in each figure in the following embodiments are for illustrative purposes only and do not necessarily reflect actual optical paths.

[0047] [Embodiment 1] Figure 1 is a schematic diagram showing the display system 10 according to Embodiment 1 installed in a vehicle 1. In Figure 1, the vehicle 1 is shown in cross-section. Figure 2 is a schematic diagram showing the first display device 100 and the second display device 200, which are components of the display system 10 according to Embodiment 1.

[0048] As shown in Figures 1 and 2, the display system 10 comprises a first display device 100, a second display device 200, and a control unit 500. The first display device 100 and the second display device 200 are located in the dashboard of the vehicle 1 and project vehicle information related to the vehicle 1 as a first virtual image 101 and a second virtual image 201, respectively. Examples of vehicle information include the vehicle speed of the vehicle 1, the engine speed, the detection results of objects approaching the vehicle 1, or navigation information from the vehicle 1's current location to its destination.

[0049] <First display device> The first display device 100 is an AR-HUD (Augmented Reality Head-up Display). The first display device 100 projects image light onto the windshield 2 of the vehicle 1. The projected image light is reflected by the windshield 2. This reflected light is directed towards the eyes of the user, the driver, sitting in the driver's seat.

[0050] The driver perceives the reflected light that enters their eyes as a first virtual image 101 that appears on the opposite side of the windshield 2 (outside the vehicle), with actual objects visible through the windshield 2 as the background. In this way, the first display device 100 projects a virtual image in front of the driver sitting in the vehicle 1.

[0051] As shown in Figure 2, the first display device 100 comprises a housing 110, a cover portion 120, a display element 130, a first optical element 140, and a second optical element 150.

[0052] The housing 110 is a box-shaped body made of light-shielding resin or metal. Specifically, the housing 110 has a roughly rectangular parallelepiped shape, with an opening 111 formed at its top. The opening 111 is closed by a cover portion 120. The internal space of the housing 110 and the cover portion 120 houses the display element 130, the first optical element 140, and the second optical element 150.

[0053] The cover portion 120 is a curved plate made of, for example, a translucent resin or glass. Specifically, the cover portion 120 has a shape that is convex downwards as a whole.

[0054] The display element 130 is, for example, a liquid crystal panel. When light from a light source (not shown) is shone onto the display element 130, it displays an image that forms the basis of the first virtual image 101 and shines the image light of the said image onto the first optical element 140. The display element 130 may also be an organic EL panel. The display element 130 is formed in a rectangular shape in plan view and is arranged in a position tilted with respect to the horizontal plane.

[0055] The first optical element 140 is positioned on the optical path of the image light emitted from the display element 130 and is an optical element that reflects the image light toward the second optical element 150. The first optical element 140 is a convex mirror formed in a rectangular shape in plan view. The first optical element 140 is positioned at an angle to the vertical plane. The reflective surface of the first optical element 140 faces the display element 130 and the second optical element 150. In other words, the reflective surface, which is the mirror surface of the convex mirror, of the first optical element 140 faces inward towards the housing 110, and the concave surface faces outward towards the housing 110.

[0056] The second optical element 150 is positioned on the optical path of the image light that has passed through the first optical element 140, and reflects the image light reflected by the first optical element 140 toward the aperture 111. Specifically, the second optical element 150 is a concave mirror formed in a rectangular shape in plan view. The second optical element 150 is positioned opposite the reflective surface side of the first optical element 140 and tilted with respect to the vertical plane of the housing 110. The reflective surface of the second optical element 150 faces the first optical element 140 and the cover portion 120. In other words, the reflective surface, which is the mirror surface of the concave mirror, of the second optical element 150 faces inward towards the housing 110, and the convex surface faces outward towards the housing 110. The image light reflected by the second optical element 150 is projected onto the windshield 2 through the aperture 111. This reflection directs the image light toward the eyes of the driver sitting in the driver's seat, forming the first virtual image 101. Figure 1 illustrates the position of the first virtual image 101 as seen from the driver's viewpoint. This position can be set by adjusting the viewing distance of the image light emitted from the display element 130 of the first display device 100. The viewing distance is the distance from the driver's viewpoint to the image formation position of the virtual image (e.g., the first virtual image 101). The driver's viewpoint is, for example, the reference eye point. The reference eye point is "a point that represents the position of the driver's eyes in normal driving conditions."

[0057] <Second display device> As shown in Figure 1, the second display device 200 projects image light toward the driver. The driver perceives the image light that enters their eyes as a second virtual image 201 projected in the distance through the aperture 221 (see Figure 2) of the second display device 200. In this way, the second display device 200 projects a virtual image in front of the driver. This is an example of a second display device that projects an image. Specifically, the second display device 200 projects the second virtual image 201 in front of the driver and below the first virtual image 101. Therefore, the downward angle of the driver's line of sight relative to the second virtual image 201 is greater than the downward angle of the driver's line of sight relative to the first virtual image 101.

[0058] As shown in Figure 2, the second display device 200 comprises a housing 220, a display element 230, a polarizing half mirror 240, a first reflector 250, and a second reflector 260.

[0059] The housing 220 is a box-shaped body formed from a light-shielding resin or metal. An opening 221 facing backward is formed at the upper end of the rear of the housing 220 (the right direction in Figure 2 is defined as the rear or rear). Image light, which becomes the second virtual image 201, is projected from the opening 221. The internal space of the housing 220 houses a display element 230, a polarizing half mirror 240, a first reflector 250, and a second reflector 260.

[0060] The display element 230 is, for example, a liquid crystal panel. When light from a light source (not shown) is shone onto the display element 230, it displays an image that forms the basis of the second virtual image 201 and shines the image light of the said image onto the polarizing half mirror 240. The display element 230 may also be an organic EL panel. The display element 230 is positioned with its display surface facing backward. Although not shown in the illustration, a λ / 4 phase difference plate (hereinafter abbreviated as λ / 4 plate) is laminated on the display surface of the display element 230. The λ / 4 plate is a λ / 4 phase difference plate that creates a phase difference of 1 / 4 of the wavelength λ in the light incident on the λ / 4 plate. For example, if the light emitted from the display surface is linearly polarized S-polarization, it is converted to circularly polarized light by passing through the λ / 4 plate.

[0061] The polarizing half-mirror 240 is configured to reflect P-polarized light and transmit S-polarized light, with a reflective polarizer plate arranged on a flat glass substrate. Furthermore, a λ / 4 plate is laminated on the surface of the polarizing half-mirror 240. The polarizing half-mirror 240 is positioned opposite the display element 230 and the first reflector 250. S-polarized image light emitted from the display element 230 is converted to circularly polarized light by the λ / 4 plate laminated on the display element 230 and directed towards the polarizing half-mirror 240. This circularly polarized image light is converted to P-polarized light by the λ / 4 plate laminated on the polarizing half-mirror 240 and reflected by the reflective polarizer plate of the polarizing half-mirror 240. The reflected P-polarized image light is converted back to circularly polarized light by passing through the λ / 4 plate again. Therefore, the polarizing half-mirror 240 is positioned such that the circularly polarized image light incident on the polarizing half-mirror 240 is reflected towards the first reflector 250 in a circularly polarized state by the λ / 4 plate and reflective polarizer laminated on the polarizing half-mirror 240.

[0062] The first reflector 250 is a concave mirror and is positioned below the polarizing half mirror 240 in Figure 2. The first reflector 250 is positioned with its concave reflective surface facing upwards. The circularly polarized image light reflected by the polarizing half mirror 240 is reflected again by the first reflector 250 while remaining circularly polarized, and then returns to the polarizing half mirror 240. The image light incident on the polarizing half mirror 240 is converted to S-polarization by the λ / 4 plate stacked on the polarizing half mirror 240, and then passes through the reflective polarizer of the polarizing half mirror 240 and proceeds upwards in Figure 2.

[0063] The second reflector 260 is a flat mirror and is positioned above the polarizing half mirror 240. Therefore, the image light that passes through the polarizing half mirror 240 and travels upward is reflected by the second reflector 260. The second reflector 260 is positioned to reflect the image light toward the aperture 221. In other words, the image light reflected by the second reflector 260 travels through the aperture 221 toward the eyes of the driver sitting in the driver's seat and becomes the second virtual image 201.

[0064] <Control Unit> As shown in Figure 1, the control unit 500 supplies power to the first display device 100 and the second display device 200. They are electrically connected and controlled. Specifically, the control unit 500 includes a CPU, RAM, ROM, etc., and the CPU executes each process by loading the program in ROM into RAM and executing it.

[0065] The control unit 500 is connected to an imaging unit 550, which is installed in the vehicle 1 and captures images of the area around the vehicle 1, via wired or wireless communication. The imaging unit 550 may also be installed in the display system 10.

[0066] The imaging unit 550 includes a front camera that photographs the front of the vehicle 1, a rear camera that photographs the rear of the vehicle 1, a right rear camera that photographs the right rear of the vehicle 1, a left rear camera that photographs the left rear of the vehicle 1, a right side camera that photographs the right side of the vehicle 1, a left side camera that photographs the left side of the vehicle 1, and so on. Figure 1 illustrates the front camera, which is an example of the imaging unit 550. The image captured by the front camera is included in the front image. The image captured by the rear camera (rear image), the image captured by the right rear camera (right rear image), and the image captured by the left rear camera (left rear image) are all included in the rear image, which shows the rear of the vehicle 1. The image captured by the right side camera (right side image) and the image captured by the left side camera (left side image) are all included in the side image, which shows the side of the vehicle 1.

[0067] The control unit 500 controls the second display device 200 to display at least a portion of the front image, rear image, and side image within the second virtual image 201.

[0068] Meanwhile, the control unit 500 controls the first display device 100 to display the vehicle speed of vehicle 1, navigation information, etc., within the first virtual image 101. The navigation information includes arrows to guide the direction of travel and warning marks to indicate the occurrence of a warning target.

[0069] <Positional relationship between the first virtual image and the second virtual image> The positional relationship between the first virtual image 101 and the second virtual image 201 will be explained below. As shown in Figure 1, the first virtual image 101 and the second virtual image 201 are arranged along the vertical direction. The first virtual image 101 is positioned behind the second virtual image 201. The first viewing distance L1, which is the viewing distance from the driver's viewpoint to the first virtual image 101, is smaller than the second viewing distance L2, which is the viewing distance from the driver's viewpoint to the second virtual image 201. Here, the reference point for the viewing distances of the first virtual image 101 and the second virtual image 201 is shown as the midpoint in the side view of the vehicle 1, but other points (e.g., the upper or lower end) may be used as the reference point if the reference point is equivalent for each virtual image.

[0070] Figure 3 is an explanatory diagram showing the driver's eye movement relative to the first virtual image 101 and the second virtual image 201 according to Embodiment 1. Figure 3(a) shows the eye movement according to Embodiment 1, and Figure 3(b) shows the eye movement according to the comparative example. The comparative example differs in that the first viewing distance L1z of the first virtual image 101 is the same as the first viewing distance L1 according to Embodiment 1, but the second viewing distance L2z of the second virtual image 201 is smaller than the first viewing distance L1z.

[0071] For example, consider a scenario where, while driving, a warning mark is displayed on the first virtual image 101 directed at the driver, and the warning target is displayed as an image on the second virtual image 201. Specifically, when the driver is looking ahead (1 in Figure 3(a)), if a warning mark is displayed on the first virtual image 101, the driver moves their gaze backward using eye movement Y1 to focus their eyes and see the warning mark in the first virtual image 101 (2 in Figure 3(a)). Next, to confirm the warning target, the driver moves their gaze forward using eye movement Y2 to focus their eyes and see the image in the second virtual image 201 to understand the warning target (3 in Figure 3(a)). After that, the driver moves their gaze forward using eye movement Y3 to focus their eyes and shifts their gaze to the actual warning target (understanding the warning target (4 in Figure 3(a))). Generally, focusing from near to far takes less time than focusing from far to near. It is said that when focusing from a distant object to a near object, the ciliary muscle needs to contract and thicken the lens, whereas when focusing from a near object to a far object, the ciliary muscle only needs to relax and thin the lens, allowing the eye to focus in a relatively short time. In this way, after the driver focuses on the first virtual image 101 that is close to the driver, they gradually move their gaze forward so that the focus of their eyes moves to the distance. As a result, the driver only has to focus on the near object, which is difficult for the eyes to focus on, once, and after that, they only need to focus on the far object, which is easier for the eyes to focus on, allowing for a smooth and easy movement of the eyes.

[0072] On the other hand, in the comparative example, when the driver is looking at the forward position (1 in Figure 3(b)), if a warning mark is displayed in the first virtual image 101, the driver moves their gaze backward using eye movement Y11 to focus their eyes and see the warning mark in the first virtual image 101 (2 in Figure 3(b)). Next, in order to confirm the warning target, the driver moves their gaze further backward using eye movement Y12 to focus their eyes and see the image in the second virtual image 201 to understand the warning target (3 in Figure 3(b)). Subsequently, the driver shifts their gaze forward using eye movement Y13 to focus their eyes and then shifts their gaze towards the actual warning target (identifying the warning target ("4" in Figure 3(b)). In this case, even after seeing the first virtual image 101, the driver shifts their gaze further backward before shifting their gaze forward. In other words, the driver needs to shift their gaze forward twice to focus, which can be burdensome for the driver. This is particularly noticeable in elderly drivers with presbyopia. For drivers with presbyopia, even if they try to shift their gaze forward to focus, their vision may remain blurry. Furthermore, even if they shift their gaze to the warning target from this state, smooth eye movement may be hindered, or focusing may become difficult.

[0073] In contrast, in this embodiment, the driver shifts their gaze only once to the foreground to focus, and then gradually shifts their gaze forward, making it easier to focus on the second virtual image 201, the position where the warning target is being watched. Furthermore, the total length of the gaze shift in this embodiment is about L10 shorter than in the comparative example in Figure 3, thus reducing the burden on the driver.

[0074] Here, as shown in Figure 1, the distance D between the first virtual image 101 and the second virtual image 201 in the side view of vehicle 1 should be within 0.25 diopters. Here, a diopter is defined as the absolute value of the difference between the reciprocal of the distance from the viewpoint position to the first virtual image 101 and the reciprocal of the distance from the viewpoint position to the second virtual image 201. Since the distance between the first virtual image 101 and the second virtual image 201 is within 0.25 diopters, the amount of focus required when the driver switches their gaze from the first virtual image 101 to the second virtual image 201 can be further suppressed.

[0075] <Example of displaying the second virtual image> Next, an example of the display of the second virtual image 201 will be described. Figure 4 is an explanatory diagram showing a first example of the display of the second virtual image 201 according to Embodiment 1. As shown in Figure 4, the second virtual image 201 has instrument information G10 on the right side and the left rear image G20, which is the left side of the side rear image, on the left side. The instrument information G10 is information measured by instruments installed in the vehicle 1, and includes measured values ​​from, for example, a vehicle speedometer, tachometer, and outside temperature gauge. The left rear image G20 is an image of the left rear of the vehicle 1 captured by the left rear camera, and is displayed based on the operation of the turn signal or the detection result of the outside camera. In the case of Figure 4, the image is a video of the left rear image G20 reflected within the side mirror frame G21. The second virtual image 201 may also include a front image and a side image.

[0076] Figure 5 is an explanatory diagram showing a second display example of the second virtual image 201 according to Embodiment 1. As shown in Figure 5, the second virtual image 201 has instrument information G10 on the right side and a front image G30 of the vehicle 1 captured by the front camera on the left side. The front image G30 is displayed based on vehicle speed information and detection results from the front camera. If the front camera is a wide-angle camera, the front image G30 is included in the second virtual image 201 as a wide-angle image. The second virtual image 201 may also include a wide-angle image of the rear.

[0077] Figure 6 is an explanatory diagram showing a third display example of the second virtual image 201 according to Embodiment 1. As shown in Figure 6, the second virtual image 201 has instrument information G10 on the left side and a blind spot image G40 on the right side. The blind spot image G40 is an image showing the scenery that is in the blind spot from the driver's perspective due to the pillar of the vehicle 1. In Figure 6, the case where the blind spot image G40 is placed on the right side corresponds to the right pillar of the vehicle 1, but in the case of the left pillar of the vehicle 1, the blind spot image G40 may be placed on the left side.

[0078] Furthermore, vehicle 1 is equipped with an in-vehicle camera that captures images of the interior of the vehicle and a blind spot camera that captures images of the exterior that are obscured by the pillars. The blind spot image G40 is a composite display of the interior image G41 captured by the in-vehicle camera and the exterior image G42 captured by the blind spot camera. If an in-vehicle camera is provided, the control unit 500 may estimate the driver's viewpoint position from the images captured by the in-vehicle camera and composite the interior image G41 and the exterior image G42 to correspond to that viewpoint position.

[0079] Vehicle 1 may be equipped with a warning target sensor for detecting warning targets outside the vehicle (motorcycles, bicycles, people, etc.). In this case, when the warning target sensor detects a warning target in a blind spot of the pillar, the control unit 500 projects the second virtual image 201, including the blind spot image G40, onto the second virtual image 201.

[0080] <Effects, etc.> As described above, according to this embodiment, the first viewing distance L1 from the driver to the first virtual image 101 is smaller than the second viewing distance L2 from the driver to the second virtual image 201. Therefore, when the driver views the scenery in front of the vehicle 1 while driving, the direction of focus of the gaze when switching between the first virtual image 101, the second virtual image 201, and the foreground is from in front of the driver to behind them, making it easier to focus. Thus, the burden on the driver when viewing different virtual images can be reduced.

[0081] Furthermore, since the distance D between the first virtual image 101 and the second virtual image 201 in the side view of vehicle 1 is within 0.25 diopters, the amount of focus of the driver's gaze when switching their gaze from the first virtual image 101 to the second virtual image 201 can be further suppressed.

[0082] Furthermore, even when the second virtual image 201 contains instrument information G10, focusing becomes easier when switching the line of sight in the order of the first virtual image 101, the second virtual image 201, and the foreground.

[0083] Furthermore, even when the rear-side view of vehicle 1 is included in the second virtual image 201, focusing becomes easier when switching the line of sight in the order of first virtual image 101, second virtual image 201, and foreground.

[0084] Furthermore, even when a wide-angle image of the front or rear of vehicle 1 is included in the second virtual image 201, focusing can be easily achieved when switching the line of sight in the order of first virtual image 101, second virtual image 201, and foreground.

[0085] Furthermore, since the blind spot image G40, which is a blind spot caused by the pillar of vehicle 1, is included in the second virtual image 201, the blind spot image G40 can be displayed at a lower cost compared to the case where the display unit is installed on the pillar itself.

[0086] [Embodiment 2] In the following description, parts identical to those in Embodiment 1 and other embodiments may be denoted by the same reference numerals, and their descriptions may be omitted. Embodiment 1 exemplifies a case where the first display device 100 that projects the first virtual image 101 is an augmented reality head-up display. However, the first virtual image may also be projected by an electronic mirror type display device.

[0087] Figure 7 is a schematic diagram showing the display system 10A according to Embodiment 2 installed in the vehicle 1. Figure 7 corresponds to Figure 1. As shown in Figure 7, the display system 10A according to Embodiment 2 projects the first virtual image 101a using an electronic mirror type display device 100a.

[0088] Specifically, the electronic mirror-type display device 100a is positioned in the upper center of the windshield 2 inside the vehicle. Here, the display system 10A is equipped with a rear camera (not shown) that captures images of the area behind the vehicle 1. The electronic mirror-type display device 100a projects a first virtual image 101a based on the rear image obtained by the rear camera. The electronic mirror-type display device 100a projects image light toward the driver. The driver perceives the image light that enters their eyes as the first virtual image 101a projected far away from the opening 321 (see Figure 8) of the electronic mirror-type display device 100a. Thus, the electronic mirror-type display device 100a is an example of a first display device that projects a virtual image in front of the driver. Specifically, the electronic mirror-type display device 100a projects the first virtual image 101a in front of the driver and above the second virtual image 201.

[0089] Figure 8 is a schematic diagram showing an electronic mirror type display device 100a according to Embodiment 2. As shown in Figure 8, the electronic mirror type display device 100a comprises a housing 320, a display element 330, a polarizing half mirror 340, and a concave mirror 350.

[0090] The housing 320 is a box-shaped body formed from a light-shielding resin or metal. An opening 321 facing backward is formed at the rear of the housing 320 (the right direction in Figure 8 is defined as the rear or rear). Image light, which becomes the first virtual image 101a, is projected from the opening 321. The internal space of the housing 320 houses a display element 330, a polarizing half mirror 340, and a concave mirror 350. The display element 330 is controlled by the control unit 500.

[0091] The display element 330 is, for example, a liquid crystal panel. When light from a light source (not shown) is shone onto the display element 330, it displays an image that forms the basis of the first virtual image 101a and shines the image light of the said image onto the polarizing half mirror 340. The display element 330 may also be an organic EL panel. The display element 330 is positioned with its display surface facing downwards. Although not shown, a λ / 4 plate is laminated on the display surface of the display element 330. The λ / 4 plate is a λ / 4 phase difference plate that creates a phase difference of 1 / 4 of the wavelength λ in the light incident on the λ / 4 plate. For example, if the light emitted from the display surface is linearly polarized S-polarized light, it is converted to circularly polarized light by passing through the λ / 4 plate.

[0092] The polarizing half-mirror 340 is configured to reflect P-polarized light and transmit S-polarized light, with a reflective polarizer plate arranged on a flat glass substrate. Furthermore, a λ / 4 plate is laminated on the surface of the polarizing half-mirror 340. The polarizing half-mirror 340 is positioned facing the display element 330 and the concave mirror 350. S-polarized image light emitted from the display element 330 is converted to circularly polarized light by the λ / 4 plate laminated on the display element 330 and directed toward the polarizing half-mirror 340. This circularly polarized image light is converted to P-polarized light by the λ / 4 plate laminated on the polarizing half-mirror 340 and reflected by the reflective polarizer plate of the polarizing half-mirror 340. The reflected P-polarized image light is converted back to circularly polarized light by passing through the λ / 4 plate again. Therefore, the polarizing half-mirror 340 is positioned such that the circularly polarized image light incident on the polarizing half-mirror 340 is reflected toward the concave mirror 350 as circularly polarized light by the λ / 4 plate and reflective polarizer plate laminated on the polarizing half-mirror 340.

[0093] The concave mirror 350 is positioned in front of the polarizing half mirror 340. The concave mirror 350 is positioned so that its concave surface, which is the reflective surface, faces backward. The circularly polarized image light reflected by the polarizing half mirror 340 is reflected again by the concave mirror 350 while retaining its circular polarization, and returns to the polarizing half mirror 340. The image light incident on the polarizing half mirror 340 is converted to S-polarization by the λ / 4 plate stacked on the polarizing half mirror 340, passes through the reflective polarizer of the polarizing half mirror 340, and travels to the rear in Figure 8. This image light passes through the aperture 321 and goes towards the eyes of the driver sitting in the driver's seat, becoming the first virtual image 101a.

[0094] As described above, even when an electronic mirror type display device 100a is provided as an example of the first display device, the first viewing distance L1a from the driver to the first virtual image 101a is smaller than the second viewing distance L2 from the driver to the second virtual image 201. Therefore, when the driver views the scenery in front of the vehicle 1 while driving, the direction of focus of the gaze when switching between the first virtual image 101a, the second virtual image 201, and the foreground is from in front of the driver to behind, making it easier to focus. Thus, the burden on the driver when viewing different virtual images can be reduced.

[0095] [Embodiment 3] In Embodiment 1, an example was given in which the first viewing distance L1 is smaller than the second viewing distance L2, and in a side view, the first virtual image 101 is positioned behind the second virtual image 201. However, in addition to the first viewing distance L1 being smaller than the second viewing distance L2, for example as shown in Figure 1, the first virtual image 101 and the second virtual image 201 may be positioned below the driver's viewpoint, the depression angle of the second virtual image 201 may be larger than the depression angle of the first virtual image 101, and furthermore, the positions of the first virtual image 101 and the second virtual image 201 in the longitudinal direction of the vehicle 1 may be the same. In this case, since the first virtual image 101 and the second virtual image 201 are positioned below the driver's viewpoint, and the first virtual image 101 is positioned above the second virtual image 201, the first viewing distance L1 from the driver's viewpoint to the first virtual image 101 becomes smaller than the second viewing distance L2 from the driver's viewpoint to the second virtual image 201.

[0096] Thus, since the positions of the first virtual image 101 and the second virtual image 201 in the longitudinal direction of the vehicle 1 are equivalent, it is possible to facilitate the movement of the gaze when moving the gaze in the order of the first virtual image 101, the second virtual image 201, and the foreground.

[0097] [Embodiment 4] Figure 9 is a schematic diagram showing the display system 10B according to Embodiment 4 installed in the vehicle 1. Figure 9 corresponds to Figure 1. Embodiment 1 above illustrates the case where the first virtual image 101 and the second virtual image 201 are arranged along the vertical direction. As shown in Figure 9, in the display system 10B according to Embodiment 4, the viewing distance to the lower end of the first virtual image 101b is shorter than the viewing distance to the upper end of the first virtual image 101b. In this case, it is preferable that the viewing distance to the upper end of the first virtual image 101b is smaller than the viewing distance of the second virtual image 201, but it is sufficient that the viewing distance of at least a part of the first virtual image 101 is smaller than the viewing distance of the second virtual image 201.

[0098] In this way, since the viewing distance to the lower end of the first virtual image 101b is shorter than the viewing distance to the upper end of the first virtual image 101b, the first virtual image 101b can be displayed to the driver, giving them a more natural sense of depth.

[0099] [Embodiment 5] Figure 10 is a schematic diagram showing the display system 10C according to Embodiment 5 installed in a vehicle 1. Figure 10 corresponds to Figure 1. Embodiment 1 exemplifies the case where the first display device 100 that projects the first virtual image 101 is an augmented reality head-up display. As shown in Figure 10, the display system 10C according to Embodiment 5 exemplifies the case where the first display device is a combiner-type head-up display 100c.

[0100] The combiner-type head-up display 100c comprises a display element 130c and a combiner 190c. The display element 130c is installed in the dashboard of the vehicle 1 and projects video light, which is the basis of the first virtual image 101, toward the combiner 190c.

[0101] The combiner 190c is installed upright on the dashboard. The combiner 190c is, for example, a half-mirror and is composed of a glass plate and a semi-transparent film of tin or silver deposited on one side of the glass plate. The combiner 190c is semi-transparent and is formed so that the driver can see the area in front of the vehicle 1 through the combiner 190c. For example, the combiner 190c is a convex or concave plate. The reflected light from the combiner 190c is directed towards the eyes of the driver sitting in the driver's seat and becomes a first virtual image 101.

[0102] Thus, even when the first display device is a combiner-type head-up display 100c, focusing can be easily achieved when switching the gaze in the order of the first virtual image 101, the second virtual image 201, and the foreground.

[0103] [Embodiment 6] Embodiment 6 describes examples of the display of the first virtual image and the second virtual image. Figures 11A to 11C are explanatory diagrams showing display examples according to Embodiment 6.

[0104] The control unit 500 detects objects around the vehicle 1 by performing image processing on the image data captured by the imaging unit 550. In other words, the control unit 500 is an example of the first detection unit according to this disclosure. Here, the objects are moving objects present around the vehicle 1 (pedestrians, animals, vehicles other than vehicle 1 (cars, motorcycles, kick scooters, etc.)). The control unit 500 may also detect objects based on the output from sensors other than the imaging unit 550. Other sensors include LiDAR (Laser Imaging Detection and Ranging).

[0105] When the control unit 500 detects an object around the vehicle 1, it includes the object P captured by the imaging unit 550 in the second virtual image 201d and projects it onto the second display device 200, and also includes the guidance mark Md in the first virtual image 101d and the second virtual image 201d and projects them onto the first display device 100 and the second display device 200.

[0106] The second virtual image 201d displays an image of the surroundings of the vehicle 1, based on image data captured by the imaging unit 550. The surrounding image includes an object P. In this embodiment, an emphasis frame Fd is superimposed on the surrounding image to make the object P stand out. The emphasis frame Fd is not displayed before the object surrounding the vehicle 1 is detected based on the image data.

[0107] When an object is detected around vehicle 1, the first virtual image 101d displays a warning mark Wd and a guidance mark Md. In other words, before an object is detected around vehicle 1, the warning mark Wd and the guidance mark Md are not displayed in the first virtual image 101d.

[0108] The warning mark Wd is a mark that informs the user that an object has been detected. The form of the warning mark Wd can be anything as long as it can inform the user that an object has been detected. In this embodiment, the warning mark Wd is positioned above the object P within the first virtual image 101d. A user who has not noticed that the object P has been displayed can recognize the display of the object P and its approximate position by looking at the warning mark Wd.

[0109] The guidance mark Md is a mark that guides the user's gaze to the object P within the second virtual image 201d. In this embodiment, the example shown is that the guidance mark Md consists of an arrow, but the guidance mark Md can take any form as long as it can guide the user's gaze to the object P. The guidance mark Md is projected so as to gradually move from the first virtual image 101d toward the object P within the second virtual image 201d and gradually decrease in size. In this embodiment, multiple guidance marks Md guide the user's gaze from the first virtual image 101d toward the object P within the second virtual image 201d.

[0110] Specifically, the guidance mark Md is first displayed only on the first virtual image 101d, as shown in Figure 11A. Next, the guidance mark Md is displayed on both the first virtual image 101d and the second virtual image 201d, as shown in Figure 11B. After that, the guidance mark Md is displayed only on the second virtual image 201d, as shown in Figure 11C, and reaches the target object P. In conjunction with this arrival, the warning mark Wd is erased. In this way, the multiple guidance marks Md are displayed in an animated manner, gradually moving from a predetermined position on the first virtual image 101d towards the target object P in the second virtual image 201d. Furthermore, the multiple guidance marks Md are displayed in an animated manner, gradually decreasing in size as they move towards the target object P. In this embodiment, the movement path of the guidance mark Md is a straight line ending at the target object P, but it may also be a curved line ending at the target object P.

[0111] As described above, when the control unit 500 detects an object, the guidance mark Md is projected to gradually move from the first virtual image 101d towards the object P in the second virtual image 201d, and to gradually decrease in size, thereby guiding the user's gaze from the first virtual image 101d to the object P in the second virtual image 201d.

[0112] As mentioned above, for the user, because the first virtual image 101d is positioned in front of the second virtual image 201d, there is a risk that elderly users may not be able to accurately recognize the first virtual image 101d in a short time due to presbyopia. However, immediately after an object is detected around vehicle 1, a large guidance mark Md is displayed on the first virtual image 101d, as well as a warning mark Wd. In other words, elderly users can recognize that some kind of notification image is displayed on the first virtual image 101d, and at the very least they can notice that an object is approaching vehicle 1. After that, the guidance mark Md guides the user's gaze to the first virtual image 101d and then the second virtual image 201d, so the user can easily focus.

[0113] Furthermore, when the control unit 500 detects an object, the warning mark Wd is included in the first virtual image 101d along with the guidance mark Md, so the user is notified by the guidance mark Md and the warning mark Wd that an object has been detected around the vehicle 1. This allows the user to recognize the object more quickly. In addition, since the warning mark Wd is erased when the guidance mark Md moves to the object P in the second virtual image 201d, excessive projection of the warning mark Wd can be suppressed. As a result, the possibility of the user being confused about whether to recognize the warning mark Wd or the object P can be reduced.

[0114] [Embodiment 7] Embodiment 7 describes an example of displaying the second virtual image. Figure 12 is an explanatory diagram showing an example of display according to Embodiment 7. Figure 12 corresponds to Figure 11A.

[0115] The control unit 500 projects the second virtual image 201e, which includes the object P, onto the second display device 200, including a frame image Fe around its outer periphery. The frame image Fe may be a frame image formed on a part of the outer periphery of the second virtual image 201e, or it may be a frame image continuously formed around the entire outer periphery. In this embodiment, a frame image Fe formed only at the four corners of the second virtual image 201e is given as an example. The frame image Fe may be continuously lit or blinking. The frame image Fe may be erased in conjunction with the guidance mark Md reaching the object P.

[0116] As described above, a second virtual image 201e including the object P and the frame image Fe is projected, so the user can quickly understand that the object P is included in the second virtual image 201e by viewing the frame image Fe.

[0117] [Embodiment 8] Embodiment 8 describes examples of the display of the first virtual image and the second virtual image. Figure 13 is an explanatory diagram showing an example of the display according to Embodiment 8. Figure 13 is a diagram corresponding to Figure 12.

[0118] The control unit 500 includes a portion of the frame image Ff in the first virtual image 101f and projects it onto the first display device 100, and includes the remainder of the frame image Ff in the second virtual image 201f and projects it onto the second display device 200. In this embodiment, as shown in Figure 13, a continuous frame image Ff is displayed around the entire circumference of the outer edge of the second virtual image 201f, and the upper edge Ff1 of the frame image Ff is displayed on the lower edge of the first virtual image 101f. In particular, in this embodiment, the upper edge Ff1 of the frame image Ff is displayed as if it is seeping out onto the lower edge of the first virtual image 101f, but it may be displayed in other ways.

[0119] Thus, since a portion of the frame image Ff (the upper edge Ff1) is included in the first virtual image 101f, the display range of the frame image Ff is expanded. This makes it easier for the user to notice the expanded display range of the frame image Ff. Therefore, the user can more quickly grasp that the object P is included in the second virtual image 201f.

[0120] In this embodiment, the case where the first virtual image 101f is positioned above and the second virtual image 201f is positioned below is illustrated. However, if the second virtual image 201f is positioned above and the first virtual image 101f is positioned below, the lower edge of the frame image Ff will be displayed on the upper edge of the first virtual image 101f.

[0121] [Embodiment 9] Embodiment 9 describes examples of the display of the first virtual image and the second virtual image. Figures 14A and 14B are explanatory diagrams showing display examples according to Embodiment 9.

[0122] When the control unit 500 detects an object around the vehicle 1, it includes the object P captured by the imaging unit 550 in the second virtual image 201g and projects it onto the second display device 200, and also includes the radial mark Rg in the first virtual image 101g and the second virtual image 201g and projects them onto the first display device 100 and the second display device 200.

[0123] The radial mark Rg is a mark that radiates outward from the object P within the second virtual image 201g. In this embodiment, the radial mark Rg guides the user's gaze from the first virtual image 101g to the object P within the second virtual image 201g.

[0124] Specifically, the radial mark Rg first appears only on the first virtual image 101g, as shown in Figure 14A. Then, as shown in Figure 14B, the radial mark Rg appears only on the second virtual image 201g and reaches the object P.

[0125] Thus, when the control unit 500 detects an object, a radial mark Rg originating from the object P in the second virtual image 201g is included in both the first virtual image 101g and the second virtual image 201g. This radial mark Rg can guide the user's gaze from the first virtual image 101g to the object P in the second virtual image 201g.

[0126] Furthermore, radial marks Rg may be displayed simultaneously on both the first virtual image 101g and the second virtual image 201g. In this case as well, a warning mark may be displayed on the first virtual image 101g as described above.

[0127] [Embodiment 10] Embodiment 10 describes examples of the display of the first and second virtual images. Figures 15A and 15B are explanatory diagrams showing examples of the display according to Embodiment 10. In Embodiment 6 described above, an example was given in which the guidance mark Md guides the user's gaze from the first virtual image 101d to the object P of the second virtual image 201d. In this Embodiment 10, an example is given in which the guidance mark Mh guides the user's gaze from the first virtual image 101h to the second virtual image 201h.

[0128] As shown in Figure 15A, when the control unit 500 detects an object around the vehicle 1, it includes the object P captured by the imaging unit 550 in the second virtual image 201h and projects it onto the second display device 200, while including the guidance mark Mh only in the first virtual image 101h and projects it onto the first display device 100. Specifically, the guidance mark Mh is an arrow positioned below the center of the first virtual image 101h. The guidance mark Mh can be in any form or position as long as it can guide the user's gaze to the first virtual image 101h.

[0129] Thus, when the control unit 500 detects an object, a second virtual image 201h containing the object P is projected, and a first virtual image 101h containing the guidance mark Mh is also projected. This allows the user's gaze to be guided from the first virtual image 101h to the second virtual image 201h. Since the user's gaze is simply guided to the second virtual image 201h only, the guidance of the user's gaze can be simplified.

[0130] As shown in Figure 15B, the control unit 500 may include a frame image Fh around the outer periphery of the second virtual image 201h, which includes the object P, and project the second virtual image 201h onto the second display device 200. The frame image Fh may be a frame image formed on a part of the outer periphery of the second virtual image 201h, or it may be a frame image formed continuously around the entire outer periphery. In this embodiment, a continuous frame image Fh over the entire outer periphery of the second virtual image 201h is shown as an example. In this way, since the second virtual image 201h including the object P and the frame image Fh is projected, the user can quickly grasp that the object P is included in the second virtual image 201h by viewing the frame image Fh. Also, although an emphasis frame Fd is displayed around the object P in Figure 15B, this is not required. This allows the frame image Fh to draw attention to the entire second virtual image 201h, especially when there are multiple objects, without directing the user's gaze to only a specific object.

[0131] [Embodiment 11] Embodiment 11 describes examples of the display of the first virtual image and the second virtual image. Figures 16A to 16C are explanatory diagrams showing display examples according to Embodiment 11.

[0132] The guidance mark Mi is projected to move from the edge of the first virtual image 101i toward the center of the first virtual image 101i, and then toward the object P within the second virtual image 201i. Figure 16A shows the state before the guidance mark Mi is projected. In Figure 16A, the surrounding image displayed as the second virtual image 201i shows the object P and the emphasis frame Fd.

[0133] Next, as shown in Figure 16B, the guidance mark Mi moves from the edge of the first virtual image 101i toward the center of the first virtual image 101i, and then bends toward the object P in the second virtual image 201i. At this time, the control unit 500 detects the source of the object's movement by performing image processing on the image data captured by the imaging unit 550, and causes the guidance mark Mi to appear from the edge of the first virtual image 101i corresponding to that source. In the case of Figure 16B, since the source is to the right, the guidance mark Mi appears from the right edge of the first virtual image 101i, extends toward the left, and bends toward the lower right at the center of the first virtual image 101i.

[0134] Subsequently, as shown in Figure 16C, the guidance mark Mi enters the second virtual image 201i and extends toward the object P, with its tip finally reaching the object P. In this way, when the control unit 500 detects an object, the guidance mark Mi is projected to move from the edge of the first virtual image 101i toward the center of the first virtual image 101i, and then toward the object P in the second virtual image 201i, thereby guiding the user's gaze from the first virtual image 101i to the object P in the second virtual image 201i.

[0135] The method of representing the guidance mark Mi is not limited to moving from the edge of the first virtual image 101i toward the center of the first virtual image 101i, and then moving toward the object P in the second virtual image 201i. Figure 17 is an explanatory diagram showing another display example according to Embodiment 11. As shown in Figure 17, a symbol Mi 10 that mimics the object may be attached to the guidance mark Mi. In this case, the symbol Mi 10 may or may not move together with the guidance mark Mi.

[0136] [Embodiment 12] Embodiment 12 describes examples of displaying the first and second virtual images. Figure 18 is a schematic diagram showing the display system 10J according to Embodiment 12. The display system 10J according to Embodiment 12 includes an imaging unit 560 located near the top of the windshield 2 inside the vehicle 1. The imaging unit 560 is a camera that photographs the user's head and is electrically connected to the control unit 500.

[0137] The control unit 500 acquires the image captured by the imaging unit 560 and estimates the user's gaze from the captured image. Specifically, the control unit 500 extracts the driver's pupil by applying predetermined image processing to the captured image and estimates the gaze from the tilt of the pupil. In other words, the imaging unit 560 and the control unit 500 are an example of the second detection unit according to this disclosure.

[0138] Figure 19 is an explanatory diagram showing an example of a display according to Embodiment 12. Figure 19 corresponds to Figure 16C. As shown in Figure 19, when the control unit 500 detects an object, it includes the object P in the second virtual image 201j and projects it onto the second display device 200, and also projects the first virtual image 101j with a warning mark Wj placed at a position corresponding to the detected user's line of sight onto the first display device 100. In the case of Figure 19, since the user's line of sight was directed to the left front, the warning mark Wj is displayed in the upper left of the first virtual image 101j.

[0139] Thus, when the control unit 500 detects an object, a second virtual image 201j containing the object P is projected, and a second virtual image 201j with a warning mark Wj positioned at a location corresponding to the user's line of sight is also projected. Therefore, the user can quickly understand that the object P is included in the second virtual image 201j by viewing the warning mark Wj.

[0140] [Embodiment 13] Embodiment 13 describes a display system 10K equipped with a warning unit 800k. Figure 20 is a schematic diagram showing the display system 10K according to Embodiment 13. The display system 10K according to Embodiment 13 includes a warning unit 800k that outputs at least one of a warning sound and a warning vibration to the user. The warning unit 800k includes at least one of a speaker for outputting a warning sound and a vibration device for outputting a warning vibration. The vibration device is positioned in a location where vibration can be transmitted to the user, such as the steering wheel or seat. The warning unit 800k is electrically connected to the control unit 500.

[0141] When the control unit 500 detects an object, it outputs at least one of a warning sound and a warning vibration from the warning unit 800k, and then includes the object P in the second virtual image 201 and projects it onto the second display device 200.

[0142] Thus, when an object is detected around the vehicle 1, at least one of a warning sound and a warning vibration is output from the warning unit 800k, and then a second virtual image 201 including the object P is projected. Therefore, the user can quickly understand that the object P is included in the second virtual image 201 by recognizing at least one of the warning sound and warning vibration.

[0143] (others) Although a display system relating to one or more embodiments of this disclosure has been described above based on embodiments, this disclosure is not limited to these embodiments. Without departing from the spirit of this disclosure, various modifications to these embodiments that a person skilled in the art could conceive of, or forms constructed by combining components from different embodiments, may also be included within the scope of one or more embodiments of this disclosure. [Industrial applicability]

[0144] This disclosure can be used in a display system for displaying virtual images. [Explanation of Symbols]

[0145] 1 vehicle 2 Windshields 10, 10A, 10B, 10C, 10J, 10K display system 100 First display device 100a Electronic mirror type display device (first display device) 100c Combiner-type Head-Up Display (First Display Device) 101, 101a, 101b, 101d, 101f, 101g, 101h, 101i, 101j First virtual image 110, 220, 320 chassis 111, 221, 321 openings 120 Cover section 130, 130c, 230, 330 display elements 140 First Optical Element 150 Second optical element 190c Combiner 200 Second display device 201, 201d, 201f, 201g, 201h, 201i, 201j Second virtual image 240, 340 Polarized Half Mirror 250 First reflector 260 Second reflector 350 concave mirror 500 Control Unit (First Detection Unit, Second Detection Unit) 550 Imaging Unit 560 Imaging Unit (Second Detection Unit) 800k warning section D interval Fd emphasis frame Fe, Ff frame image Ff1 Upper part G10 Instrument Information G20 left rear view G21 Side Mirror Frame G30 Front View G40 Blind Spot Footage G41 Interior Video G42 Exterior View L1, L1a, L1z first sight distance L2, L2z second viewing distance Md, Mh, Mi guidance marks Mi10 symbol Y1, Y2, Y3, Y11, Y12, Y13 Eye movement P Object Rg radial mark Wd, Wj warning marks

Claims

1. A first display device that projects a first virtual image in front of the user riding in the vehicle, The system includes a second display device that projects a second virtual image in front of the user, The first display device is a head-up display or an electronic mirror type display device, The first viewing distance from the user to the first virtual image is smaller than the second viewing distance from the user to the second virtual image. Display system.

2. The distance between the first virtual image and the second virtual image in a side view of the vehicle is within 0.25 diopters. The display system according to claim 1.

3. The first virtual image and the second virtual image are positioned below the user's viewpoint, and the downward angle of the second virtual image is greater than the downward angle of the first virtual image. The positions of the first virtual image and the second virtual image in the longitudinal direction of the vehicle are equivalent. The display system according to claim 1 or 2.

4. The second display device includes instrument information in the second virtual image. The display system according to claim 1 or 2.

5. The second display device includes the side and rear image of the vehicle in the second virtual image. The display system according to claim 1 or 2.

6. The second display device includes a wide-angle image of the front or rear of the vehicle in the second virtual image. The display system according to claim 1 or 2.

7. The second display device includes the blind spot image, which is obscured by the pillar of the vehicle, in the second virtual image. The display system according to claim 1 or 2.

8. The first display device is a combiner-type head-up display. The display system according to claim 1 or 2.

9. An imaging unit that captures images of the area around the vehicle, A first detection unit for detecting objects around the vehicle, The system comprises a control unit that controls the first display device and the second display device, The control unit, When the first detection unit detects an object, the imaging unit includes the object captured by the imaging unit in the second virtual image and projects it onto the second display device, and also includes guidance marks in the first and second virtual images to guide the user's gaze toward the object in the second virtual image and projects them onto the first and second display devices, respectively. The guidance mark is projected to gradually move from the first virtual image toward the object in the second virtual image, and to gradually decrease in size. The display system according to claim 1 or 2.

10. The control unit includes the guidance mark and the warning mark in the first virtual image and projects it onto the first display device. The warning mark is erased when the guidance mark moves to the object in the second virtual image. The display system according to claim 9.

11. The control unit projects the second virtual image, which includes the object, onto the second display device, including a frame image around the outer periphery of the second virtual image. The display system according to claim 9.

12. The control unit includes a portion of the frame image in the first virtual image and projects it onto the first display device. The display system according to claim 11.

13. An imaging unit that captures images of the area around the vehicle, A first detection unit for detecting objects around the vehicle, The system comprises a control unit that controls the first display device and the second display device, The control unit, When the first detection unit detects an object, the imaging unit includes the object captured by the imaging unit in the second virtual image and projects it onto the second display device, and also includes radial marks originating from the object in the second virtual image in the first and second virtual images and projects them onto the first and second display devices, respectively. The display system according to claim 1 or 2.

14. An imaging unit that captures images of the area around the vehicle, A first detection unit for detecting objects around the vehicle, The system comprises a control unit that controls the first display device and the second display device, The control unit, When the first detection unit detects an object, the imaging unit includes the object captured by the imaging unit in the second virtual image and projects it onto the second display device, and also includes a guidance mark in the first virtual image to guide the user's gaze toward the second virtual image and projects it onto the first display device. The display system according to claim 1 or 2.

15. The control unit projects the second virtual image, which includes the object, onto the second display device, including a frame image around the outer periphery of the second virtual image. The display system according to claim 14.

16. An imaging unit that captures images of the area around the vehicle, A first detection unit for detecting objects around the vehicle, The system comprises a control unit that controls the first display device and the second display device, The control unit, When the first detection unit detects an object, the imaging unit includes the object captured by the imaging unit in the second virtual image and projects it onto the second display device, and also includes guidance marks in the first and second virtual images to guide the user's gaze toward the object in the second virtual image and projects them onto the first and second display devices, respectively. The guidance mark is projected to move from the edge of the first virtual image toward the center of the first virtual image, and then toward the object within the second virtual image. The display system according to claim 1 or 2.

17. An imaging unit that captures images of the area around the vehicle, A first detection unit for detecting objects around the vehicle, The second detection unit detects the user's gaze, The system comprises a control unit that controls the first display device and the second display device, The control unit, When the first detection unit detects an object, the imaging unit includes the object captured by the imaging unit in the second virtual image and projects it onto the second display device, and the second detection unit projects a first virtual image on the first display device with a warning mark placed at a position corresponding to the user's line of sight detected by the second detection unit. The display system according to claim 1 or 2.

18. An imaging unit that captures images of the area around the vehicle, A first detection unit for detecting objects around the vehicle, A warning unit that outputs at least one of a warning sound and a warning vibration to the user, The system comprises the first display device and the second display device, and a control unit that controls the warning unit, The control unit, When the first detection unit detects an object, the warning unit outputs at least one of the warning sound and the warning vibration, The imaging unit includes the object it has captured in the second virtual image and projects it onto the second display device. The display system according to claim 1 or 2.

Images