Display system

Abstract

To provide a display system capable of allowing a user to easily and intuitively understand which direction the image corresponds to.SOLUTION: A display system 10 includes: a first display device 100 that displays a display image in front of a user riding in the vehicle 1; and a control unit 500 that controls the first display device 100 to display a surrounding image G30g obtained by an imaging unit 3 that captures an image of the surroundings of the vehicle 1. The control unit 500 is configured to control the first display device 100 so that either the surrounding image G30g or at least a portion of the periphery of the surrounding image G30g, which is displayed on the first display device 100 is relatively highlighted.SELECTED DRAWING: Figure 13

Description

[Technical Field]

[0001] The present disclosure relates to display systems. [Background technology]

[0002] Patent Document 1 discloses a monitor (display system) that displays, at a glance, images captured by a left camera that captures the left rear of a vehicle and images captured by a right camera that captures the right rear of the vehicle. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2018-176874 Summary of the Invention [Problem to be solved by the invention]

[0004] Meanwhile, a user who is concentrating on driving wants to intuitively grasp the direction in which the image displayed on the display system corresponds.

[0005] Therefore, an object of the present disclosure is to provide a display system that can make it easier for a user to intuitively understand which direction an image corresponding to is being displayed. [Means for solving the problem]

[0006] A display system according to one aspect of the present disclosure includes a first display device that displays a display image in front of a user riding in a vehicle, and a control unit that causes the first display device to display a surrounding image obtained by an imaging unit that captures images of the area around the vehicle, and the control unit controls the first display device so that either the surrounding image displayed on the first display device or at least a portion of the periphery of the surrounding image is displayed relatively highlighted. [Effects of the Invention]

[0007] According to the present disclosure, it is possible to provide a display system that can make it easier for a user to intuitively understand which direction an image corresponding to is being displayed. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a schematic diagram showing a state in which a display system according to the first embodiment is installed in a vehicle. [Figure 2] FIG. 2 is a schematic cross-sectional view showing the first display device according to the first embodiment. [Figure 3] FIG. 3 is an explanatory diagram showing a reference image according to the first embodiment. [Figure 4] FIG. 4 is an explanatory diagram showing an auxiliary image according to the first embodiment. [Figure 5] FIG. 5 is an explanatory diagram showing an auxiliary image as a comparative example. [Figure 6] FIG. 6 is an explanatory diagram showing an auxiliary image according to the second embodiment. [Figure 7] FIG. 7 is an explanatory diagram showing an auxiliary image according to the third embodiment. [Figure 8] FIG. 8 is an explanatory diagram showing a frame image according to the fourth embodiment. [Figure 9] FIG. 9 is an explanatory diagram showing a modified example of the left frame image according to the fourth embodiment. [Figure 10] FIG. 10 is an explanatory diagram showing a left frame image and a right frame image according to the fifth embodiment. [Figure 11] FIG. 11 is an explanatory diagram showing an auxiliary image according to the sixth embodiment. [Figure 12] FIG. 12 is an explanatory diagram showing an auxiliary image according to the seventh embodiment. [Figure 13] FIG. 13 is an explanatory diagram showing an auxiliary image according to the eighth embodiment. [Figure 14] FIG. 14 is an explanatory diagram showing an auxiliary image as a comparative example. [Figure 15] FIG. 15 is an explanatory diagram showing a surrounding image according to the ninth embodiment. [Figure 16]FIG. 16 is an explanatory diagram showing a display object according to the ninth embodiment. [Figure 17] FIG. 17 is an explanatory diagram showing a frame image before adjustment and a frame image after adjustment according to the tenth embodiment. [Figure 18] FIG. 18 is an explanatory diagram showing an auxiliary image according to the eleventh embodiment. [Figure 19] FIG. 19 is an explanatory diagram showing an auxiliary image according to the twelfth embodiment. [Figure 20] FIG. 20 is an explanatory diagram showing a modified example of the auxiliary image according to the twelfth embodiment. [Figure 21] FIG. 21 is an explanatory diagram showing an auxiliary image according to the thirteenth embodiment. [Figure 22] FIG. 22 is an explanatory diagram showing an auxiliary image according to the thirteenth embodiment. [Figure 23] FIG. 23 is an explanatory diagram showing an auxiliary image according to the fourteenth embodiment. [Figure 24] FIG. 24 is an explanatory diagram showing an auxiliary image according to the fourteenth embodiment. [Figure 25] FIG. 25 is an explanatory diagram showing a display switching from a reference image to an auxiliary image according to the fifteenth embodiment. [Figure 26] FIG. 26 is an explanatory diagram showing a modified example of switching display from a reference image to an auxiliary image according to the fifteenth embodiment. [Figure 27] FIG. 27 is an explanatory diagram showing an auxiliary image according to the sixteenth embodiment. [Figure 28] FIG. 28 is an explanatory diagram showing an auxiliary image according to the seventeenth embodiment. [Figure 29] FIG. 29 is an explanatory diagram showing a modified example of the auxiliary image according to the seventeenth embodiment. [Figure 30] FIG. 30 is an explanatory diagram showing an auxiliary image according to the eighteenth embodiment. [Figure 31] FIG. 31 is an explanatory diagram showing another example of an icon according to the eighteenth embodiment. [Figure 32] FIG. 32 is an explanatory diagram showing a modified example of the auxiliary image according to the eighteenth embodiment. [Figure 33]FIG. 33 is an explanatory diagram showing another example of an icon according to the eighteenth embodiment. [Figure 34] FIG. 34 is a schematic diagram showing a display system according to the nineteenth embodiment. [Figure 35] FIG. 35 is a schematic cross-sectional view showing a second display device according to the nineteenth embodiment. [Figure 36] FIG. 36 is an explanatory diagram showing an example of display by the first display device and the second display device according to the nineteenth embodiment. [Figure 37] FIG. 37 is an explanatory diagram showing an auxiliary image according to the twentieth embodiment. [Figure 38] FIG. 38 is an explanatory diagram showing another auxiliary image according to the twenty-first embodiment. [Figure 39] FIG. 39 is an explanatory diagram showing another auxiliary image according to the twenty-first embodiment. [Figure 40] FIG. 40 is an explanatory diagram showing another auxiliary image according to the twenty-first embodiment. [Figure 41] FIG. 41 is an explanatory diagram showing another auxiliary image according to the twenty-first embodiment. [Figure 42] FIG. 42 is an explanatory diagram showing the auxiliary image shown in the twenty-first embodiment. [Figure 43] FIG. 43 is an explanatory diagram showing an auxiliary image according to the twenty-second embodiment. [Figure 44] FIG. 44 is a schematic diagram showing a display system according to a twenty-third embodiment. [Figure 45] FIG. 45 is an explanatory diagram showing a frame image based on a shape instruction according to the twenty-third embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0009] A display system according to one aspect of the present disclosure includes a first display device that displays a display image in front of a user riding in a vehicle, and a control unit that causes the first display device to display a surrounding image obtained by an imaging unit that captures images of the area around the vehicle, and the control unit controls the first display device so that either the surrounding image displayed on the first display device or at least a portion of the periphery of the surrounding image is displayed relatively highlighted.

[0010] According to this, the surrounding image is highlighted relative to at least a portion of the periphery of the surrounding image, or at least a portion of the periphery of the surrounding image is highlighted relative to the surrounding image, so that the position and shape of the highlighting can inform the user of which direction of the vehicle the surrounding image corresponds to, thereby allowing the user to intuitively understand which direction the surrounding image corresponds to.

[0011] The control unit may also control the first display device so that either the surrounding image or at least a portion of an edge image surrounding the periphery of the surrounding image is displayed in a relatively highlighted manner.

[0012] According to this, the surrounding image is highlighted relative to at least a part of the edge image, or at least a part of the edge image is highlighted relative to the surrounding image, so that the position and shape of the highlighting can inform the user of which direction of the vehicle the surrounding image corresponds to.

[0013] In addition, when the control unit displays a frame image indicating the side mirror frame of the vehicle as the edge image on the first display device, the control unit may also display a rear image showing the rear of the vehicle from among the images captured by the imaging unit as the surrounding image, within an area corresponding to the mirror within the frame image.

[0014] According to this, the rear image is displayed as a surrounding image in an area corresponding to the mirror within the frame image together with a frame image showing the side mirror frame, so that the side mirror frame and the mirror image reflected therein can be expressed in an image. As a result, by visually checking the frame image and the rear image, the user can more intuitively understand which direction the rear image corresponds to. The display of the frame image also makes it possible to prevent the rear image from being mistaken for an image in front of the vehicle.

[0015] The control unit may also control the first display device to blur the edges of the surrounding image as the highlighted display.

[0016] This allows the peripheral image to be highlighted by blurring its edges.

[0017] The control unit may also cause the first display device to display an arm image indicating an arm extending from the side mirror frame together with the frame image.

[0018] According to this, since the arm image and the frame image are displayed, the user can more intuitively understand which direction is indicated by the arm image.

[0019] The control unit may also cause the first display device to display an interior image showing an interior of the vehicle together with the frame image.

[0020] This allows the user to intuitively understand which direction the interior image is facing, since the interior image and the frame image are both displayed.

[0021] The control unit may also cause the first display device to display the frame image, which realistically represents the side mirror frame.

[0022] According to this, the frame image realistically represents the side mirror frame, and the realistic frame image can enhance the sense of presence.

[0023] The control unit may also cause the first display device to display a vehicle body image showing a vehicle body provided on the vehicle together with the frame image.

[0024] According to this, since the vehicle body image and the frame image are displayed, the user can more intuitively understand which direction the vehicle is facing by looking at the vehicle body image.

[0025] The control unit may also cause the first display device to display, together with the frame image, a lighting image that indicates a lighting state of a turn signal provided in the vehicle.

[0026] According to this, a lighting image is displayed, so that the user can understand the lighting status of the turn signal from the lighting image.

[0027] The control unit may also cause the first display device to display the frame image such that an aspect ratio of the frame image is different from an aspect ratio of the side mirror frame.

[0028] According to this, since the aspect ratio of the frame image is different from the aspect ratio of the side mirror frame, it is possible to display a wide-angle image in the vertical or horizontal direction within the frame image.

[0029] The control unit may also cause the first display device to display, as a background of the frame image, a front image showing a location ahead of the vehicle, from among the images captured by the imaging unit.

[0030] This increases the sense of realism because the front image is displayed as the background of the frame image.

[0031] The control unit may also control the first display device so that a background color of the frame image changes based on an environment of the vehicle.

[0032] According to this, the background color changes based on the vehicle environment, so that the user can understand the vehicle environment simply by recognizing the background color.

[0033] The control unit may also cause the first display device to display a front image, which is part of the surrounding image and indicates a location ahead of the vehicle, arranged next to the frame image.

[0034] This allows the front image and the frame image to be displayed together, allowing the rear image and the front image to be displayed at a glance, thereby allowing the user to simultaneously grasp the rear image and the front image.

[0035] In addition, the frame image may include a right frame image indicating the side mirror frame arranged on the right side of the vehicle and a left frame image indicating the side mirror frame arranged on the left side of the vehicle, and the control unit may control the first display device so that the right frame image is displayed on the right side and the left frame image is displayed on the left side.

[0036] This allows the right frame image to be displayed on the right side and the left frame image to be displayed on the left side, allowing the user to more intuitively understand which direction the surrounding image corresponds to depending on the display layout.

[0037] The control unit may also control the first display device so that the right frame image and the left frame image are asymmetrical.

[0038] This allows the right and left frame images to be asymmetrical, allowing the user to more intuitively understand which direction they are facing based on their shapes.

[0039] In addition, the control unit may control the first display device to display the right frame image near the top right corner of the display area of ​​the first display device, and to display the left frame image near the top left corner of the display area of ​​the first display device.

[0040] With this, for example, since the right frame image is displayed close to the upper right corner of the display area of ​​the first display device, the amount of vertical line-of-sight movement required when a user viewing the area ahead of the vehicle changes their line-of-sight to the right frame image can be reduced. This also reduces the burden on the user when shifting their line-of-sight. The same applies to the left frame image.

[0041] Furthermore, when a warning target is displayed in the surrounding image, the control unit may cause the first display device to highlight the warning target and display it.

[0042] This allows the user to intuitively grasp the subject of the warning, since the subject of the warning is displayed in an emphasized manner within the surrounding image.

[0043] The control unit may also distort the surrounding image and display it on the first display device.

[0044] This allows the surrounding image to be displayed distorted, allowing the user to understand that a wide-angle image is being displayed.

[0045] The control unit may cause the first display device to display an icon indicating a surrounding situation of the vehicle together with the surrounding image.

[0046] According to this, an icon indicating the surroundings of the vehicle is displayed together with the surrounding image, so that the user can easily understand the surroundings from the icon.

[0047] The control unit may also cause the first display device to display the surrounding image in conjunction with navigation information in the vehicle.

[0048] According to this, the surrounding image is displayed in conjunction with the navigation information, so that the user can grasp the navigation information and the surrounding image together.

[0049] The control unit may also control the first display device so that a reference image and an auxiliary image including the surrounding image can be switched by scrolling.

[0050] According to this, switching between the reference image and the auxiliary image is performed by scrolling, so that the execution of the switching can be conveyed to the user without causing any discomfort.

[0051] In addition, the first display device may display the display image by projecting a first virtual image in front of the user, and the first virtual image may be positioned in front of the first display device as seen by the user.

[0052] According to this, since the first virtual image, which is the display image, is disposed forward of the first display device, the burden on the user who is viewing the area ahead of the vehicle when moving their line of sight to the first virtual image can be reduced. Furthermore, since the display image is the first virtual image, the sense of depth of the display image can be enhanced compared to when the surrounding image displayed on the flat display surface is viewed directly.

[0053] The display system may also include a second display device that projects a second virtual image in front of the user and above the display image, and the control unit may control the second display device so that a guidance image for guiding the user's line of sight toward the surrounding image is included in the second virtual image.

[0054] According to this, since the second virtual image includes a guidance image, the guidance image can guide the user's line of sight to the surrounding image within the displayed image, allowing the user to smoothly move their line of sight to the surrounding image.

[0055] The control unit may also control the first display device so that the border image appears visually different when a predetermined condition is met from when it is not met.

[0056] According to this, the border image is visually different when the specified conditions are met and when they are not met, and by visually recognizing this difference, the user can understand whether the specified conditions are met or not.

[0057] The control unit may also control the first display device so that a size of the border image differs between when a predetermined condition is satisfied and when a predetermined condition is not satisfied.

[0058] According to this, the size of the border image differs between when the specified condition is not met and when it is met, and by visually recognizing this difference, the user can understand whether the specified condition is met or not.

[0059] The control unit may also control the first display device so that a thickness of a frame line of the border image differs between when a predetermined condition is met and when it is not met.

[0060] According to this, the thickness of the border line of the edge image differs between when the specified conditions are met and when they are not met, and by visually recognizing this difference, the user can understand whether the specified conditions are met or not.

[0061] The control unit may also control the first display device so that the presence or absence of the border image differs between when a predetermined condition is met and when it is not met.

[0062] According to this, the presence or absence of the edge image differs between when the specified conditions are met and when they are not met, and by visually recognizing this difference, the user can understand whether the specified conditions are met or not.

[0063] The control unit may also control the first display device so that the color of the border image differs between when a predetermined condition is met and when it is not met.

[0064] According to this, the color of the edge image differs depending on whether the specified condition is met or not, and by visually recognizing this difference, the user can understand whether the specified condition is met or not.

[0065] The control unit may also control the first display device so that a background of the border image differs between when a predetermined condition is met and when it is not met.

[0066] According to this, the background of the border image is different when the specified conditions are met and when they are not met, and by visually recognizing this difference, the user can understand whether the specified conditions are met or not.

[0067] In addition, when the control unit displays a pillar image showing a pillar provided on the vehicle as the edge image on the first display device, the control unit may also display a forward image showing the front of the vehicle from among the images captured by the imaging unit as the surrounding image, within the pillar image.

[0068] According to this, since the front image is displayed within the pillar image as the surrounding image, it is possible to highlight the pillar image or the surrounding image, so that the user can intuitively grasp which direction the surrounding image corresponds to even in the pillar image.

[0069] In addition, when the control unit displays a bonnet image showing the bonnet equipped on the vehicle as the edge image on the first display device, the control unit may also display a front image showing the front of the vehicle from among the images captured by the imaging unit as the surrounding image, within the bonnet image.

[0070] In this way, the front image is displayed as a surrounding image within the bonnet image, and therefore it is possible to highlight both the bonnet image and the front image, allowing the user to intuitively grasp which direction the front image corresponds to, even on the bonnet.

[0071] The image processing device may also include a reception unit that receives shape instructions from the user to specify the shape of the edge image, and the control unit controls the first display device so that the edge image corresponds to the shape instructions received by the reception unit.

[0072] According to this, an edge image corresponding to the shape instruction received by the receiving unit is displayed, so that an edge image according to the user's preference can be displayed, thereby improving usability.

[0073] (Embodiment) Hereinafter, the embodiments will be described in detail with reference to the drawings. Note that each of the embodiments described below represents a specific example of the present disclosure. The numerical values, shapes, materials, components, component placement and connection configurations, steps, and step order shown in the following embodiments are merely examples and are not intended to limit the present disclosure. Furthermore, among the components in the following embodiments, components that are not described in an independent claim that represents a superordinate concept will be described as optional components.

[0074] In the following embodiments, expressions indicating the relative attitude of two directions, such as "parallel" and "orthogonal," may be used, but these expressions also include cases where the attitude is not strictly that. For example, when two directions are said to be parallel, unless otherwise specified, it does not only mean that the two directions are completely parallel, but also that the directions are substantially parallel, that is, that there is a difference of, for example, a few percent. The optical paths illustrated in the drawings in the following embodiments are intended to illustrate the principle and do not necessarily reflect the actual optical paths.

[0075] [Embodiment 1] Fig. 1 is a schematic diagram showing a state in which a display system 10 according to the first embodiment is installed in a vehicle 1. In Fig. 1, the vehicle 1 is shown in cross section.

[0076] As shown in FIG. 1 , the display system 10 includes a first display device 100 and a control unit 500. The first display device 100 is disposed on, for example, the dashboard of the vehicle 1. The first display device 100 displays, for example, vehicle information related to the vehicle 1 as a first virtual image 101. Examples of the vehicle information include the speed of the vehicle 1, the engine RPM, detection results of objects approaching the vehicle 1, navigation information from the current location of the vehicle 1 to a destination, and image information captured by a camera capturing images of the rear and surrounding areas of the vehicle 1. Note that while FIG. 1 illustrates an example in which the first display device 100 is disposed on the dashboard, the installation location of the first display device 100 is not limited thereto and may be disposed, for example, near the top of the windshield 2, in the center console, or the like.

[0077] [First display device] 1, the first display device 100 projects image light toward a driver who is a user of the display system 10. The driver perceives the image light entering his or her eyes as a first virtual image 101 projected in the distance through an opening 121 (see FIG. 2) of the first display device 100. The first virtual image 101 is an example of a display image displayed in front of the driver.

[0078] Fig. 2 is a schematic cross-sectional view showing first display device 100 according to embodiment 1. As shown in Fig. 2, first display device 100 includes housing 120, display element 130, polarizing half mirror 140, first reflecting mirror 150, and second reflecting mirror 160. Polarizing half mirror 140, first reflecting mirror 150, and second reflecting mirror 160 form an optical system for projecting image light from display element 130 as first virtual image 101.

[0079] Housing 120 is a box-shaped body made of light-blocking resin or metal. An opening 121 facing rearward is formed at the upper end of the rear of housing 120 (the right direction in FIG. 2 is defined as the rear or rear). Image light that becomes first virtual image 101 is projected from opening 121. A display element 130, a polarizing half mirror 140, a first reflecting mirror 150, and a second reflecting mirror 160 are housed in the internal space of housing 120.

[0080] The display element 130 is, for example, a liquid crystal panel, and when irradiated with light from a light source (not shown), irradiates the polarizing half mirror 140 with image light that becomes the first virtual image 101. The display element 130 may be an organic EL panel. The display element 130 is disposed with its display surface facing backward. Although not shown, a λ / 4 retardation plate (hereinafter abbreviated as λ / 4 plate) is laminated on the display surface of the display element 130. The λ / 4 plate is a λ / 4 retardation plate that imparts a phase difference of ¼ of the wavelength λ to light that enters the λ / 4 plate. For example, if the light emitted from the display surface is linearly polarized S-polarized light, it is converted into circularly polarized light by passing through the λ / 4 plate.

[0081] The polarizing half mirror 140 is configured to reflect P-polarized light and transmit S-polarized light, and a reflective polarizing plate is disposed on a flat glass substrate. Furthermore, a λ / 4 plate is laminated on the surface of the polarizing half mirror 140. The polarizing half mirror 140 is disposed in a position facing the display element 130 and the first reflecting mirror 150. The S-polarized image light emitted from the display element 130 is converted into circularly polarized light by the λ / 4 plate laminated on the display element 130 and proceeds to the polarizing half mirror 140. This circularly polarized image light is converted into P-polarized light by the λ / 4 plate laminated on the polarizing half mirror 140 and reflected by the reflective polarizing plate of the polarizing half mirror 140. The reflected P-polarized image light is converted into circularly polarized light by passing through the λ / 4 plate again. Therefore, the polarized half mirror 140 is positioned in such a way that the image light incident as circularly polarized light is reflected as circularly polarized light toward the first reflecting mirror 150 by the λ / 4 plate and the reflective polarizing plate stacked on the polarized half mirror 140.

[0082] The first reflecting mirror 150 is a concave mirror and is disposed below the polarizing half mirror 140 in Fig. 2. The first reflecting mirror 150 is disposed with its concave reflective surface facing upward. The circularly polarized image light reflected by the polarizing half mirror 140 is reflected by the first reflecting mirror 150 as it is, remaining circularly polarized, and travels back toward the polarizing half mirror 140. The image light incident on the polarizing half mirror 140 is converted into S-polarized light by a λ / 4 plate laminated on the polarizing half mirror 140, passes through the reflective polarizer of the polarizing half mirror 140, and travels upward in Fig. 2.

[0083] The second reflecting mirror 160 is a flat mirror and is disposed above the polarizing half mirror 140. Therefore, the image light that passes through the polarizing half mirror 140 and travels upward is reflected by the second reflecting mirror 160. The second reflecting mirror 160 is disposed in an orientation that reflects the image light toward the opening 121. That is, the image light reflected by the second reflecting mirror 160 travels through the opening 121 toward the eyes of the driver sitting in the driver's seat and becomes the first virtual image 101. FIG. 1 illustrates the position of the first virtual image 101 as seen from the driver's viewpoint. This position can be set by adjusting the viewing distance of the image light irradiated from the display element 130 of the first display device 100. The driver's viewpoint is, for example, a reference eye point. The reference eye point is a point that represents the position of the driver's eyes under normal driving conditions.

[0084] [Control Unit] 1, the control unit 500 is electrically connected to the first display device 100 and controls the display content of the display element 130. Specifically, the control unit 500 includes a CPU, RAM, ROM, etc., and the CPU executes various processes by expanding a program in the ROM into the RAM and executing it.

[0085] The control unit 500 is communicably connected, via wire or wirelessly, to an imaging unit 3 provided in the vehicle 1, which captures images of the surroundings of the vehicle 1. The imaging unit 3 may be provided in the display system 10.

[0086] The imaging unit 3 includes a front camera that captures images in front of the vehicle 1, a rear camera that captures images in rear of the vehicle 1, a right rear camera that captures images in the right rear of the vehicle 1, a left rear camera that captures images in the left rear of the vehicle 1, etc. The image captured by the front camera (front image), the image captured by the right front camera (right front image), and the image captured by the left front camera (left front image) are all included in the front image that shows the front of the vehicle 1. The image captured by the rear camera (rear image), the image captured by the right rear camera (right rear image), and the image captured by the left rear camera (left rear image) are all included in the rear image that shows the rear of the vehicle 1.

[0087] The control unit 500 controls the first display device 100 to display a part of the image obtained by the imaging unit 3 as a surrounding image within the first virtual image 101.

[0088] [Display example] An example of display by the first display device 100 will be described below. The first display device 100 switches between displaying a reference image G10 (see FIG. 3) and an auxiliary image G20 (see FIG. 4) as the first virtual image 101. The reference image G10 is an image that is mainly displayed during normal driving. The auxiliary image G20 is an image that includes an image G30 of the surroundings of the vehicle 1 to assist driving, and has display content different from that of the reference image G10.

[0089] The control unit 500 switches between the reference image G10 and the auxiliary image G20 by controlling the display element 130 based on a predetermined timing. For example, the control unit 500 switches from the reference image G10 to the auxiliary image G20 at the timing when a warning target such as another vehicle (car, motorcycle, bicycle, etc.) or an animal (person, dog, cat, etc.) is detected in the surrounding image G30 obtained by the imaging unit 3. Conversely, the control unit 500 switches from the auxiliary image G20 to the reference image G10 at the timing when the warning target is no longer detected in the surrounding image G30.

[0090] The control unit 500 may switch between the reference image G10 and the auxiliary image G20 based on the vehicle speed. Specifically, the control unit 500 switches from the reference image G10 to the auxiliary image G20 when the vehicle speed becomes equal to or lower than a predetermined speed, and switches from the auxiliary image G20 to the reference image G10 when the vehicle speed becomes equal to or higher than the predetermined speed.

[0091] The control unit 500 may switch between the reference image G10 and the auxiliary image G20 based on whether or not a turn signal is operated. Specifically, the control unit 500 switches from the reference image G10 to the right auxiliary image G20 when the right turn signal is operated, and switches from the reference image G10 to the left auxiliary image G20 when the left turn signal is operated. When the turn signal operation is released, the control unit 500 switches from the auxiliary image G20 to the reference image G10.

[0092] In addition to this, the control unit 500 may switch between the reference image G10 and the auxiliary image G20 when a dedicated switching button is operated, or may switch between the reference image G10 and the auxiliary image G20 based on whether or not the reverse gear of the vehicle 1 is operated.

[0093] Next, the reference image G10 and the auxiliary image G20 will be described in detail. FIG. 3 is an explanatory diagram showing the reference image G10 according to the first embodiment. As shown in FIG. 3, the reference image G10 is contained within the display region R of the first virtual image 101, with a tachometer M1 disposed on the right side and a speedometer M2 disposed on the left side. In the reference image G10, an image G11 of the surroundings ahead of the vehicle 1 obtained by the imaging unit 3 is disposed between the tachometer M1 and the speedometer M2.

[0094] FIG. 4 is an explanatory diagram showing an auxiliary image G20 according to the first embodiment. FIG. 4 shows the auxiliary image G20 for the left side. As shown in FIG. 4, the auxiliary image G20 is contained within the display region R of the first virtual image 101, with a speedometer M2 disposed on the right side and a surrounding image G30 disposed on the left side. Specifically, the surrounding image G30 is displayed together with a frame image G40 indicating a side mirror frame provided on the vehicle 1. The frame image G40 is an example of a border image that surrounds the periphery of the surrounding image G30. The side mirror frame may be a door mirror frame or a fender mirror frame.

[0095] The frame image G40 is a rectangular frame-shaped image that shows a deformed side mirror frame, and the surrounding image G30 is contained in an area within the frame image G40 that corresponds to the mirror. The surrounding image G30 is a left rear image that shows the left rear of the vehicle 1. In other words, the surrounding image G30 and the frame image G40 represent the left side mirror and the mirror image reflected therein as images. Because the surrounding image G30 is arranged on the left side of the display region R, the driver can intuitively understand that the surrounding image G30 displays the mirror image reflected in the left side mirror frame. Note that if the surrounding image G30 is a right rear image that shows the right rear of the vehicle 1, the surrounding image G30 should be arranged on the right side of the display region R, and the speedometer M2 should be arranged on the left side.

[0096] Here, control unit 500 displays at least a part of the periphery of surrounding image G30 so that it is blurred more than the inner part. In the present embodiment, the entire periphery of frame image G40 is blurred along with the periphery of surrounding image G30.

[0097] Fig. 5 is an explanatory diagram showing an auxiliary image G20z as a comparative example. As shown in Fig. 5, in the auxiliary image G20z, the periphery of the surrounding image G30 and the frame image G40 are not blurred and are displayed with clear lines.

[0098] Compared to FIG. 5, in FIG. 4, the frame image G40, along with the periphery of the surrounding image G30, is blurred all around and is highlighted with a thick line. Here, FIG. 4 shows that the unblurred surrounding image G30 is displayed with relative emphasis compared to at least a portion of the periphery (the entire periphery in FIG. 4) of the blurred surrounding image G30. Blurring the periphery of the surrounding image G30 in this manner is hereinafter referred to as "highlighting." Blurring the entire periphery of the surrounding image G30 gives the driver the impression of an increased sense of perspective within the surrounding image G30. Furthermore, blurring the entire periphery of the surrounding image G30 can also help the driver focus their attention on the display content of the surrounding image G30. The blurred frame image G40 has a nearly right-angled bottom right corner, and its radius of curvature is smaller than the radii of curvature of the top right, bottom left, and top left corners. Therefore, the driver can imagine that the left side mirror is fixed to the vehicle 1 at the bottom right of the frame image G40. Therefore, the shape of the frame image G40 allows the driver to intuitively recognize that it is the surroundings image G30 on the left rear side of the vehicle 1.

[0099] Here, the case where the periphery of the surrounding image G30 and the frame image G40 are uniformly blurred all around has been exemplified, but the right side closer to the driver and its vicinity may be blurred more emphatically than the other sides. In other words, because it is difficult for the driver to focus on the right side closer to the driver, the periphery of the surrounding image G30 and the right side of the frame image G40 may be blurred more emphatically. In this case, the driver can intuitively understand that the surrounding image G30 displays a mirror image reflected in the left side mirror frame.

[0100] Also, at least a portion of the periphery of the surrounding image G30 may be blurred for emphasis. For example, if the surrounding image G30 is an image of the left rear of the vehicle 1, the control unit 500 blurs only the right side of the surrounding image G30 that is close to the driver and its vicinity, and does not blur other sides. Even in this case, the driver can intuitively understand that the surrounding image G30 displays a mirror image reflected in the left side mirror frame.

[0101] Note that the "highlighted display" described above refers to a display in which the periphery of the surrounding image G30 is blurred to make it less noticeable than the inner part, thereby visually emphasizing the inner part. However, the highlighted display may also include visually emphasizing the periphery by adjusting at least one of the brightness, color, size, etc. of the periphery.

[0102] The surroundings image G30 is displayed in an area corresponding to the mirror within the frame image G40 together with the frame image G40 indicating the side mirror frame, so that the side mirror frame and the mirror image reflected therein can be expressed in an image. This allows the driver to intuitively understand which direction the surroundings image G30 corresponds to by visually checking the frame image G40 and the surroundings image G30. The display of the frame image G40 can also prevent the surroundings image G30 from being mistakenly recognized as an image in front of the vehicle.

[0103] Since the first virtual image 101, which is the display image, is disposed forward of the first display device 100, it is possible to reduce the burden on the driver who is viewing the area ahead of the vehicle 1 when moving his or her line of sight to the first virtual image 101. Furthermore, since the display image is the first virtual image 101, it is possible to enhance the sense of depth of the display image compared to when the surrounding image displayed on a flat display surface is viewed directly.

[0104] [Embodiment 2] A description will be given of embodiment 2. In the following description, the same parts as those in embodiment 1 will be given the same reference numerals, and the description thereof may be omitted.

[0105] 6 is an explanatory diagram showing an auxiliary image G20a according to embodiment 2. As shown in FIG. 6, the frame image G40a and the surrounding image G30a of the auxiliary image G20a are enlarged compared to those of FIG. 5, and the outer periphery of the frame image G40a is not displayed. Therefore, the entire periphery of the surrounding image G30a is blurred and highlighted. In this case, because the outer periphery of the frame image G40a is not displayed, it is possible to widen the display range of the surrounding image G30a.

[0106] 6, the outer periphery of the frame image G40a is not displayed, and therefore, in order to indicate that the surrounding image G30a is an image of the left rear, the blurred peripheral edge of the surrounding image G30a is made to form a nearly right angle at the bottom right, and the radius of curvature is made smaller than the radii of curvature at the top right, bottom left, and top left, similar to Fig. 4. This allows the driver to intuitively recognize that the surrounding image G30a is an image of the left rear of the vehicle 1 from the shape of the peripheral edge of the surrounding image G30a.

[0107] [Embodiment 3] A third embodiment will be described. FIG. 7 is an explanatory diagram showing an auxiliary image G20b according to the third embodiment. As shown in FIG. 7, the auxiliary image G20b displays an arm image G41b showing an arm extending from a side mirror frame of the vehicle 1, a frame image G40, and a surrounding image G30. The arm image G41b extends from the lower right corner of the frame image G40 downward and to the right. This allows the driver to more intuitively understand that the frame image G40 is an image representing the left side mirror of the vehicle 1. Note that the periphery of the surrounding image G30, the frame image G40, and the arm image G41b in FIG. 7 are all blurred. Similarly, in the fourth to seventh embodiments (FIGS. 8 to 12) described below, the periphery and frame image of the surrounding image are all blurred.

[0108] [Embodiment 4] A fourth embodiment will be described. FIG. 8 is an explanatory diagram showing a frame image G40c according to the fourth embodiment. The frame image G40c includes a left frame image G40cL (see (a) of FIG. 8) showing a side mirror frame arranged on the left side of the vehicle 1 and a right frame image G40cR showing a side mirror frame arranged on the right side of the vehicle 1. Depending on the type of vehicle 1, the shape of the side mirror frame may differ between the left and right. For example, in some types of recreational vehicles, when the driver's seat is on the right seat, an auxiliary mirror is provided in the left side mirror frame. In this way, in the case of a vehicle having side mirrors with different shapes on the left and right, the left frame image G40cL and the right frame image G40cR are displayed in an asymmetrical shape in the auxiliary image G20 according to the shape. Specifically, in the left frame image G40cL, an auxiliary mirror frame image G41c is arranged in the lower left corner, whereas in the right frame image G40cR, an auxiliary mirror frame image is not provided.

[0109] In this way, since the left frame image G40cL and the right frame image G40cR are asymmetrical, the shape allows the driver to more intuitively understand which direction is which.

[0110] 9 is an explanatory diagram showing a modified example of the left frame image according to Embodiment 4. In the left frame image G40cL1 shown in FIG. 9, the auxiliary mirror frame G41c1 is arranged within the peripheral image G30c1. Specifically, the auxiliary mirror frame G41c1 is arranged in the lower left corner within the peripheral image G30c1. In this case as well, the left frame image G40cL1 is asymmetrical with respect to the frame image G40c.

[0111] [Embodiment 5] A fifth embodiment will now be described. FIG. 10 is an explanatory diagram showing a left frame image G40dL and a right frame image G40dR according to the fifth embodiment. The left frame image G40dL and the right frame image G40dR have shapes that taper outward. Specifically, the left frame image G40dL has a vertical width that narrows as it moves to the left. The right frame image G40dR has a vertical width that narrows as it moves to the right. Even in this case, the driver can more intuitively grasp which direction is which.

[0112] [Embodiment 6] A sixth embodiment will now be described. Fig. 11 is an explanatory diagram showing an auxiliary image G20e according to the sixth embodiment. As shown in Fig. 11, in the auxiliary image G20e, the frame image G40e and the surrounding image G30e are enlarged compared to Fig. 7, and part of the outer periphery of the frame image G40e is not displayed. In this way, because part of the outer periphery of the frame image G40a is not displayed, it is possible to widen the display range of the surrounding image G30e.

[0113] [Embodiment 7] A seventh embodiment will be described. FIG. 12 is an explanatory diagram showing an auxiliary image G20f according to the seventh embodiment. As shown in FIG. 12, the auxiliary image G20f displays an interior image G42f showing a part of the interior of the vehicle 1, an arm image G41f, a frame image G40f, and a surrounding image G30f. The interior image G42f includes a pillar image G43f showing a pillar provided on the vehicle 1 and a door interior image G44f showing the interior of a door provided on the vehicle 1. In this manner, the interior image G42f and the frame image G40f are displayed, so that the driver can more intuitively understand which direction the surrounding image G30f faces. Note that the interior image G42f may include only one of the pillar image G43f and the door interior image G44f.

[0114] [Embodiment 8] An eighth embodiment will be described. FIG. 13 is an explanatory diagram showing an auxiliary image G20g according to the eighth embodiment. As shown in FIG. 13, the auxiliary image G20g realistically depicts a side mirror frame provided on the vehicle 1, and a blurred frame image G40g is provided. Specifically, the frame image G40g may be created based on a captured image obtained by capturing an image of an actual side mirror frame, or may be a CG image created from design data of the side mirror frame. In this way, the frame image G40g realistically depicts the side mirror frame, and the realistic frame image G40g can enhance the sense of realism. Because the frame image G40g realistically depicts the side mirror frame, the shape of the frame image G40g allows the driver to more intuitively grasp the direction of the surrounding image G30g.

[0115] In addition, in the auxiliary image G20g, a vehicle body image G50g showing the vehicle body of the vehicle 1 is included in the surrounding image G30g and displayed together with a frame image G40g. For example, in FIG. 13, the surrounding image G30g is an image showing the left rear of the vehicle, so the vehicle body image G50g is an image showing the left rear part of the vehicle body and is displayed at the right end of the surrounding image G30g. In this way, the vehicle body image G50g and the frame image G40g are displayed, so that the driver can more intuitively understand which direction the vehicle is facing by using the vehicle body image G50g. A function may be provided to change the color of the vehicle body image G50g to match the body color of the vehicle 1.

[0116] Here, a lighting image G51g indicating the lighting status of the turn signal provided on the vehicle 1 is provided at one end of the frame image G40g. The control unit 500 acquires the lighting status of the turn signal of the vehicle 1 and controls the display mode of the lighting image G51g according to the lighting status. Specifically, when the turn signal of the vehicle 1 is flashing, the control unit 500 turns on or flashes the lighting image G51g. On the other hand, when the turn signal of the vehicle 1 is off, the control unit 500 turns off the lighting image G51g. In this way, the lighting image G51g is displayed, so that the driver can understand the lighting status of the turn signal from the lighting image G51g. Note that the flashing and off of the turn signal may be expressed by varying at least one of the color, shape, and size of the lighting image G51g.

[0117] The control unit 500 performs well-known image processing on the surrounding image G30g to determine whether a warning target is displayed. If a warning target is displayed, the control unit 500 visually emphasizes the warning target and displays it on the first display device 100. Specifically, the control unit 500 displays an arrow Y1 pointing to the warning target or a frame W1 surrounding the warning target. Because the warning target is displayed in the surrounding image G30g with emphasis, the driver can intuitively grasp the warning target. Any display method that visually emphasizes the warning target may be used. For example, the warning target may be enlarged, flashed, or the color or brightness of the warning target may be changed. Furthermore, if a warning target is displayed in the surrounding image G30g, an alarm may be issued by sound or by vibrating a vibration unit provided on the seat or steering wheel.

[0118] The control unit 500 also blurs the entire periphery of the frame image G40g along with the periphery of the surrounding image G30g. FIG. 14 is an explanatory diagram showing an auxiliary image G21z as a comparative example. As shown in FIG. 14, in the auxiliary image G21z, the periphery of the surrounding image G30g and the frame image G49z are not blurred but are displayed with clear lines. The control unit 500 may create the frame image G40g by blurring the unblurred frame image G49z through image processing, or may create the frame image G40g by intentionally blurring the side mirror frame and capturing it with the imaging unit 3.

[0119] In this embodiment, as shown in Fig. 13, the entire periphery of the surrounding image G30g is blurred, which gives the driver the impression of an increased sense of perspective within the surrounding image G30g. Furthermore, blurring the entire periphery of the surrounding image G30g also makes it easier for the driver to focus their attention on the display content of the surrounding image G30g. Note that in Figs. 15, 17 to 27, 36 to 43 in the following embodiments, the peripheries and frame images of the surrounding images are all blurred.

[0120] [Embodiment 9] A ninth embodiment will be described. Fig. 15 is an explanatory diagram showing a surrounding image G30h according to the ninth embodiment. As shown in Fig. 15, the control unit 500 distorts the surrounding image G30h and displays it on the first display device 100.

[0121] Fig. 16 is an explanatory diagram showing a display object r12 according to the ninth embodiment. As shown in Fig. 16, for example, with respect to the shooting range R10 of the left rear camera, the display object r11 of the surrounding image G30g shown in Fig. 13 is the range surrounded by the dashed line L1. The display object r11 is positioned in the center of the shooting range R10. This display object r11 is clipped and displayed as the surrounding image G30g.

[0122] On the other hand, the display object r12 of the surrounding image G30h is the range within the shooting range R10 that is surrounded by the dashed line L2. The display object r12 has a range that is larger in the vertical (height) and horizontal (left-right) directions than the display object r11. In order to cut out this display object r12 and display it as the surrounding image G30h, the control unit 500 distorts and displays the images of the top, bottom, left, and right portions of the display object r12. In this way, the display object r12 of the surrounding image G30h has a wider range than the display object r12 of the surrounding image G30g and is displayed in a distorted manner, which allows the driver to perceive that a wide-angle image is being displayed.

[0123] [Embodiment 10] A tenth embodiment will be described. In the tenth embodiment, a case will be illustrated in which a border image G40g displayed on the first display device 100 is adjusted by changing the aspect ratio. Fig. 17 is an explanatory diagram showing a border image G40g before adjustment and border images G41i and G42i after adjustment according to the tenth embodiment.

[0124] 17(a) shows a frame image G40g before adjustment, and the aspect ratio of this frame image G40g is equal to the aspect ratio of the side mirror frame provided on the vehicle 1. FIG. 17(b) shows a frame image G41i after adjustment, and this frame image G41i is longer in the horizontal direction than the aspect ratio of the side mirror frame provided on the vehicle 1. FIG. 17(c) shows a frame image G42i after adjustment, and this frame image G42i is longer in the vertical direction than the aspect ratio of the side mirror frame provided on the vehicle 1.

[0125] The control unit 500 adjusts the aspect ratio based on a predetermined operation. Specifically, when a blinker is activated, the control unit 500 controls the first display device 100 to switch from frame image G40g to frame image G41i (from (a) in FIG. 17 to (b) in FIG. 17). In response to this switching, the control unit 500 also switches the surrounding image G30g to the surrounding image G31i. As shown in FIG. 16, the display object r13 of the surrounding image G31i is the range within the shooting range R10 that is surrounded by the dashed-dotted line L3. The display object r13 is an area that is equal in height to the display object r11 but larger in width. This display object r13 is clipped and displayed as the surrounding image G31i.

[0126] When the blinker driving operation is released, the control unit 500 controls the first display device 100 to switch from the frame image G41i and the surrounding image G31i to the frame image G40g and the surrounding image G30g (from (b) of FIG. 17 to (a) of FIG. 17). Note that although (b) of FIG. 17 shows the frame image G41i stretched in the horizontal direction, it may be shrunk in the vertical direction.

[0127] Furthermore, when the reverse gear is shifted, the control unit 500 controls the first display device 100 to switch from the frame image G40g to the frame image G42i (FIG. 17(a) to FIG. 17(c)). In response to this switching, the control unit 500 also switches the surrounding image G30g to the surrounding image G32i. As shown in FIG. 16, the display object r14 of the surrounding image G32i is the range within the shooting range R10 that is surrounded by the two-dot chain line L4. The display object r14 is an area that is the same widthwise as the display object r11 but larger vertically. This display object r14 is cut out and displayed as the surrounding image G32i.

[0128] When the reverse gear operation is released, the control unit 500 controls the first display device 100 to switch from the frame image G42i and the surrounding image G32i to the frame image G40g and the surrounding image G30g (from (c) of FIG. 17 to (a) of FIG. 17). Note that although (c) of FIG. 17 shows the frame image G42i stretched vertically, it may be shrunk horizontally.

[0129] In this way, since the aspect ratio of the frame images G41i, G42i is different from the aspect ratio of the side mirror frame, a wide-angle image in the vertical or horizontal direction can be displayed within the frame images G41i, G42i.

[0130] [Embodiment 11] An eleventh embodiment will be described. FIG. 18 is an explanatory diagram showing an auxiliary image G20j according to the eleventh embodiment. As shown in FIG. 18, the control unit 500 causes the first display device 100 to display a front image G46j (more specifically, a front image showing the left front) showing the area ahead of the vehicle 1, among the images captured by the imaging unit 3, as the background of a frame image G40j. Since the front image G46j is displayed as the background of the frame image G40j in this manner, the sense of realism can be enhanced. Here, the control unit 500 may blur the background of the frame image G40j when displaying it. Furthermore, an imaging unit for capturing the front image G46j may be installed in the side mirror frame of the vehicle 1, or an imaging unit for capturing the front image G46j including the side mirror frame may be installed in the vehicle 1. In the latter case, the frame image G40j is displayed superimposed on a portion of the image corresponding to the side mirror frame.

[0131] Furthermore, the control unit 500 may control the first display device 100 so that the background color of the frame image G40j varies based on the environment of the vehicle 1. Specifically, the control unit 500 estimates the environment of the vehicle 1 based on at least one of the current date and time, the illuminance sensor, the image captured by the imaging unit 3, weather information acquired through communication, and current location information. The control unit 500 determines the background color of the frame image G40j based on the estimation result. For example, the background color may be determined to be blue during the daytime and black or dark gray during the nighttime. The background color may be determined to be light gray when it is cloudy. The background color may be determined to be white when it is snowing. Since the background color varies based on the environment of the vehicle 1 in this way, the driver can understand the environment of the vehicle 1 simply by recognizing the background color.

[0132] [Embodiment 12] A twelfth embodiment will be described. FIG. 19 is an explanatory diagram showing an auxiliary image G20k according to the twelfth embodiment. As shown in FIG. 19, in the auxiliary image G20k, a left frame image G40kL is arranged on the left side, a right frame image G40kR is arranged on the right side, and a speedometer M2 is arranged in the center. An image G30kL of the surroundings to the left rear of the vehicle 1 is arranged within the left frame image G40kL, and an image G30kR of the surroundings to the right rear of the vehicle 1 is arranged within the right frame image G40kR. In this way, the left frame image G40kL is arranged on the left side, and the right frame image G40kR is displayed on the right side, so that the display layout allows the driver to more intuitively understand which direction the surrounding images G30kL and G30kR correspond to. This display form may be displayed, for example, when a reverse gear is shifted, or when a warning target is approaching from the left or right rear. A rear image may also be displayed.

[0133] FIG. 20 is an explanatory diagram showing a modified example of the auxiliary image G20k according to the twelfth embodiment. For example, when the driver is sitting in the right seat, the right side mirror frame appears larger than the left side mirror frame to the driver. To reproduce this, in FIG. 20, the right frame image G40kR is displayed larger than the left frame image G40kL. This allows the driver to more intuitively understand which direction the surrounding images G30kL and G30kR correspond to.

[0134] [Embodiment 13] A thirteenth embodiment will now be described. FIGS. 21 and 22 are explanatory diagrams showing an auxiliary image G20m according to the thirteenth embodiment. As shown in FIGS. 21 and 22, the auxiliary image G20m is displayed in a viewable manner together with a speedometer M2, an image G11 of the surroundings ahead of the vehicle 1, and a tachometer M1. Specifically, in FIG. 21, the left frame image G40mR, the speedometer M2, the surroundings image G11, and the tachometer M1 are arranged from left to right. In FIG. 22, the speedometer M2, the surroundings image G11, the tachometer M1, and the right frame image G40mR are arranged from left to right. In this manner, various pieces of information are displayed in a viewable manner, allowing the driver to grasp this information all at once. Furthermore, in the case of FIG. 22, the right frame image G40mR is displayed in the upper right corner of the display region R of the first display device 100, thereby reducing the amount of vertical gaze movement required when a user viewing the area ahead of the vehicle shifts their gaze to the right frame image G40mR. Therefore, the burden on the driver in moving his or her line of sight can be reduced. The same is true for the left frame image G40mL in FIG.

[0135] [Embodiment 14] A fourteenth embodiment will be described. Fig. 23 and Fig. 24 are explanatory diagrams showing an auxiliary image G20n according to the fourteenth embodiment. In Fig. 23 and Fig. 24, an image from a front camera provided in the vehicle 1 is displayed as a surrounding image G12 (forward image) on the first display device 100. Here, the front camera is a camera that captures an image in front of the vehicle 1 at a wide angle, and is capable of capturing an image of a warning target that is in a blind spot for the driver due to an obstacle in front of the vehicle.

[0136] Specifically, in Fig. 23, a left frame image G40nL, a speedometer M2, a surrounding image G12, and a tachometer M1 are arranged from left to right. In Fig. 24, the left frame image G40nL and the surrounding image G12 are arranged on the left and right, and a digital speedometer M3 is arranged below the surrounding image G12.

[0137] In either case, the surrounding image G12 showing the area ahead of the vehicle 1 and the surrounding image G30nL in the left frame image G40nL are displayed in a list, allowing the user to simultaneously grasp the surrounding images G12 and G30nL.

[0138] [Embodiment 15] A description will be given of a fifteenth embodiment. In the fifteenth embodiment, a description will be given of the display when switching from the reference image G10 to the auxiliary image G20g. Fig. 25 is an explanatory diagram showing the display when switching from the reference image G10 to the auxiliary image G20g according to the fifteenth embodiment. (a) of Fig. 25 shows the reference image G10, (c) of Fig. 25 shows the auxiliary image G20g, and (b) of Fig. 25 shows the switching in progress.

[0139] Specifically, when the timing for switching arrives, the control unit 500 scrolls the reference image G10 to the right while displaying the reference image G10 shown in (a) of FIG. 25 on the first display device 100. At this time, because a frame image G40g is arranged on the left side of the reference image G10, the frame image G40g appears from the left side ((b) of FIG. 25). Finally, the control unit 500 displays the auxiliary image G20g on the first display device 100 as shown in (c) of FIG. 25. In this way, switching between the reference image G10 and the auxiliary image G20g is performed by scrolling, so that the execution of the switching can be communicated to the driver without any sense of discomfort.

[0140] Note that the switching display by scrolling is not limited to this. Fig. 26 is an explanatory diagram showing a modified example of the switching display from reference image G10 to auxiliary image G20g according to embodiment 15. Fig. 26(a) shows reference image G10, Fig. 26(e) shows auxiliary image G20g, and Fig. 26(b) to (d) show the switching in progress.

[0141] Specifically, when the timing for switching arrives, the control unit 500 scrolls the reference image G10 to the right while displaying the reference image G10 shown in (a) of FIG. 26 on the first display device 100. At this time, blank spaces are lined up on the left side of the reference image G10, and the blank spaces appear from the left side ((b) of FIG. 26). As the scrolling progresses and only the speedometer M2 is displayed as shown in (c) of FIG. 26, the control unit 500 displays a frame image G40g in the blank spaces so that the frame image G40g gradually becomes darker ((d) of FIG. 26). Finally, the control unit 500 displays an auxiliary image G20g on the first display device 100 as shown in (e) of FIG. 26.

[0142] [Embodiment 16] A sixteenth embodiment will be described. FIG. 27 is an explanatory diagram showing an auxiliary image G20p according to the sixteenth embodiment. As shown in FIG. 27, in the auxiliary image G20p, an area where the speedometer M2 is displayed is defined as a first area R11, and an area where the frame image G40g is displayed is defined as a second area R12. The first area R11 and the second area R12 are formed by dividing the display area R of the first virtual image 101 in the left-right direction. The control unit 500 highlights the periphery of the second area R12 according to the direction of the surrounding image G30g within the frame image G40g. Specifically, since the surrounding image G30g is an image of the left rear of the vehicle 1, the control unit 500 highlights the left side R12L and the bottom side R12B of the second area R12 by flashing them. In addition, if the surrounding image G30g is an image of the right rear of the vehicle 1, the control unit 500 flashes the right side and the bottom side of the second area R12. Alternatively, a plurality of light sources, such as LEDs, may be arranged around the periphery of the display region R of the first virtual image 101, and the control unit 500 may blink the light sources at positions corresponding to the direction of the peripheral image G30g to highlight the peripheral image G30g. FIG. 27 illustrates an example in which the left side R12L and bottom side R12B of the second region R12, which are at least a portion of the periphery of the peripheral image G30g, are blinked to highlight the peripheral image G30g relative to the peripheral image G30g. At the same time, the periphery of the peripheral image G30g and the frame image G40g are blurred, thereby highlighting the peripheral image G30g relative to at least a portion (all of the peripheral image G30g and the frame image G40g in FIG. 27). However, these highlighting operations do not need to be performed simultaneously. For example, only the former (the blinking of the left side R12L and bottom side R12B of the second region R12) may be performed, without blurring the periphery of the peripheral image G30g and the frame image G40g.

[0143] In this way, the direction of the surrounding image G30g is displayed in a highlighted manner together with the frame image G40g, so that the driver can more intuitively grasp the direction of the surrounding image G30g.

[0144] [Embodiment 17] A seventeenth embodiment will be described. FIG. 28 is an explanatory diagram showing an auxiliary image G20q according to the seventeenth embodiment. As shown in FIG. 28, in the auxiliary image G20q, the entire second region R12 is the surrounding image G30q. In this case, the control unit 500 highlights a part of the periphery of the surrounding image G30q. Specifically, since the surrounding image G30q is an image of the left rear of the vehicle 1, the control unit 500 highlights the left side R12L and the bottom side R12B of the second region R12 by blinking them. In this way, the direction of the surrounding image G30q is represented by highlighting, so that the driver can intuitively understand which direction the surrounding image G30q corresponds to.

[0145] Fig. 29 is an explanatory diagram showing a modified example of the auxiliary image according to the seventeenth embodiment. As shown in Fig. 29, in the auxiliary image G20r, the entire second region R12r is a surrounding image G30r. The surrounding image G30r is an image captured by a front camera provided on the vehicle 1. As such, since the surrounding image G30r is an image of the area in front of the vehicle 1, the control unit 500 highlights only the upper edge R12T of the second region R12r by flashing it.

[0146] [Embodiment 18] An eighteenth embodiment will be described. FIG. 30 is an explanatory diagram showing an auxiliary image G20s according to the eighteenth embodiment. As shown in FIG. 30, the control unit 500 causes an icon I1 indicating the surrounding conditions of the vehicle 1 to be displayed together with a surrounding image G30q on the first display device 100. Specifically, the icon I1 indicates a warning target displayed in the surrounding image G30q together with the vehicle 1 as the surrounding conditions of the vehicle 1. The icon I1 in FIG. 30 indicates that a warning target is present in the left vicinity of the vehicle 1. In this way, the icon I1 indicating the surrounding conditions of the vehicle 1 is displayed together with the surrounding image G30q, so the driver can easily grasp the surrounding conditions by using the icon I1.

[0147] FIG. 31 is an explanatory diagram showing another example of an icon according to the eighteenth embodiment. In icon I2 in FIG. 31(a), a fan-shaped mark indicates that there is a warning target to the left rear of vehicle 1. In icon I3 in FIG. 31(b), a camera mark indicates that there is a warning target to the left rear of vehicle 1. In icon I4 in FIG. 31(c), a warning mark indicates that the warning target is displayed in the surrounding image G30q. In icon I8 in FIG. 31(d), a fan-shaped mark indicates that there is a warning target to the left rear of vehicle 1, and the warning target is further indicated by a motorcycle mark. Note that if the type of warning target (e.g., motorcycle, bicycle, car, kick scooter, pedestrian, etc.) can be detected by a sensor or the like, a mark corresponding to the detected type may be included in icon I8.

[0148] Fig. 32 is an explanatory diagram showing a modified example of the auxiliary image according to the eighteenth embodiment. As shown in Fig. 32, the control unit 500 causes the first display device 100 to display an icon I5 indicating the surrounding situation of the vehicle 1 together with the surrounding image G30r1. The icon I5 in Fig. 32 indicates a warning target approaching from the right in front of the vehicle 1.

[0149] Fig. 33 is an explanatory diagram showing another example of an icon according to the eighteenth embodiment. Icon I6 in Fig. 33(a) uses a fan-shaped mark to indicate that a warning target is present to the right front of vehicle 1. Icon I7 in Fig. 33(b) uses a fan-shaped mark to indicate that a warning target is approaching from the right in front of vehicle 1. The fan-shaped mark spreads out along the dashed line to indicate the progress of the warning target.

[0150] [Embodiment 19] Next, a description will be given of embodiment 19. Fig. 34 is a schematic diagram showing a display system 10S according to embodiment 19. As shown in Fig. 34, the display system 10S further includes a second display device 200 that projects a second virtual image 201 in front of the driver and above the first virtual image 101.

[0151] The second display device 200 is an AR-HUD (Augmented Reality Head-up Display). The second display device 200 projects light onto an area D1 of a windshield (front glass) 2, which is a display medium. The projected light is reflected by the windshield 2. This reflected light is directed toward the eyes of the driver sitting in the driver's seat, who is the user of the second display device 200. The driver perceives the reflected light that has entered his or her eyes as a second virtual image 201 that appears on the opposite side of the windshield 2 (outside the vehicle) against the background of actual objects visible through the windshield 2.

[0152] Next, the configuration of the second display device 200 will be described with reference to Fig. 35. Fig. 35 is a schematic cross-sectional view showing the second display device 200 according to the nineteenth embodiment.

[0153] 35 , the second display device 200 includes a housing 210, a cover 220, a display element 230, a first optical element 240, and a second optical element 250. The first optical element 240 and the second optical element 250 form an optical system for projecting the image light from the display element 230 as a second virtual image 201.

[0154] The housing 210 is a box-shaped body made of light-blocking resin or metal. Specifically, the housing 210 has a substantially rectangular parallelepiped shape, and an opening 211 is formed in the upper part thereof. The opening 211 is closed by the cover part 220. A display element 230, a first optical element 240, and a second optical element 250 are housed in the internal spaces of the housing 210 and the cover part 220.

[0155] The cover portion 220 is a curved plate made of, for example, a light-transmitting resin or glass. Specifically, the cover portion 220 has a shape that is convex downward as a whole.

[0156] The display element 230 is, for example, a liquid crystal panel, and when irradiated with light from a light source (not shown), irradiates the first optical element 240 with image light that becomes the second virtual image 201. The display element 230 may be an organic EL panel. The display element 230 is formed in a rectangular shape in a plan view and is disposed in an orientation that is inclined with respect to the horizontal plane.

[0157] The first optical element 240 is disposed on the optical path of the image light emitted from the display element 230, and is an optical element that reflects the image light toward the second optical element 250. The first optical element 240 is a convex mirror formed in a rectangular shape in a plan view. The first optical element 240 is disposed in an orientation that is tilted with respect to a vertical plane. The reflective surface of the first optical element 240 faces the display element 230 and the second optical element 250. In other words, the reflective surface of the first optical element 240, which is the mirror surface of the convex mirror, faces inward of the housing 210, and the concave surface faces outward of the housing 210.

[0158] The second optical element 250 is an optical member disposed on the optical path of the image light that has passed through the first optical element 240 and that reflects the image light reflected by the first optical element 240 toward the opening 211. Specifically, the second optical element 250 is a concave mirror formed in a rectangular shape in a plan view. The second optical element 250 faces the reflective surface side of the first optical element 240 and is disposed in an orientation inclined with respect to the vertical plane of the housing 210. The reflective surface of the second optical element 250 faces the first optical element 240 and the cover portion 220. That is, the reflective surface of the second optical element 250, which is the mirror surface of the concave mirror, faces inward of the housing 210, and the convex surface faces outward of the housing 210. The image light reflected by the second optical element 250 is projected onto the windshield 2 through the opening 211. This reflection causes the image light to be directed toward the eyes of the driver sitting in the driver's seat, forming a second virtual image 201. 34 illustrates the position of the second virtual image 201 as seen from the driver's viewpoint. This position can be set by adjusting the viewing distance of the image light emitted from the display element 230 of the second display device 200. The driver's viewpoint is, for example, the reference eye point.

[0159] The control unit 500 is electrically connected to the second display device 200 and controls the display content of the display element 230. FIG. 36 is an explanatory diagram showing a display example of the first display device 100 and the second display device 200 according to the nineteenth embodiment. As shown in FIG. 36, the first virtual image 101 of the first display device 100 switches between displaying a reference image G10 and an auxiliary image G20g (FIG. 36 shows the auxiliary image G20g being displayed). The second virtual image 201 of the second display device 200 is disposed above and adjacent to the first virtual image 101 and displays navigation information S10 for the vehicle 1. Specifically, the second virtual image 201 displays an arrow guiding the driver to turn left as the navigation information S10, as well as a speedometer S11 and a visual guidance arrow S12. The visual guidance arrow S12 is a guidance image for guiding the driver's gaze toward a warning target displayed in the surrounding image G30g within the frame image G40g.

[0160] In this way, since the second virtual image 201 includes the line-of-sight guidance arrow S12, the line-of-sight guidance arrow S12 can guide the driver's line of sight to the surrounding image G30g within the first virtual image 101. This allows the driver to smoothly move their line of sight to the surrounding image G30g.

[0161] Furthermore, the control unit 500 may switch from the reference image G10 to the auxiliary image G20g at the timing when the navigation information S10 is displayed. In this way, the surrounding image G30g is displayed in conjunction with the navigation information S10, so that the driver can grasp the navigation information S10 and the surrounding image G30g together.

[0162] [Embodiment 20] Embodiment 20 will be described. Fig. 37 is an explanatory diagram showing auxiliary images G20 and G20t shown in embodiment 20. In embodiment 20, when a predetermined condition is not satisfied, auxiliary image G20 is displayed on the first display device 100, and when the predetermined condition is satisfied, it is switched to another auxiliary image G20t.

[0163] FIG. 37(a) shows an auxiliary image G20, and FIG. 37(b) shows another auxiliary image G20t. The frame images G40 and G40t in the auxiliary image G20 and the auxiliary image G20t are visually different. Specifically, the frame image G40 in the auxiliary image G20 and the frame image G40t in the auxiliary image G20t are different in size. FIG. 37 illustrates an example in which the frame image G40t in the auxiliary image G20t is larger than the frame image G40 in the auxiliary image G20, but the frame image G40t may be smaller than the frame image G40. The surrounding image G30t within the frame image G40t may or may not be enlarged to match the size of the frame image G40t.

[0164] When a predetermined condition is met while the auxiliary image G20 is displayed on the first display device 100, the control unit 500 controls the first display device 100 to switch to the auxiliary image G20t. Here, the predetermined condition may be at least one of the following: when the distance between the vehicle 1 and the warning target becomes shorter than a predetermined distance; when the warning target turns on its blinker in a direction approaching the vehicle 1; or when the warning target is driving unstably (such as meandering). The control unit 500 determines these conditions by performing a well-known detection process on the image captured by the imaging unit 3. Note that the distance between the vehicle 1 and the warning target may be determined using the detection result of a distance measurement sensor (radar or LiDAR: Light Detection and Ranging) provided in the vehicle 1.

[0165] The control unit 500 may repeatedly switch between displaying the auxiliary image G20 and the auxiliary image G20t while a predetermined condition is satisfied. Alternatively, the control unit 500 may display only the auxiliary image G20t only while the predetermined condition is satisfied, and then return to the auxiliary image G20 when the predetermined condition is no longer satisfied.

[0166] In this way, the size of the frame images G40, G40t differs between when the specified conditions are met and when they are not met, so if the driver can visually recognize this difference, he or she can understand whether the specified conditions are met or not.

[0167] Hereinafter, other modified examples of auxiliary images will be described. Figures 38 to 41 are explanatory diagrams showing other auxiliary images G20u, G20v, G20w, and G20x according to Embodiment 21. Figures 38 to 41 are diagrams corresponding to Figure 37.

[0168] Figure 38(a) shows auxiliary image G20, and Figure 38(b) shows another auxiliary image G20u. Auxiliary image G20 and auxiliary image G20u are visually different from each other because the thickness of the border lines of frame images G40 and G40u are different. Figure 38 illustrates an example in which the border line of frame image G40u of auxiliary image G20u is thicker than that of frame image G40 of auxiliary image G20, but this relationship may be reversed.

[0169] In this way, the thickness of the frame lines of the frame images G40, G40u differs depending on whether the specified conditions are met or not, and if the driver visually recognizes this difference, the driver can understand whether the specified conditions are met or not.

[0170] Figure 39(a) shows auxiliary image G20, and Figure 39(b) shows another auxiliary image G20v. Auxiliary image G20 and auxiliary image G20v are visually different due to the presence or absence of a frame image G40. In other words, auxiliary image G20v does not display a frame image.

[0171] In this way, the presence or absence of the frame image G40 differs between when the specified conditions are met and when they are not met, so if the driver can visually recognize this difference, he or she can understand whether the specified conditions are met or not.

[0172] Figure 40(a) shows auxiliary image G20, and Figure 40(b) shows another auxiliary image G20w. Auxiliary image G20 and auxiliary image G20w are visually different because the colors of frame images G40 and G40w are different. Here, "different colors" means that at least one of chromaticity, lightness, and saturation is different.

[0173] In this way, the colors of the frame images G40, G40w are different when the specified conditions are met and when they are not met, so if the driver can visually recognize the difference, he or she can understand whether the specified conditions are met or not.

[0174] Fig. 41(a) shows auxiliary image G20, and Fig. 41(b) shows another auxiliary image G20x. Auxiliary image G20 and auxiliary image G20x are visually different because the backgrounds of frame images G40 and G40x are different. Fig. 41 illustrates an example in which the background colors of frame images G40 and G40x are different, but the display content of the background may also be different.

[0175] In this way, the background of the frame images G40, G40x is different when the specified conditions are met and when they are not met, so if the driver can visually recognize this difference, he or she can understand whether the specified conditions are met or not.

[0176] [Embodiment 21] A twenty-first embodiment will be described. Fig. 42 is an explanatory diagram showing an auxiliary image G210 shown in the twenty-first embodiment. The auxiliary image G210 is an image showing a scene in a blind spot caused by a pillar of the vehicle 1 as seen from the driver. Fig. 42 shows the auxiliary image G210 corresponding to the pillar on the right side of the vehicle 1.

[0177] Furthermore, the vehicle 1 is equipped with an in-vehicle camera for capturing images of the interior of the vehicle cabin and a pillar camera for capturing images of the exterior of the vehicle that are blind spots due to the pillars. The auxiliary image G210 is a composite image of an interior image G211 captured by the in-vehicle camera and an exterior image G212 captured by the pillar camera, and is displayed together with a digital speedometer G214. The pillar camera is an example of an imaging unit, and the exterior image G212 is included in the forward image. Here, whether an object in the exterior image G212 (a motorcycle in the example of FIG. 42) is in the driver's blind spot is determined based on the positional relationship between the driver's viewpoint position detected by a driver monitoring camera separately provided in the vehicle cabin and the object in the exterior image G212. If it is determined that the warning object in the exterior image G212 is in the driver's blind spot, the positional relationship between the interior image G211 and the exterior image G212 when superimposed is determined. Then, the reference image G10 is switched to the auxiliary image G210.

[0178] The control unit 500 causes the first display device 100 to display, as an edge image, a pillar image G213 indicating a pillar provided on the vehicle 1. At this time, the control unit 500 causes the vehicle exterior image G212 to be displayed as a surrounding image, being placed within the pillar image G213. The control unit 500 controls the first display device 100 so that either the vehicle exterior image G212 or at least a part of the pillar image G213 is displayed in a relatively highlighted manner.

[0179] According to this, the forward image is displayed as the outside-of-vehicle image G212 (surroundings image) within the pillar image G213, and therefore the pillar image G213 or the surroundings image can also be highlighted. Therefore, the driver can intuitively grasp in the pillar image G213 which direction the surroundings image corresponds to.

[0180] Although the interior image G211 is an image captured by an in-vehicle camera, the interior image G211 may be a computer graphics image stored in the control unit 500 in advance.

[0181] [Embodiment 22] Embodiment 22 will be described. Fig. 43 is an explanatory diagram showing an auxiliary image G220 shown in Embodiment 22. The auxiliary image G220 is an image showing a scene in a blind spot caused by the hood of the vehicle 1 when viewed from the driver.

[0182] A hood camera that captures an external image of a blind spot caused by the hood is provided on the vehicle 1. The hood camera is an example of an imaging unit, and the outside image G222 captured by the hood camera is included in the forward image.

[0183] The control unit 500 causes the first display device 100 to display a hood image G223 showing the hood of the vehicle 1 as an edge image together with the digital speedometer G225. At this time, the control unit 500 causes the first display device 100 to display a blind spot image G224, which is a blind spot caused by the hood, of the vehicle exterior image G222 as a surrounding image and includes it within the hood image G223. The control unit 500 controls the first display device 100 so that either the blind spot image G224 or at least a part of the hood image G223 is displayed with relative emphasis.

[0184] According to this, the forward image is displayed as a blind spot image G224 (surrounding image) within the bonnet image G223, and therefore can be highlighted in the bonnet image G223 or the surrounding image. Therefore, the driver can intuitively grasp in the bonnet image G223 which direction the surrounding image corresponds to.

[0185] Note that the hood image G223 may also be a computer graphics image stored in advance in control unit 500, similar to the interior image G211.

[0186] [Embodiment 23] A twenty-third embodiment will be described. Fig. 44 is a schematic diagram showing a display system 10Y according to the twenty-third embodiment. As shown in Fig. 44, the display system 10Y includes a reception unit 4y electrically connected to a control unit 500. The reception unit 4y is an input device that receives a shape instruction from the driver to specify the shape of the frame image. For example, the reception unit 4y is a touch panel, a physical switch, or the like.

[0187] The control unit 500 controls the first display device 100 so that a frame image corresponding to the shape instruction received by the receiving unit 4y is generated. FIG. 45 is an explanatory diagram showing a frame image based on a shape instruction according to embodiment 23. (a) of FIG. 45 shows a frame image G40y1 when the shape instruction is a trapezoid. (b) of FIG. 45 shows a frame image G40y2 when the shape instruction is an oval. (c) of FIG. 45 shows a frame image G40y3 when the shape instruction is a pentagon. (d) of FIG. 45 shows a frame image G40y4 when the shape instruction is a hexagon. (e) of FIG. 45 shows a frame image G40y5 when the shape instruction is a parallelogram.

[0188] In this way, the frame images G40y1, G40y2, G40y3, G40y4, and G40y5 of the side mirrors corresponding to the shape instruction received by the receiving unit 4y are displayed, so that the frame images G40y1, G40y2, G40y3, G40y4, and G40y5 can be displayed according to the driver's preferences. Therefore, usability can be improved. Note that the display of the frame images G40y1, G40y2, G40y3, G40y4, and G40y5 according to the shape instruction is not limited to side mirror images, and pillar images and hood images may also be displayed according to the shape instruction.

[0189] (others) While the display system according to one or more aspects of the present disclosure has been described above based on the embodiments, the present disclosure is not limited to these embodiments. As long as they do not deviate from the spirit of the present disclosure, various modifications conceivable by those skilled in the art to the present embodiments and configurations constructed by combining components of different embodiments may also be included within the scope of one or more aspects of the present disclosure.

[0190] For example, in the above embodiment, the first display device 100 that projects the first virtual image 101 is exemplified, but the first display device may be a display device that displays an image, such as a liquid crystal or organic EL monitor. The same applies to the second display device.

[0191] As described in the above embodiments, highlighting includes highlighting the surrounding image by blurring at least a portion of the periphery of the surrounding image, and highlighting the surrounding image by, for example, flashing at least a portion of the periphery of the surrounding image. In either case, the surrounding image remains unchanged, and highlighting is achieved by weakening (blurring) or strengthening (flashing, etc.) the periphery of the surrounding image relative to the surrounding image. Therefore, either the surrounding image or at least a portion of the periphery of the surrounding image is highlighted relatively.

[0192] (Addendum) The above description of the embodiments and the like discloses the following techniques.

[0193] [Technology 1] a first display device that displays a display image in front of a user riding in a vehicle; a control unit that displays a surrounding image obtained by an imaging unit that images the surroundings of the vehicle on the first display device, the control unit controls the first display device so that either the surrounding image displayed on the first display device or at least a part of a periphery of the surrounding image is displayed in a relatively highlighted manner. Display system.

[0194] [Technology 2] the control unit controls the first display device so that either the surrounding image or at least a part of an edge image surrounding a periphery of the surrounding image is displayed in a relatively highlighted manner. The display system according to claim 1.

[0195] [Technology 3] When the control unit causes the first display device to display a frame image showing a side mirror frame of the vehicle as the edge image, the control unit causes a rear image showing a rear of the vehicle among the images captured by the imaging unit to be displayed as the surrounding image in an area corresponding to the mirror in the frame image. The display system according to Art 2.

[0196] [Technology 4] the control unit controls the first display device to blur the periphery of the surrounding image as the highlighted display. The display system according to technology 3.

[0197] [Technology 5] the control unit causes the first display device to display an arm image indicating an arm extending from the side mirror frame together with the frame image. 10. The display system according to claim 3 or 4.

[0198] [Technology 6] the control unit causes the first display device to display an interior image showing an interior of the vehicle together with the frame image, The display system according to any one of techniques 3 to 5.

[0199] [Technology 7] The control unit causes the first display device to display the frame image that realistically represents the side mirror frame. The display system according to any one of techniques 3 to 7.

[0200] [Technology 8] the control unit causes the first display device to display a vehicle body image showing a vehicle body provided in the vehicle together with the frame image. The display system according to any one of techniques 3 to 7.

[0201] [Technology 9] The control unit causes the first display device to display a lighting image indicating a lighting state of a turn signal provided in the vehicle together with the frame image. The display system according to any one of techniques 3 to 8.

[0202] [Technology 10] the control unit causes the first display device to display the frame image such that an aspect ratio of the frame image is different from an aspect ratio of the side mirror frame. The display system according to any one of techniques 3 to 9.

[0203] [Technology 11] the control unit causes the first display device to display, as a background of the frame image, a front image showing a front of the vehicle, among the images captured by the imaging unit. The display system according to any one of techniques 3 to 10.

[0204] [Technology 12] The control unit controls the first display device so that a background color of the frame image changes based on an environment of the vehicle. The display system according to any one of techniques 3 to 11.

[0205] [Technology 13] The control unit causes the first display device to display a front image, which is included in the surrounding image and indicates a location ahead of the vehicle, next to the frame image. The display system according to any one of techniques 3 to 12.

[0206] [Technology 14] the frame image includes a right frame image showing the side mirror frame arranged on the right side of the vehicle and a left frame image showing the side mirror frame arranged on the left side of the vehicle, the control unit controls the first display device so that the right frame image is displayed on the right side and the left frame image is displayed on the left side. The display system according to any one of techniques 3 to 13.

[0207] [Technology 15] the control unit controls the first display device so that the right frame image and the left frame image are asymmetrical. The display system according to Art. 14.

[0208] [Technology 16] the control unit controls the first display device so that the right frame image is displayed in an upper right corner of a display area of ​​the first display device, and the left frame image is displayed in an upper left corner of a display area of ​​the first display device. 16. A display system according to claim 14 or 15.

[0209] [Technology 17] When a warning target is displayed in the surrounding image, the control unit causes the first display device to highlight the warning target. The display system according to any one of the first to sixth aspects of the present invention.

[0210] [Technology 18] The control unit distorts the surrounding image and displays it on the first display device. The display system according to any one of the first to seventeenth aspects.

[0211] [Technology 19] The control unit causes the first display device to display an icon indicating a surrounding situation of the vehicle together with the surrounding image. The display system according to any one of the first to eighteenth aspects.

[0212] [Technology 20] the control unit causes the first display device to display the surrounding image in conjunction with navigation information in the vehicle. A display system according to any one of techniques 1 to 19.

[0213] [Technology 21] the control unit controls the first display device so that a reference image and an auxiliary image including the surrounding image can be switched by scrolling. The display system according to any one of the first to twenty techniques.

[0214] [Technology 22] the first display device displays the display image by projecting a first virtual image in front of the user; the first virtual image is disposed in front of the first display device as viewed from the user; The display system according to any one of the first to twenty-first techniques.

[0215] [Technology 23] a second display device that projects a second virtual image in front of the user and above the display image; The control unit controls the second display device so that a guidance image for guiding the user's line of sight toward the surrounding image is included in the second virtual image. The display system according to any one of the first to second aspects of the present invention.

[0216] [Technology 24] the control unit controls the first display device so that the edge image is visually different when a predetermined condition is satisfied and when a predetermined condition is not satisfied. The display system according to Art 2.

[0217] [Technology 25] the control unit controls the first display device so that a size of the border image differs between when a predetermined condition is satisfied and when a predetermined condition is not satisfied. The display system described in Technology 24.

[0218] [Technology 26] the control unit controls the first display device so that a thickness of a frame line of the border image differs between when a predetermined condition is satisfied and when a predetermined condition is not satisfied. The display system described in Technology 24.

[0219] [Technology 27] the control unit controls the first display device such that the presence or absence of the border image differs between when a predetermined condition is satisfied and when a predetermined condition is not satisfied. The display system described in Technology 24.

[0220] [Technology 28] the control unit controls the first display device so that a color of the border image differs between when a predetermined condition is satisfied and when a predetermined condition is not satisfied. The display system described in Technology 24.

[0221] [Technology 29] the control unit controls the first display device so that a background of the border image differs between when a predetermined condition is satisfied and when a predetermined condition is not satisfied. The display system described in Technology 24.

[0222] [Technology 30] When the control unit causes the first display device to display a pillar image showing a pillar provided in the vehicle as the edge image, the control unit causes a front image showing a front of the vehicle among the images captured by the imaging unit to be displayed as the surrounding image within the pillar image. The display system according to Art 2.

[0223] [Technology 31] When the control unit causes the first display device to display a bonnet image showing a bonnet provided on the vehicle as the edge image, the control unit causes a front image showing a front of the vehicle among the images captured by the imaging unit to be displayed as the surrounding image within the bonnet image. The display system according to Art 2.

[0224] [Technology 32] a receiving unit that receives a shape instruction from the user to specify a shape of the edge image; the control unit controls the first display device so that the edge image corresponds to the shape instruction received by the receiving unit. The display system according to any one of techniques 2 to 31. [Industrial Applicability]

[0225] The present disclosure can be used in a display system for displaying images. [Explanation of symbols]

[0226] 1 vehicle 2 Windshield 3. Imaging unit 4y Reception Department 10, 10S, 10Y display system 100 First display device 101 First virtual image (display image) 120 cabinet 121 Opening 130 Display element 140 Polarized Half Mirror 150 First reflector 160 Second reflector 200 Second display device 201 Second Virtual Image 210 cabinet 211 Opening 220 Cover 230 Display element 240 First Optical Element 250 Second Optical Element 500 control section D1 area G10 Reference Image G11, G12, G30, G30a, G30c1, G30e, G30f, G30g, G30h, G30kL, G30kR, G30nL, G30q, G30r, G30r1, G31i, G32i Surrounding Image G20, G20a, G20b, G20e, G20f, G20g, G20j, G20k, G20m, G20n, G20p, G20q, G20r, G20s, G20t, G20u, G20v, G20w, G20x, G20z, G21z, G210, G220 auxiliary images G40, G40a, G40c, G40e, G40f, G40g, G40j, G40t, G40u, G40w, G40x, G40y1, G40y2, G40y3, G40y4, G40y5, G41g, G41i, G42i, G49z Frame image (border image) G40cL, G40cL1, G40dL, G40kL, G40mL, G40nL Left frame image G40cR, G40dR, G40kR, G40mR Right frame image G41b, G41f arm images G41c auxiliary mirror frame image G41c1 Auxiliary mirror frame G42f interior image G43f pillar image G44f door interior image G46j front image G50g body image G51g lighting image G211 interior image G212 Outside image (surrounding image) G213 Pillar image (edge ​​image) G214, G225 Digital Speedometer G222 exterior image G223 bonnet image (edge ​​image) G224 Blind Spot Image (Surrounding Image) I1, I2, I3, I4, I5, I6, I7, I8 icons L1 dashed line L2 dashed line L3 dash-dot line L4 double-dashed line M1 Tachometer M2, M3, S11 Vehicle speedometer R display area r11, r12, r13, r14 display target R10 shooting range R11 First area R12, R12r second area R12B bottom edge R12L left side R12T top edge S10 Navigation Information S12 Visual guidance arrow W1 frame Y1 Arrow

Claims

1. a first display device that displays a display image in front of a user riding in a vehicle; a control unit that displays a surrounding image obtained by an imaging unit that images the surroundings of the vehicle on the first display device, the control unit controls the first display device so that either the surrounding image displayed on the first display device or at least a part of a periphery of the surrounding image is displayed in a relatively highlighted manner. Display system.

2. the control unit controls the first display device so that either the surrounding image or at least a part of an edge image surrounding a periphery of the surrounding image is displayed in a relatively highlighted manner. The display system of claim 1 .

3. When the control unit causes the first display device to display a frame image showing a side mirror frame of the vehicle as the edge image, the control unit causes a rear image showing a rear of the vehicle among the images captured by the imaging unit to be displayed as the surrounding image in an area corresponding to the mirror in the frame image. The display system of claim 2 .

4. the control unit controls the first display device to blur the periphery of the surrounding image as the highlighted display. The display system of claim 3 .

5. the control unit causes the first display device to display an arm image indicating an arm extending from the side mirror frame together with the frame image.

5. A display system according to claim 3 or 4.

6. the control unit causes the first display device to display an interior image showing an interior of the vehicle together with the frame image, 5. A display system according to claim 3 or 4.

7. The control unit causes the first display device to display the frame image that realistically represents the side mirror frame.

5. A display system according to claim 3 or 4.

8. the control unit causes the first display device to display a vehicle body image showing a vehicle body provided in the vehicle together with the frame image.

5. A display system according to claim 3 or 4.

9. The control unit causes the first display device to display a lighting image indicating a lighting state of a turn signal provided in the vehicle together with the frame image. The display system of claim 3 .

10. the control unit causes the first display device to display the frame image such that an aspect ratio of the frame image is different from an aspect ratio of the side mirror frame.

5. A display system according to claim 3 or 4.

11. the control unit causes the first display device to display, as a background of the frame image, a front image showing a front of the vehicle, among the images captured by the imaging unit.

5. A display system according to claim 3 or 4.

12. The control unit controls the first display device so that a background color of the frame image changes based on an environment of the vehicle. The display system of claim 3 .

13. The control unit causes the first display device to display a front image, which is included in the surrounding image and indicates a location ahead of the vehicle, next to the frame image.

5. A display system according to claim 3 or 4.

14. the frame image includes a right frame image showing the side mirror frame arranged on the right side of the vehicle and a left frame image showing the side mirror frame arranged on the left side of the vehicle, the control unit controls the first display device so that the right frame image is displayed on the right side and the left frame image is displayed on the left side.

5. A display system according to claim 3 or 4.

15. the control unit controls the first display device so that the right frame image and the left frame image are asymmetrical.

15. The display system of claim 14.

16. the control unit controls the first display device so that the right frame image is displayed in an upper right corner of a display area of ​​the first display device, and the left frame image is displayed in an upper left corner of a display area of ​​the first display device.

15. The display system of claim 14.

17. When a warning target is displayed in the surrounding image, the control unit causes the first display device to highlight the warning target.

3. A display system according to claim 1 or 2.

18. The control unit distorts the surrounding image and displays it on the first display device.

3. A display system according to claim 1 or 2.

19. The control unit causes the first display device to display an icon indicating a surrounding situation of the vehicle together with the surrounding image.

3. A display system according to claim 1 or 2.

20. the control unit causes the first display device to display the surrounding image in conjunction with navigation information in the vehicle.

3. A display system according to claim 1 or 2.

21. the control unit controls the first display device so that a reference image and an auxiliary image including the surrounding image can be switched by scrolling.

3. A display system according to claim 1 or 2.

22. the first display device displays the display image by projecting a first virtual image in front of the user; the first virtual image is disposed in front of the first display device as viewed from the user; 3. A display system according to claim 1 or 2.

23. a second display device that projects a second virtual image in front of the user and above the display image; the control unit controls the second display device so that a guidance image for guiding the user's line of sight toward the surrounding image is included in the second virtual image.

3. A display system according to claim 1 or 2.

24. the control unit controls the first display device so that the edge image is visually different when a predetermined condition is satisfied and when a predetermined condition is not satisfied. The display system of claim 2 .

25. the control unit controls the first display device so that a size of the border image differs between when a predetermined condition is satisfied and when a predetermined condition is not satisfied.

25. The display system of claim 24.

26. the control unit controls the first display device so that a thickness of a frame line of the border image differs between when a predetermined condition is satisfied and when a predetermined condition is not satisfied.

25. The display system of claim 24.

27. the control unit controls the first display device such that the presence or absence of the border image differs between when a predetermined condition is satisfied and when a predetermined condition is not satisfied.

25. The display system of claim 24.

28. the control unit controls the first display device so that a color of the border image differs between when a predetermined condition is satisfied and when a predetermined condition is not satisfied.

25. The display system of claim 24.

29. the control unit controls the first display device so that a background of the border image differs between when a predetermined condition is satisfied and when a predetermined condition is not satisfied.

25. The display system of claim 24.

30. When the control unit causes the first display device to display a pillar image showing a pillar provided in the vehicle as the edge image, the control unit causes a front image showing a front of the vehicle among the images captured by the imaging unit to be displayed as the surrounding image within the pillar image. The display system of claim 2 .

31. When the control unit causes the first display device to display a bonnet image showing a bonnet provided on the vehicle as the edge image, the control unit causes a front image showing a front of the vehicle among the images captured by the imaging unit to be displayed as the surrounding image within the bonnet image. The display system of claim 2 .

32. a receiving unit that receives a shape instruction from the user to specify a shape of the edge image; the control unit controls the first display device so that the edge image corresponds to the shape instruction received by the receiving unit. The display system of claim 2 .

Images