Head-up display device, display control device and display system for vehicles

Abstract

[Task] The goal is to enable a driver, as a visual perceiver, to correctly and intuitively recognize a course change point such as an intersection, etc. [Solution] A head-up display device (HUD device 100) has an image display unit 120, which displays a first virtual image showing a movement route of a vehicle, and a second virtual image whose display position changes along the first virtual image and which, when the vehicle approaches a point for carrying out a course change, shows a course direction of the vehicle, and a control unit 110, which, when the vehicle enters the point for carrying out the course change, performs a control that moves and displays the second virtual image in a direction opposite to the course direction shown by the second virtual image.

Description

[Technical field]

[0001] The present invention relates to a head-up display device or the like which is used in a moving body such as a vehicle or the like and which visually recognizes a display object (virtual image) superimposed on a front landscape of the moving body. [Technical background]

[0002] Conventionally, a head-up display device (hereinafter simply referred to as a HUD device) is known that enhances the expressiveness in the depth direction (the front and rear directions of a vehicle) by using a virtual display object (virtual image) (a visual observer can perceive depth through an oblique image plane (display area).) and provides intuitive information presentation to the visual observer. This HUD device forms an augmented reality (AR) in which the virtual images are arranged at predetermined positions in a space of a front landscape (the real landscape in the forward direction seen by the visual observer in the vehicle) in the depth direction or in the up-down and left-right directions, and the virtual images are added to the real landscape (front landscape) such as a road surface, etc., and displayed.

[0003] For example, in Patent Document 1, a navigation device is disclosed which displays on the HUD device a moving route of a vehicle with a travel destination guide image (guide line 20 in Fig. 2 of Patent Document 1), gradually enlarges and displays a map in a bird's-eye view overlooking a front of the vehicle as it approaches a destination, and stops enlarging the map as it approaches further, and displays a destination direction image (AR display 27 with an arrow sign in Fig. 2 of Patent Document 1), which can display a route at the guidance point at the display location of the guide line. The so-called "map display" is a display form that displays the vehicle's route guidance on the map by displaying the map, and the AR display is a display form that forms augmented reality, which displays navigation information against actual scenery, etc., and performs route guidance. [Prior art document][Patent document]

[0004] [Patent document 1] WO 2021 / 132553 A1 [Summary of the invention]

[0005] However, according to the technique disclosed in Patent Document 1 above, there is a problem that, when performing route guidance, it is difficult to accurately and intuitively understand a right-turn or left-turn point, etc., depending on the distance to a course change point such as an intersection, etc. As a result, a driver who visually recognizes the route may misrecognize it. In particular, when the vehicle has entered an intersection, etc., the image area is largely obscured by the unrecognizable enlarged destination direction image (AR display with arrow characters). When superimposed on a real landscape, it largely obstructs the front field of view, making it difficult to recognize the front field of view.

[0006] The present invention has been created to achieve this object, and its object is to provide a head-up display device, etc., which is configured to enable a driver as a visual recognizer to visually recognize a course change point such as an intersection, etc. correctly and intuitively.

[0007] Other objects of the present invention will become apparent to those skilled in the art upon consideration of the following exemplary embodiments and the best mode as well as the accompanying drawings. [Means of solving the problem]

[0008] In the following, embodiments according to the present invention are shown by way of example for a better understanding of the essence of the present invention.

[0009] A first embodiment provides a head-up display device that projects a virtual image superimposed on the front landscape for display onto a virtually configured display area in front of a vehicle as an image plane, comprising an image display part that displays a first virtual image showing a movement route of the vehicle and a second virtual image whose display position changes along the first virtual image and which, when the vehicle approaches a point for executing a course change, shows a course direction of the vehicle, a control part that, when the vehicle enters the point for executing the course change, carries out a control that moves and displays the second virtual image in a direction opposite to the course direction shown by the second virtual image.

[0010] The “first virtual image” is a route image Gu1, which, as in Fig. 4 (a) (b), has a turning point be near the course change point such as an intersection or the like, which the vehicle passes, consists of a portion of an arrow shaft (shaft s) extending to the turning point be and a portion of an arrowhead (arrowhead ah) showing the direction of travel of the vehicle, and is displayed superimposed on the road surface. The portion of the arrowhead (arrowhead ah) is dispensable. In addition, the "second virtual image" is an AR image Gu2, etc., whose display position, such as in Fig. 4 (a) (b), which changes according to the movement of the vehicle along the first virtual image (route image Gu1), and which is displayed stationary when the vehicle approaches the course change point such as an intersection, etc., near the turning point be of the first virtual image (route image). The AR image Gu2 consists, for example, of Fig. 4 (b), consists of one or more arrowhead components (sharp part of the triangle of the arrowhead ah) which are visually recognized as floating above the road surface near the turning point be (course change point such as intersection, etc.) of the route image Gu1.

[0011] In addition, the "course change point" indicates a right or left turn point such as an intersection, T-junction, curve, or the like, which the vehicle traveling to the destination passes while traveling to the destination. The "vehicle approaching a course change point" indicates the case where a distance to the course change point has reached a predetermined threshold, and the action "moving and displaying the second virtual image in a direction opposite to a course direction shown by the second virtual image" indicates, for example, the performance of a video display (sequence display) in which, as in Fig. 6A and Fig. 6B, when the vehicle enters the intersection, etc., the second virtual image is evacuated (moved) in the direction (X direction) opposite to the advancing direction shown by the second virtual image (arrowhead ah) according to a turn of the vehicle in the left-right direction (angle of view in the transverse direction), for example, at a preconfigured speed (position change according to time), without moving the positional relationship in the forward and backward direction (angle of view in the longitudinal direction).

[0012] According to the first embodiment, when the vehicle enters the turn-making point, the control part performs control to move the second virtual image in the direction opposite to the direction shown by the second virtual image and displays it on the image display part. For example, when the vehicle enters an intersection, etc., video display is performed in which the second virtual image is evacuated (moved) in the direction opposite to the vehicle's direction of travel, for example, at a pre-configured speed (position change over time), corresponding to the vehicle's left-right turn (image angle in the transverse direction). This enables a driver, as a visual observer, to correctly and intuitively visually recognize the turn-making point, such as an intersection, etc.

[0013] In a second aspect dependent on the first aspect, the control part may perform control that displays the first virtual image on a road surface as superimposed on the front landscape and displays the second virtual image so as to be visually recognized as floating vertically along the road surface.

[0014] According to the second aspect, the control part displays the first virtual image superimposed on the front landscape, whereby the display can be realized that makes the turning direction of the vehicle and the real landscape feel unified and increases the elective affinity, further the control part displays the second virtual image as floating vertically along the road surface, whereby the turning direction and point of the vehicle can be effectively communicated, and the first virtual image superimposed on the road surface and the second virtual image displayed as floating vertically along the road surface have a synergistic effect, thus enabling the driver as a visual recognizer to visually recognize the course change point such as intersection, etc. more correctly and intuitively.

[0015] In a third embodiment, which depends on the first or second embodiment, the control part can carry out a control which, if a distance to a point for making a course change of the vehicle is within a predetermined distance range, displays the second virtual image stationary near a turning point of the first virtual image at which a maximum curvature is reached at an arbitrary point for making the course change, and moves and displays the second virtual image in a direction opposite to the course direction shown by the second virtual image when the vehicle enters the arbitrary point for making the course change.

[0016] According to the third aspect, the control part displays the second virtual image in a stationary manner near the turning point of the first virtual image when the distance to the point for executing the course change of the vehicle is within the predetermined distance range, and moves the second virtual image in the direction opposite to the course direction shown by the second virtual image and displays it when entering the arbitrary point for executing the course change.As described above, the display is carried out in different display configurations depending on the distance to the point for executing the course change of the vehicle, in particular, when the vehicle enters the arbitrary point for executing the short change, the control is carried out which moves and displays the second virtual image in the direction opposite to the course direction shown by the second virtual image, so that the driver as a visual recognizer can intuitively understand the direction of movement and can intuitively and clearly recognize the distance to the turning point (course change point such as intersection, etc.) of the first virtual image.

[0017] In a fourth aspect dependent on the first to third aspects, the control part may perform control that changes a size of the second virtual image with respect to both a longitudinal viewing angle and a transverse viewing angle of the display area smaller than a size of the first virtual image and depending on a distance to an arbitrary point for performing the course change, and displays it.

[0018] According to the fourth aspect, the control part performs control to make the size of the second virtual image smaller than the first virtual image in terms of both the longitudinal and transverse viewing angles of the display area, and to change the size of the second virtual image according to the distance to the arbitrary point for executing the course change. As described above, the control part displays the second virtual image in a smaller size than the first virtual image, thereby synergistically showing the heading direction of the vehicle to the driver as a visual observer. As a result, the driver as a visual observer can relatively perceive the distance to the course change point based on the display positions of the first virtual image and the second virtual image showing the same course change point, and can more accurately and intuitively recognize the distance from the vehicle to the course change point.

[0019] A fifth embodiment provides a display control device comprising a processing device that controls a head-up display device that projects a virtual image superimposed on a front landscape onto a display area virtually configured in front of a vehicle as an image plane for display, wherein the processing device carries out a control that displays a first virtual image showing a movement route of the vehicle and a second virtual image, the display position of which changes along the first virtual image and which, when the vehicle approaches a point for implementing a course change, shows a course direction of the vehicle, on the head-up display device, and carries out a control when the vehicle enters the point for implementing the course change,which moves the second virtual image in a direction opposite to the heading direction shown by the second virtual image and displays it on the head-up display device.

[0020] According to the fifth aspect, when the vehicle enters the turn-making point, the processing device performs control to move the second virtual image in the direction opposite to the direction shown by the second virtual image and displays it on the head-up display device. Therefore, the display control device can be provided that performs video display, for example, when the vehicle enters an intersection, etc., in which the second virtual image is evacuated (moved) in the direction opposite to the vehicle's direction of travel, for example, at a preconfigured speed (position change over time), according to the vehicle's left-right turn (angle of view in the transverse direction), thereby enabling the driver, as a visual observer, to correctly and intuitively visually recognize the turn-making point such as an intersection, etc.

[0021] A sixth embodiment provides a display system for vehicles comprising the head-up display device, which projects a virtual image superimposed on the front landscape for display onto a virtually configured display area in front of a vehicle as an image plane, and a display control device for controlling the head-up display device, wherein the display control device performs control, which displays a first virtual image showing a movement route of the vehicle and a second virtual image, the display position of which changes along the first virtual image and which shows a heading direction of the vehicle when the vehicle approaches a point for making a course change, on the head-up display device, and performs control when the vehicle enters a point for making a course change,which moves the second virtual image in a direction opposite to the heading direction shown by the second virtual image and displays it on the head-up display device.

[0022] According to the sixth aspect, when the vehicle enters the turn-making point, the display control device performs control to move the second virtual image in the direction opposite to the direction shown by the second virtual image and display it on the head-up display device. Thus, a vehicle display system can be provided that performs video display when the vehicle enters an intersection, etc., in which the second virtual image is evacuated (moved) in the direction opposite to the direction of travel of the vehicle, for example, at a pre-configured speed (position change over time), in accordance with the vehicle's left-right turn (angle of view in the transverse direction), thereby enabling the driver, as a visual observer, to correctly and intuitively visually recognize the turn-making point such as an intersection, etc.

[0023] Those skilled in the art will readily understand that the embodiments according to the present invention, which have been shown by way of example, can be further modified without departing from the spirit of the present invention. [Brief description of the drawings] [ Fig. 1] is a view provided to show an application example of a head-up display device of the embodiment of the present invention to a vehicle and to explain a relationship between the eye position of a driver and an image plane (display area) virtually configured in front of the vehicle. [ Fig. 2] is a block diagram showing a structure of a display system for vehicles including the head-up display device of the embodiment of the present invention. [ Fig. 3] is a flowchart showing an operation of the head-up display device of the embodiment of the present invention. [ Fig. 4] are views showing an example of a screen structure of the head-up display device of the embodiment of the present invention, wherein Fig. 4 (a) shows a route image (first virtual image) and an AR image (second virtual image) displayed stationary near the turning point of the route image, and Fig. 4 (b) shows a view where the route image (first virtual image) and the AR image (second virtual image) are seen, in this case, from a bird's eye view. [ Fig. 5] is a view showing an example of a screen configuration of the head-up display device of the embodiment of the present invention, in which the AR image (second virtual image) moved and displayed in the opposite direction to the heading direction when the vehicle enters the intersection is viewed from a bird's eye view. [ Fig. 6A] is a view showing an example of a screen configuration of the head-up display device of the embodiment of the present invention, and showing a display form of the route image (first virtual image) and the AR image (second virtual image) in a case where the distance to a point for performing the course change of the vehicle is within a predetermined distance range. [ Fig. 6B] is a view showing another example of the screen configuration of the head-up display device of the embodiment of the present invention, and showing a display form of the route image (first virtual image) and the AR image (second virtual image) when the vehicle enters the course change point. [Embodiment of the invention]

[0024] A best mode explained below is used to facilitate understanding of the present invention. Therefore, those skilled in the art should be careful not to unduly limit the present invention by the embodiments explained below (hereinafter referred to as the present embodiment).

[0025] Hereinafter, a display system 1000 for vehicles including a head-up display device (hereinafter referred to as HUD device 100 unless otherwise specified) of the present embodiment will be shown by way of example and explained with reference to the drawings. (Structure of the embodiment)

[0026] Fig. 1 is a view provided to show an application example of a HUD device 100 of the present embodiment to a vehicle 1 and to explain a relationship between the eye position of a driver and a display area virtually configured in front of the vehicle as an image plane.

[0027] In the following explanation, in a case where a driver 4 sitting in a driver's seat of the vehicle 1 as a visual recognizer of the HUD device 100 faces the front of the vehicle 1, a left-right direction, an up-down direction, and a front-and-back direction are X-axis (left direction is positive X-axis direction), a Y-axis (up direction is positive Y-axis direction), and a Z-axis (forward direction is positive Z-axis direction).

[0028] It will be Fig. 1. The HUD device 100 of the present embodiment is provided in an instrument panel 5 of the vehicle 1 and includes a control part 110 and an image display part 120 (in a dashed line outline). The HUD device 100 emits a display light L onto a front windshield 2 (an example of a component for projecting) and visually displays the image in a display area VA as an image plane, which is virtually configured on the more forward side (positive Z-axis direction) than the front windshield 2. Thus, the driver 4 as a visual recognizer can visually recognize the image (virtual image) superimposed on a front landscape FV as a real space visually recognized via the front windshield 2.

[0029] The display area VA is a plane, a curved surface, or a portion of a partially curved surface on which an image generated within the HUD device 100 is projected as a virtual image, and is also referred to as an image plane. The visual recognizability of the display area VA itself is low, to the extent that it is actually visually unrecognizable or difficult to recognize by the driver 4.In the display area VA, an angle (tilt angle θt) formed with the horizontal direction (XZ plane) around the left-right direction (X-axis direction) of the vehicle 1 as an axis, an angle (longitudinal arrangement angle θv) formed on the assumption that an angle formed by a line connecting the eyebox center (eye position of the driver 4) to an upper end of the display area VA and a line connecting the eyebox center (eye position of the driver 4) to a lower end of the display area VA is a longitudinal image angle, a bisector of this longitudinal image angle, and the horizontal direction (XZ plane) are configured.

[0030] The eyebox is either an area that is equal to an area (also called an eye ellipse) where the eye position (center of the eyebox) of the driver 4 is assumed to be located in the passenger compartment, or an area that is configured to encompass a large part of it (e.g., 80% or more). The eyebox is therefore (1) an area in which all virtual images are visually recognizable and outside of which a part is not visually recognized, (2) an area in which at least a part of the virtual image is visually recognizable and outside of which no part is visually recognized, (3) an area in which at least a part of the virtual image is illuminated with a predetermined luminance (e.g.,(4) a region in which, if the stereoscopically visible virtual image can be displayed, at least a portion of the virtual image can be stereoscopically viewed and outside of which no portion of the virtual image is stereoscopically viewed. That is, if both eyes of the driver 4 are positioned outside the eyebox, the driver 4 may not visually view the entire virtual image, may have difficulty viewing it due to the extremely low visual visibility of the virtual image, or may not stereoscopically view the virtual image.

[0031] The image display part 120 includes, for example, a liquid crystal display device 121 having a display surface for displaying the image, and an optical relay system 122. The liquid crystal display device 121 may be a transmission display that transmits light from a backlight (not shown in the figure), or it may be a projection display that projects an image (virtual image) onto a screen. In these cases, the display surface is a display surface in the transmission display and a screen in the projection display. An actuator (not shown) such as an electric motor or the like, controlled by the control part 110, may be mounted on the liquid crystal display device 121 so that it can be rotated.

[0032] The relay optical system 122 is arranged on a light path of the light (display light L) of the image (virtual image) from the liquid crystal display device 121 between the liquid crystal display device 121 and the front windshield 2, and consists of one or more optical components that project the display light L of the image (virtual image) from the liquid crystal display device 121 onto the front windshield 2 outside the image display part 120. The relay optical system 122 includes at least one concave mirror and may additionally include, for example, one or more refractive optical components such as a lens or the like, diffractive optical components such as a hologram or the like, reflective optical components, or a combination of these.

[0033] An actuator (not shown) such as an electric motor or the like is mounted on the optical relay system 122 and controlled by the control part 110 so that it can rotate. Specifically, when the vehicle display system 1000 is at a standstill, the actuator can change the position and angle of the optical relay system 122 so that the sunlight from the outside is not directed onto the liquid crystal display device 121 via the optical relay system 122. During the activation of the vehicle display system 1000, the actuator can change the position and angle of the optical relay system 122 so that the display light of the image from the liquid crystal display device 121 is projected onto a predetermined position of the front windshield 2.

[0034] The image display part 120 can change the angle (tilt angle θt) formed by the display area VA and a driving lane of the vehicle 1 by driving the actuator described above.

[0035] The tilt angle θt is configured to an angle at which, along the horizontal plane (e.g., the road surface of the lane traveled by vehicle 1), an upper part (part of the positive Y-axis direction) of the display area VA seen by the driver 4 is located at a position farther from the driver 4 than the lower part (part of the negative Y-axis direction). The tilt angle θt does not need to be 0 [degrees] (the display area VA and the road surface are parallel to each other), and it is desirable to be configured to less than 20 [degrees], setting it to a pre-configured angle (or setting it to be within a pre-configured angle range). However, the configuration value of the tilt angle θt can also be arbitrarily changed by the driver 4.

[0036] In addition, a longitudinal arrangement angle θv is configured to an angle such that all or most of the display area VA is positioned below the horizontal direction. The longitudinal arrangement angle θv is typically configured below the horizontal direction to less than 5 [degrees] and set to a pre-configured angle (or set to be within a pre-configured angle range). However, the configuration value of the longitudinal arrangement angle θv can also be arbitrarily changed by the driver 4.

[0037] The control part 110 includes table data in which the longitudinal arrangement angle θv of the display area VA is associated with the drive size of the actuator, and table data in which the tilt angle θt of the display area VA is associated with the drive size of the actuator. Based on this table data, each actuator can be driven to achieve the configured tilt angle θt and longitudinal arrangement angle θv.

[0038] Fig. 2 is a block diagram showing a structure of the display system 1000 for vehicles including the HUD device 100. As shown in Fig. As shown in Figure 2, the vehicle display system 1000 includes a display controller 300 and a navigation device 400, which are interconnected to be interactively communicable via an I / O interface 500. A behavior sensor 401, a camera 402, a LiDAR (Light Detection and Ranging) 403, an eye position sensor 404, etc., are further connected to the I / O interface 500.

[0039] The display control device 300 comprises a processing device (hereinafter referred to as processor 200) and a HUD device 100. In addition to managing the navigation device 400 connected to the I / O interface 500 or the interfaces for various types of sensors 401-404, the processor 200 can perform a control which sends to the HUD device 100 a first virtual image superimposed on the road surface (cf. Gu1 of the following Fig. 4 (a) (b)) and a second virtual image (cf. Gu2 of the subsequently explained Fig. 4 (a) (b)), whose display position changes along the first virtual image Gu1 and moves and displays when the vehicle 1 enters a point such as an intersection, etc., to execute the course change in a direction opposite to the course direction shown by the second virtual image Gu2, such as an intersection, etc. This will be explained in detail later.

[0040] The “first virtual image” shows, for example, Fig. 4 (a) (b), a route image Gu1 having a turning point be near the course change point such as an intersection or the like, which the vehicle 1 passes, is composed of a portion of an arrow shaft (shaft s) extending to the turning point be and a portion of an arrowhead (arrowhead ah) showing the direction of travel of the vehicle 1, and is displayed superimposed on the road surface. In the route image Gu1 (first virtual image), the arrowhead portion is dispensable. In addition, the "second virtual image", such as in Fig. 4 (a) (b) shows an AR image Gu2 whose display position changes along the route image Gu1 (first virtual image) and which is displayed stationary as the vehicle 1 approaches the course change point such as an intersection, etc., near the turning point be of the route image Gu1 (first virtual image). The AR image Gu2 consists of one or more arrowhead components (arrowhead ah) that are visually recognized as floating above the road surface near the turning point be (course change point such as an intersection, etc.) of the route image Gu1.

[0041] In addition, the "course change point" indicates a right or left turn point such as an intersection, T-junction, curve, or the like, which the vehicle 1 traveling to the destination passes when traveling to the destination. The "vehicle approaching the course change point" indicates the case where a distance to the course change point has reached a predetermined threshold, and the action "moving and displaying the second virtual image in a direction opposite to a course direction shown by the second virtual image" indicates, for example, the performance of a video display (sequence display) in which, as in Fig. 6A and Fig. 6B, when the vehicle 1 enters the intersection, etc., the second virtual image is evacuated (moved) in the direction opposite to the advancing direction of the vehicle 1 shown by the arrowhead ah portion of the AR image (second virtual image) in accordance with a turning of the vehicle in the left-right direction (angle of view in the lateral direction), for example, at a pre-configured speed (position change according to time), without moving the positional relationship in the forward and backward directions (angle of view in the longitudinal direction).

[0042] The HUD device 100 comprises, as shown in the Fig. 1, the control part 110 and the image display part 120, which includes the liquid crystal display device 121 and the optical relay system 122.

[0043] The control part 110 can perform control, when the vehicle 1 enters a point such as an intersection, etc., to execute the course change, to move and display the route image Gu1 (second virtual image) in the direction opposite to the course direction shown by the AR image (second virtual image). For example, when the vehicle 1 enters an intersection, etc., a video display is performed in which the AR image is evacuated (moved) in the direction opposite to the direction of travel of the vehicle 1, for example, at a preconfigured speed (position change over time), corresponding to the vehicle 1's left-right turn (image angle in the transverse direction), thereby enabling the driver, as a visual observer, to correctly and intuitively visually recognize the course change point such as an intersection, etc.

[0044] Furthermore, the control part 110 can perform control that displays the route image Gu1 (first virtual image) superimposed on the road surface as a frontal landscape and displays the AR image (second virtual image) so that it is visually recognized as floating vertically along the road surface. Thus, the display can be realized that allows the vehicle 1 to perceive the unified sense of the turning direction and the real landscape, and the elective affinity is increased. Furthermore, the route image Gu1 (first virtual image) superimposed on the road surface and the AR image Gu2 (second virtual image) displayed as floating vertically along the road surface have a synergistic effect, thus enabling the driver 4, as a visual recognizer, to visually recognize the course change point such as intersections, etc., more correctly and intuitively.

[0045] In addition, the control part 110 can perform control that, if a distance to a point for executing the course change of the vehicle 1 is within a predetermined distance range, displays the AR image Gu2 (second virtual image) in a stationary manner near the turning point be of the route image Gu1 (first virtual image) in which a maximum curvature is reached at an arbitrary point for executing the course change, and moves and displays the AR image Gu2 (second virtual image) in the direction opposite to the course direction shown by the AR image Gu2 (second virtual image) when the vehicle 1 enters the arbitrary point for executing the course change.As described above, the display is carried out in different display configurations depending on the distance to the point for executing the course change of the vehicle 1, in particular, when the vehicle 1 enters the arbitrary point for executing the short change, the control is carried out which moves and displays the AR image Gu2 (second virtual image) in the direction opposite to the course direction shown by the AR image Gu2 (second virtual image), so that the driver 4 as a visual recognizer can intuitively understand the direction of movement and can intuitively and clearly recognize the distance to the turning point be (course change point such as intersection, etc.) of the route image Gu1 (first virtual image).

[0046] Furthermore, the control part 110 can perform control to make the AR image (second virtual image) smaller than the route image Gu1 (first virtual image) in both the longitudinal and transverse directions of the display area VA, and to resize and display the AR image Gu2 (second virtual image) according to the distance to the desired point for making the turn. As described above, the AR image Gu2 (second virtual image) is displayed in a smaller size than the route image Gu1 (first virtual image), thereby synergistically showing the heading direction of the vehicle 1 to the driver 4 as the visual discerner, so that the driver 4 as the visual discerner can relatively perceive the distance to the turn point based on the display positions of the route image Gu1 (first virtual image) and the AR image Gu2 (second virtual image) showing the same turn point.

[0047] To perform the above-described control, the control part 110 includes, for example, a processor with an internal or external memory (ROM / RAM) and a graphics controller that draws the route image Gu1 (first virtual image) and the AR image Gu2 (second virtual image) generated by the processor 200 on a VRAM (Video RAM) allocated to a predetermined area of ​​the RAM, and displays them on the image display part 120 according to a display timing, and performs each of the above-described functions by executing the programs stored in the ROM. Furthermore, it is also possible to implement at least part of the above-described functions not by the processor but by hardware such as an FPGA (Field Programmable Gate Array), a logic circuit, etc.

[0048] The image display part 120 is controlled by the control part 110 described above, wherein the image display part 120, such as in Fig. 4 (a) (b), the route image Gu1 having the turning point be near the course change point such as intersection, etc., which the vehicle 1 passes, is composed of the portion of the arrow shaft (shaft s) extending to the turning point be and the portion of the arrowhead (arrowhead ah) showing the traveling direction of the vehicle 1, and is displayed superimposed on the road surface, the AR image Gu2 (second virtual image), the display position of which, as shown in Fig. 4 (a) (b), which changes according to the movement of the vehicle 1 along the route image Gu1 (first virtual image) and which stands still when the vehicle 1 approaches the course change point such as intersection, etc., near the turning point be of the route image Gu1 (first virtual image).

[0049] Hereinafter, an additional explanation will be given of the AR image Gu2. The AR image Gu2 (second virtual image) displayed on the HUD device 100 of the present embodiment is a character displayed in a field of view FV (see FIG. Fig. 1) of the HUD device 100 of the present embodiment, the arrowhead is displayed accompanying the route image Gu1 and shows the traveling direction of the vehicle 1. This sign consists of only a portion of one or more arrowheads (arrowhead ah) displayed at the course change point such as an intersection, positioned perpendicular to the road surface. It shows the traveling direction of the vehicle 1, and is displayed relatively small when the vehicle 1 is located at a location far from the course change point, and relatively large as the vehicle 1 approaches the course change point. It does not require a portion of the arrow shaft (shaft s) compared to the AR image expressed as a normal arrow image, so its display area in the viewing angle of the HUD device 100 is reduced, and thus visual recognition can be increased without obstructing the front field of vision.

[0050] We return to the explanation of the Fig. 2. The navigation device 400 uses a behavior sensor 401 described later, a global navigation satellite system (GNSS) such as internal GPS (Global Positioning System), etc., or a gyro sensor, and performs information processing such as guidance of surrounding facilities, route guidance, etc. of the vehicle 1 according to the internal map data or after obtaining the map data through radio communication with the outside of the vehicle. If it is detected based on the result of the information processing that, for example, an intersection at which the vehicle 1 is to turn is approaching, it transmits a signal for promoting display output based on the result of this information processing at the appropriate time to the display control device 300 (HUD device 100) via the I / O interface 500.

[0051] The navigation device 400 includes the map data as described above. Regarding the map data, it can obtain and store up-to-date map information, for example, through communication, etc., with an external center (not shown) via a V2X (Vehicle to X) communication system (not shown). The map data is mapping data digitized to represent the traveling environment of the vehicle 1. Specifically, it is desirable that, as the mapping data, it be digital data of the high-precision dynamic map. The dynamic map is a digital map in which vast dynamic information that changes hour by hour, such as traffic regulations, construction work information, accidents, congestion, pedestrians, traffic light information, etc., is combined with static information such as high-precision three-dimensional position information (road surface information, lane information, three-dimensional construction), etc.

[0052] The behavior sensor 401 includes an IMU (Inertial Measurement Unit) that detects the behavior of the vehicle 1, a vehicle speed sensor, a steering angle sensor that detects the steering wheel angle of a steering wheel, etc. The IMU can measure driving conditions and attitude of the vehicle using a three-axis acceleration sensor and a three-axis angular velocity sensor (gyro sensor) (translational movement in three axis directions from the acceleration [m / s 2 ] and rotational movement from the angular velocity [deg / s]. Information detected or acquired by the behavior sensor 401 is transmitted to the navigation device 400 and the display control device 300 (HUD device 100) via the I / O interface 500.

[0053] The vehicle display system 1000 includes, in addition to the above-described behavior sensor 401, the camera 402 that detects the driving environment including the front of the vehicle 1, the LiDAR 403, and the eye position sensor 404. The camera 402 captures at least a front view (real landscape) of the vehicle 1, and the LiDAR 403 irradiates, for example, an obstacle or the like captured by the camera 402 and present in front of the vehicle 1 with light using near-infrared light, visible light, or ultraviolet light, detects its reflected light with a light sensor, and determines a distance to the obstacle based on a respective time difference.

[0054] The eye position sensor 404 is composed of an infrared camera, etc., that detects the eye position of the driver 4. The display control device 300 (processing device 200) receives an image captured by the infrared camera (example of the eye position presumption information) and can determine the eye position of the driver 4 by analyzing this captured image. The processing device 200 may be one that receives the eye position information of the driver 4 determined based on the infrared camera captured image from the I / O interface 500. The method for obtaining the eye position information of the driver 4 of the vehicle 1 or the eye position presumption information is not limited to this, and can be obtained using the known eye position detection (presumption) technique.

[0055] The I / O interface 500 performs communication (it may also be referred to as CAN communication) with other components (reference numerals 400 - 404), for example, according to the CAN (Controller Area Network) standard other than the display control device 300, via an ECU (not shown) provided in the vehicle 1. The telecommunications standard selected by the I / O interface 500 is not limited to CAN, and includes a cable communication interface such as CANFD (CAN with Flexible Data Rate), LIN (Local Interconnect Network), Ethernet (registered trademark), MOST (Media Oriented Systems Transport: MOST is a registered trademark), UART (Universal Asynchronous Receiver Transmitter), USB (Universal Serial Bus), etc., or an in-vehicle communication interface (internal communication) as a short-range radio communication interface within a range of several tens of meters, such asPersonal Area Network (PAN) such as Bluetooth (registered trademark) network, etc., Local Area Network (LAN), etc. such as 802.11 x Wi-Fi (registered trademark) network, etc.

[0056] In addition, the I / O interface 500 may include an interface of off-vehicle communication (external communication) such as wide area network (e.g., Internet communication network), etc., due to the standards for cellular communication such as wireless wide area network (WWAN0, IEEE802.16 - 2004 (WiMAX: Worldwide Interoperability for Microwave Access)), IEEE802.16e-Base (Mobile WiMAX), 4G, 4G-LTE, LTE Advanced, 5G, etc. (Operation of the embodiment)

[0057] Fig. 3 is a flowchart showing the operation of the HUD device 100 of the present embodiment. Fig. 4 are views showing an example of a screen structure of the HUD device 100 of the present embodiment, wherein Fig. 4 (a) shows the route image (first virtual image) and the AR image (second virtual image) displayed stationary near the turning point of the route image, and Fig. 4 (b) shows a view where the route image (first virtual image) and the AR image (second virtual image) are seen, in this case, from a bird's eye view. Fig. 5 is a view showing an example of a screen configuration of the HUD device 100 of the present embodiment, in which the AR image (second virtual image) moved and displayed in a direction opposite to the heading direction when the vehicle 1 enters the intersection is viewed from a bird's eye view.

[0058] The following describes the operation of the vehicle display system 1000 according to Fig. 2, mainly the operation of the HUD device 100 of the present embodiment based on the Fig. 3 to 5 explained.

[0059] The navigation device 400 first displays the map including the current position of the vehicle 1 on the image display part 120 (liquid crystal display 121) of the HUD device 100 via the display control device 300. Furthermore, a guide route to the configured destination is displayed on the map, an image showing the course change direction before the course change point based on the guide route is displayed, and an enlarged map is displayed near the intersection, so that route guidance can be performed on the screen.

[0060] The HUD device 100 (control part 110) monitors whether the guided route search is performed by the navigation device 400 (step ST101) and, if the guided route search is performed (step ST101 "YES"), displays the map at a predetermined reduced scale (preconfigured scale) in a bird's-eye view form on the image display part 120 (step ST102). The vehicle 1 then moves according to the guided route determined by the navigation device 400. When approaching a course change point such as an intersection, the control part 110 compares the remaining distance to the intersection with a display change threshold A (step ST103). The "display change threshold A" indicates the remaining distance when switching from the map display at the predetermined reduced scale, for example, as shown in Fig. 4 (a) (b) into the image area displaying the enlarged route image Gu1 (first virtual image) near the course change point, and represents, for example, a point of 500 m before the previously configured course change point such as intersection, etc.

[0061] When the remaining distance to the course change point such as an intersection, etc., according to the movement of the vehicle 1 reaches the display change threshold A (step ST103 "YES"), the control part 110 enlarges the reduced scale of the map displayed on the image display part 120 and displays the course change point such as an intersection, etc., together with the surrounding map on the image display part 120. At the same time, it performs control to display the route image Gu1 (first virtual image) superimposed on the road surface (step ST104). The route image Gu1 (first virtual image) displayed at this time has, as shown in Fig. 4 (a) (b), the turning point be in the vicinity of the heading change point of the vehicle 1 is composed of the portion of the arrow shaft (shaft s) extending to the turning point be and the portion of the arrowhead (arrowhead ah) connected via the turning point be in question to one end (upper side of the screen) of the portion of the arrow shaft (shaft s) and showing the traveling direction of the vehicle 1, and is displayed superimposed on the road surface.

[0062] If in step ST103 the remaining distance to the course change point such as intersection etc. is equal to or greater than the display change threshold A (step ST103 "NO"), the control part 110 repeats the process in step ST102 until the remaining distance to the course change point such as intersection etc. reaches the display change threshold A.

[0063] Next, the control part 110 compares the remaining distance to the course change point such as an intersection with the display switching threshold B (step ST105). The display switching threshold B is a threshold value when the vehicle 1 further approaches the course change point such as an intersection, for example, within the predetermined distance range such as 300 m or the like. When the remaining distance to the course change point such as an intersection becomes equal to or less than the display switching threshold B according to the further movement of the vehicle 1 (step ST105 "YES"), the control part 110 performs control (step ST106) to statically display the AR image Gu2 (second virtual image) near the route image Gu1 (first virtual image) and display it.In step ST106, when the display position of the AR image Gu2 (second virtual image) changes along the outer edge of the route image Gu1 (first virtual image) and the vehicle 1 approaches the course change point such as intersection, etc. (approaches the inside of the predetermined distance range), the AR image Gu2 is displayed as shown in FIG. Fig. 4 (a) (b), the vehicle is displayed stationary near the turning point be of the route image Gu1. The proximity of the turning point be of the route image Gu1 is determined depending on the viewing angle of the HUD device 100, so it is not uniquely definable, but it shows, for example, a distance from the current position of the vehicle 1 of 30 m before the turning point.

[0064] On the other hand, if the remaining distance to the intersection reaches the display change threshold B (step ST105 “NO”) and the vehicle 1 enters the course change point such as intersection, etc. (step ST107 “YES”), the control part 110 evacuates, as in Fig. 5, the AR image Gu2 (second virtual image), in other words, moves the AR image Gu2 (second virtual image) in the direction opposite to the heading direction indicated by the arrowhead portion (arrowhead ah) of the relevant AR image Gu2 (second virtual image) and displays it (step ST108). Specifically, this means: When vehicle 1 enters, such as in Fig. 6B, at the course change point such as an intersection, etc., the control part 110 performs the video display (sequence display) in which the AR image Gu2 is evacuated (moved) in the direction opposite to the advancing direction of the vehicle 1 shown by the AR image Gu2 (second virtual image) in accordance with the turning of the vehicle 1 in the left-right direction (angle of view in the lateral direction) at a pre-configured speed (position change according to time) without moving the positional relationship in the forward and backward directions (angle of view in the longitudinal direction).

[0065] Whether the vehicle 1 has entered the course change point such as an intersection, etc., can be judged based on the position information of the vehicle 1 measured by a GPS installed in the navigation device 400 and the map information. If it is judged in step ST107 that the vehicle has not entered the intersection (step ST107 "NO"), the control part 110 returns to the process in step ST105 and the following steps.

[0066] In the process at step ST108, the control part 110 may change the speed of movement of the AR image Gu2 (second virtual image) according to the traveling speed of the vehicle 1. When, according to the traveling condition (entering the intersection, turning operation for course change, deceleration for turning, acceleration due to the completion of the turning operation, etc.) of the vehicle 1 at the intersection, the route image Gu1 (first virtual image) displayed superimposed on the road surface is moved so that the driver 4, as a visual recognizer, can perceive that the movement cooperates with the traveling condition (controlling the display speed and acceleration or deceleration of the movement of the route image Gu1 (first virtual image)), the movement can be performed while maintaining the positional relationship between the AR image Gu2 (second virtual image) and the route image Gu1 (first virtual image).Regarding the display of the AR image Gu2 (second virtual image), the movement following the traveling circumstance of the vehicle 1 at the course change point such as intersection, etc., can be realized by these controls, so that this enables the driver 4 as a visual recognizer to visually recognize the course change point such as intersection, etc. more correctly and further intuitively.

[0067] In addition, a display configuration may also be selected in which the control part 110 expresses the AR image Gu2 with a figure simulating an arrow pointing in the left-right direction (angle of view in the lateral direction), or expresses it with parts of multiple figures, and displays at least a part of it flashing or the like on the image display part 120. It may further perform control that increases or decreases the number of sharp parts of the triangle of the arrowhead section (arrowhead ah) of the AR image Gu2 (second virtual image) depending on the distance between the vehicle 1 and the course change point such as an intersection, control that gradually increases the size, or control that weakens at least one of the luminance, contrast, and transparency.

[0068] Fig. 6A and Fig. 6B shows an example of a screen configuration of the HUD device 100 of the present embodiment. Fig. 6A shows an example of the display form of the route image Gu1 (first virtual image) and the AR image Gu2 (second virtual image) in a case where the distance to the point to execute the course change is within the predetermined distance range, in which (a) shows a situation where the vehicle 1 approaches the intersection, and (b) shows a display form on the image display part 120 at that time. Fig. Fig. 6B shows an example of the display form of the route image Gu1 (first virtual image) and the AR image Gu2 (second virtual image) in a case of the vehicle 1 entering the intersection, wherein (a) shows a situation in which the vehicle 1 has entered the intersection, and (b) shows a display form on the image display part 120 at that time. In (a) of the two Fig. 6A and Fig. 6B shows R a road near the intersection, where CR shows the vehicle 1 and a rectangular area Gu2v enclosed by a dashed line shows a position of the AR image Gu2 (second virtual image) in the virtual space.

[0069] Under certain circumstances (below the display change threshold B if “YES” in step ST105 in Fig. 3), in which, as in (a) the Fig. 6A, the vehicle 1 approaches the course change point such as intersection, etc., the AR image Gu2 (second virtual image) is displayed so that, as shown in (b) of the Fig. 6A, the vehicle is stationary near the route image Gu1 (first virtual image). The proximity of the turning point be of the route image Gu1 (first virtual image) is determined depending on the viewing angle of the HUD device 100, so it is not uniquely definable, but it shows, for example, a distance of 30 m from the current position of the vehicle 1 before the turning point. Under the circumstance where the vehicle 1 continues to approach the course change point such as an intersection, etc., and the remaining distance is within the predetermined distance range, control is performed that performs display while maintaining the positional relationship between the route image Gu1 (first virtual image) and the AR image Gu2 (second virtual image) on the image display part 120. In other words, the control part 110 fixes the position Gu2v of an AR arrow in the virtual space, changes the viewpoint in the virtual space based on the position, direction (attitude), etc.of vehicle 1 and displays the AR image Gu2 (second virtual image).

[0070] When vehicle 1 (CR) enters the course change point such as intersection etc., as in (a) of the Fig. 6B, the video display (sequence display) is performed, in which, as in (b) the Fig. 6B, the AR image Gu2 is evacuated (moved) in the direction opposite to the direction of travel of the vehicle 1 (X-arrow direction) shown by the arrowhead portion (arrowhead ah) of the AR image Gu2 (second virtual image) according to the turning of the vehicle 1 in the left-right direction (image angle in the transverse direction) at a pre-configured speed (position change depending on time) without changing the positional relationship in the forward and backward directions (image angle in the longitudinal direction). The position Gu2v of the AR image Gu2 in the virtual space, shown with a rectangle enclosed by a dashed line, moves further in the direction of the arrow X in (a) of the Fig. 6B.

[0071] When the vehicle 1 (CR) enters the point such as intersection, etc. to perform the course change, the control part 110 carries out the control, which displays the video on the image display part 120 in which, according to the turning of the vehicle 1 (CR), it turns in the left-right direction (angle of view in the transverse direction) in the direction opposite to the direction of travel of the vehicle 1 (CR) (X direction in the Fig. 6B (a) (b)) is evacuated (moved) at the previously configured speed (position change depending on time), which allows the driver as a visual recognizer to correctly and intuitively visually recognize the course change point. (Modified example)

[0072] According to the above-described vehicle display system 1000, the HUD device 100 (control part 110) has been explained as one that performs the control that, when the vehicle 1 enters the point to execute the course change, moves the AR image Gu2 (second virtual image) in the direction opposite to the course direction shown by the AR image Gu2 (second virtual image) and displays it on the image display part 120. In contrast, the HUD device 100 can be regarded as merely a display device, and the display control device 300 (processing device 200 in Fig. 2) When the vehicle 1 enters the heading change point, it can perform control to move the AR image Gu2 (second virtual image) in the direction opposite to the heading direction shown by the AR image Gu2 (second virtual image) and display it on the HUD device 100 (image display part 120). That is, the processing device 200 of the display control device 300 can individually perform a series of the above-described controls. In this case, the processing load of the HUD device 100 (control part 110) can be reduced. (Advantages of the present embodiment)

[0073] The head-up display device of the present embodiment is, as explained above, a head-up display device (HUD device 100) which, as shown in, for example, Fig. 1, the virtual image V is projected onto the display area VA as a virtually configured image plane in front of the vehicle 1, superimposed on the front landscape for display. The HUD device 100 in question has, as shown, for example, in Fig. 2, an image display part 120 which displays the first virtual image (cf. route image Gu1 in Fig. 4 (a) (b)), which shows the movement route of the vehicle 1, and the second virtual image (cf. AR image Gu2 of Fig. 4 (a) (b)), the display position of which changes along the first virtual image and which, when the vehicle 1 approaches the point for carrying out the course change, shows the course direction of the vehicle, a control part 110 which, when the vehicle 1 enters the point for carrying out the course change, carries out the control which moves the second virtual image in the direction opposite to the course direction shown by the second virtual image (cf. the arrow X of Fig. 6A and Fig. 6B) moves and displays.

[0074] According to the HUD device 100 of the present embodiment, when the vehicle 1 enters the turn-making point, the control part 110 performs control to move the AR image Gu2 (second virtual image) in the direction opposite to the direction of travel shown by the AR image Gu2 (second virtual image) and displays it on the image display part 120. Thus, for example, when the vehicle 1 enters an intersection, video display is performed in which the AR image Gu2 is evacuated (moved) in the direction opposite to the travel direction of the vehicle 1, for example, at a pre-configured speed (position change over time), corresponding to the left-right turn of the vehicle 1 (angle of view in the transverse direction), thereby enabling the driver as a visual recognizer to correctly and intuitively visually recognize the turn-making point such as an intersection, etc.

[0075] Furthermore, in the HUD device 100 of the present embodiment, the control part 110 can perform a control such as shown in Fig. 4 (a) (b), displays the route image Gu1 (first virtual image) superimposed on the road surface as a foreground landscape, and displays the AR image Gu1 (second virtual image) so as to be visually recognized as floating vertically along the road surface.

[0076] According to the HUD device 100 of the present embodiment, the control part 110 displays the route image Gu1 (first virtual image) superimposed on the front landscape, thereby realizing the display that makes the vehicle 1 perceive the unified sense of the turning direction and the real landscape, and increasing the elective affinity. Further, the control part 110 displays the AR image Gu2 (second virtual image) as floating vertically along the road surface, thereby effectively communicating the direction and turning point of the vehicle. The route image Gu1 (first virtual image) superimposed on the road surface and the AR image (second virtual image) displayed as floating vertically along the road surface have a synergistic effect, thus enabling the driver, as a visual recognizer, to visually recognize the course change point such as intersections, etc. more correctly and intuitively.

[0077] Furthermore, in the HUD device 100 of the present embodiment, the control part 110 can perform a control that, if a distance to the point for performing the course change of the vehicle 1, such as in Fig. 3, is within a predetermined distance range (step ST105 “YES”), the AR image Gu2 (second virtual image), such as in Fig. 5, in the vicinity of the turning point be of the route image Gu1 (first virtual image) in which a maximum curvature is reached at an arbitrary point for executing the course change, displays it stationary (step ST106), and when the vehicle 1 enters the arbitrary point for executing the course change (step ST107 "YES"), moves the AR image Gu2 (second virtual image) in the direction opposite to the course direction shown by the AR image Gu2 (second virtual image) and displays it (step ST108).

[0078] According to the HUD device 100 of the present embodiment, the control part 110 statically displays the AR image Gu2 (second virtual image) near the turning point be of the route image Gu1 (first virtual image) when the distance to the point for turning the vehicle 1 is within the predetermined distance range, and moves and displays the AR image Gu2 (second virtual image) in the direction opposite to the heading direction shown by the AR image Gu2 (second virtual image) when entering the arbitrary point to perform the turning.As described above, the display is carried out in different display configurations depending on the distance to the point for executing the course change of the vehicle 1, in particular when the vehicle 1 enters the arbitrary point for executing the short change, the control is carried out which moves and displays the AR image Gu2 (second virtual image) in the direction opposite to the course direction shown by the AR image Gu2 (second virtual image), so that the driver as a visual recognizer can intuitively understand the direction of movement and can intuitively and clearly recognize the distance to the turning point (course change point such as intersection, etc.) of the route image Gu1 (first virtual image).

[0079] In addition, in the HUD device 100 of the present embodiment, the control part 110 may also perform the control that changes the size of the AR image Gu2 (second virtual image) smaller than the size of the route image Gu1 (first virtual image) in both the longitudinal direction and lateral direction of the display area VA, and changes the size of the AR image Gu2 (second virtual image) according to the distance to the arbitrary point for performing the course change, and displays it.

[0080] According to the HUD device 100 of the present embodiment, the control part 110 performs control to make the size of the AR image Gu2 (second virtual image) smaller than the size of the route image Gu1 (first virtual image) in both the longitudinal and lateral viewing angles of the display area VA, and to change the size of the AR image Gu2 (second virtual image) according to the distance to the arbitrary point for making the turn. As described above, the control part 110 displays the AR image Gu2 (second virtual image) smaller than the route image Gu1 (first virtual image), thereby synergistically displaying the heading direction of the vehicle 1 to the driver as a visual discerner.As a result, the driver as a visual recognizer can relatively perceive the distance to the course change point based on the display positions of the route image Gu1 (first virtual image) and the AR image Gu2 (second virtual image) showing the same course change point, and recognize the distance from vehicle 1 to the course change point more correctly and intuitively.

[0081] Furthermore, the display control device of the present embodiment is a display control device 300 including the processing device 200 that controls the head-up display device (HUD device 100) which, as shown in, for example, Fig. 1 and Fig. 2, the virtual image V is projected onto the virtually configured display area VA in front of the vehicle 1 as the image plane, superimposed on the front landscape for display. The processing device 200 carries out a control which projects the first virtual image (cf. e.g. route image Gu1 according to Fig. 4 (a) (b)), which shows the movement route of the vehicle 1, and the second virtual image (cf. e.g. AR image Gu2 according to Fig. 4 (a) (b)), whose display position changes along the first virtual image and which shows the heading direction of the vehicle 1 as the vehicle 1 approaches the heading change execution point, displays it on the head-up display device (HUD device 100), and when the vehicle 1 enters the heading change execution point, performs control which moves the second virtual image (AR image Gu2) in the direction opposite to the heading direction shown by the second virtual image and displays it on the head-up display device (HUD device 100).

[0082] According to the display control device 300 of the present embodiment, when the vehicle 1 enters the turn-making point, the processing device 200 performs control to move the second virtual image (AR image Gu2) in the direction opposite to the direction shown by the second virtual image and displays it on the HUD device 100. Therefore, the display control device 300 can be provided that performs video display, for example, when the vehicle 1 enters an intersection, etc., in which the second virtual image is evacuated (moved) in the direction opposite to the direction of travel of the vehicle, for example, at a preconfigured speed (position change over time), corresponding to the left-right turn of the vehicle 1 (angle of view in the lateral direction), thereby enabling the driver, as a visual discerner, to recognize the turn-making point such as an intersection, etc.to be recognized correctly and intuitively visually.

[0083] Furthermore, the vehicle display system of the present embodiment represents a vehicle display system 1000 which, as shown in, for example, Fig. 1 and Fig. 2, the head-up display device (HUD device 100) projects the virtual image V superimposed on the front landscape onto the virtually configured display area VA in front of the vehicle 1 as the image plane for display, and the display control device 300 for controlling the head-up display device. The display control device 300 performs a control that displays the first virtual image (cf., for example, route image Gu1 according to Fig. 4 (a) (b)), which shows the movement route of the vehicle 1, and the second virtual image (cf. e.g. AR image Gu2 according to Fig.4 (a) (b)), whose display position changes along the first virtual image and which shows the heading direction of the vehicle 1 as the vehicle 1 approaches the heading change execution point, displays it on the head-up display device (HUD device 100), and when the vehicle 1 enters the heading change execution point, performs control which moves the second virtual image (AR image Gu2) in the direction opposite to the heading direction shown by the second virtual image and displays it on the head-up display device (HUD device 100).

[0084] According to the vehicle display system 1000 of the present embodiment, when the vehicle 1 enters the turn-making point, the display control device 300 performs control to move the second virtual image (AR image Gu2) in the direction opposite to the direction shown by the second virtual image and display it on the head-up display device (HUD device 100). Therefore, the vehicle display system 1000 can be provided that, for example, when the vehicle 1 enters the turn-making point such as an intersection, performs video display in which the second virtual image is moved in the direction opposite to the direction of travel of the vehicle 1, for example, in accordance with the left-right turn of the vehicle 1 (angle of view in the lateral direction).is evacuated (moved) at the previously configured speed (position change depending on time), which enables the driver as a visual recognizer to correctly and intuitively visually recognize the course change point such as intersection, etc.

[0085] The present invention is not limited to the exemplary embodiments described above, and those skilled in the art could easily modify the exemplary embodiments described above within the scope encompassed by the claims. [List of reference symbols]

[0086] 100 ... Head-up display device (HUD device), 110 ... Control part, 120 ... Image display part, 121 ... Liquid crystal display device, 122 ... Optical relay system, 200 ... Processing device (processor), 300 ... Display control device, 400 ... Navigation device, 401 ... Behavior sensor, 402 ... Camera, 403 ... LiDAR, 404 ... Eye position sensor, 500 ... I / O interface, 1000 ... Vehicle display system, VA ... Display area, Gu1 ... Route image (first virtual image), Gu2 ... AR image (second virtual image), s ... Section of the arrow shaft of the route image, be ... Turn point of the route image, ah ... Section of the arrowhead of the route image, Gu2v ... Position of the AR image in the virtual space QUOTES CONTAINED IN THE DESCRIPTION

[0000] This list of documents submitted by the applicant was generated automatically and is included solely for the convenience of the reader. This list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions. Cited patent literature

[0000] WO 2021 / 132553 A1

[0004]

Claims

[1] A head-up display device that projects a virtual image superimposed on a front landscape for display onto a display area virtually configured in front of a vehicle as an image plane, comprising an image display part that displays a first virtual image showing a movement route of the vehicle and a second virtual image whose display position changes along the first virtual image and shows a heading direction of the vehicle when the vehicle approaches a point for making a heading change, a control part that carries out control when the vehicle enters the point for making the heading change, which moves and displays the second virtual image in a direction opposite to the heading direction shown by the second virtual image. [2] The head-up display device according to claim 1, wherein the control part performs control that displays the first virtual image superimposed on the front landscape on a road surface and displays the second virtual image so as to be visually recognized as floating vertically along the road surface. [3] The head-up display device according to claim 1, wherein the control part performs control such that, if a distance to a point for making a course change of the vehicle is within a predetermined distance range, the second virtual image is stationary and displayed in the vicinity of a turning point of the first virtual image at which a maximum curvature is achieved at an arbitrary point for making the course change, and, when the vehicle enters the arbitrary point for making the course change, the second virtual image is moved and displayed in a direction opposite to the course direction shown by the second virtual image. [4] The head-up display device according to any one of claims 1 to 3, wherein the control part performs control that changes a size of the second virtual image with respect to both a longitudinal angle of view and a transverse angle of view of the display area smaller than a size of the first virtual image and depending on a distance to an arbitrary point for performing the course change, and displays it. [5] A display control device comprising a processing device which controls a head-up display device which projects a virtual image superimposed on a front landscape onto a display area virtually configured in front of a vehicle as an image plane for display, wherein the processing device performs a control which displays a first virtual image showing a movement route of the vehicle and a second virtual image, the display position of which changes along the first virtual image and which, when the vehicle approaches a point for making a course change, shows a course direction of the vehicle, on the head-up display device, and when the vehicle enters a point for carrying out the course change, a control is carried out which moves the second virtual image in a direction opposite to the course direction shown by the second virtual image and displays it on the head-up display device. [6] A display system for vehicles comprising a head-up display device that projects a virtual image superimposed on a front landscape onto a display area virtually configured in front of a vehicle as an image plane for display, and a display control device for controlling the head-up display device, wherein the display control device performs a control which displays a first virtual image showing a movement route of the vehicle and a second virtual image, the display position of which changes along the first virtual image and which, when the vehicle approaches a point for making a course change, shows a course direction of the vehicle, on the head-up display device, and when the vehicle enters the point for implementing the course change, a control is carried out which moves the second virtual image in a direction opposite to the course direction shown by the second virtual image and displays it on the head-up display device.

Images