Head-up display device and display control device

Abstract

To facilitate grasping of a difference between the position of a real world based on a non-route guide image and the position of the real world based on a route guide image from a display state of each image.SOLUTION: The head-up display device comprises: image display means for displaying a guide image superposed on a landscape ahead of a vehicle; and control means for changing the display position of the guide image viewed by a viewer in a near-far direction. The control means superposes and displays a non-route guide image on a non-route guide position when a vehicle 1 passes through a notification start position set by a prescribed distance before a route guide position. Then, the control means adjusts a route guide image so as to be viewed just in front of a non-route guide image and causes the image display means to display the image. The control means displays, by adjusting the route guide image, the route guide image to change from in front of the display position of the non-route guide image to a depth side.SELECTED DRAWING: Figure 7

Description

[Technical Field]

[0001] The present disclosure relates to a head-up display device and a display control device. [Background technology]

[0002] Head-up display (HUD) devices are known that can intuitively inform a driver of roads where to turn right or left by displaying route guidance images (arrow icons, etc.) for guiding the vehicle's driving route on a projection screen provided on top of the vehicle's instrument panel. In recent years, HUD devices for AR (Augmented Reality) navigation systems have been proposed that superimpose virtual visual information (route guidance images, etc.) on the surrounding scenery (actual scenery) of the real world by projecting route guidance images for guiding the driving route and POI (Point of Interest) images such as store icons onto a windshield (projected portion, front window) in front of the vehicle so as to be superimposed on the scenery ahead of the vehicle as viewed by the driver (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2005-69800 Summary of the Invention [Problem to be solved by the invention]

[0004] However, when a HUD device for an AR navigation device is used to project route guidance images for turning right or left, etc., superimposed on the actual view, there is a problem in that it is not easy for the driver to understand, based on the projected route guidance images, etc., where he or she should actually turn.

[0005] For this reason, HUD devices have been developed that make it easier to grasp intersections where turns should be made by displaying an image showing non-route guidance (non-route guidance image) at intersections where turns should not be made, etc. However, even with such HUD devices, it is not easy to determine the difference in distance between the position (real space position) in the real world (actual scene) where the non-route guidance image where turns should not be superimposed and the position in the real world (actual scene) where the route guidance image where turns should be superimposed, from the display state of each image, which makes it difficult to grasp the driving route in advance.

[0006] The present disclosure has been made in consideration of the above-mentioned problems, and aims to provide a head-up display device that makes it easy to grasp the difference between a real-world position based on a non-route guidance image and a real-world position based on a route guidance image from the display state of each image, and makes it easy to grasp the driving route in advance. [Means for solving the problem]

[0007] In order to solve the above-described problems, a head-up display device in a first embodiment of the present disclosure includes an image display means for projecting a guidance image onto a projection unit, thereby superimposing the guidance image on a landscape ahead of the vehicle, and a control means for changing a display position of the guidance image viewed by a viewer in the vehicle in a near or far direction by adjusting the guidance image projected by the image display means, and the control means performs the route guidance at a position between the notification start position and the route guidance position when the vehicle passes a notification start position that is located a predetermined distance before a route guidance position at which route guidance is provided to the viewer. At a non-route guidance location where the viewer should not be located, a non-route guidance image to be viewed by the viewer is superimposed on the non-route guidance location by the image display means, and then a route guidance image for providing the route guidance at the route guidance location is adjusted so that it is viewed by the viewer in front of the display position of the non-route guidance image and displayed by the image display means, and by adjusting the route guidance image displayed so that it is viewed in front of the display position of the non-route guidance image, the route guidance image displayed by the image display means is displayed so that it is changed from in front of the display position of the non-route guidance image to behind it.

[0008] In addition, in a head-up display device of a second embodiment that can be dependent on the first embodiment, the control means may adjust the route guidance image that has been changed to be behind the display position of the non-route guidance image, and cause the image display means to superimpose the route guidance image on the route guidance position.

[0009] Furthermore, in a head-up display device of a third embodiment that can be dependent on the first or second embodiment, the control means may erase the non-route guidance image that was superimposed on the non-route guidance position when the vehicle passes the non-route guidance position.

[0010] Furthermore, in a head-up display device of a fourth embodiment that can be dependent on any of the first to third embodiments, when there are a plurality of non-route guidance positions located between the notification start position and the route guidance position, the control means may cause the image display means to superimpose and display non-route guidance images corresponding to each of the non-route guidance positions, and may also superimpose and display all of the non-route guidance images simultaneously.

[0011] Furthermore, in a head-up display device of a fifth embodiment that can be dependent on any of the first to fourth embodiments, when there are a plurality of non-route guidance positions located between the notification start position and the route guidance position, the control means may adjust the route guidance image and display it on the image display means so that the route guidance image is perceived as being closer to the viewer than the display position of the non-route guidance image superimposed on the non-route guidance position that is closest to the notification start position, and then adjust the route guidance image that is displayed so that it is perceived as being closer to the viewer than the display position of the non-route guidance image, thereby changing the display position of the route guidance image so that the route guidance image displayed by the image display means is perceived by the viewer as having moved from the front side of the display position of the non-route guidance image superimposed on the nearest non-route guidance position to the back side of the display position of the non-route guidance image superimposed on the non-route guidance position that is farthest from the notification start position.

[0012] In addition, the display control device in the sixth embodiment is a display control device that controls a head-up display device that projects a guidance image onto a projection unit, thereby superimposing the guidance image on the scenery in front of the vehicle, and is characterized in that it acquires information indicating a route guidance position where route guidance is provided and information indicating a non-route guidance position that is closer than the route guidance position and where route guidance is not provided, displays a non-route guidance image at a position corresponding to the non-route guidance position, and after displaying the non-route guidance image, displays the route guidance image as if it has moved from the front to the back of the non-route guidance image. [Effects of the Invention]

[0013] According to the head-up display device of the present disclosure, the difference between a real-world position based on a non-route guidance image and a real-world position based on a route guidance image can be easily grasped from the display state of each image, making it easier to grasp the driving route in advance. [Brief explanation of the drawings]

[0014] [Figure 1] 1 is a schematic diagram showing a configuration of an in-vehicle system including a HUD device according to an embodiment. [Figure 2] 1 is a block diagram illustrating a display control device according to an embodiment, an information acquisition unit, and an image generation unit. [Figure 3] 10A and 10B are schematic diagrams illustrating how the apparent size of a virtual object VOB is determined using the visual angle 2θ, where (a) shows an example in which the perceptual distance Ds is long, and (b) shows an example in which the perceptual distance Ds is short. [Figure 4] 10 is a flowchart showing a display / deletion process of a guide image by a control unit according to an embodiment. [Figure 5] 10 is a flowchart showing a guidance display start process of a control unit according to an embodiment. [Figure 6] FIG. 10 is a diagram showing a route guidance image displayed on the windshield before the vehicle reaches the "route guidance position." [Figure 7]1 is a bird's-eye view image that schematically shows the vicinity of an intersection where a vehicle should turn left. [Figure 8] 10 is a diagram showing a state in which a "route guidance image" or the like is not displayed on the windshield in the embodiment. FIG. [Figure 9] 10 is a diagram showing a state in which a "non-route guidance image A" and a "non-route guidance image B" are displayed on a windshield in accordance with an embodiment. FIG. [Figure 10] 10 is a diagram showing a state in which a "route guidance image" is displayed in front of a "non-route guidance image A" on the windshield in accordance with an embodiment. FIG. [Figure 11] 10 is a diagram showing a schematic view of a "route guidance image" moving from the front to the back on the windshield of the embodiment. FIG. [Figure 12] 10 is a diagram showing a state in which a "route guidance image" is displayed behind a "non-route guidance image B" and a "non-route guidance image A" on the windshield according to the embodiment. FIG. DETAILED DESCRIPTION OF THE INVENTION

[0015] An example of a head-up display (HUD) device according to the present disclosure will be described in detail below with reference to the accompanying drawings. FIG. 1 is a schematic diagram showing an example of the configuration of an in-vehicle system including a HUD device. The in-vehicle system 100 is installed in a vehicle 1. The in-vehicle system 100 includes an pupil detection camera 110, a stereo camera 120, an image processing unit 130, a communication unit 140, an ECU (Electronic Control Unit) 150, a navigation device 160, and a HUD device 200.

[0016] The pupil detection camera 110 detects the gaze direction and position of the left eye EL and right eye ER of the viewer (driver) 4. Information relating to the gaze direction and position detected by the pupil detection camera 110 (information on the gaze direction, etc.) is output to an information acquisition unit 280 of the HUD device 200, which will be described later.

[0017] The stereo camera 120 is equipped with a pair of lenses, and can capture a pair of images with different shooting angles (taking parallax into consideration) by simultaneously capturing an image of the scene ahead of the vehicle with the left and right lenses. The pair of images captured by the stereo camera 120 is output to the image processing unit 130.

[0018] The image processing unit 130 acquires image data captured by the stereo camera 120 and performs image analysis. The image processing unit 130 references a pair of images captured by the stereo camera 120 and uses stereo matching technology to search for corresponding points in each image to detect parallax for the same object (forward target), and calculates the distance to the forward target using the principle of triangulation based on parallax. Information about the distance (distance information) calculated by the image processing unit 130 is output to the information acquisition unit 280 of the HUD device 200.

[0019] If necessary, the radar unit 170 can be installed in the vehicle 1. The radar unit 170 can measure the distance and direction to the target (forward target) by emitting radio waves toward the target and measuring the reflected waves. Information about the distance (distance information) measured by the radar unit 170 is output to the information acquisition unit 280 of the HUD device 200.

[0020] The communication unit 140 acquires information indicating the traveling state of the vehicle 1 (such as location information based on the GPS (Global Positioning System)) using a communication function. The communication unit 140 may be a GPS device that detects and acquires vehicle location information, or a vehicle-to-vehicle communication device that uses a mobile phone line.

[0021] The ECU 150 is a device that controls all systems mounted on the vehicle, and performs, for example, control related to the vehicle body such as turning lights on / off, detecting whether the doors are open or closed, and operation of the keyless entry system, as well as control related to vehicle driving such as brake operation, engine control, steering status, and steering assistance. By acquiring various information necessary for controlling the vehicle 1 from the ECU 150, a control unit (control means) 300 (described later) of the HUD device 200 can determine the driving status of the vehicle 1. The various information acquired from the ECU 150 is output to an information acquisition unit 280 of the HUD device 200.

[0022] The navigation device 160 acquires various information related to the vehicle's driving conditions and the like from the ECU 150 and the like, acquires vehicle position information from a GPS device (communication unit 140) and the like, and performs route search and route guidance for guiding the vehicle 1 to the destination by using map information recorded in a recording means (not shown). For example, the navigation device 160 detects the position of an intersection where a right or left turn should be made based on the route information to the destination, and displays guidance for a right or left turn operation to the viewer (driver) 4 a predetermined distance before the intersection.

[0023] The HUD device 200 acquires information on "route guidance position," "notification start position," "non-route guidance position," "route guidance distance," and "non-route guidance distance" from the navigation device 160. The information on "route guidance position" refers to information on the real-world position (real space position) of an intersection where the vehicle 1 should turn right or left (see "route guidance position" illustrated in FIG. 7).

[0024] The information on the "notification start position" refers to information on the real-world position at which the control unit 300 starts the process of using a "route guidance image" and a "non-route guidance image" to allow the viewer (driver) 4 to visually recognize the position of an intersection where they should turn right or left (see the "notification start position" illustrated in Figure 7).

[0025] The information on the "non-route guidance position" refers to information on roads that connect to intersections or the like in the real world that exist between the "notification start position" and the "route guidance position," and that are information on positions in the real world where the vehicle 1 must not turn right or left (see "non-route guidance position A" and "non-route guidance position B" shown in Figure 7). If there are multiple "non-route guidance positions," multiple pieces of information on the "non-route guidance position" are set.

[0026] The "route guidance distance" information refers to the real-world (actual space) distance from the "notification start position" to the "route guidance position," and this range is called the "route guidance distance range" (see the "route guidance distance range" illustrated in Figure 7).

[0027] The "non-route guidance distance" information refers to the real-space distance from the "notification start position" to the "non-route guidance position," and this range is called the "non-route guidance distance band" (see "non-route guidance distance band A" and "non-route guidance position B" shown in Figure 7). If there are multiple "non-route guidance positions," multiple "non-route guidance distance bands" are also set.

[0028] The navigation device 160 outputs the above-mentioned information on the “route guidance position”, “notification start position”, “non-route guidance position”, “route guidance distance”, and “non-route guidance distance” to the information acquisition unit 280 of the HUD device 200.

[0029] The HUD device 200 includes a stereoscopic display device 210 equipped with a control unit 300, an optical system (image display means) 270, and an information acquisition unit 280. The HUD device 200 is installed, for example, in a dashboard (not shown) of the vehicle 1.

[0030] The information acquisition unit 280 is an input interface (or input / output interface), and as described above, acquires information such as gaze direction from the pupil detection camera 110, acquires distance information from the image processing unit 130 and the radar unit 170, acquires information indicating the driving state and the like (position information, etc.) from the communication unit 140, and acquires various information necessary for controlling the vehicle from the ECU 150. Furthermore, the information acquisition unit 280 acquires the above-mentioned information on the "route guidance position," "notification start position," "non-route guidance position," "route guidance distance," and "non-route guidance distance" from the navigation device 160. The information acquisition unit 280 outputs the various acquired information to the control unit 300.

[0031] The stereoscopic display device 210 has an image generation unit (image display means) 220, an image display unit (image display means) 230, a light beam separation unit (image display means) 240, and a display control device 250. The image display unit 230 is a liquid crystal display device or the like, and has an image display surface for displaying an image. The light beam separation unit 240 has a lenticular lens, a parallax barrier, or the like, and separates light emitted from the image display surface of the image display unit 230 into light beams for the left and right eyes. The light beams separated by the light beam separation unit 240 are output to an optical system 270.

[0032] The display control device 250 has a control unit 300, which has a virtual object size adjustment unit 310. The control unit 300 controls, for example, the processing of the image generation unit 220 (specifically, for example, image rendering processing) and the operation of the image display unit 230. The control unit 300 also performs display switching processing to switch between two-dimensional display and three-dimensional display of route guidance images (icon images such as arrows for route guidance) perceived (visually recognized) by the viewer (driver) 4. Furthermore, the control unit 300 can also control the visibility of content images to deal with crosstalk (a phenomenon in which left and right images are displayed simultaneously for a moment at a timing when the left and right images should be displayed alternately to display an image three-dimensionally).

[0033] The optical system 270 has a curved mirror (image display means such as a concave mirror) 275. The curved mirror 275 reflects the light received from the light beam splitter 240 and projects image display lights K1 and K2 onto the windshield (projected portion) 2. The optical system 270 also includes other optical members (lenses, auxiliary reflectors, etc.) not shown, as necessary.

[0034] When the display lights K1 and K2 are projected onto the windshield 2 by the curved mirror 275 of the optical system 270, viewpoint images (parallax images) for the left and right eyes having parallax are displayed in a visible manner ahead of the viewer (driver) 4. Specifically, as shown in FIG. 1, virtual images VL and VR are displayed on a virtual image display surface (also referred to as an imaging surface or a display surface) PS in the line of sight of the viewer (driver) 4. When the viewer (driver) 4 views these virtual images VL and VR, the viewer (driver) 4 is able to perceive a stereoscopic image (stereoscopic image, 3D image) having a sense of depth in the perspective direction due to the influence of left and right parallax. The stereoscopic image having a sense of depth is perceived by the viewer (driver) 4 as a virtual object VOB at the position of a stereoscopic display surface (convergence surface) VS located behind the virtual image display surface PS.

[0035] For the purpose of explaining the perceptual distance and the like, which will be described later, the position of the virtual image display surface PS will be referred to as the "adjusted position," the position that is the reference for the viewpoint of the viewer (driver) 4 will be referred to as the "viewpoint position," and the distance from the viewpoint position to the adjusted position will be referred to as the "adjusted distance." Furthermore, the distance from the viewpoint position to the position of the stereoscopic display surface VS will be referred to as the "perceptual distance." The "perceptual distance" refers to the distance at which the viewer (driver) 4 perceives a stereoscopic image.

[0036] Furthermore, the distance from the position of the virtual image display surface PS to the position of the stereoscopic display surface VS is called the "virtual distance." The "perceived distance" is the distance obtained by adding the "virtual distance" to the "adjusted distance." Note that when a route guidance image or the like is displayed to the driver in two dimensions rather than three dimensions, a planar virtual image is displayed at the position of the virtual image display surface PS.

[0037] 2 is a block diagram showing the display control device 250, the information acquisition unit 280, and the image generation unit 220. The display control device 250 has the control unit 300 as described above, and the control unit 300 has the virtual object size adjustment unit 310. The virtual object size adjustment unit 310 has a perceptual distance calculation unit 330 and a visual angle 2θ determination unit 340. The perceptual distance calculation unit 330 calculates the perceptual distance described above based on various information (e.g., information on the line of sight, distance information, etc.) acquired from the information acquisition unit 280. The visual angle 2θ determination unit 340 determines the visual angle 2θ corresponding to the perceptual distance calculated by the perceptual distance calculation unit 330.

[0038] The viewing angle 2θ is used as an index for specifying the apparent size of the virtual object VOB as seen by the viewer (driver) 4. Figures 3(a) and 3(b) are schematic diagrams for explaining that the apparent size of the virtual object VOB is specified using the viewing angle 2θ. In Figure 3, parts that are common to Figure 1 are assigned the same reference numerals.

[0039] 3(a) and 3(b), the distance (perceived distance) from the viewpoint of the viewer (driver) 4 to a predetermined real space position is defined as the perceived distance Ds, and the size of the virtual object VOB at the predetermined real space position is defined as L. Furthermore, in FIG. 3(a) and 3(b), the arctangent, which is the inverse trigonometric function of the tangent, is defined as Atan, and the function that converts an angle in radians to an angle in degrees is defined as degrees, where θ is calculated by degrees(Atan(L / 2Ds)), and the visual angle 2θ is calculated by 2×degrees(Atan(L / 2Ds)).

[0040] Also, in Figures 3(a) and (b), Dp indicates the adjustment distance indicating the distance from the viewpoint of the viewer (driver) 4 to the virtual image display surface PS, VL and VR indicate virtual images VL and VR having parallax for each of the left and right viewpoints displayed on the virtual image display surface PS, and VS indicates the stereoscopic display surface VS on which the virtual object VOB is displayed.

[0041] The perceptual distance Ds varies, for example, within a range of 4 m to 50 m. However, this is just an example and is not limiting. Also, the size L of the virtual object VOB shown in Figures 3(a) and 3(b) is set to 0.5 m, for example.

[0042] Comparing Figures 3(a) and (b), the size L of the virtual object VOB is set to 0.5 m in both cases, so there is no difference in actual size. However, since the perceived distance Ds in Figure 3(b) is shorter than the perceived distance Ds in Figure 3(a), the apparent size of the virtual object VOB perceived by the viewer (driver) 4 is larger in Figure 3(b).

[0043] 3(a) and 3(b), the visual angle 2θ corresponds to the size L of the virtual object VOB, and the shorter the perceived distance Ds, the larger the visual angle 2θ. Therefore, the visual angle 2θ can be used as an index showing the apparent size of the virtual object VOB as perceived by the viewer (driver) 4.

[0044] Therefore, the visual angle 2θ corresponding to the perceived distance Ds is specified based on a function (characteristic line) showing the relationship between the perceived distance Ds and the visual angle 2θ, and the size of the virtual object VOB can be variably controlled based on the specified visual angle 2θ. For example, the size and position of the virtual object VOB can be changed by appropriately changing the size (and display position) of the virtual images VL and VR on the virtual image display surface PS.

[0045] The perceptual distance Ds calculated by the perceptual distance calculation unit 330 and the visual angle 2θ determined by the visual angle 2θ determination unit 340 are output to the image generation unit 220. The image generation unit 220 performs image rendering processing based on the acquired perceptual distance Ds and visual angle 2θ to generate a route guidance image that serves as the basis for the virtual images VL and VR, and displays the image on the image display surface of the image display unit 230. As already described, the image displayed on the image display surface of the image display unit 230 is separated by the light beam separation unit 240 into light beams for the left and right eyes, and these are displayed as virtual images VL and VR on the virtual image display surface PS via the optical system 270.

[0046] In this way, the size and distance of the object VOB perceived by the viewer (driver) 4 are controlled based on the perceptual distance Ds calculated by the perceptual distance calculation unit 330 and the visual angle 2θ determined by the visual angle 2θ determination unit 340. Here, the perceptual distance calculation unit 330 and the visual angle 2θ determination unit 340 belong to the control unit 300 and are controlled by the control unit 300. Therefore, the control unit 300 essentially calculates the perceptual distance Ds and determines the visual angle 2θ, and the position, size, sense of depth, etc. of the object VOB perceived by the viewer (driver) 4 are adjusted and controlled based on the perceptual distance Ds and visual angle 2θ determined by the control unit 300. This object VOB corresponds to the "route guidance image" and "non-route guidance image" already explained.

[0047] The control unit 300 calculates and determines the perceived distance Ds and the visual angle 2θ by acquiring information such as line of sight direction and distance information from the information acquisition unit 280, and causes the image generation unit 220 to create virtual images VL and VR, thereby adjusting and controlling the position, size, sense of depth, etc. of the "route guidance image" and "non-route guidance image." Furthermore, the control unit 300 acquires information on the "route guidance position," "non-route guidance position," "notification start position," "route guidance distance," and "non-route guidance distance" from the information acquisition unit 280, thereby controlling the display position and timing of display / erasure of the "route guidance image," etc.

[0048] Fig. 4 is a flowchart showing the contents of the display / deletion process of the guide image by the control unit 300, and Fig. 5 is a flowchart showing the contents of the guide display start process shown in S.03 of Fig. 4. The process of the control unit 300 will be described with reference to Figs. 4 and 5.

[0049] First, the control unit 300 acquires information such as a "route guidance position" from the navigation device 160 (S.01). In a typical navigation device, when the vehicle 1 approaches a junction where the vehicle 1 should turn during route guidance, the navigation device 160 starts route guidance from a position a predetermined distance before the junction. For example, when the vehicle 1 reaches a position 300 meters before the intersection where the vehicle 1 should turn, the navigation device 160 provides voice guidance such as "Turn right 300 meters ahead," and outputs information to the HUD device 200 to display a route guidance image (e.g., a route guidance image in the shape of a "<" character) encouraging the vehicle 1 to turn right. In the navigation device 160 according to the embodiment, when the vehicle 1 approaches a position ("notification start position") a predetermined distance before the position where the vehicle 1 should turn during route guidance ("route guidance position"), the navigation device 160 transmits the "route guidance position," "notification start position," "non-route guidance position," "route guidance distance," and "non-route guidance distance" described above to the control unit 300.

[0050] In the process of S.01, the control unit 300 determines whether or not it has received information on the "route guidance position," "notification start position," "non-route guidance position," "route guidance distance," and "non-route guidance distance" from the navigation device 160 (S.02). If it has not been able to acquire information such as the "route guidance position" from the navigation device 160 (No in S.02), the control unit 300 ends the display / deletion process of the guide image. Thereafter, the control unit 300 executes the display / deletion process of the guide image again, and repeats the process from S.01.

[0051] Fig. 6 shows the state of the route guidance image projected onto the windshield 2 before (or when) information such as a "route guidance position" is acquired by the control unit 300 from the navigation device 160. In the case of Fig. 6, because a general route guidance process is being executed by the navigation device 160, the route guidance image (a left turn icon in the shape of a "<") is displayed superimposed on the position of the intersection where the vehicle should turn (the position of the intersection in the real world).

[0052] On the other hand, if the control unit 300 can acquire information such as the "route guidance position" from the navigation device 160 (Yes in S.02), the control unit 300 performs the guidance display start process shown in FIG. 5 (S.03).

[0053] Here, information such as the "route guidance position" acquired from the navigation device 160 will be explained using an overhead image that schematically shows the vicinity of an intersection where the vehicle should turn left. FIG. 7 is an image that schematically shows the vicinity of an intersection where the vehicle should turn left. When the vehicle 1 travels from the bottom to the top of FIG. 7, the guidance display start process shown in FIG. 5 starts when the vehicle 1 reaches the "notification start position."

[0054] In FIG. 7, there are two crossroads between the "notification start position" and the "route guidance position," and two "non-route guidance positions" ("non-route guidance position A" and "non-route guidance position B") have been set to prevent left turns at either intersection. Two "non-route guidance images" ("non-route guidance image A" and "non-route guidance image B") are displayed at the two "non-route guidance positions," as described below. Also, as shown in FIG. 7, the range from the "notification start position" to the "route guidance position" corresponds to the "route guidance distance band," the range from the "notification start position" to the "non-route guidance position B" on the closer side corresponds to the "non-route guidance distance band B," and the range from the "notification start position" to the "non-route guidance position A" on the far side corresponds to the "non-route guidance distance band A."

[0055] In the guidance display start process shown in Fig. 5, the control unit 300 temporarily erases the "route guidance image" and "non-route guidance image" displayed on the windshield 2 as shown in Fig. 8 (S.20). Next, the control unit 300 projects (displays) the "non-route guidance image" on the windshield 2 so that the "non-route guidance image" is superimposed on a real-world position that corresponds to the "non-route guidance position" (S.21).

[0056] 7 shows two "non-route guidance positions" as described above. Therefore, in S.21, control unit 300 projects "non-route guidance image A" and "non-route guidance image B" onto windshield 2 so that they are superimposed on real-world positions corresponding to "non-route guidance position A" and "non-route guidance position B," allowing viewer (driver) 4 to simultaneously perceive "non-route guidance image A" and "non-route guidance image B."

[0057] Figure 9 shows how "non-route guidance image A" and "non-route guidance image B" are superimposed on the actual view through the windshield 2 by S.21. In Figure 9, "non-route guidance image A" and "non-route guidance image B" are displayed as icon images with an X inside a circle.

[0058] After the "non-route guidance image A" and the "non-route guidance image B" are displayed on the windshield 2, the control unit 300 projects the "route guidance image" onto the windshield 2 so that the viewer (driver) 4 perceives the "route guidance image" at a position closer to the viewer (driver) 4 than the display positions of all the "non-route guidance images" ("non-route guidance image A" and "non-route guidance image B"), as shown in Fig. 10 (S.22). The control unit 300 adjusts the size and position of the projected "route guidance image."

[0059] Thereafter, the control unit 300 performs animation display processing that creates the perception that the "route guidance image" is moving through space from a position in front of all "non-route guidance images" to a position in the back (flying through space, changing perspective) (S.23). Specifically, the control unit 300 changes the size and position of the projected "route guidance image" (virtual object VOB) based on the perception distance Ds and visual angle 2θ already explained, thereby causing the viewer (driver) 4 to perceive the "route guidance image" as moving from the front to the back.

[0060] 11 is a diagram showing a schematic diagram of the animation display process in which the "route guidance image" moves from a position in front of the "non-route guidance image B" to the back of the "non-route guidance image A." The "route guidance image" displayed in the foreground moves smoothly to the back through the animation display process.

[0061] Thereafter, the control unit 300 performs a process of projecting a "route guidance image" onto the windshield 2 so as to be superimposed on the "route guidance position" (a position in the real world) that is located furthest back from the display positions of all "non-route guidance images B" and "non-route guidance images A" (S.24). In Fig. 12, the "route guidance image" is displayed behind the display positions of the "non-route guidance images B" and "non-route guidance images A."

[0062] In this way, the control unit 300 displays a "non-route guidance image" (S.21) to allow the viewer (driver) 4 to unconsciously (or consciously) perceive a "non-route guidance position," and then performs a display process (S.23, S.24) in which the "route guidance image" moves smoothly (continuously) using animation display process, based on each perceived "non-route guidance position," from the near side of all "non-route guidance positions" (S.22) to the farthest "route guidance position." By performing this kind of guidance display start process (FIG. 5) for a "route guidance image," etc., the viewer (driver) 4 can be impressed (attracted to) the presence of the "route guidance image." Furthermore, it becomes possible to consciously perceive the sense of distance from the "notification start position" to the "route guidance position" based on the relative difference between the display position of the already displayed "non-route guidance image A" ("non-route guidance position A") and the display position of the "non-route guidance image B" ("non-route guidance position B").

[0063] After performing the guidance display start process (S.03) shown in Fig. 5, the control unit 300 shifts the process to S.04 in Fig. 4. Thereafter, the control unit 300 acquires "location information" of the vehicle 1 by acquiring GPS information or the like via the communication unit 140, and also acquires "travel distance information" of the vehicle 1 via the ECU 150 (S.04).

[0064] Next, the control unit 300 performs a process to change the guidance image according to the distance traveled by the vehicle 1 (S.05). In the process of changing the guidance image, the control unit 300 adjusts the display position and size of the "route guidance image" and "non-route guidance image" so that they are superimposed on the real scene each time the vehicle 1 travels, based on the acquired "position information" and "travel distance information" of the vehicle 1. Specifically, as already explained, the control unit 300 changes the size and position of the "route guidance image" and "non-route guidance image" (virtual object VOB) based on the perceived distance Ds and the visual angle 2θ.

[0065] Then, the control unit 300 determines whether the vehicle 1 has reached (passed) a non-route guidance position (a real-world position where a non-route guidance image is superimposed) based on the acquired "position information" and "travel distance information" of the vehicle 1 (S.06). Specifically, the control unit 300 determines how far the vehicle 1 has traveled from the "notification start position" based on the "travel distance information," using the "notification start position" acquired in S.01 as a reference. For example, if the vehicle 1 has moved a "non-route guidance distance B" from the "notification start position" based on the "travel distance information" (Yes in S.06), the control unit 300 determines that the vehicle 1 has reached the "non-route guidance position B" (has passed the "non-route guidance distance zone B") and performs processing to erase the "non-route guidance image B" projected on the windshield 2 (S.07).

[0066] Thereafter (if Yes or No in S.06), the control unit 300 determines whether the vehicle 1 has reached the "route guidance position" (the real-world position where the "route guidance image" is superimposed) based on the acquired "position information" and "travel distance information" of the vehicle 1 (S.08). Specifically, similar to the processing of S.06, the control unit 300 determines whether the vehicle 1 has moved the "route guidance distance" from the "reporting start position" (whether the vehicle 1 has passed the "route guidance distance band") based on the "travel distance information" using the "reporting start position" as a reference.

[0067] If the vehicle 1 has not moved the "route guidance distance" (No in S.08), the control unit 300 proceeds to S.06 and repeatedly executes the process of determining whether the vehicle 1 has moved the "non-route guidance distance" from the "notification start position." In the HUD device 200 shown in the embodiment, two "non-route guidance positions" are set, and even if the vehicle 1 reaches (passes) the "non-route guidance position B" through the process described above, there is another "non-route guidance position" ("non-route guidance position A") before reaching the "route guidance position." Therefore, if the vehicle 1 has not reached (passed) the "non-route guidance position A," the determination in S.08 is No, and the process proceeds to S.06.

[0068] In the processing of S.06, if the vehicle 1 moves the "non-route guidance distance A" from the "notification start position" (Yes in S.06), the control unit 300 determines that the vehicle 1 has reached the "non-route guidance position A" (has passed the "non-route guidance distance range A"), and performs processing to erase the "non-route guidance image A" projected onto the windshield 2 (S.07).

[0069] Thereafter, as described above, a determination process is performed to determine whether the vehicle 1 has reached the "route guidance position" (S.08), and if it is determined that the vehicle 1 has moved the "route guidance distance" (has passed the "route guidance distance band") (Yes in S.08), the control unit 300 performs a process to enlarge and display the "route guidance image" projected on the windshield 2 (a process to make the "route guidance image" easier for the viewer (driver) 4 to perceive) (S.09). Then, the control unit 300 acquires steering wheel steering information from the ECU 150 and GPS information (position information) from the communication unit 140, and thereby determines whether the viewer (driver) 4 has moved the vehicle 1 according to the route guidance (turned left in the example of FIG. 7) or whether the vehicle 1 has taken a route that is completely different from the route guidance (S.10).

[0070] If the vehicle 1 has traveled according to the route guidance or has taken a route different from the route guidance (Yes in S.10), the control unit 300 performs processing to erase the "route guidance image" projected on the windshield 2 (S.11), and ends the display / erasure processing of the guidance image shown in Fig. 4. If the vehicle 1 has traveled according to the route guidance, the control unit 300 executes normal route guidance processing different from Fig. 4, and if the vehicle 1 has traveled along a route different from the route guidance, the control unit 300 performs a new route search and starts new route guidance processing.

[0071] If the vehicle 1 is not moving according to the route guidance and is not proceeding on a route different from the route guidance (No in S.10), it may be assumed that the vehicle 1 is waiting for a traffic light at an intersection where it should turn, or that the vehicle 1 is in the middle of turning but has not yet finished turning at the intersection, etc. In this case, the control unit 300 returns the process to S.09 and repeatedly executes the same process until it becomes clear whether the vehicle 1 has moved according to the route guidance or has moved on a route completely different from the route guidance.

[0072] If there are multiple "non-route guidance positions" between the "notification start position" and the "route guidance position," as already explained, the above-mentioned processes from S.06 to S.11 will be repeatedly executed as appropriate until it is clear whether the vehicle 1 has passed through all of the "non-route guidance positions" and moved according to the route guidance or whether the vehicle 1 has taken a route different from the route guidance.

[0073] As described above, in the HUD device 200 according to this embodiment, when the vehicle 1 advances to the "notification start position," first, the "non-route guidance image A" and the "non-route guidance image B" are displayed (projected) on the windshield 2, and then animation display processing is performed to smoothly (continuously) move the "route guidance image" (appearing to fly) from the foreground to the background of the "non-route guidance image A" and the "non-route guidance image B." This allows the viewer (driver) 4 to understand that the "route guidance position" is farther away than the "non-route guidance position A" and the "non-route guidance position B." Furthermore, not only is the viewer visually aware that the "route guidance position" is farther away than the positions where the "non-route guidance image A" and the "non-route guidance image B" are superimposed, but the difference in display positions between the "route guidance image" and the "non-route guidance image A" and the "non-route guidance image B" makes it possible to recognize the difference in distance in the real world (actual space).

[0074] Furthermore, when it is determined that the vehicle 1 has passed through the "non-route guidance distance zone B" and the "non-route guidance distance zone A," the display of the "non-route guidance image A" and the "non-route guidance image B" is erased (S.07 in Fig. 4), making it easier for the viewer (driver) 4 to understand that the vehicle 1 has passed the "non-route guidance position A" and the "non-route guidance position B." Furthermore, since the "non-route guidance image" does not continue to be displayed, the viewer (driver) 4 does not feel uncomfortable due to the continuous display.

[0075] Furthermore, even when multiple "non-route guidance positions" are set, "non-route guidance distance bands" are set individually, and the passing of each "non-route guidance position" is determined, and the display process (movement process / erasure process) of the corresponding "non-route guidance image" is performed. Therefore, by having the viewer (driver) 4 view each "non-route guidance image," the corresponding "non-route guidance position" can be easily and intuitively recognized.

[0076] Furthermore, when the vehicle 1 proceeds to the "notification start position," even if multiple "non-route guidance positions" are installed, multiple "non-route guidance images" are simultaneously displayed at once, making it possible to promptly notify the viewer (driver) 4 of the "non-route guidance positions." In particular, with the HUD device 200 according to the embodiment, when the vehicle 1 proceeds to the "notification start position," a process is performed (S.20) to erase the "route guidance image" projected on the windshield 2, and then a "non-route guidance image" is simultaneously displayed (S.21). This makes the display of the "non-route guidance image" stand out, making it easier for the viewer (driver) 4 to recognize the "non-route guidance image."

[0077] Although the HUD device and display control device of the present disclosure have been described in detail above with reference to the drawings, the HUD device and display control device of the present disclosure are not limited to the configurations of the HUD device 200 and the display control device 250 described in the embodiment. For example, the control unit 300 of the HUD device 200 described in the embodiment can change the size and position of the “route guidance image” (virtual object VOB) based on the perceived distance Ds and the visual angle 2θ, thereby making the viewer (driver) 4 perceive the “route guidance image” as if it is moving from the foreground to the background. In this way, adjusting the position and size of the “route guidance image” based on the perceived distance Ds and the visual angle 2θ is effective when using parallax to make the viewer (driver) 4 perceive a sense of depth. However, the method of making the viewer (driver) 4 perceive a sense of depth is not limited to this, and the position and size may also be adjusted using a planar (two-dimensionally displayed) “route guidance image.”

[0078] As already explained, the control unit 300 can perform display switching processing to switch between a 2D display and a 3D display of the route guidance image perceived (visually recognized) by the viewer (driver) 4, and when the route guidance image is to be viewed by the viewer (driver) 4 in a 2D display rather than a 3D display, a planar virtual image is displayed at the position of the virtual image display surface PS. In this way, when a planar (2D display) "route guidance image" is displayed, the control unit 300 does not need to adjust the position and size of the "route guidance image" based on the perception distance Ds and the visual angle 2θ, which makes it possible to reduce the processing load on the control unit 300.

[0079] Furthermore, in the HUD device 200 according to the embodiment, the control unit 300 receives information on the "route guidance position," "reporting start position," "non-route guidance position," "route guidance distance," and "non-route guidance distance" from the navigation device 160. However, the information acquired from the navigation device 160 is not limited to these pieces of information. For example, if the control unit 300 can acquire the "route guidance position" and the "reporting start position," it can calculate the "route guidance distance." Also, if the control unit 300 can acquire the "non-route guidance position" and the "reporting start position," it can calculate the "non-route guidance distance." Therefore, it is not necessarily necessary to acquire the "route guidance distance" or the "non-route guidance distance" from the navigation device 160.

[0080] Furthermore, in the HUD device 200 according to the embodiment, the range from the "report start position" to the "route guidance position" is defined as the "route guidance distance band," and the range from the "report start position" to the "non-route guidance position" is defined as the "non-route guidance distance band." The method for determining whether the vehicle 1 has reached a "route guidance position" or a "non-route guidance position" has been described. The method determines whether the vehicle 1 has passed through the "route guidance distance band" or the "non-route guidance distance band." However, without using distance-based information such as the "route guidance distance band" or the "non-route guidance distance band," it is also possible to determine whether the vehicle 1 has reached a "route guidance position" or a "non-route guidance position" based on the position information by acquiring position information based on GPS in real time. In this case, it is not necessary to use the "route guidance distance band" (route guidance distance) or the "non-route guidance distance band" (non-route guidance distance) as a determination criterion.

[0081] Furthermore, in the HUD device 200 according to the embodiment, as shown in FIGS. 9 to 12, a case has been described in which the "non-route guidance image A" and the "non-route guidance image B" are displayed only on the left side of the vehicle 1 in the traveling direction. In the HUD device 200 according to the embodiment, the description has been given on the assumption that the vehicle 1 turns left at the "route guidance position" based on route guidance, and therefore a case in which the "non-route guidance image" is also displayed only on the left side has been exemplified. However, the display position of the "non-route guidance image" is not limited to the left side. The "non-route guidance image" may be displayed anywhere as needed, such as on the right or left side of an intersection, and its display position is not particularly limited.

[0082] In addition, in the HUD device 200 according to the embodiment, the case where the "route guidance image" or the like is erased once (S.20) when the vehicle 1 proceeds to the "notification start position" has been described. However, in the "process of displaying the "route guidance image" or the like at a closer position (S.22)" that is performed thereafter, the previously displayed "route guidance image" may be erased.

[0083] Furthermore, the display control device 250 according to some embodiments may be provided outside the HUD device 200 (for example, on the vehicle 1 side). In this case, the display control device 250 acquires information from the communication unit 140, the ECU 150, the navigation device 160, etc., generates information for displaying an image, and outputs the information to the image display unit 230 (the HUD device 200). [Explanation of symbols]

[0084] 1...Vehicle 2...Windshield (projected area) 4...Visitor (driver) 100...In-vehicle systems 110...Eye detection camera 120...Stereo camera 130...Image processing unit 140...Communications Department 150...ECU 160 ...Navigation device 170 ...Radar section 200...Head-up display device (HUD device) 210...Stereoscopic display device 220 ...Image generation unit (image display means) 230 ...Image display unit (image display means) 240 ... Light beam separation unit (image display means) 250 ...Display control device 270...Optical system (image display means) 275 ... Curved mirror (image display means) 280…Information acquisition department 300 ...control unit (control means) 310 ... Virtual object size adjustment section 330 ... Perceptual distance calculation unit 340...Visual angle 2θ determining unit K1,K2…display light

Claims

1. an image display means for projecting a guide image onto a projection target portion, thereby superimposing the guide image on a view ahead of the vehicle; a control means for adjusting the guide image projected by the image display means to change the display position of the guide image viewed by a viewer in the vehicle in a near or far direction; and When the vehicle passes a notification start position that is located a predetermined distance before a route guidance position where route guidance is provided to the viewer, the control means At a non-route guidance position that is located between the notification start position and the route guidance position and where the route guidance should not be performed, a non-route guidance image that is to be viewed by the viewer is superimposed and displayed on the non-route guidance position by the image display means, a route guidance image for providing the route guidance at the route guidance position is adjusted so that it is viewed by the viewer in front of a display position of the non-route guidance image, and is displayed by the image display means; By adjusting the route guidance image displayed so as to be viewed in front of the display position of the non-route guidance image, the route guidance image displayed by the image display means is displayed so as to change from the front side to the back side of the display position of the non-route guidance image. A head-up display device characterized by:

2. The control means adjusts the route guidance image that has been changed to a position behind the non-route guidance image, and causes the image display means to superimpose and display the route guidance image at the route guidance position. The head-up display device according to claim 1 .

3. The control means erases the non-route guidance image that has been superimposed on the non-route guidance position when the vehicle passes the non-route guidance position.

3. The head-up display device according to claim 1 or 2, wherein:

4. When there are a plurality of non-route guidance positions located between the notification start position and the route guidance position, the control means causes the image display means to superimpose and display non-route guidance images corresponding to the respective non-route guidance positions, and simultaneously superimpose and display all of the non-route guidance images.

3. The head-up display device according to claim 1 or 2, wherein:

5. When there are a plurality of non-route guidance positions located between the notification start position and the route guidance position, The control means and then adjusting and displaying the route guidance image by the image display means so that the route guidance image is viewed closer to the user than the display position of the non-route guidance image superimposed on the non-route guidance position nearest to the notification start position among the plurality of non-route guidance positions. By adjusting the route guidance image displayed so that it is visually perceived in front of the display position of the non-route guidance image, the display position of the route guidance image displayed by the image display means is changed so that the viewer visually perceives the route guidance image as having moved from the front side of the display position of the non-route guidance image superimposed on the closest non-route guidance position to the back side of the display position of the non-route guidance image superimposed on the non-route guidance position farthest from the notification start position. The head-up display device according to claim 4 .

6. A display control device that controls a head-up display device that projects a guide image onto a projection target and superimposes the guide image on a view ahead of a vehicle, acquire information indicating a route guidance position where route guidance is to be performed and information indicating a non-route guidance position that is closer than the route guidance position and where route guidance is not to be performed, displaying a non-route guidance image at a position corresponding to the non-route guidance position; and a control unit that, after displaying the non-route guidance image, displays the route guidance image as if the non-route guidance image has moved from the front side to the back side. A display control device comprising:

Images