Display control device, display device, and display control method

Abstract

To realize display control that enables securing stable visual sensation by suppressing the sense of discomfort due to the fact that a vehicle mark indicating the position of the host vehicle disappears when the host vehicle approaches an intersection and a display image including a map changes from wide-area display to narrow-area display.SOLUTION: A control unit 83 shows first maps (M1, M2) in a first contraction scale which are aerial views overlooking the surrounding including ahead of a vehicle 1 and shows a vehicle mark 23 indicating the position of the vehicle 1 on the first maps (M1, M2) when the distance between the vehicle 1 and an intersection is larger than a first threshold TH1 under a driving situation where the vehicle 1 needs to turn left or a turn right at the intersection ahead. When the distance becomes smaller than or equal to the first threshold TH1, the vehicle mark 23 is erased, and second maps (M3-M5) which are aerial views overlooking the vicinity of the intersection are displayed in a second contraction scale larger than the first contraction scale, and a guidance mark 25 adjusted for contraction scale and indicating the travel direction of the vehicle is displayed on the first maps (M3-M5).SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present invention relates to a display control device, a display device, a display control method, and the like, which are mounted on a vehicle such as an automobile. [Background technology]

[0002] Patent Document 1 discloses a technology relating to map display that effectively avoids increasing the burden on the driver and enables the driver to intuitively grasp the points where he or she should make right or left turns without error.

[0003] Patent Document 2 also shows an example of a slope HUD (inclined surface HUD) in a Head-Up Display (HUD) device, in which a virtual virtual image display surface (imaging surface) that displays a virtual image is a flat or curved surface that is inclined with respect to the surface of the road on which the vehicle is traveling. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] International Publication No. WO2021 / 132553 [Patent Document 2] Patent Publication No. 2021-51231 Summary of the Invention [Problem to be solved by the invention]

[0005] (Prior Art) The content of the conventional technology shown in FIG. 2 of Patent Document 1 will be briefly described below with reference to FIG.

[0006] Here, FIG. 9 is a diagram showing a conventional technique having substantially the same contents as FIG. 2 of Patent Document 1. In FIG. In FIG. 9, for ease of explanation, some of the reference characters are different from those in FIG. 2 of Patent Document 1. Similarly, in FIG. 9, characters (for example, the words "wide area display" and "narrow area display") that are not shown in FIG. 2 of Patent Document 1 have been added.

[0007] In Figure 9, a driving scenario is assumed in which the vehicle travels straight on the road it is currently traveling on, turns left at the intersection ahead (here, a crossroads fork), travels straight on the road after the left turn, turns left at the next intersection (here, a T-shaped road fork that splits into left and right), and then travels straight a little further to reach the destination.

[0008] In FIG. 9, the HUD device displays a map corresponding to the above driving scene (a map as a bird's-eye view looking down on the front of the vehicle), and on the map, guide lines 200 indicating the travel route (a linear or band-like route guide displayed in a specified design (color, brightness, etc.), and displayed so as to be superimposed on the road surface), a vehicle mark 230 indicating the position of the vehicle, a destination mark 220 indicating the destination, icons of major buildings, etc. are displayed.

[0009] In addition, the HUD device switches the scale of the map depending on the guidance point (here, the distance to the fork in the road at the crossroads mentioned above) and performs scale change processing such as increasing the scale over time (wide-area display / narrow-area display switching control).

[0010] A-1 and A-2 in FIG. 9 show display examples (wide-area display examples) during the period until the distance between the vehicle and the guidance point (here, the intersection of the above-mentioned crossroads) reaches the first display switch determination distance TH10. In A-2, the scale (magnification) of the map etc. is increased compared to A-1 in response to the fact that the distance between the vehicle and the intersection has been shortened.

[0011] A-3 and A-4 in Figure 9 show display examples (first half display examples of narrow-area display) for a period when the distance between the vehicle and the guidance point (crossroads intersection) is greater than or equal to the first display switching determination distance TH10 and less than or equal to the second display switching determination distance TH20. In A-4, the scale (magnification) of the map etc. is increased compared to A-3 in response to the fact that the distance between the vehicle and the intersection has been shortened.

[0012] A-5 and A-6 in FIG. 9 show display examples (second half display examples of narrow area display) when the distance between the vehicle and the guidance point (crossroads intersection) exceeds the second display switch determination distance TH20. In A-5 and A-6 of FIG. 9, the enlargement of the scale (magnification) of the map, etc. is stopped. In A-5 of Fig. 9, the map, guide lines 200, and building icons are maintained. However, in A-5 of Fig. 9, a mark 270 indicating the route at the specified point (guidance point) after turning left is displayed. In A-6 of FIG. 9, the map is erased, and only a mark 270 indicating the route (having a base end 270A and an arrow 270B at the tip) is displayed.

[0013] (Problems discovered by the inventors of the present invention) As a result of investigations by the inventors of the present invention, the following problems have become apparent. (1) In FIG. 9 described above, at the timing of switching from the wide-area display to the narrow-area display (in other words, at the timing of the transition from A-2 to A-3 in FIG. 9), the vehicle mark (reference numeral 230) indicating the vehicle position is erased. This visual change can cause discomfort and confusion to the viewer. (2) The present inventors have considered applying the above-mentioned conventional technique shown in FIG. 9 to a slope HUD (inclined surface HUD). Here, in a slope HUD (inclined surface HUD), the vehicle mark (symbol 230) is displayed with a sense of depth according to the shape and inclination angle of the inclined virtual image display surface (in other words, on the road surface, it gives the viewer the visual sense of an emphasized depth extending from near to far), which has a significant impact on the viewer's vision. If the vehicle mark (230) that gives a distinctive visual effect with an emphasis on the sense of depth suddenly disappears when switching between the wide-area display and the narrow-area display, the viewer is more likely to feel the sense of disappearance. Therefore, it is preferable to take some kind of measure, especially when using a slope HUD. (3) In the conventional technology shown in FIG. 9, when the vehicle is turning left or right, no marks such as guide signs indicating the direction of travel are displayed. In this respect, there is a limit to improving the convenience of the HUD device (or, more broadly, a display device). The above problems have been identified by the present inventors.

[0014] One object of the present invention is to realize display control that suppresses the discomfort caused by the disappearance of the vehicle mark indicating the vehicle's position when the vehicle approaches an intersection and the display image including the map switches from a wide-area display to a narrow-area display, thereby ensuring stable vision. Another object of the present invention is to improve the convenience of the display device by making it possible to display marks such as guide signs indicating the direction of travel even when the vehicle is turning left or right.

[0015] Other objects of the present invention will become apparent to those skilled in the art by referring to the following exemplary aspects and best modes, as well as the accompanying drawings. [Means for solving the problem]

[0016] In order to facilitate an understanding of the outline of the present invention, embodiments according to the present invention will be exemplified below.

[0017] In a first aspect, the display control device is a display control device that is mounted on a vehicle and has a control unit that controls image display of a display device that allows an image to be viewed by a viewer who is a passenger of the vehicle, and when the vehicle is in a driving situation where it is necessary to turn left or right at an intersection ahead of the vehicle and the distance from the vehicle to the intersection is greater than a first threshold value, the control unit displays a first map that is a bird's-eye view of the surroundings including the front of the vehicle at a first scale, and displays a host vehicle mark having a predetermined shape that can indicate the position of the vehicle and the traveling direction of the vehicle on a map of the first map that corresponds to the road on which the vehicle is actually traveling. A wide-area display control is implemented in which the vehicle mark is displayed so as to be superimposed on a first road, and when the vehicle approaches the intersection and the distance from the vehicle to the intersection becomes equal to or less than the first threshold, the vehicle mark is erased and a second map which is a bird's-eye view of the area near the intersection is displayed at a second scale larger than the first scale, and a narrow-area display control is implemented in which a guide mark indicating the vehicle's direction of travel, which has a shape identical or similar to the specified shape of the vehicle mark, is displayed so as to be superimposed on the first road at a first position of the first road on the second map, with the scale adjusted so as not to interfere with the visibility of the intersection on the second map.

[0018] In the first mode, when switching from the wide-area display to the narrow-area display, a guide mark (guidance display) indicating the traveling direction of the own vehicle is displayed instead of the own vehicle mark indicating the own vehicle position. When a narrow-area display is used, the scale of the map becomes larger, but if the vehicle mark indicating the vehicle's position is displayed without being erased, the vehicle mark will be enlarged in accordance with the change in scale and may cover the route to the intersection on the map, making it difficult for the viewer to see. Therefore, in this embodiment, the vehicle mark is erased. However, on the other hand, in order to suppress the sense of incongruity and confusion caused by the disappearance of the vehicle mark, a guide mark having the same or similar shape as the vehicle mark, with the scale adjusted, is displayed.

[0019] In this embodiment, the vehicle mark itself is designed to have a predetermined shape (such as a triangle or an arrow shape) that can indicate the direction in which the vehicle is traveling, and therefore the vehicle mark not only serves as a mark indicating the vehicle's position, but also has the function of indicating the direction in which the vehicle is traveling. Therefore, if, instead of the vehicle mark that was displayed so as to overlap the road on the map, a guide mark of the same or a similar shape is displayed so as to overlap the same road and at an appropriate size that does not interfere with the view of the intersection on the map, for example, at a position slightly forward from the viewer's perspective (first position), even if the viewer perceives the guide mark within their field of vision, they will recognize it as having the same appearance as the vehicle mark just ahead, resulting in a seamless visual experience, and therefore the sense of discomfort and confusion caused by the disappearance of the vehicle mark can be sufficiently suppressed.

[0020] In a second aspect dependent on the first aspect, when the vehicle approaches the intersection further and the distance from the vehicle to the intersection becomes equal to or less than a second threshold value smaller than the first threshold value, the control unit may move the display position of the guidance mark from the first position to a second position that is farther away from the intersection on the second map as viewed by the viewer, or to a third position that overlaps with a branch road of the intersection on the second map, and may change the direction of travel indicated by the guidance mark to the direction in which the branch road extends.

[0021] In a second embodiment, the guide mark is also used as a route change guide indicating the direction of a left or right turn. Since the primary function of the guidance mark is to guide the vehicle in the direction of travel, it can be used not only to guide the vehicle along the route up to an intersection, but also as a route change guide showing the direction to turn left or right after reaching the intersection. This enables a variety of guidance displays that were previously not possible, improving the convenience of display devices such as HUD devices.

[0022] In a third aspect that is dependent on the first or second aspect, the control unit performs display control to display the display image as a virtual image on a virtual virtual image display surface that is a flat or curved surface inclined with respect to the surface of the road on which the vehicle is traveling, and the specified shape of the vehicle mark is a shape that causes the viewer to perceive a sense of depth corresponding to at least one of the shape of the virtual image display surface and the inclination angle with respect to the road surface, and the shape of the guidance mark is a shape that causes the viewer to perceive a sense of depth common to the sense of depth in the vehicle mark when the guidance mark is displayed in the same posture and position as the vehicle mark.

[0023] In the third embodiment, a display technology such as a slope HUD that displays an image (virtual image) on a virtual image display surface (imaging surface) that is an inclined surface is used. Here, when the vehicle mark is designed to allow the viewer to perceive an appropriate sense of depth in accordance with the shape of the virtual image display surface (imaging surface) and the inclination angle relative to the road surface, the guidance mark is also designed to have a shape that creates a common (in other words, the same (including approximately the same) or similar) sense of depth when displayed in the same posture and position. When using a slope HUD or the like, the vehicle mark is often displayed with a sense of depth depending on the shape and inclination angle of the inclined virtual image display surface (in other words, on the road surface, it gives the viewer the visual sense of enhanced depth, as if extending from near to far), which has a significant impact on the viewer's vision. If such a vehicle mark, which provides a distinctive visual appearance, suddenly disappears when switching between wide-area display and narrow-area display, the viewer is likely to feel a sense of disappearance. However, according to the present embodiment, when switching from wide-area display to narrow-area display, the sense of depth of each mark is the same, resulting in a seamless visual appearance, and therefore making it possible to sufficiently suppress any sense of discomfort or confusion.

[0024] In a fourth aspect dependent on the second aspect, the control unit may perform display mode change control to change at least one of the shape, pattern, color, and brightness of the guidance mark during a turning period in which the vehicle is turning in response to a left turn or a right turn, or to split the guidance mark into a plurality of images, or to split the guidance mark into a plurality of images and to change at least one of the shape, pattern, color, and brightness, or to split the guidance mark into a plurality of images and, upon the splitting, to provide a period in which one image before the split and the plurality of images after the split coexist, and to fade out the one image over time and to fade in the plurality of images over time, or to rotate the guidance mark around at least one coordinate axis of a display coordinate system used for displaying images, which is set in a space ahead of the vehicle, or to rotate the guidance mark around at least one coordinate axis of a local coordinate system set in the space ahead corresponding to the intersection.

[0025] In the fourth aspect, we assume that the guidance mark indicates the direction in which the vehicle will travel when turning left or right (in other words, the direction of turning left or right) (the case of the second aspect described above), and provide several examples of modifications to the display mode of the guidance mark in this case. For example, by changing at least one of the shape, pattern, color, and brightness of the guide mark, it becomes easier for the viewer to perceive the direction of travel. Also, for example, by splitting a single guide mark into multiple images and increasing the number of elements (guidance elements) that make up the guide mark, a display that is easier to see and allows for easier perception of direction can be realized. Furthermore, for example, a period can be set during which one image of the guide mark before it is split into multiple images (in other words, multiple guide elements) and a guide mark made up of the multiple images after that single image has been split into multiple images are displayed side by side, and the brightness of the single image is gradually decreased over time to fade it out, while the brightness of the guide mark made up of multiple images (multiple guide elements) is gradually increased over time to fade it in. This makes it possible to make the transition from the image before it is split to the image after it is split seamlessly with reduced sense of incongruity, and to realize a display that is easy to see and allows for easy perception of direction. In addition, by implementing display control that makes the brightness, color, etc. of some of the multiple images (multiple guidance elements) different from the brightness and color of the other images (other guidance elements) when fading in, visibility can be improved and directional perception can be made easier. Furthermore, for example, by rotating the guide mark around the coordinate axes of the display coordinate system or the coordinate axes of a local coordinate system that is set appropriately in accordance with the extension direction of a branch road at an intersection, the way the guide mark appears to the viewer can be appropriately and dynamically changed, thereby creating a novel visual experience and further improving visibility.

[0026] In a fifth aspect which is dependent on any one of the first to fourth aspects, the control unit may dynamically change the direction of travel indicated by the guidance mark to correspond to the turning of the vehicle by changing the display mode of the guidance mark during a turning period in which the vehicle is turning in response to a left or right turn.

[0027] In the fifth aspect, the guide mark can also be used as a turning guide indicating that the vehicle is turning smoothly when turning left or right, for example. Since the guidance mark's main function is to guide the vehicle's travel direction, it can be used not only to guide the vehicle along the route to an intersection, but also as a turning guide that dynamically shows changes in the vehicle's travel direction while the vehicle is turning after reaching the intersection. This enables a variety of guidance displays that were previously not possible, further improving the convenience of display devices such as HUD devices.

[0028] In a sixth aspect dependent on the fifth aspect, if it is determined that the actual turning trajectory of the vehicle deviates from a normal trajectory, the display mode of the guidance mark may be changed to a warning display that provides a warning to the viewer.

[0029] According to the sixth aspect, when a deviation from a normal turning path is detected during a turn of the vehicle, a warning can be issued by changing the display mode of the guide mark. This can, for example, encourage the viewer to perform an appropriate driving operation and assist in returning the vehicle to the normal turning path.

[0030] In a seventh aspect, a display device includes a display unit that displays an image, and a display control device according to any one of the first to sixth aspects.

[0031] According to the seventh aspect, a highly functional and user-friendly display device can be realized.

[0032] In an eighth aspect dependent on the seventh aspect, the display device may be a projection type display device that displays an image displayed on the display unit as a virtual image on a virtual image display surface by projecting display light of the image displayed on the display unit onto a projection target.

[0033] According to the eighth aspect, a projection type display device with high functionality and improved user-friendliness can be realized. Typically, a head-up display (HUD) device or a windshield display (WSD) device can be used as the projection type display device. The term "projection type display device" is to be interpreted in a broad sense. The projection target may be a windshield of a vehicle. The projection target may also be the glasses part of a glasses-type head-mounted display. In this case, the head-mounted display may be understood as a type of head-up display in the broad sense. Therefore, it can be included in the present invention.

[0034] In a ninth aspect, a display control method is a display control method for controlling image display of a display device mounted on a vehicle and allowing an image to be viewed by a viewer who is a passenger of the vehicle, and when the vehicle is in a driving situation where it is necessary to turn left or right at an intersection ahead of the vehicle and a distance from the vehicle to the intersection is greater than a first threshold value, a first map which is a bird's-eye view of the surroundings including the front of the vehicle is displayed at a first scale, and a host vehicle mark having a predetermined shape capable of indicating the position of the vehicle and indicating the traveling direction of the vehicle is displayed so as to be superimposed on a first road on the first map which corresponds to the road on which the vehicle is actually traveling. and when the vehicle approaches the intersection further and the distance from the vehicle to the intersection becomes equal to or less than the first threshold, performing a narrow-area display control of erasing the vehicle mark and displaying a second map which is a bird's-eye view of the vicinity of the intersection at a second scale larger than the first scale, and displaying a guide mark indicating the traveling direction of the vehicle and having a shape identical or similar to the predetermined shape of the vehicle mark at a first position of the first road on the second map, with the scale adjusted so as not to obstruct visibility of the intersection on the second map.

[0035] According to the ninth aspect, when the vehicle approaches an intersection and the display image including the map switches from a wide-area display to a narrow-area display, the sense of incongruity caused by the disappearance of the vehicle mark indicating the vehicle's position can be suppressed, and display control can be realized that ensures stable vision. [Brief description of the drawings]

[0036] [Figure 1] FIG. 1 is a diagram showing an example in which an image (virtual image) including a map and a host vehicle mark is displayed by a slope HUD (inclined surface HUD). [Diagram 2] FIG. 2 is a diagram showing an example of the configuration of a HUD device as a display device. [Diagram 3] FIG. 3 is a diagram showing an example of a wide-area display and a narrow-area display. [Figure 4] 4(A) and (B) are diagrams showing an example of a display using a guidance mark made up of a plurality of images (a plurality of guidance elements) in a narrow-area display. [Diagram 5] FIG. 5 is a diagram showing another example of display (an example in which fade-in and fade-out are performed in parallel) using a guidance mark made up of a plurality of images (a plurality of guidance elements) in narrow-area display. [Figure 6] FIG. 6 is a diagram showing other examples of the wide-area display and the narrow-area display (including an example in which the guidance mark is rotated around the coordinate axis). [Figure 7] FIG. 7 is a diagram showing still another example of the wide-area display and the narrow-area display (including a display example during a turning period of the host vehicle). [Figure 8] FIG. 8 is a flowchart showing an example of a display control procedure. [Figure 9] FIG. 9 is a diagram showing an example of a conventional wide-area display and narrow-area display. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0037] The best mode described below is used to easily understand the present invention. Therefore, those skilled in the art should be aware that the present invention is not unduly limited by the mode described below.

[0038] (First embodiment) Please refer to Fig. 1. Fig. 1 is a diagram showing an example in which an image (virtual image) including a map and a host vehicle mark is displayed by a slope HUD (inclined surface HUD). In Fig. 1, the width direction of the vehicle 1 is defined as the X direction (lateral direction), the height direction of the vehicle 1 is defined as the Y direction (up-down direction), and the direction indicating the forward and backward directions of the vehicle 1 is defined as the Z direction (front-rear direction). This also applies to Figs. 3, 4, 6, and 7.

[0039] Furthermore, although the term "mark" is used in the following description, this term can be replaced with a synonymous term such as an icon.

[0040] In A-1 of Fig. 1, an in-vehicle HUD device 100 is housed in a dashboard 41 of a vehicle 1. The HUD device 100 can display an image (virtual image) V1 (see A-2 of Fig. 1) on virtual image display surfaces (imaging surfaces) PSa to PSc, which are virtual inclined surfaces. In the following description, the technology for displaying an image (virtual image) on an inclined virtual image display surface (imaging surface), or a HUD device capable of such display, may be referred to as a "slope HUD (inclined surface HUD)."

[0041] The device body 120 of the HUD device 100 has a display (image generating unit) 150 such as a liquid crystal panel, a screen (display unit) 151 with a display surface 164, a curved mirror (concave mirror, etc.) 170 with a light reflecting surface 179, and a control unit 83 that controls the display of images.

[0042] The curved mirror 170 is a component of the display optical system 95. The display 150, the screen 151, and the curved mirror 170 constitute a projection unit 93.

[0043] The curved mirror 170 reflects light from the screen (display unit) 151 and projects (projects) the display light K onto a windshield (projected member) 2 provided in the vehicle 1. A part of the display light K is reflected by the windshield (projected member) 2 and enters the viewpoint (eye) 3 of a viewer (e.g., a driver) 5 as a passenger aboard the vehicle 1, and a virtual image is displayed on the virtual image display surfaces PSa to PSc.

[0044] Each of the virtual image display surfaces PSa to PSc is a virtual inclined surface that is inclined with respect to the road surface 6. The virtual image display surface PSa has a planar shape, and the virtual image display surfaces PSb and PSc have a curved shape.

[0045] In addition, a part of the virtual image display surface PSc is located lower than the road surface 6. The image (virtual image) formed on this part is actually recognized in the mind of the viewer 5 as if it were superimposed on the road surface 6.

[0046] The curvature of the reflecting surface 179 of the curved mirror (concave mirror, etc.) 170 is not made uniform, but for example, it is made a free-form surface, and the reflectance can be changed appropriately depending on the vertical position, thereby making it possible to change the shape of the virtual image display surface and the inclination angle with respect to the road surface 6 (symbol θ of A-2 in Figure 1).

[0047] In A-2 of Fig. 1, a flat virtual image display surface PSa is used. As shown in A-2 of Fig. 1, an image (virtual image) V1 is displayed in an area near the end of the virtual image display surface PSa that is closer to the viewer 5 (in other words, an area on the near side as viewed from the viewer 5).

[0048] A-3 of Figure 1 shows, as an actual scene ahead of the vehicle 1, a road (straight road) 11' on which the vehicle 1 is currently traveling, a left turn road 12' and a right turn road 14' that constitute the branch roads at the intersection, a virtual virtual image display surface PSa, and an image (virtual image) V1 displayed in the area of ​​the virtual image display surface PSa that is closer to the viewer 5.

[0049] The virtual image V1 includes a map M1 of the surroundings including the area ahead of the vehicle 1, a destination indication (destination mark) 22, and a host vehicle mark 23 indicating the position of the vehicle (host vehicle) 1.

[0050] The map M1 includes a road (straight road) 11 on the map which corresponds to the road (straight road) 11' (road as the actual scene) on which the vehicle 1 is currently traveling, a left-turn road 12 on the map which corresponds to a left-turn road 12' as the actual scene, a right-turn road 14 on the map which corresponds to a right-turn road 14' as the actual scene, guide lines 20 indicating the travel route, and a vehicle mark (vehicle icon) 23 indicating the vehicle's position.

[0051] The guide line 20 is a route guide displayed in a line or band shape with a predetermined design (color, brightness, etc.), and is preferably displayed so as to be superimposed on the road surface. In A-3 of Fig. 1, the guide line 20 is represented by a black band-shaped figure superimposed on the road surface.

[0052] Here, the vehicle mark 23 has a shape designed to emphasize a sense of depth according to the shape, inclination angle, etc. of the virtual image display surface PSa. As described above, the vehicle mark 23 has a function of indicating the vehicle position, and further has a function of indicating the traveling direction of the vehicle.

[0053] In other words, the vehicle mark 23 is configured in a shape capable of indicating the traveling direction of the vehicle 1 (for example, a triangle or an arrow shape).

[0054] Specifically, the vehicle mark 23 is in the shape of an arrow close to a triangle in A-3 of FIG. 1, and the traveling direction of the vehicle 1 can be indicated by the direction of the apex (top) of the tip of the shape.

[0055] In addition, the vehicle mark 23 can be configured in the shape of a three-dimensional arrow as shown in A-4 of FIG. 1, or in the shape of a three-dimensional arrow similar to a boomerang as shown in A-5 of FIG. 1.

[0056] The vehicle mark 23 having such a shape can indicate the traveling direction of the vehicle 1 depending on the orientation of the apex (top) at the tip of the figure (arrow).

[0057] In the examples of A-4 and A-5 in FIG. 1, the vehicle mark 23 has a three-dimensional shape in order to realize a more easily visible display (however, the present invention is not limited to this).

[0058] As described above, the host vehicle mark 23 is designed so that the sense of depth is emphasized according to the shape and inclination angle of the virtual image display surface (imaging surface) PSa, which is an inclined surface. In other words, in a preferred example, the vehicle mark 23 has a predetermined shape, and the predetermined shape is designed to cause the viewer 5 to perceive a sense of depth corresponding to at least one of the shape of the virtual image display surface PSa and the inclination angle θ with respect to the road surface 6.

[0059] In the example of A-3 in Figure 1, since the distance between the vehicle (host vehicle) 1 and the intersection is greater than the first threshold value (symbol TH1 in Figure 3), the control unit 83 displays the virtual image V1 as a wide-area display (sometimes referred to as a "small-world display").

[0060] Furthermore, when the vehicle (own vehicle) 1 approaches the intersection and the distance between the vehicle (own vehicle) 1 and the intersection becomes equal to or less than a first threshold value TH1, the control unit 83 enlarges the scale of the map and displays the virtual image V1 as a narrow-area display (sometimes referred to as a "semi-AR display").

[0061] In this embodiment, in order to suppress the sense of incongruity felt by the viewer 5 due to the disappearance of the vehicle mark 23 when switching from the wide-area display to the narrow-area display, the control unit 83 displays a guide mark (reference numeral 25 in FIG. 3) having the same or similar shape as the vehicle mark 23 (and preferably a shape that allows the viewer 5 to perceive a common sense of depth) at a position close to the intersection on the map (a position slightly ahead as seen by the viewer 5) of the road 11 on the map that corresponds to the road 11' on which the vehicle 1 is currently traveling, immediately after the start of the narrow-area display. Details of this point will be described later.

[0062] Next, reference will be made to Fig. 2. Fig. 2 is a diagram showing an example of the configuration of a HUD device as a display device.

[0063] The display system 115 includes a communication unit 65, a navigation device 70, an ECU (Electronic Control Unit) 77 capable of collecting various types of vehicle information and the like, and a HUD device 100.

[0064] The navigation device 70 includes a navigation information acquisition unit 71 and map information 74. The navigation information acquisition unit 71 includes a driving route information acquisition unit 72 and a host vehicle position information acquisition unit 73. The map information 74 includes host vehicle position information 75 and a display database 76.

[0065] The HUD device 100 includes a display control device (processor) 80 and a projection unit 93.

[0066] The projection unit 93 includes a display unit (a screen having a display surface 164 in the example of A-1 in FIG. 1) 151 and a display optical system 95 (having a curved mirror 170).

[0067] The display control device (processor) 80 includes an information acquisition unit 81, a storage 82, and a control unit 83 that controls the display of images.

[0068] The control unit 83 has a wide area / narrow area switching control unit 84 that switches between wide area display and narrow area display, a wide area display control unit 85 (having a vehicle mark display control unit 86 that controls the display of the vehicle mark 23), and a narrow area display control unit 87.

[0069] The narrow-area display control unit 87 has a vehicle mark erasure control unit 88 that erases the vehicle mark 23 when switching from wide-area display to narrow-area display, and a guidance mark display control unit 89 that performs display control such as displaying the guidance mark 25 instead of the vehicle mark 23.

[0070] The guidance mark display control unit 89 has a pre-vehicle turning display control unit 90 that controls the display of the guidance mark 25 before the host vehicle 1 turns by turning left or right, and a host vehicle turning period display control unit 91 that controls the display of the guidance mark 25 during the turning period when the host vehicle 1 is turning by turning left or right.

[0071] Next, reference is made to Fig. 3. Fig. 3 is a diagram showing an example of a wide-area display and a narrow-area display. Here, as previously shown in A-3 of FIG. 1, a driving situation is assumed in which the vehicle (host vehicle) 1 needs to make a left turn (or a right turn) at an intersection ahead.

[0072] A-1 in FIG. 3 shows a navigation image including a map M1 and a vehicle mark 23 indicating the vehicle position.

[0073] The content of the display image of A-1 in FIG. 3 is the same as that previously explained in A-3 in FIG. 1, and therefore a duplicated detailed explanation will be omitted.

[0074] In A-1 of FIG. 3, a map M1 is displayed at a first scale.

[0075] In addition, in A-1 of FIG. 3, a vehicle mark 23 having a predetermined shape (for example, the arrow shapes shown in A-3 to A-5 of FIG. 1) that indicates the position of the vehicle and can indicate the traveling direction of the vehicle is displayed on the map M1 so as to be superimposed on the road 11 on the map M1 that corresponds to the actual road 11' along which the vehicle 1 is actually traveling.

[0076] In addition, in this embodiment, the vehicle mark 23 has a shape designed to emphasize the sense of depth depending on the shape and inclination angle θ of the virtual image display surface PSa shown in A-3 of Figure 1.

[0077] In A-2 of Fig. 3, the scale of the display image is enlarged as the vehicle 1 moves forward. In other words, in A-2 of Fig. 3, the map M2 and the host vehicle mark 23, the size of which is slightly enlarged, are displayed.

[0078] 3 are displayed, the distance between the vehicle 1 and the intersection in the actual scene is greater than the first threshold TH1, so a wide-area display (small-world display) is being performed. In other words, the maps M1 and M2 are bird's-eye views of the surroundings including the front.

[0079] On the maps M1 and M2, the route along which vehicle 1 should travel is displayed by guide lines (here, band-like figures with adjusted color, brightness, etc., that are displayed superimposed on the route (road) along which vehicle 1 should travel: shown as black band-like figures in the figure) 20, and at the destination, a display of the destination (destination icon) 22 is displayed.

[0080] 3, the distance between the vehicle 1 and the intersection in the real scene is equal to or smaller than the first threshold value TH1, so the display is switched from the wide-area display (small world display) to the narrow-area display (semi-AR display). As a result, the scale of the map is increased. In FIG. 3A-3, the scale of map M3 is a second scale that is larger than the first scale.

[0081] In A-3 of Figure 3, map M3 is a much larger map (a bird's-eye view of the intersection area) than map M2 shown in A-2 of Figure 3, and the main buildings are shown quite large.

[0082] 3, the vehicle mark 23 indicating the vehicle position that was displayed immediately before is erased, and instead, a guide mark 25 indicating the traveling direction of the vehicle 1 is displayed at a first position Q1 indicated by a dashed ellipse. Such display control is performed by the vehicle before turning display control unit 90 shown in FIG.

[0083] When the map is displayed in a narrow area, the scale of the map becomes larger, but if the vehicle mark 23 indicating the vehicle position is displayed without being erased, the vehicle mark 23 will be enlarged in accordance with the change in scale, and may cover the route to the intersection on the map, making it difficult for the viewer to see. Therefore, the vehicle mark 23 is erased. However, in order to reduce the sense of incongruity caused by the visual change caused by the erasure, the guide mark 25 is displayed at the first position Q1 instead of the vehicle mark 23.

[0084] The first position Q1 is set to a position slightly ahead of the viewer 5 and close to an intersection on the map.

[0085] The scale of the guide mark 25 is adjusted so as not to obstruct the view of the intersection on the map. The guide mark 25 has the same or similar shape as the vehicle mark 23 that was displayed immediately before, and preferably has a shape that has the same sense of depth.

[0086] As explained above, when a slope HUD or the like is used, the vehicle mark 23 is often displayed with a sense of depth depending on the shape and inclination angle of the inclined virtual image display surface PSa, etc. (in other words, on the road surface 6, it gives the viewer 5 the visual impression of an emphasized sense of depth extending from near to far), which has a large impact on the vision of the viewer 5.

[0087] If the vehicle mark 23, which provides such a distinctive visual effect, suddenly disappears when switching between wide-area display and narrow-area display, the viewer 5 is likely to feel a sense of loss. However, by displaying a guide mark 25 of the same or similar shape (preferably with a common sense of depth) in place of the vehicle mark 23 when switching from wide-area display to narrow-area display, a seamless visual effect (visual continuity) is obtained, and the sense of discomfort is reduced.

[0088] Moreover, the guidance mark 25 shown in A-3 of FIG. 3 is oriented in the same direction as the vehicle mark 23 displayed in A-2 of FIG. 3 immediately before (the direction instructing the vehicle 1 to go straight).

[0089] 3A-2, the vehicle mark 23 is displayed so as to overlap the straight road 11. Similarly, in FIG. 3A-3, the guide mark 25 is displayed so as to overlap the straight road 11.

[0090] 3, when the viewer 5 perceives the guide mark 25 in his / her field of vision, even if the guide mark appears to be displayed slightly ahead (far away) from the viewer 5's perspective, the viewer 5 will recognize it as the same visual appearance as the vehicle mark 23 that was displayed just before. This makes it possible to realize a seamless visual appearance (visual continuity), and to sufficiently suppress discomfort and confusion.

[0091] In this way, even if a guidance mark 25 of the same or similar shape (preferably a shape with the same sense of depth) is displayed slightly forward from the viewer in place of the host vehicle mark 23 immediately after switching from wide-area display to narrow-area display, in a preferred example, the guidance mark 25 is displayed so as to overlap the straight road 11, just like the host vehicle mark 23, indicate the same direction, and is displayed at an appropriate size that does not interfere with the view of the intersection on the map. Therefore, even if the viewer perceives the guidance mark 25 within their field of vision, they will recognize it as having the same appearance as the host vehicle mark 23 just ahead, resulting in a seamless visual experience, and therefore the sense of discomfort and confusion caused by the disappearance of the host vehicle mark 23 can be sufficiently suppressed.

[0092] It is also possible to omit A-3 in FIG. 3 and move from A-2 in FIG. 3 to A-4 or A-5 in FIG. 3 abruptly and display guide marks 25, 25 indicating a left turn. In this case, however, the visual change would be large and sudden, which may cause a sense of discomfort.

[0093] Therefore, first, at A-3 in FIG. 3, a guide mark 25 indicating to go straight is displayed near the intersection on the map (first position Q1 near the intersection a little ahead as seen by the viewer 5) to ensure natural vision.

[0094] In A-4 and A-5 in FIG. 3, the distance between the vehicle 1 and the intersection in the actual scene is equal to or less than the second threshold TH2 which is smaller than the first threshold.

[0095] Accordingly, in A-4 of Figure 3, the display position of the guidance mark 25 is moved from the first position Q1 in A-3 of Figure 3 to a second position Q2 (indicated by a dashed ellipse in the figure), which is farther away from the intersection on the map as viewed by the viewer 5, and the orientation of the guidance mark 25 is changed so that the direction of travel indicated by the guidance mark 25 is changed to the extension direction (leftward) of the branch road (specifically, the left turn road 12).

[0096] In addition, in A-5 of FIG. 3, the display position of the guidance mark 25 is moved from the first position Q1 in A-3 of FIG. 3 to a third position Q3 (indicated by a dashed oval in the figure), which is the position of the branch road at the intersection on the map, and the travel direction indicated by the guidance mark 25 is changed to the extension direction (left direction) of the branch road (specifically, the left turn road 12).

[0097] In other words, in A-4 and A-5 in FIG. 3, the guide mark 25 is also used as a route change guide indicating the direction of a left turn (or a right turn).

[0098] Since the guidance mark 25 is a mark whose main function is to guide the vehicle in the direction of travel, it can be used not only to guide the vehicle 1 along the route up to the intersection, but also as a route change guide showing the direction of left and right turns after reaching the intersection.

[0099] This enables a variety of guidance displays that were not possible with the conventional technology, thereby improving the convenience of the HUD device 100 (or, in a broader sense, a display device).

[0100] In addition, in A-4 and A-5 of Figures 3, the display mode of the guidance mark 25 (for example, at least one of the shape, pattern, color, and brightness of the guidance mark) may be changed to a mode different from that of the guidance mark 25 in A-3 of Figure 3. This can enhance the visual effect when indicating the direction, making it easier for the viewer 5 to perceive the direction of movement.

[0101] Second Embodiment Next, reference is made to Fig. 4. Fig. 4(A) and (B) are diagrams showing an example of a display using a guidance mark made up of a plurality of images (a plurality of guidance elements) in a narrow-area display.

[0102] Previously, A-4 and A-5 in FIG. 3 show examples in which the guide mark 25 is used to indicate the traveling direction of the vehicle 1 when turning left. Similarly, FIGS. 4(A) and (B) also show examples in which the guide mark 25 is used to indicate the traveling direction of the vehicle 1 when turning left. However, in Figures 4(A) and (B), a single image is split into multiple images (multiple guide elements) and the display mode of each of the multiple split images (multiple guide elements) is changed, thereby enhancing the visual effect when indicating direction, which differs from A-4 and A-5 in Figure 3. It is assumed that the map M4 shown in A-4 of FIG. 3 is displayed in FIGS. 4(A) and 4(B).

[0103] 4A, a plurality of divided images (a plurality of guide elements) 28a to 28d are displayed at a fourth portion Q4. Each of these images (each of the guide elements) 28a to 28d is assembled to form one guide mark 28.

[0104] In Fig. 4(B), at the fifth portion Q5, a plurality of divided images (a plurality of guide elements) 29a-29d are displayed, and the display manner of each of the divided images (a plurality of guide elements) 29a-29d is changed to further enhance the visual effect when indicating the direction. Note that each of these images (each of the guide elements) 29a-29d is collected to form one guide mark 29.

[0105] In this way, in Figures 4(A) and (B), the guide mark 25, which was displayed as a single image in A-4 of Figure 3 described above, is split into multiple images (multiple guide elements) 28a-28d, 29a-29d, and by increasing the number of elements (guide elements) that make up the guide mark, a display that is easier to see and allows for easier perception of direction can be achieved.

[0106] (Third embodiment) Next, reference is made to Fig. 5. Fig. 5 is a diagram showing another example of display (an example in which fade-in and fade-out are performed in parallel) using a guidance mark made up of multiple images (multiple guidance elements) in narrow-area display.

[0107] In FIG. 5, the guide mark 25 shown in A-4 of FIG. 3 and the guide mark 29 also shown in FIG. 4(B) are used in combination, and a process of fading out one of them and a process of fading in the other are used in combination.

[0108] In A-1 of FIG. 5, the guide mark 25, which is one image before division, is displayed at normal brightness. In A-2 of FIG. 5, the multiple images (in other words, multiple guide elements) 29a to 29d after division are displayed with low brightness, while the brightness of the guide mark 25, which is one image, is reduced. In A-3 of FIG. 5, the brightness of the multiple images (multiple guide elements) 29a to 29d after division is increased, while the brightness of the guide mark 25, which is one image, is decreased. In A-4 of FIG. 5, the brightness of the multiple images (multiple guide elements) 29a to 29d after division is increased, while the guide mark 25, which is a single image, becomes invisible. In A-5 of FIG. 5, the image (guidance element) 29a located at the right end of the multiple images (multiple guidance elements) 29a to 29d is subjected to a highlighting process, for example, by displaying it in a different color or with higher brightness. In A-6 of FIG. 5, an image (guide element) 29b is highlighted, in A-7 of FIG. 5, an image (guide element) 29c is highlighted, and in A-8 of FIG. 5, an image (guide element) 29d is highlighted.

[0109] In this way, a period is provided during which a single image 25 before splitting and an image consisting of multiple images (multiple guidance elements) 29a-29d after splitting are displayed side by side, and the brightness of the single image 25 is gradually decreased over time to fade it out, while the brightness of the guidance mark consisting of multiple images (multiple guidance elements) 29a-29d is gradually increased over time to fade it in. This makes it possible to make the transition from the image 25 before splitting to the images 29a-29d after splitting a seamless transition with reduced discomfort, and to realize a display that is easy to see and allows for easy perception of direction. In addition, when fading in, display control can be implemented to make the brightness or color, etc. of some of the multiple images (multiple guidance elements) 29a to 29d different from the brightness or color of the other images (other guidance elements), thereby improving visibility and making it easier to perceive direction.

[0110] (Fourth embodiment) Next, reference is made to Fig. 6. Fig. 6 is a diagram showing other examples of wide-area display and narrow-area display (including an example in which a guidance mark is rotated around a coordinate axis). In FIG. 6, a display process is performed in which the guidance mark 25 is rotated around at least one coordinate axis of a display coordinate system (here, an XYZ Cartesian coordinate system) used to display images, which is set in the space ahead of the vehicle 1. Note that a display mode change control may be performed in which the display is rotated around at least one coordinate axis of a local coordinate system (not shown) that is set in the space ahead in correspondence with the intersection.

[0111] In Fig. 6, A-1 to A-3 in Fig. 6 are the same as A-1 to A-3 in the previously shown Fig. 3. Also, A-4 in Fig. 6 is the same as A-4 in the previously shown Fig. 3.

[0112] A-5 in FIG. 6 shows an example of how the guide mark 25 appears when viewed from the Z direction (direction along the Z axis) in the XYZ orthogonal coordinate system. A-6 in FIG. 6 shows how the guide mark 25 shown in A-5 in FIG. 6 appears when viewed from the X direction (the direction along the X axis).

[0113] A-7 in Figure 6 shows how the guide mark 25 shown in A-5 in Figure 6 appears when rotated a predetermined angle around the X-axis in the XYZ Cartesian coordinate system and viewed from the Z direction (the direction along the Z-axis). A-8 in FIG. 6 shows how the guide mark 25 shown in A-7 in FIG. 6 appears when viewed from the X direction (the direction along the X axis).

[0114] As can be seen by comparing A-5 and A-6 in Figure 6 with A-7 and A-8 in Figure 6, even if it is the same guide mark 25, the way the guide mark 25 appears to the viewer 5 is quite different before and after the guide mark 25 is rotated by a predetermined angle around the X-axis.

[0115] In this way, by rotating the guidance mark 25 around at least one coordinate axis of the display coordinate system (XYZ Cartesian coordinate system) or at least one coordinate axis of a local coordinate system (not shown) that is set appropriately in accordance with the extension direction of the branch road at an intersection, the appearance of the guidance mark 25 from the viewer 5 can be appropriately and dynamically changed, thereby creating, for example, a novel visual sensation and further improving the visibility of the guidance mark 25 when turning left (or right).

[0116] Fifth embodiment Next, reference is made to Fig. 7. Fig. 7 is a diagram showing still another example of the wide-area display and the narrow-area display (including a display example during a turning period of the host vehicle).

[0117] In Fig. 7, A-1 to A-3 in Fig. 7 are the same as A-1 to A-3 in the previously shown Fig. 3. Also, A-4 in Fig. 7 is the same as A-4 in the previously shown Fig. 3.

[0118] A-4 to A-8 in Fig. 7 show display examples during the turning period of the vehicle 1. Note that display control of guidance marks and the like during the turning period of the host vehicle is performed by the display control unit 91 during the turning period of the host vehicle previously shown in Fig. 2.

[0119] In the seventh, A-4 to A-8, no map is displayed, but guide lines 20 and guide marks 25 are displayed.

[0120] In A-4 to A-8 of Figure 7, the guidance mark 25 is used as a turning guidance display (a guidance display that shows the direction of the vehicle 1 as it turns) that indicates, for example, that the vehicle 1 is turning smoothly when turning left or right.

[0121] Since the guidance mark 25 is a mark whose main function is to guide the direction of travel of the vehicle 1, it can be used not only to guide the vehicle along the route up to the intersection, but also as a turning guide that dynamically shows changes in the direction of travel of the vehicle 1 while it is turning after reaching the intersection. This enables a variety of guidance displays that were not possible with the prior art, and the convenience of display devices such as the HUD device 100 can be further improved.

[0122] In A-5 to A-7 of Fig. 7, no map is displayed, but guide lines (black arrow shapes) 20 are shown. Also, an arrow 20A indicating a direction is displayed at the tip of the guide line 20. Also, in A-8 of Fig. 7, only the arrow 20A at the tip of the guide line 20 is shown.

[0123] The guide line 20 shown in A-5 to A-8 in FIG. 7 corresponds to the guide line 270 shown in A-6 in FIG. 9 described above.

[0124] As shown in A-5 to A-8 in FIG. 7, the shape of the guide mark 25 changes dynamically in response to the left turn of the vehicle 1. In order to cause this change in shape, for example, the technique of rotating guide mark 25 around a coordinate axis of a coordinate system (for example, at least one of the X-axis, Y-axis, and Z-axis in an XYZ orthogonal coordinate system) as previously described in A-5 to A-8 of Figure 6 can be appropriately used.

[0125] 7A-7, the vehicle 1 finishes turning, and the guide mark 25 returns to the display state before the turn. In FIG. 7A-7, the guide mark 25 is displayed so as to overlap the arrow 20A at the tip of the guide line 20.

[0126] In this way, by utilizing the guidance mark 25 as a turning guide that dynamically indicates changes in the direction of travel of the vehicle 1 even while the vehicle 1 is turning, it becomes possible to provide diverse and dynamic guidance displays that were not previously possible, thereby further improving the convenience of display devices such as the HUD device 100.

[0127] Sixth embodiment In this embodiment, the guide mark 25 is also used as a warning indicator.

[0128] In A-4 to A-8 of Figure 7 described above (display of guidance mark 25 during the turning period of vehicle 1), if the control unit 83 determines that the actual turning trajectory of vehicle 1 deviates from the normal trajectory, the control unit 83 may change the display mode of the guidance mark 25 to a warning display that issues a warning to the viewer.

[0129] For example, the guidance marks 25 in A-4 to A-8 of Figure 7 shown above can be colored a predetermined color (e.g., red or yellow) and the colored guidance marks 25 can be made to flash, thereby issuing a warning to the viewer 5.

[0130] In this way, according to the sixth embodiment, when a deviation from a normal trajectory is recognized during a turn of the vehicle 1, a warning can be issued by changing the display mode of the guide mark 25. This makes it possible to, for example, encourage the viewer 5 to perform an appropriate driving operation and assist in returning the vehicle to a normal trajectory.

[0131] Eighth embodiment FIG. 8 is a flowchart showing an example of a display control procedure.

[0132] In step S1, information acquisition processing is performed. Specifically, for example, in step S11, navigation information acquisition processing is performed.

[0133] In step S2, a wide-area display process S2 is performed. Specifically, in step S21, display control of guide lines is performed, and in step S22, display control of the destination is performed.

[0134] In step S23, display control of the vehicle mark indicating the vehicle position is performed. This vehicle mark is also displayed in the conventional example of Figure 9 described above, but the vehicle mark in this embodiment preferably has a sense of depth adjusted to fit the inclined surface serving as the virtual image display surface, and has a shape that can indicate the direction of travel (such as a triangular shape or an arrow shape, including three-dimensional shapes), and in this respect is essentially different from the conventional example of Figure 9.

[0135] In step S3, wide area / narrow area switching processing is performed.

[0136] Furthermore, in step S4, narrow area display processing is carried out. Specifically, in step S41, a scale change control of the display image is performed, and in step S42, a host vehicle mark erasure control is performed.

[0137] In step S43, display control is performed on a guidance mark near the intersection that has a shape inherited from the shape of the vehicle mark (the same or a similar shape, and preferably a shape that also has a common sense of depth).

[0138] In a preferred example, immediately after wide-area / narrow-area switching, in order to reduce any discomfort felt by the viewer, the vehicle mark is displayed in the same direction of travel (and on the same road) as before the switch, and then display control is implemented to change the orientation of the vehicle mark to the direction corresponding to the left / right turn (the direction in which the branching road extends).

[0139] In a preferred example, various display mode change processes can be implemented. For example, the design of the guide mark, including its shape, pattern, and color, may be changed. Also, control may be performed to split the guide mark into multiple marks. Also, transition control (fade-in / fade-out control) from the pre-split guide mark to the post-split guide mark may be performed. In addition, a rotation control may be implemented in which the guide mark is rotated around the coordinate axis of the display system or the coordinate axis of the local coordinate system set corresponding to the intersection.

[0140] In step S44, display control of the guidance mark during the turning period of the host vehicle (preferably dynamic display control in which the display form (shape of the guidance mark, etc.) is dynamically changed) is performed.

[0141] In step S45, it is determined whether or not to end the display of the map display (navigation image). If the answer is Y, the display is ended, and if the answer is N, the process returns to step S1.

[0142] According to this embodiment, when the vehicle approaches an intersection and the display image including the map switches from a wide-area display to a narrow-area display, it is possible to realize a display control method that suppresses the discomfort caused by the disappearance of the vehicle mark indicating the vehicle's position and ensures stable vision.

[0143] As described above, according to the present invention, when the vehicle approaches an intersection and the display image including the map switches from a wide-area display to a narrow-area display, it is possible to suppress the discomfort caused by the disappearance of the vehicle mark indicating the vehicle's position, and to realize display control that ensures stable vision.

[0144] Furthermore, according to the present invention, it is possible to display dynamic marks such as guide signs indicating the direction of travel even while the vehicle is turning left or right, thereby improving the convenience of the display device.

[0145] Furthermore, according to the present invention, a display device or a projection display device with high functionality and improved convenience can be realized. As the projection display device, a head-up display (HUD) device or a windshield display (WSD) device can typically be used. The term "projection display device" is to be interpreted in a broad sense.

[0146] The projection target member onto which the image is projected may be a windshield of a vehicle, etc. The projection target member may be the eyeglasses of a glasses-type head-mounted display, in which case the head-mounted display may be understood as a type of head-up display in a broad sense, and thus may be included in the present invention.

[0147] The present invention is not limited to the above-described embodiment, and various modifications and applications are possible. For example, the guide mark may have a function of indicating the traveling direction of the vehicle as well as a function of issuing a warning. The shape of the guide mark may be a triangle or an arrow, but is not limited thereto, and various shapes may be used.

[0148] Additionally, the HUD device and display system also include those used as simulators (for example, aircraft simulators, simulators as game devices, etc.).

[0149] In the above-described embodiment, the projection display device has been mainly described as an HUD device, but the present invention is not limited to this, and for example, an in-car projector or the like can also be used.

[0150] The present invention is not limited to the above-described exemplary embodiments, and those skilled in the art could easily modify the above-described exemplary embodiments to the extent that they fall within the scope of the claims. [Explanation of symbols]

[0151] 1...vehicle, host vehicle, host vehicle, 2...projected member (windshield, etc.), 5...viewer (driver, etc.) who is a passenger in the vehicle, 3...point of view (eyes), 6...road surface, 11...road on which the vehicle is traveling on the map (straight road), 11'...road on which the vehicle is traveling in the real scene (straight road), 12...branching road (left turn road) at an intersection on the map, 12'...branching road (left turn road) at an intersection in the real scene, 14...branching road (left turn road) at an intersection on the map, a branch road (right turn road) at an intersection in a real scene, 14' a branch road (right turn road) at an intersection in a real scene, 22 a destination display (destination mark), 20 a guide line, 20A an arrow at the tip of the guide line, 23 (23a, 23b) a vehicle mark, 25 a guide mark, 28 a to 28 d, 29 a to 29 d an image after splitting (guide element), 41 a dashboard, 65 a communication unit, 70 a navigation device, 71 a navigation information acquisition unit, 72 a driving Route information acquisition unit, 73... Vehicle position information acquisition unit, 74... Map information, 75... Vehicle position information, 76... Display database, 77... ECU, 81... Information acquisition unit, 82... Storage, 83... Control unit, 84... Wide area / narrow area switching control unit, 85... Wide area display control unit, 86... Vehicle mark display control unit, 87... Narrow area display control unit, 88... Vehicle mark deletion control unit, 89... Guidance mark display control unit, 90... Vehicle turning front display display control unit, 91... display control unit during vehicle turning period, 93... projection unit, 95... display optical system, 100... HUD device, 115... display system, 150... display device (image generating unit) such as an LCD panel, 151... display unit (screen or the like) 164... display surface, 170... curved mirror, 179... reflecting surface, PSa to PSc... virtual image display surface (imaging surface), K... display light, V1... image (virtual image), M1 to M4... map (map image).

Claims

1. A display control device having a control unit that is mounted on a vehicle and controls image display of a display device that allows an image to be viewed by a viewer who is a passenger of the vehicle, The control unit is In a driving situation in which the vehicle needs to turn left or right at an intersection ahead, when the distance from the vehicle to the intersection is greater than a first threshold value, A first map is displayed at a first scale, the first map being a bird's-eye view of the surroundings including the front of the vehicle. performing a wide-area display control for displaying a vehicle mark having a predetermined shape capable of indicating the position of the vehicle and the traveling direction of the vehicle, so as to be superimposed on a first road on the first map corresponding to the road on which the vehicle is actually traveling; When the vehicle approaches the intersection further and the distance from the vehicle to the intersection becomes equal to or less than the first threshold value, The vehicle mark is erased, displaying a second map, which is a bird's-eye view of the vicinity of the intersection, at a second scale larger than the first scale; A guide mark indicating a traveling direction of the vehicle, the guide mark having a shape identical or similar to the predetermined shape of the vehicle mark, Adjusting the scale so as not to obstruct the visibility of the intersection on the second map, performing narrow-area display control to display the first road on the second map at a first position of the first road so as to overlap the first road; Display control device.

2. The control unit is When the vehicle approaches the intersection further and the distance from the vehicle to the intersection becomes equal to or less than a second threshold value that is smaller than the first threshold value, a display position of the guidance mark is moved from the first position to a second position that is farther away from the intersection on the second map as seen by the viewer, or to a third position that is a position of a branch road at the intersection on the second map, and a traveling direction indicated by the guidance mark is changed to an extension direction of the branch road; The display control device according to claim 1 .

3. The control unit is A display control is performed to display a display image as a virtual image on a virtual virtual image display surface which is a plane or a curved surface inclined with respect to a road surface on which the vehicle is traveling, and The predetermined shape of the vehicle mark is a shape that allows the viewer to perceive a sense of depth corresponding to at least one of the shape of the virtual image display surface and an inclination angle with respect to the road surface, The shape of the guidance mark is such that, when the guidance mark is displayed in the same posture and at the same position as the vehicle mark, the viewer perceives a sense of depth common to the sense of depth of the vehicle mark. The display control device according to claim 1 .

4. The control unit is Regarding the guide mark, A display mode change control for changing at least one of the shape, pattern, color, and brightness; Or, A display mode change control for dividing the guide mark into a plurality of images; Or, A display mode change control for dividing the guide mark into a plurality of images and changing at least one of the shape, pattern, color, and brightness; Or, a display mode change control for splitting the guide mark into a plurality of images, providing a period during which one image before the split and the plurality of images after the split coexist, fading out the one image over time, and fading in the plurality of images over time; Or, a display mode change control for rotating the guide mark around at least one coordinate axis of a display coordinate system used for displaying an image, which is set in a space ahead of the vehicle, or for rotating the guide mark around at least one coordinate axis of a local coordinate system set in the space ahead of the vehicle in correspondence with the intersection; The display control device according to claim 2 , which performs the above.

5. The control unit is During a turning period in which the vehicle is turning left or right, changing a display mode of the guidance mark to dynamically change a traveling direction indicated by the guidance mark so as to correspond to the turning of the vehicle; The display control device according to claim 1 .

6. The control unit is when it is determined that the actual turning trajectory of the vehicle deviates from a normal trajectory, the display mode of the guide mark is changed to a display mode of a warning display that issues a warning to the viewer. The display control device according to claim 5 .

7. A display unit for displaying an image; A display control device according to any one of claims 1 to 6, A display device having the above configuration.

8. The display device is a projection type display device that projects display light of an image displayed on the display unit onto a projection target, thereby displaying the image as a virtual image on a virtual image display surface. The display device according to claim 7.

9. A display control method for controlling image display of a display device mounted on a vehicle and allowing an image to be viewed by a viewer who is a passenger of the vehicle, comprising: a step of performing wide-area display control in which, under a driving situation in which the vehicle needs to make a left or right turn at an intersection ahead, when a distance from the vehicle to the intersection is greater than a first threshold, a first map which is a bird's-eye view of the surroundings including the area ahead of the vehicle is displayed at a first scale, and a host vehicle mark having a predetermined shape capable of indicating the position of the vehicle and the traveling direction of the vehicle is displayed so as to be superimposed on a first road on the first map which corresponds to the road on which the vehicle is actually traveling; a step of performing narrow-area display control in which, when the vehicle approaches the intersection further and the distance from the vehicle to the intersection becomes equal to or less than the first threshold value, the vehicle mark is erased, and a second map which is a bird's-eye view of the vicinity of the intersection is displayed at a second scale larger than the first scale, and a guide mark indicating the traveling direction of the vehicle and having a shape identical or similar to the predetermined shape of the vehicle mark is displayed at a first position of the first road on the second map so as to overlap the road, with the scale adjusted so as not to obstruct visibility of the intersection on the second map; A display control method comprising:

Images