Display control device, display device, and display control method

Abstract

In a display control device, a display device, and a display control method, a control unit (83), when a distance between a vehicle and an intersection is greater than a first threshold value in a driving condition in which the vehicle needs to turn left or right at the intersection ahead, controls the vehicle to turn left or right at the intersection ahead. A first map, which is a top view from which the surroundings including the front of the vehicle are overlooked, is displayed on a first scale, a host vehicle mark (23) indicating the position of the vehicle is displayed on the first map, and when the distance is equal to or less than a first threshold value, the host vehicle mark is cancelled, and when the distance is equal to or less than a second threshold value, the host vehicle mark is cancelled. A second map, which is a top view from the vicinity of the intersection, is displayed on a second scale larger than the first scale, and a guide mark (25) indicating the traveling direction of the vehicle after scale adjustment is displayed on the first map. The display control implemented by the present invention can suppress a sense of incongruity caused by disappearance of an own vehicle mark indicating the position of the own vehicle when the own vehicle approaches an intersection and a display image including a map is switched from a wide-area display to a narrow-area display, and can ensure a stable vision.

Description

Technical Field

[0001] The present invention relates to a display control device, a display device, a display control method, etc., which are mounted on a vehicle such as an automobile. Background Art

[0002] Patent Document 1 discloses a technology related to map display, which can effectively avoid an increase in the burden on the driver and accurately and intuitively grasp the location of a right turn, a left turn, etc.

[0003] Patent Document 2 discloses an example of a head-up display (HUD) device in which a virtual image display surface (imaging surface) that displays a virtual image is a flat or curved surface that is inclined relative to the road surface on which the vehicle is traveling.

[0004] Prior art literature

[0005] Patent Literature

[0006] Patent Document 1: International Publication No. WO2021 / 132553

[0007] Patent Document 2: Japanese Patent Application Publication No. 2021-51231

[0008] Problems to be solved by the invention

[0009] (Prior Art)

[0010] Below, refer to Fig. 9 Briefly explain the patent document 1 Figure 2 The content of the recorded prior art.

[0011] Here, Fig. 9 This is in accordance with Patent Document 1. Figure 2 Figures of prior art with substantially the same content.

[0012] In addition, Fig. 9 In order to facilitate the explanation, part of the symbols are used in conjunction with those in Patent Document 1. Figure 2 The symbols are different.

[0013] In addition, similarly, Fig. 9 Add Patent Document 1 Figure 2 Words not described in the specification (for example, the terms "wide-area display" and "narrow-area display").

[0014] exist Fig. 9In the figure, a driving scenario is assumed in which the vehicle goes straight on the road it is currently traveling on, turns left at the intersection ahead (here, the fork in the road at the crossroads), goes straight on the road after the left turn, turns left at the next intersection (here, the fork in the road at a T-junction that splits to the left and right), and then goes straight slightly to reach the destination.

[0015] exist Fig. 9 In the embodiment of the present invention, a map corresponding to the above-mentioned driving scenario (a map as a bird's-eye view of the front of the vehicle) is displayed through the HUD device, on which are displayed guide lines (linear or strip-shaped, route guidance displayed with a specified appearance (color or brightness, etc.) and displayed in a manner overlapping with the road surface) 200 indicating the moving path, a vehicle mark 230 indicating the position of the vehicle, a destination mark 220 indicating the destination, icons of major buildings, etc.

[0016] In addition, the HUD device switches the scale of the map according to the guidance point (here, the distance from the branch point of the above-mentioned intersection) and implements scale change processing such as increasing the scale as time passes (switching control of wide-area display / narrow-area display).

[0017] Fig. 9 A-1 and A-2 show display examples (display examples of wide-area display) during a period until the distance between the host vehicle and the guidance point (here, the intersection of the crossroads) reaches the first display switching determination distance TH10.

[0018] In A-2, the scale (magnification) of the map or the like is increased compared to A-1 in response to the reduction in the distance between the host vehicle and the intersection.

[0019] Fig. 9 A-3 and A-4 show display examples (display examples of the first half of the narrow-area display) when the distance between the vehicle and the guidance point (intersection of the crossroads) is greater than the first display switching determination distance TH10 and less than the second display switching determination distance TH20.

[0020] In A-4, the scale (magnification) of the map or the like is increased compared to A-3 in accordance with the reduction in the distance between the host vehicle and the intersection.

[0021] Fig. 9 A-5 and A-6 show display examples (display examples of the second half of the narrow area display) when the distance between the host vehicle and the guidance point (intersection of the crossroad) is greater than the second display switching determination distance TH20.

[0022] exist Fig. 9 In A-5 and A-6 of FIG. 1 , the enlargement of the scale (magnification) of the map etc. is stopped.

[0023] exist Fig. 9 In A-5 of FIG. 1 , the map, guide line 200, and building icons are displayed. Fig. 9 In A-5 of FIG. 1 , a mark 270 is displayed indicating a travel route at a predetermined point (guidance point) after turning left.

[0024] exist Fig. 9 In A-6 of FIG. 1 , the map is deleted and only a mark 270 (having a base end portion 270A and an arrow 270B at a top end portion) indicating the travel route is displayed.

[0025] (Technical Problem Discovered by the Inventors of the Present Invention)

[0026] As a result of studies conducted by the inventors of the present invention, the following technical problems were clarified.

[0027] (1) In the above Fig. 9 In the case of switching from wide-area display to narrow-area display (in other words, from Fig. 9 At the time of transfer from A-2 to A-3), the vehicle mark (symbol 230) indicating the position of the vehicle is deleted.

[0028] This visual change may cause a visual observer to feel a sense of disharmony or confusion.

[0029] (2) The present inventors conducted the above Fig. 9 The prior art shown is applied to the research of bevel HUD (inclined surface HUD).

[0030] Here, in the slope HUD (inclined surface HUD), the vehicle mark (symbol 230) is displayed in a manner having a sense of depth (in other words, on the road surface, from the perspective of a visual observer, in a manner that gives a sense of depth that is enhanced as if extending from near to far) according to the shape or inclination angle of the inclined virtual image display surface, which has a greater impact on the vision of the visual observer.

[0031] If the vehicle mark (symbol 230) with enhanced depth and characteristic visual sense suddenly disappears when switching between wide-area display and narrow-area display, the possibility of the visual observer feeling the disappearance increases. Therefore, it is preferable to adopt some countermeasure, especially when using a sloped HUD.

[0032] (3) In the above Fig. 9 In the prior art, when the vehicle turns left or right, the guide display indicating the direction of travel and other signs are not displayed at all. In this regard, the improvement in convenience of the HUD device (display device in a broad sense) is limited.

[0033] The present inventors have found out the above technical problems. Summary of the invention

[0034] One object of the present invention is to provide a display control device, a display device and a display control method, which realize a display control that can suppress the sense of disharmony caused by the disappearance of the vehicle mark indicating the position of the vehicle when the display image including the map switches from the wide-area display to the narrow-area display when the vehicle approaches an intersection, thereby ensuring stable visual display control.

[0035] Another object of the present invention is to display signs such as guide displays indicating the direction of travel while the vehicle is turning left or right, thereby improving the convenience of the display device.

[0036] Other objects of the present invention will be apparent to those skilled in the art by referring to the following exemplary technical solutions and optimal implementations and the accompanying drawings.

[0037] Means for solving problems

[0038] In order to easily understand the outline of the present invention, the technical aspects of the present invention are exemplified below.

[0039] The first technical solution is a display control device, which is installed in a vehicle and has a control unit that controls the image display of a display device that enables a visual observer who is a passenger of the vehicle to visually observe the image, wherein the control unit, in a driving situation where the vehicle needs to turn left or right at an intersection ahead, when the distance from the vehicle to the intersection is greater than a first threshold, implements displaying a first map that is a bird's-eye view of the surroundings ahead of the vehicle using a first scale, and places a vehicle mark of a specified shape that can indicate the position of the vehicle and the direction of travel of the vehicle in alignment with the first map corresponding to the road on which the vehicle is actually traveling. The invention relates to a wide-area display control in which the vehicle is displayed in an overlapping manner with the first road on the map; when the vehicle further approaches the intersection so that the distance from the vehicle to the intersection is below the first threshold value, the vehicle mark is deleted, and a second map is displayed as a bird's-eye view of the vicinity of the intersection using a second scale larger than the first scale; a guide mark indicating the direction of travel of the vehicle and having a shape that is the same as or similar to the prescribed shape of the vehicle mark is adjusted in scale so as not to hinder visual observation of the intersection on the second map; and a narrow-area display control is implemented in which the vehicle is displayed at a first position of the first road on the second map in an overlapping manner with the road.

[0040] In the first aspect, when switching from the wide-area display to the narrow-area display, a guide mark (guide display) indicating the traveling direction of the vehicle is displayed instead of the vehicle mark indicating the position of the vehicle.

[0041] When it becomes a narrow-area display, the scale of the map is increased. However, if the display is performed without canceling the vehicle mark indicating the vehicle's position, it is conceivable that the vehicle mark will be enlarged corresponding to the above-mentioned change in scale, resulting in covering the path to the intersection on the map, making visual observation difficult for the visual observer.

[0042] Therefore, in this technical solution, the vehicle mark is cancelled.

[0043] However, on the other hand, in order to suppress the sense of incongruity or confusion caused by the disappearance of the own vehicle mark, a guide mark having the same or similar shape as the own vehicle mark after adjusting its scale is displayed.

[0044] In this technical solution, the vehicle mark itself is designed to have a specified shape (a triangle or arrow shape, etc.) that can indicate the direction of travel of the vehicle. Therefore, the vehicle mark not only serves as a mark indicating the position of the vehicle, but also has the function of indicating the direction of travel of the vehicle.

[0045] Accordingly, instead of displaying the own vehicle mark in a manner overlapping with the road on the map, a guide mark of the same or similar shape is displayed in a manner overlapping with the same road and in an appropriate size that does not hinder the visual observation of the intersection on the map. For example, when displayed at a position slightly forward (first position) as viewed from a visual observer, even if the visual observer perceives the guide mark in the field of vision, it will be recognized as the same visual as the previous own vehicle mark, so that uninterrupted vision can be obtained, thereby fully suppressing the sense of disharmony or confusion caused by the disappearance of the own vehicle mark.

[0046] In a second technical solution subordinate to the first technical solution, the control unit may, when the vehicle further approaches the intersection and the distance from the vehicle to the intersection is below a second threshold value which is smaller than the first threshold value, move the display position of the guide mark from the first position to a second position which is farther than the intersection on the second map as viewed by the visual observer or to a third position which overlaps with a branch road of the intersection on the second map, and change the direction of travel indicated by the guide mark to an extension direction of the branch road.

[0047] In the second technical solution, the guide mark is also used as a route change guide indicating the direction of left turn or right turn.

[0048] The guide mark is a mark whose main function is to guide the vehicle's travel direction. Therefore, it not only guides the vehicle on the route to the intersection, but can also be used as a route change guide to indicate the direction of left or right turn after reaching the intersection.

[0049] This makes it possible to provide various guidance displays that were not possible before, and improve the convenience of display devices such as HUD devices.

[0050] In a third technical solution subordinate to the first technical solution or the second technical solution, the control unit may implement display control to display the display image as a virtual image on a plane or curved surface that is inclined relative to the road surface of the road on which the vehicle is traveling, i.e., a virtual virtual image display surface, and the specified shape of the own vehicle mark is a shape that enables the visual observer to perceive a sense of depth corresponding to at least one of the shape of the virtual image display surface and the inclination angle relative to the road surface, and the shape of the guide mark is a shape that enables the visual observer to perceive a sense of depth that is the same as the sense of depth of the own vehicle mark when displayed in the same posture and at the same position as the own vehicle mark.

[0051] In the third technical solution, a display technology such as an inclined surface HUD is used to display an image (virtual image) on an inclined virtual image display surface (imaging surface).

[0052] Here, in a case where the vehicle markings are designed to enable the visual observer to perceive an appropriate sense of depth in a manner corresponding to the shape of the virtual image display surface (imaging surface) or the inclination angle relative to the road surface, the guide markings are also shaped to produce a common (in other words, the same (including substantially the same) or similar) sense of depth when displayed in the same posture and at the same position.

[0053] When using a sloped HUD, etc., the vehicle markings are mostly displayed in a manner that gives a sense of depth (in other words, on the road surface, from the perspective of the visual observer, a sense of depth is enhanced as if extending from near to far) based on the shape or tilt angle of the inclined virtual image display surface, which has a greater impact on the visual observer's vision.

[0054] When this vehicle mark that is endowed with a characteristic visual sense suddenly disappears when switching between wide-area display and narrow-area display, the possibility of the visual observer feeling the disappearance increases. However, according to the present technical solution, when switching from wide-area display to narrow-area display, since the depth sense of each mark is the same, an uninterrupted vision is obtained, thereby being able to fully suppress the sense of incoordination or confusion.

[0055] In the fourth technical scheme subordinate to the second technical scheme, the control unit may implement display mode change control of changing at least one of the shape, pattern, color and brightness of the guide mark during the turning period of the vehicle corresponding to the left turn or the right turn, or the display mode change control of splitting the guide mark into multiple images, or the display mode change control of splitting the guide mark into multiple images and changing at least one of the shape, pattern, color and brightness, or the display mode change control of splitting the guide mark into multiple images and setting a period in which the one image before the split and the multiple images after the split coexist, so that the one image gradually darkens with the passage of time and the multiple images gradually brightens with the passage of time, or the display mode change control of rotating the guide mark around at least one coordinate axis of a display coordinate system for displaying images set in the space in front of the vehicle, or the display mode change control of rotating around at least one coordinate axis of a local coordinate system set in the space in front of the vehicle corresponding to the intersection.

[0056] In the fourth technical solution, assuming that the guide mark indicates the direction of travel of the vehicle when turning left or right (in other words, the direction of turning left or right) (the case of the second technical solution mentioned above), multiple examples of changes in the display method of the guide mark in this case are given.

[0057] For example, with respect to the guide mark, by changing at least one of the shape, pattern, color, and brightness, it is easy for the visual observer to perceive the moving direction.

[0058] In addition, for example, by splitting a guide mark as one image into multiple images and increasing the number of elements (guide elements) constituting the guide mark, a display that is easier to see and easier to perceive the direction can be achieved.

[0059] In addition, for example, during the coexistence and display of an image of a guide mark before splitting and a guide mark composed of the multiple images after the one image is split into multiple images (in other words, multiple guide elements), the brightness of one image is gradually reduced to make it darker over time, and on the other hand, the brightness of the guide mark composed of the multiple images (multiple guide elements) is gradually increased to make it brighter over time. This allows the transition from the image before splitting to the image after splitting to be an uninterrupted transition with reduced sense of disharmony, thereby enabling a display that is easy to observe and easy to perceive the direction.

[0060] In addition, when the light gradually brightens, by implementing display control that makes the brightness or color of a part of the multiple images (multiple guiding elements) different from the brightness or color of other images (other guiding elements), it is possible to further improve the observability and make the perception of direction easier.

[0061] In addition, for example, by rotating the guide mark around the coordinate axis of the display coordinate system or around the coordinate axis of a local coordinate system appropriately set corresponding to the extension direction of the branch road at the intersection, the visual effect of the guide mark observed by the visual observer can be appropriately and dynamically changed, thereby producing a novel visual effect and further improving the observability.

[0062] In the fifth technical scheme belonging to any one of the first technical scheme to the fourth technical scheme, the control unit can dynamically change the direction of travel indicated by the guide mark in a manner corresponding to the turn of the vehicle by changing the display method of the guide mark during the turning of the vehicle corresponding to the left turn or the right turn.

[0063] In the fifth aspect, the guide mark can also be used as a turning guide or the like indicating that the vehicle turns smoothly, for example, along with a left turn or a right turn.

[0064] Since the guidance mark is a mark whose main function is to guide the direction of travel of the vehicle, it not only guides the route to the intersection, but can also be flexibly used as a turning guidance that dynamically indicates the change in the direction of travel of the vehicle when turning after reaching the intersection.

[0065] This makes it possible to provide various guidance displays that were not possible before, and can further improve the convenience of display devices such as HUD devices.

[0066] In a sixth technical solution subordinate to the fifth technical solution, when it is determined that the actual turning trajectory of the vehicle deviates from a normal trajectory, the display mode of the guide mark may be changed to a warning display for giving a warning to the visual observer.

[0067] According to the sixth technical solution, when the vehicle is turning and a turn that deviates from the normal track is confirmed, a warning can be given by changing the display mode of the guide mark. Thus, for example, the visual observer can be prompted to perform appropriate driving operations and assist in returning to the normal track.

[0068] In a seventh technical solution, a display device includes: a display unit that displays an image; and the display control device according to any one of the first to sixth technical solutions.

[0069] According to the seventh technical solution, a display device with high functionality and improved convenience can be realized.

[0070] In an eighth technical solution dependent on the seventh technical solution, the display device may be a projection type display device that displays the image as a virtual image on a virtual image display surface by projecting display light of the image displayed on the display unit toward a projection target component.

[0071] According to the eighth aspect, it is possible to realize a projection display device having high functionality and improved convenience.

[0072] In addition, as a projection type display device, a head-up display (HUD) device or a windshield display (WSD) device can be typically used. The term "projection type display device" is interpreted in a broad sense. The projected component can be a windshield of a vehicle, etc. In addition, the projected component can also be the glasses part of a glasses-type head-mounted display. In this case, the head-mounted display can be understood as a kind of head-up display in a broad sense. Therefore, it can be included in the present invention.

[0073] The ninth technical solution is a display control method, which controls the image display of a display device mounted on a vehicle so that a visual observer who is a passenger of the vehicle can visually observe the image, wherein the method includes: in a driving situation where the vehicle needs to turn left or right at an intersection ahead, when the distance from the vehicle to the intersection is greater than a first threshold, a first map is displayed using a first scale as a bird's-eye view of the surroundings in front of the vehicle, and a vehicle mark with a specified shape that can indicate the position of the vehicle and the direction of travel of the vehicle is overlapped with a first road on the first map corresponding to the road on which the vehicle is actually traveling. and a step of controlling a wide-area display in which a host vehicle mark is displayed in an overlapping manner when the vehicle further approaches the intersection so that the distance from the vehicle to the intersection is less than the first threshold value, deleting the host vehicle mark, and displaying a second map as a bird's-eye view of the vicinity of the intersection using a second scale larger than the first scale, adjusting the scale of a guide mark indicating the direction of travel of the vehicle having a shape identical or similar to the prescribed shape of the host vehicle mark in a manner not to hinder visual observation of the intersection on the second map, and controlling a narrow-area display in which the host vehicle mark is displayed at a first position of the first road on the second map in an overlapping manner with the road.

[0074] According to the ninth technical solution, when the vehicle approaches an intersection and the display image including the map switches from wide-area display to narrow-area display, the sense of incongruity caused by the cancellation of the vehicle mark indicating the vehicle's position can be suppressed, thereby ensuring stable visual display control. BRIEF DESCRIPTION OF THE DRAWINGS

[0075] Figure 1This is a diagram showing an example of a case where an image (virtual image) including a map and a vehicle symbol is displayed by a slope HUD (inclined surface HUD).

[0076] Figure 2 This is a diagram showing an example of the structure of a HUD device as a display device.

[0077] Figure 3 This is a diagram showing an example of wide-area display and narrow-area display.

[0078] Figure 4 (A) and (B) are diagrams showing an example of display using a guide mark composed of a plurality of images (a plurality of guide elements) in a narrow-area display.

[0079] Figure 5 This is a diagram showing another example of display using a guide mark composed of a plurality of images (a plurality of guide elements) in a narrow-area display (an example of performing fade-in and fade-out in parallel at the same time).

[0080] Figure 6 It is a diagram showing another example of wide-area display and narrow-area display (including an example of rotating the guide mark around the coordinate axis).

[0081] Figure 7 It is a diagram showing still another example of the wide-area display and the narrow-area display (including a display example during a turning period of the host vehicle).

[0082] Figure 8 This is a flowchart showing an example of the display control procedure.

[0083] Fig. 9 It is a diagram showing an example of wide-area display and narrow-area display according to the conventional technology.

[0084] Explanation of symbols

[0085] 1: vehicle, own vehicle, own vehicle;

[0086] 2: Projected parts (windshield, etc.);

[0087] 5: Visual observers who are passengers of the vehicle (driver, etc.);

[0088] 3: Viewpoint (eyes);

[0089] 6: Road surface;

[0090] 11: The road on which the vehicle is traveling on the map (straight route);

[0091] 11': The road on which the vehicle is traveling in the real scene (straight route);

[0092] 12: The fork in the road at the intersection on the map (left turn);

[0093] 12': The fork road (left turn road) at the real intersection;

[0094] 14: The fork in the road at the intersection on the map (right turn);

[0095] 14': The fork in the road at the real intersection (right turn);

[0096] 22: Display of destination (destination mark);

[0097] 20: guide line;

[0098] 20A: arrow at the top of the guide wire;

[0099] 23 (23a, 23b): Vehicle mark;

[0100] 25: guide mark;

[0101] 28a-28d, 29a-29d: images after splitting (guiding elements);

[0102] 41: Dashboard;

[0103] 65: Ministry of Communications;

[0104] 70: Navigation device;

[0105] 71: navigation information acquisition unit;

[0106] 72: driving path information acquisition unit;

[0107] 73: vehicle position information acquisition unit;

[0108] 74: map information;

[0109] 75: vehicle location information;

[0110] 76: Display database;

[0111] 77: ECU;

[0112] 81: Information acquisition department;

[0113] 82: memory;

[0114] 83: Control Department;

[0115] 84: wide area / narrow area switching control unit;

[0116] 85: wide area display control unit;

[0117] 86: vehicle mark display control unit;

[0118] 87: narrow-band display control unit;

[0119] 88: Vehicle mark deletion control unit;

[0120] 89: guide mark display control unit;

[0121] 90: Display control unit before turning of the vehicle;

[0122] 91: Display control unit during turning of the vehicle;

[0123] 93: Projection Department;

[0124] 95: display optical system;

[0125] 100: HUD device;

[0126] 115: Display system;

[0127] 150: a display such as a liquid crystal panel (image generating unit);

[0128] 151: display unit (screen, etc.);

[0129] 164: display surface;

[0130] 170: curved mirror;

[0131] 179: reflective surface;

[0132] PSa~PSc: virtual image display surface (imaging surface);

[0133] K: display light;

[0134] V1: image (virtual image);

[0135] M1~M4: Map (map image). DETAILED DESCRIPTION

[0136] The best embodiment described below is for easy understanding of the present invention. Therefore, those skilled in the art should note that the present invention is not improperly limited to the embodiment described below.

[0137] (First Embodiment)

[0138] Reference Figure 1 . Figure 1 This is a diagram showing an example of a case where an image (virtual image) including a map and a vehicle symbol is displayed by a slope HUD (inclined surface HUD).

[0139] In addition, Figure 1 In the diagram, the width direction of the vehicle 1 is defined as the X direction (lateral direction), the height direction of the vehicle 1 is defined as the Y direction (up and down direction), and the direction indicating the forward and backward directions of the vehicle 1 is defined as the Z direction (front and back direction). Figure 3 , Figure 4 , Figure 6 , Figure 7 The same is true in Chinese.

[0140] In the following description, the term "mark" is used, but this term can be replaced with a term having the same meaning as "icon".

[0141] exist Figure 1 In A-1 of the present invention, the vehicle-mounted HUD device 100 is housed in the instrument panel 41 of the vehicle 1. The HUD device 100 can display an image (virtual image) V1 (see FIG. 1 ) on virtual image display surfaces (imaging surfaces) PSa to PSc, which are virtual inclined surfaces. Figure 1 A-2).

[0142] In the following description, a technology for displaying an image (virtual image) on an inclined virtual image display surface (imaging surface) or a HUD device capable of such display may be referred to as a "slanted surface HUD".

[0143] The equipment body 120 of the HUD device 100 has: a display (image generating unit) 150 such as a liquid crystal panel; a screen (display unit) 151, which has a display surface 164; a curved mirror (concave mirror, etc.) 170, which has a light reflecting surface 179; and a control unit 83, which implements image display control.

[0144] The curved mirror 170 is a component of the display optical system 95. In addition, the display 150, the screen 151, and the curved mirror 170 constitute the projection unit 93.

[0145] The curved mirror 170 reflects the light from the screen (display unit) 151, and projects (projects) the display light K onto the windshield (projected component) 2 provided on the vehicle 1. A portion of the display light K is reflected by the windshield (projected component) 2, and enters the viewpoint (eye) 3 of the visual observer (e.g., the driver) 5 who is a passenger in the vehicle 1, and a virtual image is displayed on the virtual image display surfaces PSa to PSc.

[0146] The virtual image display surfaces PSa to PSc are all virtual inclined surfaces inclined with respect to the road surface 6. The virtual image display surface PSa is in a flat shape, and the virtual image display surfaces PSb and PSc are in a curved shape.

[0147] In addition, a part of the virtual image display surface PSc is located at a position lower than the road surface 6. The image (virtual image) formed on this part is actually recognized as overlapping with the road surface 6 in the brain of the visual observer 5.

[0148] By making the curvature of the reflecting surface 179 of the curved mirror (concave mirror, etc.) 170 inconsistent, for example, as a free-form surface, the reflectivity thereof is appropriately changed according to the position in the vertical direction, thereby changing the shape of the virtual image display surface or the inclination angle ( Figure 1 The symbol θ of A-2).

[0149] exist Figure 1 In A-2, a virtual image display surface PSa is used as a plane. Figure 1 As shown in A-2 of FIG. 1 , the image (virtual image) V1 is displayed in a region near the end of the virtual image display surface PSa on the side close to the visual observer 5 (in other words, a region on the front side as viewed from the visual observer 5 ).

[0150] exist Figure 1 In A-3, there are shown the road (straight route) 11' on which the vehicle 1 is currently traveling, which is the real scene in front of the vehicle 1, the left turn road 12' and the right turn road 14' that are the forks in the road constituting the intersection, the virtual virtual image display surface PSa, and the image (virtual image) V1 displayed on the area of ​​the virtual image display surface PSa located near the front side as observed by the visual observer 5.

[0151] The virtual image V1 includes a surrounding map M1 including the front of the vehicle 1 , a destination display (destination mark) 22 , and a host vehicle mark 23 indicating the position of the vehicle (host vehicle) 1 .

[0152] Map M1 includes: a road (straight route) 11 on the map, which corresponds to the road (straight route) 11' (the road as a real scene) on which the vehicle 1 is currently traveling; a left turn road 12 on the map, which corresponds to the left turn road 12' as a real scene; a right turn road 14 on the map, which corresponds to the right turn road 14' as a real scene; a guide line 20, which indicates the moving path; and a vehicle mark (vehicle icon) 23, which indicates the position of the vehicle.

[0153] The guide line 20 is a line or strip-shaped route guide displayed in a predetermined appearance (color or brightness, etc.), and is preferably displayed in a manner overlapping the road surface. Figure 1 In A-3, it is expressed by a blackened strip graphic overlapping the road surface.

[0154] The vehicle mark 23 has a shape designed to enhance the sense of depth according to the shape and inclination angle of the virtual image display surface PSa. As described above, the vehicle mark 23 has a function of indicating the position of the vehicle, but also has a function of indicating the direction of travel of the vehicle.

[0155] In other words, the vehicle mark 23 is formed of a shape (for example, a triangle or an arrow figure) that can indicate the traveling direction of the vehicle 1 .

[0156] Specifically, the vehicle mark 23 is Figure 1 In A-3 of FIG. 1 , the arrow is in a shape close to a triangle, and the direction of travel of the vehicle 1 can be indicated by the direction of the vertex (top) at the top of the figure.

[0157] In addition, the vehicle mark 23 is Figure 1 As shown in A-4, it can be composed of a three-dimensional arrow shape. In addition, Figure 1 Like A-5 of FIG. 1 , it may be formed in a three-dimensional arrow shape similar to the shape of a boomerang.

[0158] The own vehicle mark 23 having such a shape can indicate the traveling direction of the vehicle 1 according to the orientation of the vertex (top) at the top of the figure (arrow).

[0159] In addition, Figure 1 In the examples A-4 and A-5 of FIG. 1 , the vehicle mark 23 has a three-dimensional shape for realizing a display that is easier to see (but not limited to this).

[0160] As described above, the own vehicle mark 23 is designed to enhance the sense of depth according to the shape and inclination angle of the virtual image display surface (imaging surface) PSa which is an inclined surface.

[0161] In other words, in a preferred example, the vehicle mark 23 has a predetermined shape designed to allow the visual observer 5 to perceive a sense of depth corresponding to at least one of the shape of the virtual image display surface PSa and the inclination angle θ with respect to the road surface 6 .

[0162] exist Figure 1 In the example of A-3, since the distance between the vehicle (host vehicle) 1 and the intersection is greater than the first threshold value ( Figure 3 The symbol TH1) is large, so the control unit 83 displays the virtual image V1 as a wide-area display (sometimes referred to as a "small-world display").

[0163] In addition, when the vehicle (the vehicle itself) 1 approaches the intersection so that the distance between the vehicle (the vehicle itself) 1 and the intersection is below the first threshold TH1, the control unit 83 enlarges the scale of the map and displays the virtual image V1 as a narrow-area display (sometimes referred to as a "semi-AR display").

[0164] In the present embodiment, in order to suppress the sense of disharmony felt by the visual observer 5 due to the disappearance of the own vehicle mark 23 when switching from the wide-area display to the narrow-area display, the control unit 83 replaces the guide mark ( 23 ) having the same or similar shape as the own vehicle mark 23 (and preferably a shape that enables the visual observer 5 to perceive a common sense of depth) after the start of the narrow-area display. Figure 3The symbol 25) is displayed at a position close to the intersection on the map (slightly ahead from the visual observer 5) of the road 11 on the map corresponding to the road 11' on which the vehicle 1 is currently traveling. The details of this point will be described later.

[0165] Next, refer to Figure 2 . Figure 2 This is a diagram showing an example of the structure of a HUD device as a display device.

[0166] The display system 115 includes a communication unit 65 , a navigation device 70 , an ECU (Electronic Control Unit) 77 capable of collecting various vehicle information and the like, and a HUD device 100 .

[0167] The navigation device 70 includes a navigation information acquisition unit 71 and map information 74. The navigation information acquisition unit 71 includes a driving route information acquisition unit 72 and a host vehicle position information acquisition unit 73. The map information 74 includes host vehicle position information 75 and a display database 76.

[0168] The HUD device 100 includes a display control device (processor) 80 and a projection unit 93 .

[0169] The projection unit 93 has a display unit (in Figure 1 In the example of A-1, there is a screen 151 having a display surface 164 and a display optical system 95 (having a curved mirror 170).

[0170] The display control device (processor) 80 includes an information acquisition unit 81 , a memory 82 , and a control unit 83 that controls the display of an image.

[0171] The control unit 83 includes a wide-area / narrow-area switching control unit 84 that switches between wide-area display and narrow-area display, a wide-area display control unit 85 (including a vehicle mark display control unit 86 that controls display of the vehicle mark 23 ), and a narrow-area display control unit 87 .

[0172] The narrow area display control unit 87 includes: a vehicle mark deletion control unit 88 that deletes the vehicle mark 23 when switching from the wide area display to the narrow area display; and a guide mark display control unit 89 that performs display control such as displaying the guide mark 25 instead of the vehicle mark 23.

[0173] The guide mark display control unit 89 includes: a display control unit 90 before the vehicle turns, which implements display control of the guide mark 25 before the vehicle 1 turns left or right; and a display control unit 91 during the vehicle turns, which implements display control of the guide mark 25 during the vehicle turns when the vehicle 1 turns left or right.

[0174] Next, refer to Figure 3 . Figure 3 This is a diagram showing an example of wide-area display and narrow-area display.

[0175] Here, as before Figure 1 As shown in A-3 of FIG. 8 , it is assumed that a vehicle (host vehicle) 1 needs to turn left (or right) at the intersection ahead.

[0176] exist Figure 3 A-1 of FIG. 1 shows a navigation image including a map M1 and a vehicle mark 23 indicating the position of the vehicle.

[0177] Figure 3 The contents of the A-1 display image are the same as before Figure 1 The same as described in A-3, and repeated detailed description is omitted.

[0178] exist Figure 3 In A-1 of FIG. 1 , a map M1 is displayed using a first scale.

[0179] In addition, Figure 3 In A-1 of FIG. 1 , on the map M1, a shape having a predetermined shape (for example, Figure 1 The vehicle mark 23 (arrow patterns shown in A-3 to A-5 of FIG. 1 ) is displayed so as to overlap with the road 11 on the map M1 corresponding to the real scene of the road 11 ′ on which the vehicle 1 actually travels.

[0180] In addition, in this embodiment, the vehicle mark 23 has a corresponding Figure 1 The shape or inclination angle θ of the virtual image display surface PSa shown in A-3 is designed so as to enhance the sense of depth.

[0181] exist Figure 3 In A-2 of FIG. 1 , the scale of the displayed image is enlarged as the vehicle 1 moves forward. Figure 3 In A-2 of FIG. 1 , the map M2 and the vehicle mark 23 which is slightly enlarged in size are displayed.

[0182] exist Figure 3 At the time when A-1 and A-2 are displayed, the distance between the vehicle 1 and the real scene intersection is greater than the first threshold TH1, so a wide area display (small world display) is implemented. In other words, the maps M1 and M2 are maps showing the surroundings including the front in a bird's-eye view.

[0183] On the maps M1 and M2, the path that the vehicle 1 should travel is displayed by a guide line (here, a strip-shaped graphic with adjusted color or brightness, etc., which is displayed overlapping with the path (road) that the vehicle 1 should travel: in the figure, it is displayed as a blackened strip-shaped graphic) 20, and the destination is displayed at the destination (destination icon) 22.

[0184] exist Figure 3 In A-3, since the distance between the host vehicle 1 and the real scene intersection is less than the first threshold TH1, the wide area display (small world display) is switched to the narrow area display (semi-AR display). In this way, the scale of the map increases.

[0185] exist Figure 3 In A-3, the scale of map M3 is a second scale larger than the first scale.

[0186] exist Figure 3 In A-3, map M3 is Figure 3 The map M2 shown in A-2 is a significantly enlarged map (a bird's-eye view of the vicinity of the intersection) so that the main buildings are also displayed quite large.

[0187] exist Figure 3 In A-3 of FIG. 1 , the vehicle mark 23 indicating the vehicle position previously displayed is deleted, and a guide mark 25 indicating the traveling direction of the vehicle 1 is displayed at the first position Q1 indicated by the dotted ellipse instead. This display control is different from the previous Figure 2 The vehicle before turning display control unit 90 shown in FIG.

[0188] When the narrow area display is used, the scale of the map is enlarged. However, if the vehicle mark 23 indicating the position of the vehicle is displayed without being deleted, it is conceivable that the vehicle mark 23 is enlarged corresponding to the above-mentioned change in scale, resulting in the path to the intersection on the map being covered, making it difficult for the visual observer to observe. Therefore, the vehicle mark 23 is deleted. However, in order to reduce the sense of disharmony caused by the visual change caused by the deletion, the guide mark 25 is displayed at the first position Q1 instead of the vehicle mark 23.

[0189] The first position Q1 is a position close to an intersection on the map and is set slightly ahead as viewed from the visual observer 5 .

[0190] The guide mark 25 is displayed with the scale adjusted so as not to hinder the visual observation of the intersection on the map. In addition, the guide mark 25 has the same or similar shape as the vehicle mark 23 displayed before, and preferably has the same shape with a sense of depth.

[0191] As previously described, when using a sloped HUD, etc., the vehicle mark 23 is mostly displayed in a manner having a sense of depth (in other words, on the road surface 6, from the perspective of the visual observer 5, in a manner that gives a visual sense of depth that is enhanced as if extending from near to far) based on the shape or tilt angle of the inclined virtual image display surface PSa, etc., and therefore has a greater impact on the vision of the visual observer 5.

[0192] When the vehicle mark 23 endowed with a characteristic visual sense suddenly disappears when switching between wide-area display and narrow-area display, the possibility of the visual observer 5 feeling the sense of disappearance increases. However, when switching from wide-area display to narrow-area display, by displaying the same or similar shape (preferably, the same sense of depth) guide mark 25 instead of the vehicle mark 23, uninterrupted vision (vision with continuity) can be obtained, thereby reducing the sense of disharmony.

[0193] and, Figure 3 The guide mark 25 shown in A-3 is the same as that in the previous Figure 3 The same direction as the direction indicated by the own vehicle mark 23 shown in A-2 of FIG. 1 (the direction indicating that the vehicle 1 is moving straight).

[0194] In addition, Figure 3 In A-2 of FIG. 1 , the vehicle mark 23 is displayed in a manner overlapping the straight route 11, but Figure 3 In A-3 of FIG. 1 , the guide mark 25 is also displayed in a manner overlapping with the straight route 11 .

[0195] Therefore, in Figure 3 When the visual observer 5 perceives the guide mark 25 in the visual field, even if the guide mark is displayed slightly in front (far away) from the visual observer 5, the visual observer 5 will recognize it as the same visual as the vehicle mark 23 displayed before. Thus, uninterrupted vision (continuous vision) can be achieved, and the sense of incongruity or confusion can be fully suppressed.

[0196] In this way, after the switch from wide-area display to narrow-area display is implemented, even if a guide mark 25 of the same or similar shape (preferably a shape with the same sense of depth) is displayed slightly in front of the visual observer instead of the vehicle mark 23, the guide mark 25 will be displayed in a preferred example in a manner that overlaps with the straight route 11 in the same way as the vehicle mark 23, and in an appropriate size that indicates the same direction and does not hinder the visual observation of the intersection on the map. Therefore, even if the visual observer perceives the guide mark 25 in the field of vision, it is recognized as the same visual as the previous vehicle mark 23, and an uninterrupted vision can be obtained, thereby fully suppressing the sense of disharmony or confusion caused by the disappearance of the vehicle mark 23.

[0197] Alternatively, you may consider omitting Figure 3 A-3 from Figure 3 A-2 direct to Figure 3 The A-4 or A-5 is transferred to display the guide marks 25, 25 indicating a left turn, but in this case, the visual change is large, which may feel sudden and produce a sense of disharmony.

[0198] Therefore, first of all Figure 3 In A-3, a guide mark 25 indicating straight travel is displayed near the intersection on the map (a first position Q1 near the intersection slightly ahead as viewed from the visual observer 5) to ensure natural vision.

[0199] exist Figure 3 In A-4 and A-5, the distance between the vehicle 1 and the real intersection is equal to or less than a second threshold value TH2 which is smaller than the first threshold value.

[0200] Along with this, Figure 3 In A-4, the display position of the guide mark 25 is changed from Figure 3 The first position Q1 of A-3 is moved to a second position Q2 (indicated by a dotted ellipse in the figure) far away from the intersection on the map as observed by the visual observer 5, and the orientation of the guide mark 25 is changed to change the direction of travel indicated by the guide mark 25 to the extension direction (left) of the fork road (specifically, the left turn road 12).

[0201] In addition, Figure 3 In A-5, the display position of the guide mark 25 is changed from Figure 3 The first position Q1 of A-3 moves to the position of the fork in the intersection on the map, that is, the third position Q3 (indicated by a dotted ellipse in the figure), and the travel direction indicated by the guide mark 25 is changed to the extension direction (left) of the fork in the road (specifically, the left turn road 12).

[0202] In other words, Figure 3 In A-4 and A-5, the guide mark 25 is also used as a route change guide indicating the direction of the left turn (or right turn).

[0203] Since the guide mark 25 is a mark whose main function is to guide the vehicle's travel direction, it not only guides the vehicle 1 along the route to the intersection, but can also be flexibly used as a route change guide indicating the direction of a left or right turn after reaching the intersection.

[0204] This makes it possible to perform various guidance displays that were not possible in the past, and improve the convenience of the HUD device 100 (in a broad sense, the display device).

[0205] In addition, Figure 3 In A-4 and A-5 of the present invention, the display mode of the guide mark 25 (for example, at least one of the shape, pattern, color and brightness of the guide mark) can be changed to be the same as that of the present invention. Figure 3 The A-3 guide is marked 25 different ways.

[0206] This can improve the visual effect when indicating the direction, making it easier for the visual observer 5 to perceive the moving direction.

[0207] (Second Embodiment)

[0208] Next, refer to Figure 4 . Figure 4 (A) and (B) are diagrams showing an example of display using a guide mark composed of a plurality of images (a plurality of guide elements) in a narrow-area display.

[0209] In the previous Figure 3 A-4 and A-5 of FIG. 1 show an example in which the guide mark 25 is used to indicate the traveling direction of the vehicle 1 when turning left.

[0210] Figure 4 (A) and (B) are also examples in which the guide mark 25 is used to indicate the traveling direction of the vehicle 1 when turning left.

[0211] However, in Figure 4 In (A) and (B), one image is split into multiple images (multiple guide elements), or the display mode of each of the multiple images (multiple guide elements) after the split is changed to further improve the visual effect when indicating the direction. Figure 3 The A-4 and A-5 are different.

[0212] In addition, Figure 4 In (A) and (B), the previous Figure 3 A-4 shows the map M4.

[0213] exist Figure 4 In (A), a plurality of images (a plurality of guide elements) 28a to 28d are displayed in the fourth portion Q4. In addition, these images (guide elements) 28a to 28d are combined to form one guide mark 28.

[0214] exist Figure 4 In (B), the split multiple images (multiple guide elements) 29a to 29d are displayed on the fifth part Q5, and the display mode of the split multiple images (multiple guide elements) 29a to 29d is changed to further improve the visual effect when indicating the direction. In addition, these images (guide elements) 29a to 29d are combined to form a guide mark 29.

[0215] In this way, Figure 4 In (A) and (B) described above, Figure 3 In A-4, the guide mark 25 displayed as one image is split into multiple images (multiple guide elements) 28a~28d, 29a~29d, and the number of elements (guide elements) constituting the guide mark is increased, thereby achieving a display that is easier to observe and easy to perceive the direction.

[0216] (Third Embodiment)

[0217] Next, refer to Figure 5 . Figure 5 This is a diagram showing another example of display using a guide mark composed of a plurality of images (a plurality of guide elements) in a narrow-area display (an example of performing fade-in and fade-out in parallel at the same time).

[0218] exist Figure 5 In the combination before use Figure 3 The guide mark 25 shown in A-4 and the same as before in Figure 4 The guide mark 29 shown in (B) is used, and a process of fading one side into dark and a process of fading the other side into bright are used in combination.

[0219] exist Figure 5 In A-1, the guide mark 25 as an image before splitting is displayed with normal brightness.

[0220] exist Figure 5 In A-2, the split multiple images (in other words, multiple guide elements) 29a to 29d are displayed with low brightness, and on the other hand, the brightness of the guide mark 25 as one image is reduced.

[0221] exist Figure 5 In A-3, the brightness of the split multiple images (multiple guide elements) 29a to 29d is further increased, while on the other hand, the brightness of the guide mark 25 as one image is further reduced.

[0222] exist Figure 5 In A-4, the brightness of the split multiple images (multiple guide elements) 29a to 29d is further increased, while on the other hand, the guide mark 25 as one image is made invisible.

[0223] exist Figure 5 In A-5, an enhanced display process is performed such as displaying the image (guidance element) 29a located at the right end among the plurality of images (plurality of guidance elements) 29a to 29d in a different color or with a higher brightness.

[0224] exist Figure 5 In A-6, the enhanced display image (guiding element) 29b is Figure 5In A-7, the enhanced display image (guiding element) 29c is Figure 5 In A-8, the display image (guiding element) 29d is enhanced.

[0225] In this way, a period is set in which an image 25 before the split and an image composed of multiple images (multiple guide elements) 29a~29d after the split are displayed simultaneously. By gradually reducing the brightness of one image 25 and making it darker over time, on the other hand, the brightness of the guide mark composed of multiple images (multiple guide elements) 29a~29d is gradually increased and made brighter over time. In this way, the transition from the image 25 before the split to the image 29a~29d after the split can be an uninterrupted transition with reduced sense of disharmony, and a display that is easy to observe and easy to perceive the direction can be achieved.

[0226] In addition, when the light gradually brightens, by implementing display control to make the brightness or color of a part of the multiple images (multiple guide elements) 29a~29d different from the brightness or color of other images (other guide elements), it is possible to further improve the observability and make the perception of direction easier.

[0227] (Fourth Embodiment)

[0228] Next, refer to Figure 6 . Figure 6 It is a diagram showing another example of wide-area display and narrow-area display (including an example of rotating the guide mark around the coordinate axis).

[0229] exist Figure 6 In the display process, the guide mark 25 is rotated about at least one coordinate axis of a display coordinate system (here, an XYZ orthogonal coordinate system) for displaying an image set in a space in front of the vehicle 1.

[0230] Furthermore, a display mode change control may be implemented in which the display mode is rotated around at least one coordinate axis of a local coordinate system (not shown) set in the forward space corresponding to the intersection.

[0231] exist Figure 6 middle, Figure 6 A-1 to A-3 are the same as those shown above. Figure 3 The same as A-1 to A-3. Figure 6 A-4 is similar to the one shown previously Figure 3 Same as A-4.

[0232] Figure 6 A-5 shows an example of the visual effect of the guide mark 25 when viewed from the Z direction (direction along the Z axis) of the XYZ orthogonal coordinate system.

[0233] Figure 6 A-6 shows the Figure 6 The guide mark 25 shown in A-5 shows the visual effect of the guide mark 25 when viewed from the X direction (direction along the X axis).

[0234] Figure 6 A-7 shows the Figure 6 The guide mark 25 shown in A-5 is a visual effect when the guide mark 25 is rotated by a specified angle around the X axis of the XYZ orthogonal coordinate system and is observed from the Z direction (direction along the Z axis).

[0235] Figure 6 The A-8 shows the Figure 6 The guide mark 25 shown in A-7 shows the visual effect of the guide mark 25 when viewed from the X direction (direction along the X axis).

[0236] If Figure 6 The A-5 and A-6 are Figure 6 By comparing A-7 and A-8, it can be seen that even if it is the same guide mark 25, the visual effect of the guide mark 25 observed by the visual observer 5 is significantly different before and after the guide mark 25 is rotated around the X-axis by a specified angle.

[0237] In this way, by rotating the guide mark 25 around at least one coordinate axis of the display coordinate system (XYZ orthogonal coordinate system) or at least one coordinate axis of a local coordinate system (not shown) appropriately set corresponding to the extension direction of the branch road at the intersection, the visual effect of the guide mark 25 observed by the visual observer 5 can be appropriately and dynamically changed, thereby, for example, being able to produce a novel visual effect and further improve the observability of the guide mark 25 when turning left (or right).

[0238] (Fifth Embodiment)

[0239] Next, refer to Figure 7 . Figure 7 It is a diagram showing still another example of the wide-area display and the narrow-area display (including a display example during a turning period of the host vehicle).

[0240] exist Figure 7 middle, Figure 7 A-1 to A-3 are the same as those shown above. Figure 3 The same as A-1 to A-3. Figure 7 A-4 is similar to the one shown previously Figure 3 Same as A-4.

[0241] Figure 7 A-4 to A-8 of FIG. 1 show examples of display during the turning of the vehicle 1. In addition, the display control of the guide mark during the turning of the vehicle 1 is the same as that of the previous Figure 2 The display control unit 91 shown is implemented during the turning of the vehicle.

[0242] exist Figure 7 In A-4 to A-8 of FIG. 1 , the map is not displayed but the guide line 20 and the guide mark 25 are displayed.

[0243] exist Figure 7 In A-4 to A-8 of FIG. 1 , the guide mark 25 is used as a turning guide display indicating that the host vehicle 1 turns smoothly, for example, along with a left turn or a right turn (a guide display indicating the direction of the host vehicle 1 along with the turn).

[0244] Since the guide mark 25 is a mark whose main function is to guide the travel direction of the vehicle 1, it not only guides the travel route to the intersection, but can also be flexibly used as a turning guide that dynamically indicates the change in the travel direction of the vehicle 1 during a turn after reaching the intersection.

[0245] This makes it possible to perform various guidance displays that were not possible in the past, and the convenience of display devices such as the HUD device 100 can be further improved.

[0246] exist Figure 7 In A-5 to A-7 of FIG. 1 , a guide line (a black arrow graphic) 20 is shown instead of a map. In addition, an arrow 20A indicating a direction is shown at the top of the guide line 20. Figure 7 In A-8 of FIG. 1 , only the arrow 20A at the tip end portion of the guide wire 20 is shown.

[0247] also, Figure 7 The guide lines 20 shown in A-5 to A-8 are equivalent to the previously described Fig. 9 The guide wire 270 is shown in A-6.

[0248] In addition, if Figure 7 As shown in A-5 to A-8 of FIG. 1 , the guide mark 25 changes shape dynamically in response to the left turn of the host vehicle 1 .

[0249] In order to produce this shape change, for example, the previously described Figure 6 A-5 to A-8 of the present invention are techniques for rotating the guide mark 25 around the coordinate axis of the coordinate system (for example, at least one of the X axis, Y axis, and Z axis in the XYZ orthogonal coordinate system).

[0250] exist Figure 7 In A-7 of FIG. 1 , the vehicle 1 completes its turn, and accordingly, the guide mark 25 returns to its display state before the turn. Figure 7 A-7 is displayed in such a way that the guide mark 25 and the arrow 20A at the top end of the guide wire 20 overlap.

[0251] In this way, when the vehicle 1 turns, the guide mark 25 can also be flexibly used as a turning guide to dynamically indicate the change in the direction of travel of the vehicle 1, thereby enabling diverse and dynamic guidance displays that were previously impossible to achieve, thereby further improving the convenience of display devices such as the HUD device 100.

[0252] (Sixth Embodiment)

[0253] In the present embodiment, the guide mark 25 is also used as a warning display.

[0254] As previously explained Figure 7 In A-4 to A-8 (display of guide mark 25 during turning of vehicle 1), when the control unit 83 determines that the actual turning trajectory of vehicle 1 deviates from the normal trajectory, the control unit 83 can change the display mode of the guide mark 25 to a warning display that gives a warning to the visual observer.

[0255] For example, by making the previously shown Figure 7 The guide marks 25 of A-4 to A-8 are colored in a predetermined color (for example, red or yellow), or the colored guide marks 25 are further flashed, thereby providing a warning to the visual observer 5.

[0256] Thus, according to the sixth embodiment, when the vehicle 1 is turning and a turn that deviates from the normal track is confirmed, a warning can be given by changing the display mode of the guide mark 25. Thus, for example, the visual observer 5 can be prompted to perform appropriate driving operations and assist in returning to the normal track.

[0257] (Eighth Embodiment)

[0258] Figure 8 This is a flowchart showing an example of the display control procedure.

[0259] In step S1, information acquisition processing is performed. Specifically, for example, in step S11, navigation information acquisition processing is performed.

[0260] In step S2, wide area display processing S2 is performed. Specifically, in step S21, display control of guide lines is performed, and in step S22, display control of the destination is performed.

[0261] Furthermore, in step S23, display control of the vehicle mark indicating the position of the vehicle is performed.

[0262] This vehicle is marked as previously described Fig. 9The vehicle mark in this embodiment is preferably configured to adjust the depth sense in a manner suitable for an inclined surface as a virtual image display surface, and has a shape that can indicate the direction of travel (a triangular figure or an arrow figure, etc., including a three-dimensional figure). In this respect, Fig. 9 The existing examples are fundamentally different.

[0263] Furthermore, in step S3, wide area / narrow area switching processing is performed.

[0264] Furthermore, in step S4, narrow-area display processing is performed.

[0265] Specifically, in step S41, the scale change control of the display image is implemented, and in step S42, the own vehicle mark deletion control is implemented.

[0266] In step S43, display control of a guide mark having a shape inherited from the shape of the vehicle mark (the same or similar shape, preferably a shape having the same sense of depth) near the intersection is performed.

[0267] In a preferred example, in order to reduce the visual observer's sense of disharmony after the wide-area / narrow-area switching, the vehicle mark is displayed in the same direction of travel (and on the same road) as before the switching, and then the direction of the vehicle mark is changed to a display control corresponding to the left turn / right turn (the extension direction of the fork road).

[0268] In a preferred example, various display format change processes can be implemented.

[0269] For example, changes may be made to the appearance including the shape, pattern, and color of the guide mark.

[0270] In addition, control can be implemented to split the guide mark into multiple ones.

[0271] In addition, transition control (fade-in / fade-out control) from the guide mark before the splitting to the guide mark after the splitting can be implemented.

[0272] Furthermore, rotation control may be performed to rotate the guide mark around the coordinate axis of the display system coordinates or the local coordinate axis set corresponding to the intersection.

[0273] In step S44, display control of the guide mark while the vehicle is turning (preferably, dynamic display control for dynamically changing the display posture (shape of the guide mark, etc.)) is implemented.

[0274] In step S45, it is determined whether the map display (navigation image) is to be terminated. If so, the display is terminated, and if not, the process returns to step S1.

[0275] According to this embodiment, a display control method can be implemented that can suppress the discomfort caused by the disappearance of the vehicle mark indicating the vehicle position when the display image including the map switches from wide-area display to narrow-area display when the vehicle approaches an intersection, thereby ensuring stable vision.

[0276] As described above, according to the present invention, it is possible to suppress the discomfort caused by the disappearance of the vehicle mark indicating the position of the vehicle when the display image including the map changes from wide-area display to narrow-area display when the vehicle approaches an intersection, thereby ensuring stable visual display control.

[0277] Furthermore, according to the present invention, even while the vehicle is turning left or right, a dynamic mark such as a guide display indicating the traveling direction can be displayed, thereby improving the convenience of the display device.

[0278] In addition, according to the present invention, a display device or projection type display device with high functionality and improved convenience can be realized. In addition, as a projection type display device, a head-up display (HUD) device or a windshield display (WSD) device can be typically used. The term projection type display device is interpreted in a broad sense.

[0279] In addition, the projected component of the projected image may be a windshield of a vehicle, etc. In addition, the projected component may also be the glasses part of a glasses-type head-mounted display. In this case, the head-mounted display can be understood as a kind of head-up display in a broad sense. Therefore, it can be included in the present invention.

[0280] The present invention is not limited to the above-mentioned embodiments, and various deformations and applications are possible. For example, in addition to the function of indicating the direction of travel of the vehicle, the guide mark can also have the function of issuing a warning. In addition, as the shape of the guide mark, a triangle shape or an arrow shape can be used, but it is not limited to these, and various shapes can be used.

[0281] In addition, the HUD device or display system also includes a device used as a simulator (for example, an aircraft simulator, a simulator as a game device, etc.).

[0282] Furthermore, in the above-described embodiment, the HUD device is mainly described as an example of a projection display device, but the present invention is not limited thereto, and for example, an in-vehicle projector or the like may also be used.

[0283] The present invention is not limited to the above-described exemplary embodiments, and those skilled in the art should be able to easily modify the above-described exemplary embodiments within the scope of the claims.

Claims

1. A display control device comprising a control unit for controlling image display of a display device, wherein the display device is mounted on a vehicle and allows a visual observer who is a passenger of the vehicle to visually observe an image, wherein: The control unit, in a driving situation in which the vehicle needs to turn left or right at a forward intersection, when a distance from the vehicle to the intersection is greater than a first threshold, wide-area display control is implemented, wherein the wide-area display control is to display a first map using a first scale, the first map being a bird's-eye view of the surroundings including the front of the vehicle, and displaying a vehicle mark having a predetermined shape that can indicate the position of the vehicle and the traveling direction of the vehicle in a manner overlapping with a first road on the first map corresponding to the road on which the vehicle is actually traveling, When the vehicle further approaches the intersection and the distance from the vehicle to the intersection becomes equal to or smaller than the first threshold, the control unit Implement narrow-area display control, wherein the narrow-area display control is: deleting the vehicle mark, and A second map is displayed using a second scale larger than the first scale, the second map being a bird's-eye view of the vicinity of the intersection, adjusting the scale of a guide mark indicating the traveling direction of the vehicle and having a shape identical to or similar to the prescribed shape of the own vehicle mark so as not to obstruct visual observation of the intersection on the second map, The first position of the first road on the second map is displayed in a manner overlapping the road.

2. The display control device according to claim 1, characterized in that: When the vehicle approaches the intersection further and the distance from the vehicle to the intersection becomes equal to or smaller than a second threshold value which is smaller than the first threshold value, the control unit The display position of the guide mark is moved from the first position to a second position which is farther than the intersection on the second map as viewed by the visual observer, or to a third position which is a fork in the road which is an intersection on the second map, and the direction of travel indicated by the guide mark is changed to an extension direction of the fork in the road.

3. The display control device according to claim 1, characterized in that: The control unit performs display control to display the display image as a virtual image on a virtual virtual image display surface that is a flat or curved surface inclined with respect to a road surface on which the vehicle is traveling, and The predetermined shape of the own vehicle mark is set to a shape that allows the visual observer to perceive a sense of depth corresponding to at least one of the shape of the virtual image display surface and the inclination angle relative to the road surface, The shape of the guide mark is a shape that allows the visual observer to perceive a sense of depth that is the same as the sense of depth of the vehicle mark when the guide mark is displayed in a common posture and at a common position with the vehicle mark.

4. The display control device according to claim 2, characterized in that: The control unit implements display mode change control for changing at least one of the shape, pattern, color and brightness of the guide mark. or, A display mode change control is performed to split the guide mark into a plurality of images, or, Splitting the guide mark into a plurality of images and changing at least one of the shape, pattern, color and brightness of the display mode, or, The guide mark is split into a plurality of images, and during the splitting, a period is set in which the one image before the splitting and the plurality of images after the splitting coexist, so that the one image gradually darkens as time passes, and the plurality of images gradually brightens as time passes, display mode change control, or, The display mode change control is to make the guide mark rotate around at least one coordinate axis of a display coordinate system for displaying an image set in the space in front of the vehicle, or to change the display mode control by rotating around at least one coordinate axis of a local coordinate system set in the space in front corresponding to the intersection.

5. The display control device according to claim 1, characterized in that: The control unit is configured to control the vehicle to turn left or right during the turning period. By changing the display form of the guide mark, the travel direction indicated by the guide mark is dynamically changed in a manner corresponding to the turn of the vehicle.

6. The display control device according to claim 5, characterized in that: The control unit changes the display mode of the guide mark to a warning display mode for giving a warning to the visual observer when it is determined that the actual turning trajectory of the vehicle deviates from a normal trajectory.

7. A display device, characterized in that: The display device has: A display unit that displays an image; and The display control device according to any one of claims 1 to 6.

8. The display device according to claim 7, characterized in that: The display device is a projection type display device that displays the image as a virtual image on a virtual image display surface by projecting display light of the image displayed on the display unit onto a projection target member.

9. A display control method for controlling image display of a display device mounted on a vehicle and allowing a visual observer who is a passenger of the vehicle to visually observe an image, characterized in that: The display control method comprises: In a driving condition where the vehicle needs to turn left or right at an intersection ahead, when a distance from the vehicle to the intersection is greater than a first threshold, a step of implementing wide-area display control, the step of wide-area display control comprising: displaying a first map using a first scale, the first map being a bird's-eye view of a surrounding area ahead including the vehicle, and displaying a vehicle mark having a predetermined shape capable of indicating the position of the vehicle and indicating the direction of travel of the vehicle in a manner overlapping with a first road on the first map corresponding to a road on which the vehicle is actually traveling; and When the vehicle further approaches the intersection so that the distance from the vehicle to the intersection is below the first threshold, a narrow-area display control step is implemented, the narrow-area display control step being: deleting the vehicle mark, and displaying a second map at a second scale larger than the first scale, the second map being a bird's-eye view of the vicinity of the intersection, adjusting the scale of a guide mark indicating the direction of travel of the vehicle and having a shape that is the same as or similar to the prescribed shape of the vehicle mark so as not to hinder visual observation of the intersection on the second map, and displaying the guide mark at a first position of the first road on the second map so as to overlap with the road.

Images