Head-up display device

Abstract

The present invention provides a head-up display device that can display information in a manner that facilitates users in making appropriate situational judgments. [Solution] The control unit of the head-up display device can divide the area of ​​image 5, which is displayed on a virtual surface set in front of the vehicle's windshield, into a first display area 6, a second display area 7, and a third display area 8, each displaying different types of information. The control unit can acquire navigation information and other types of information different from navigation information from the infotainment system, and can acquire driving assistance information from the driving assistance system. When the control unit simultaneously displays navigation information, other types of information, and driving assistance information in the area of ​​image 5, it displays navigation information in the first display area 6, driving assistance information in the second display area 7, and other types of information in the third display area 8.

Description

Technical Field

[0001] The present disclosure relates to a head-up display device.

Background Art

[0002] Patent Document 1 describes a head-up display device that projects display light representing an image onto a windshield of a vehicle and causes the user, mainly the driver of the vehicle, to visually recognize the image in front of the windshield.

Prior Art Document

Patent Document

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In this type of device, since an image is displayed superimposed on the actual scene viewed through the windshield, depending on the display mode of the information in the image, information that should be displayed far away as perceived by the user may be displayed near the user, or information that should be displayed near as perceived by the user may be displayed far away from the user, which may cause confusion when the user makes a situation judgment.

[0005] The present disclosure has been made in view of the above circumstances, and an object thereof is to provide a head-up display device capable of displaying information in a manner that makes it easy for the user to make an appropriate situation judgment.

Means for Solving the Problems

[0006] To achieve the above object, the head-up display device according to the present disclosure is A head-up display device that projects display light representing an image onto the windshield of a vehicle, thereby displaying the image to the user on a virtual surface set in front of the windshield, The display unit that emits the aforementioned display light, The system includes a control unit that controls the image by controlling the operation of the display unit, and is capable of acquiring navigation information and other types of information different from the navigation information from the infotainment system installed in the vehicle, and is capable of acquiring driver assistance information related to driver assistance for the vehicle from the driver assistance system installed in the vehicle, The control unit, The area of ​​the image displayed on the virtual surface can be divided into a first display area, a second display area, and a third display area, each displaying a different type of information. When the navigation information, the heterogeneous information, and the driving support information are displayed simultaneously in the area of ​​the image, the navigation information is displayed in the first display area, the driving support information is displayed in the second display area which is visible to the user below the first display area, and the heterogeneous information is displayed in the third display area. [Effects of the Invention]

[0007] According to this disclosure, information can be displayed in a manner that makes it easier for users to make appropriate judgments about the situation. [Brief explanation of the drawing]

[0008] [Figure 1] A diagram showing how a head-up display device according to one embodiment of this disclosure is mounted on a vehicle. [Figure 2] Block diagram of a head-up display device and various systems according to the above embodiment. [Figure 3] A diagram showing an example of an image displayed by the head-up display device according to the same embodiment as described above. [Figure 4] A flowchart of the display mode change process according to the same embodiment as above. [Figure 5]This figure shows an example of changing the appearance of an image according to the display appearance change process according to the above embodiment. [Figure 6] This figure shows an example of changing the appearance of an image according to the display appearance change process according to the above embodiment. [Figure 7] This figure shows an example of changing the appearance of an image according to the display appearance change process according to the above embodiment. [Figure 8] This figure shows an example of changing the appearance of an image according to the display appearance change process according to the above embodiment. [Figure 9] This figure shows an example of changing the appearance of an image according to the display appearance change process according to the above embodiment. [Figure 10] This figure shows an example of changing the appearance of an image according to the display appearance change process according to the above embodiment. [Figure 11] This figure shows an example of changing the appearance of an image according to the display appearance change process according to the above embodiment. [Figure 12] This figure shows an example of changing the appearance of an image according to the display appearance change process according to the above embodiment. [Modes for carrying out the invention]

[0009] One embodiment of this disclosure will be described with reference to the drawings.

[0010] As shown in Figure 1, the head-up display device 10 (hereinafter also referred to as the HUD device 10) is installed, for example, in the dashboard 2 of the vehicle 1. The HUD device 10 projects a display light L representing an image onto the windshield 3 of the vehicle 1, thereby displaying the image to the user 4 (mainly the driver of the vehicle 1) on a virtual surface A set in front of the windshield 3. The user 4 can see the virtual image V of the image represented by the display light L by positioning their viewpoint within the eye box E.

[0011] The virtual plane A is set to be inclined forward with respect to the vertical direction of the vehicle 1. Here, Up, Dd, Fd, and Bd shown with arrows in FIG. 1 indicate the up, down, front, and rear directions of the vehicle 1 respectively. For example, one end of the virtual plane A closest to the vehicle 1 is set at a position about 5 m from the vehicle 1, and the other end farthest from the vehicle 1 is set at a position about 10 m from the vehicle 1. The size, shape, and position of the virtual plane A and the glove box E are determined based on the optical system constituted by the HUD device 10 and the windshield 3.

[0012] As shown in FIG. 2, the HUD device 10 includes a display unit 11 and a control unit 12. The control unit 12 is capable of communicating with each of the in-vehicle information system 20 and the driving support system 30 mounted on the vehicle 1.

[0013] The display unit 11 generates and emits display light L and is composed of, for example, a liquid crystal display, an organic EL (Electro-Luminescence) display, etc. Note that the display unit 11 may be configured using a reflective display device such as a DMD (Digital Micro mirror Device) or LCOS (Liquid Crystal On Silicon) and a screen. The display light L emitted by the display unit 11 is reflected by one or more mirrors (not shown) and guided to the windshield 3.

[0014] The control unit 12 is a controller that controls the overall operation of the HUD 10, and includes a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), and a drive circuit that drives the display unit 11 by controlling the CPU and the GPU. The control unit 12 controls the image represented by the display light L by controlling the operation of the display unit 11. Further, the control unit 12 executes a display mode change process described later according to the information acquired from each of the infotainment system 20 and the driving support system 30. Various data including a program for executing the display mode change process are stored in the ROM. The control by the control unit 12 specific to the present embodiment will be described later. Further, the control unit 12 receives various instruction operations by the user 4 from an input device (not shown) such as a steering switch and a touch panel provided in the interior of the vehicle 1, and executes control according to the received operation content. Note that the control unit 12 may receive an instruction operation by the user 4 via the motion detection unit 32 as described later. Further, the control unit 12 may receive an instruction operation by the user 4 via an input device provided in the infotainment system 20.

[0015] The infotainment system 20 is configured to communicate with each of the navigation system 21 and the electronic device 22 and provide information based on various applications to the user 4. The infotainment system 20 can provide the control unit 12 with navigation information by the navigation system 21 and information by the electronic device 22, which is a different type of information (hereinafter referred to as different type information) from the navigation information.

[0016] The navigation system 21 is a well-known configuration that uses GPS (Global Positioning System) to determine the position of vehicle 1 and provides route guidance to the destination according to settings made by user 4. The navigation system 21 is installed in or connected to vehicle 1. Here, the navigation system 21 connected to vehicle 1 refers to a configuration that can be realized by a navigation application on an information terminal such as a smartphone or tablet carried by user 4, which is capable of communicating with the infotainment system 20 via wired or wireless connection.

[0017] The electronic devices 22 are various devices used within the vehicle 1, and include not only devices installed in the vehicle 1 (hereinafter referred to as "in-vehicle devices") but also devices brought into the vehicle 1 by the user 4 (hereinafter referred to as "brought-in devices"). In other words, the number and type of electronic devices 22 that communicate with the infotainment system 20 are arbitrary, and it is also arbitrary whether the electronic devices 22 are in-vehicle devices or brought-in devices. For example, in-vehicle devices include audio equipment, air conditioning equipment that provides HVAC (Heating Ventilating Air Conditioning), etc. Brought-in devices are information terminals such as smartphones and tablet devices carried by the user 4, and are devices that can communicate with the infotainment system 20 by wire or wireless connection. The types of heterogeneous information that the electronic devices 22 can provide to the control unit 12 are arbitrary and include (i) audio information including not only music playback but also video playback, (ii) air conditioning information in the vehicle 1, and (iii) information related to applications executed by the information terminal (Internet, calls, email, SNS (Social Networking Service), etc.). Furthermore, audio information may be provided to the infotainment system 20 not from an audio device as an in-vehicle device, but from an information terminal as a personal device that runs an audio application.

[0018] The driver assistance system 30 is a so-called ADAS (Advanced Driver Assistance System) and is installed in the vehicle 1 with a well-known configuration for assisting driving. The driver assistance system 30 provides driver assistance information related to the driving assistance of the vehicle 1 to the control unit 12. The driver assistance system 30 broadly comprises a situation analysis unit 31, an action detection unit 32, and an ECU (Electronic Control Unit) 33.

[0019] The situation analysis unit 31 analyzes information about the surroundings of vehicle 1 from various sensors, such as a vehicle speed sensor, which senses the situation of vehicle 1 (self-vehicle situation), and from various sensors, such as a camera and LiDAR (Light Detection And Ranging), which sense the external situation of vehicle 1, and outputs a signal indicating the analysis result to the control unit 12 and ECU 33. The situation analysis unit 31 may also be equipped with a module capable of communication such as V2N (Vehicle To Cellular Network), V2V (Vehicle To Vehicle), V2P (Vehicle To Pedestrian), and V2I (Vehicle To Roadside Infrastructure), and may collect information about the surroundings of vehicle 1. In other words, the situation analysis unit 31 may be capable of any of the V2X (Vehicle To Everything) communication between vehicle 1 and the outside of vehicle 1.

[0020] The motion detection unit 32 monitors the user 4's actions and outputs signals indicating the monitoring results to the control unit 12 and the ECU 33. The actions monitored by the motion detection unit 32 may include not only instruction operations performed from input devices such as steering switches and touch panels, but also the direction of the user 4's gaze and point of focus, etc., which are identified based on information from cameras, infrared sensors, etc., that monitor the user 4.

[0021] The ECU 33 is configured to control various parts of the vehicle 1 and can control the operation of the vehicle 1 according to information from the situation analysis unit 31 and the motion detection unit 32, respectively. For example, the ECU 33 controls the vehicle 1 to ACC (Adaptive Cruise Control) or an automatic driving mode according to information from the motion detection unit 32 according to settings made by the user 4. In this embodiment, the automatic driving mode is, for example, an automatic driving level of "2+", "3", or "4". The ECU 33 also implements safety driving support such as AEB (Autonomous Emergency Braking) and LKAS (Lane Keeping Assist System) according to information from the situation analysis unit 31, for example.

[0022] This concludes the explanation of the configuration of the HUD device 10, the infotainment system 20, and the driver assistance system 30. Next, an example of an image displayed by the HUD device 10 will be explained with reference to Figure 3.

[0023] Image 5 in Figure 3 is an example of an image displayed on virtual surface A (an image that user 4 perceives as a virtual image V). Since controlling the image displayed on the display unit 11 is synonymous with controlling the image 5 that user 4 actually perceives, the control of image 5 by the control unit 12 will be described below. The control unit 12 can divide the area 5A of image 5 into a first display area 6, a second display area 7, and a third display area 8, each displaying different types of information. The second display area 7 is perceived by user 4 as being below the first display area 6. In other words, to user 4, the second display area 7 is perceived as being closer than the first display area 6. Furthermore, as shown in Figure 3, the control unit 12 can not only position the third display area 8 so that it is perceived below the second display area 7 by user 4, but also, as will be described later, so that it is perceived above the first display area 6 by user 4.

[0024] When the control unit 12 simultaneously displays navigation information and other information acquired from the infotainment system 20 and driver assistance information acquired from the driver assistance system 30 in area 5A of image 5, it displays navigation information in the first display area 6, driver assistance information in the second display area 7, and other information in the third display area 8. This prevents the driver assistance information, which indicates information about the vehicle 1 itself or the area around the vehicle, from being displayed further away from the user 4 than the navigation information, thus preventing the user 4 from becoming confused. Therefore, the HUD device 10 makes it easier for the user 4 to make appropriate judgments. Hereinafter, when the control unit 12 displays predetermined information, it refers to displaying that predetermined information in image 5 as an icon, graphic, character, or a combination thereof.

[0025] Here, navigation information that can be obtained from the infotainment system 20 and displayed by the control unit 12 includes, for example, destination information, TBT (Turn-by-Turn) information, map information, lane information, etc.

[0026] Destination information is information about the destination set by user 4, such as the distance to the destination and the direction to the destination. TBT information is information that represents the direction of travel at intersections to reach the destination using an arrow icon, and may include the distance to the intersection. In addition, TBT information may not only show the direction of travel at the intersection immediately preceding vehicle 1 (hereinafter referred to as the first intersection), but may also show the direction of travel at the intersection after the first intersection (hereinafter referred to as the second intersection), or it may show the distance from the first intersection to the second intersection, or the distance from vehicle 1 to the second intersection. Map information shows a map of the area around vehicle 1, and if a destination is set, it also includes the driving route to the destination within the map. Lane information shows the lane in which vehicle 1 is traveling, and if a destination is set, it also includes the recommended driving lane to the destination. As will be described later, in the appropriate figures from Figure 5 onwards, specific examples of each piece of information that is displayed are shown as destination information 6a, TBT information 6b, map information 6c, and lane information 6d.

[0027] Furthermore, as mentioned above, the types of heterogeneous information that can be obtained from the infotainment system 20 and displayed by the control unit 12 are arbitrary and not limited, but examples of heterogeneous information include audio information and current location-related information.

[0028] Audio information is information related to audio set by user 4, such as (i) the name of the song being played or selected (including the album title), (ii) the album artwork, and (iii) the icon related to the media player. Current location-related information is information related to the current location of vehicle 1 as identified by the navigation system 21, such as information that is advantageous to user 4, or a POI (Point of Interest) set by user 4. Note that current location-related information is not limited to information provided by the electronic device 22, but may also be information provided by the navigation system 21. In this paper, heterogeneous information is defined as a different type of information from navigation information, but this definition means that heterogeneous information displayed in the third display area 8 only needs to be different from the navigation information displayed in the first display area 6, and does not exclude the possibility that at least a part of the heterogeneous information is obtained from the navigation system 21. In Figures 5 and later as appropriate, specific examples of each type of information to be displayed are shown as audio information 8a and current location-related information 8b.

[0029] In addition, examples of driver assistance information that can be obtained from the driver assistance system 30 and displayed by the control unit 12 include surrounding area information, setting information, forward warning information, BSW (Blind Spot Warning) information, lane change information, etc.

[0030] Surrounding information is information that shows the surrounding situation of vehicle 1 in an overhead view along with an icon for vehicle 1. Setting information is information that shows the setting status of the driver assistance system 30, such as the set speed of ACC and whether it is in autonomous driving mode. Forward warning information is information that shows warnings about what is ahead of vehicle 1, such as there being an object that poses a collision risk in front of vehicle 1 or there being a construction site in front of vehicle 1. BSW information is information that shows there is an object that poses a collision risk to the side or rear of vehicle 1. Lane change information is information that shows lane changes made by vehicle 1 while it is in autonomous driving mode. Note that forward warning information and BSW information may be included in surrounding information or may be displayed together with setting information. In addition, lane change information may be included in surrounding information. As will be described later, in the appropriate figures from Figure 5 onwards, specific examples of each type of information that is displayed are shown as surrounding information 7a, setting information 7b, forward warning information 7c, BSW information 7d, and lane change information 7e.

[0031] Furthermore, the control unit 12 changes the proportions occupied by the first display area 6, the second display area 7, and the third display area 8 in area 5A of image 5 according to at least one of the navigation information, driving support information, and heterogeneous information. The proportions occupied by the first display area 6, the second display area 7, and the third display area 8 refer to the size ratio of the first display area 6, the second display area 7, and the third display area 8 in a preset area 5A, and include cases where one or two of the display areas are 0% (i.e., when those one or two display areas disappear from area 5A of image 5). In this way, by changing the size ratio of the first display area 6, the second display area 7, and the third display area 8 as needed, high-priority information can be effectively conveyed to the user 4.

[0032] Furthermore, within region 5A (for example, at the left and right ends of region 5A), fixed display areas for displaying speed limits, etc., may be provided separately from the first display area 6, the second display area 7, and the third display area 8. In other words, if the entire region 5A is considered 100% in percentage terms, and the percentage occupied by the first display area 6 in region A is X%, the percentage occupied by the second display area 7 is Y%, and the percentage occupied by the third display area 8 is Z%, then the proportions occupied by the first display area 6, the second display area 7, and the third display device 8 change in the portion of region 5A excluding the fixed display areas, so X+Y+Z does not necessarily have to be 100%.

[0033] Next, an example of the display mode change process executed by the control unit 12 will be described with reference to Figure 4. This process is executed, for example, continuously while the HUD device 10 is running. At the start of the display mode change process, an image 5 in the default mode, having a first display area 6, a second display area 7, and a third display area 8 with a default size ratio, is displayed. The default size ratio may be the default size ratio or a size ratio set by the user 4. The default mode may also be the driver assistance priority mode, navigation priority mode, or heterogeneous information priority mode described later.

[0034] (Display mode change process) In the display mode change process, the control unit 12 acquires various information from the infotainment system 20 and the driver assistance system 30 (step S1). As a result, the control unit 12 acquires at least one of navigation information, heterogeneous information, and driver assistance information.

[0035] Next, the control unit 12 determines whether or not it is necessary to change the display mode of image 5 based on the information acquired in step S1 (step S2). Specifically, the control unit 12 determines whether it is necessary to change the display mode of image 5 if (i) the driving assistance priority condition, navigation priority condition, or heterogeneous information priority condition is met and the met condition has changed from the previous condition (including the case where the current image 5 is the default mode), or (ii) none of the driving assistance priority condition, navigation priority condition, or heterogeneous information priority condition is met and the current image 5 is not the default mode. Here, the driving assistance priority condition is a predetermined condition in which driving assistance information has a higher priority than navigation information and heterogeneous information. The navigation priority condition is a predetermined condition in which driving assistance information has a higher priority than driving assistance information and heterogeneous information. The heterogeneous information priority condition is a predetermined condition in which driving assistance information has a higher priority than driving assistance information and heterogeneous information.

[0036] Here, the control unit 12 identifies, for example, at least one of the following first essential conditions (A1) to (A5) based on various information obtained from the driver assistance system 30, and determines that the driver assistance priority condition has been met if the priority of the identified first essential condition is higher than the priority of the second essential condition and the third essential condition described later. (A1) A situation in which an object posing a collision risk is detected in front of the vehicle. (A2) A situation in which an object posing a collision risk is detected to the side or rear of the vehicle. (A3) Vehicle 1, which is in autonomous driving mode, is about to change lanes. (A4) The situation is about to be resolved when the driving authority will be transferred from the autonomous driving state to user 4 as the driver. (A5) The instructions given by User 4 are requesting to inquire about driver assistance information.

[0037] Furthermore, based on various information obtained from the infotainment system 20, the control unit 12 identifies, for example, at least one of the second essential conditions (B1) to (B4) below, and determines that the navigation priority condition is met if the priority of the identified second essential condition is higher than the priority of the first essential condition and the third essential condition described later. (B1) A situation in which the road on which Vehicle 1 is traveling has more than the set number of lanes (however, the set number is 2 or more). (B2) A situation in which the number of lane changes required for vehicle 1 to reach the recommended driving lane is equal to or greater than the set number (however, the set number is 1 or greater). (B3) A situation in which vehicle 1 is required to change direction repeatedly. Specifically, when P1 is the point where vehicle 1 immediately needs to change direction, and P2 is the point where it needs to change direction immediately following P1, the distance from P1 to P2 (i.e., the distance from the first intersection to the second intersection as described above) is less than the predetermined value. (B4) The instructions given by User 4 indicate a request for navigation information.

[0038] Furthermore, based on various information obtained from the infotainment system 20, the control unit 12 identifies, for example, at least one of the following third essential situations (C1) to (C3), and determines that the heterogeneous information priority condition is met if the priority of the identified third essential situation is higher than the priority of the first essential situation and the second essential situation. (C1) A notification regarding unrelated information has been sent from infotainment system 20 to user 4. (C2) A situation in which operational feedback is generated in response to an instruction operation performed by user 4 on control unit 12. (C3) The instructions given by User 4 are requesting the query for different information.

[0039] Priority levels are pre-assigned to each of the following: (A1) to (A5), which are examples of the first essential conditions; (B1) to (B4), which are examples of the second essential conditions; and (C1) to (C3), which are examples of the third essential conditions. These priorities should be set higher for information that is more important regarding the safe driving of vehicle 1. For example, if the priority of (A1) is set higher than the priorities of (B1) and (C1), and the control unit 12 has identified the conditions of (A1), (B1), and (C1), the control unit 12 will determine that the driving assistance priority condition has been met.

[0040] If it is determined in step S2 that there is no need to change the display mode of image 5 (step S2; No), the control unit 12 executes the process again from step S1. On the other hand, if it is determined that there is a need to change the display mode of image 5 (step S2; Yes), the control unit 12 changes the display mode of image 5 as described below (step S3).

[0041] Step S2; If the driver assistance priority condition is met with Yes, in Step S3 the control unit 12 sets Image 5 to the driver assistance priority mode. In the driver assistance priority mode, driver assistance information corresponding to at least one of the identified situations (A1) to (A5) is displayed in the second display area 7. In addition, the driver assistance priority mode is a mode in which the size of the second display area 7 is larger than that of the first display area 6 and the third display area 8 (this also includes a mode in which at least one of the first display area 6 and the third display area 8 is absent in Image 5). When Image 5 is changed from the default mode, the navigation priority mode described later, or the heterogeneous information priority mode to the driver assistance priority mode, the control unit 12 enlarges the second display area 7 to a size greater than that immediately before the driver assistance priority condition is met, or makes the second display area 7 appear if it was not present immediately before the driver assistance priority condition is met. In addition, the control unit 12 reduces the size of at least one of the first display area 6 and the third display area 8 to a size smaller than the size immediately before the driving assistance priority condition is met, or erases it. This change in the size ratio of the first display area 6, the second display area 7, and the third display area 8 is performed gradually through animation.

[0042] Step S2; If the navigation priority condition is met with Yes, in Step 3 the control unit 12 sets image 5 to the navigation priority mode. In the navigation priority mode, navigation information corresponding to at least one of the identified situations (B1) to (B4) is displayed in the first display area 6. The navigation priority mode is also a mode in which the size of the first display area 6 is larger than that of the second display area 7 and the third display area 8 (this also includes a mode in which at least one of the second display area 7 and the third display area 8 is absent in image 5). When image 5 is changed from the default mode, the driving assistance priority mode, or the heterogeneous information priority mode described later to the navigation priority mode, the control unit 12 enlarges the first display area 6 to a size greater than that immediately before the navigation priority condition is met, or makes the first display area 6 appear if it was not present immediately before the navigation priority condition is met. At the same time, the control unit 12 reduces or erases at least one of the second display area 7 and the third display area 8 to a size greater than that immediately before the navigation priority condition is met. The changes in the size ratios of the first display area 6, the second display area 7, and the third display area 8 are performed gradually through animation.

[0043] Step S2; If the heterogeneous information priority condition is met with Yes, in Step 3 the control unit 12 sets image 5 to the heterogeneous information priority mode. In the heterogeneous information priority mode, heterogeneous information corresponding to at least one of the identified situations (C1) to (C3) is displayed in the third display area 8. The heterogeneous information priority mode is arbitrary as long as it is a mode in which the heterogeneous information is easier to recognize than immediately before the heterogeneous information priority condition is met. When image 5 is changed from the default mode, driving assistance priority mode, or navigation priority mode to the heterogeneous information priority mode, the control unit 12 (i) enlarges the third display area 8 to a size greater than immediately before the heterogeneous information priority condition is met, (ii) places the third display area 8 in a different position than immediately before the heterogeneous information priority condition is met, or (iii) makes the third display area 8 appear if it was not present immediately before the heterogeneous information priority condition is met. Such changes in the size ratio of the first display area 6, the second display area 7, and the third display area 8 are performed gradually by animation.

[0044] If in step S2, the driver assistance priority condition, navigation priority condition, and heterogeneous information priority condition are not met, and the previous image 5 is not in the default state (i.e., the previous image 5 is in the driver assistance priority state, navigation priority state, or heterogeneous information priority state), then in step 3, the control unit 12 sets image 5 to the default state. Even when image 5 is changed from the driver assistance priority state, navigation state, or heterogeneous information priority state to the default state, the change in the size ratio of the first display area 6, the second display area 7, and the third display area 8 is performed gradually by animation. After executing step S3, the control unit 12 executes the process again from step S1.

[0045] Furthermore, when the control unit 12 changes the image 5 to a driver assistance priority mode, if it simultaneously identifies multiple situations from (A1) to (A5), it may display driver assistance information in the second display area 7 to notify the driver of content corresponding to all identified situations, or it may display driver assistance information in the second display area 7 to notify the driver of content corresponding to the highest priority situation, according to the pre-set priority for each of the situations (A1) to (A5).

[0046] Similarly, when the control unit 12 changes the image 5 to a navigation priority mode, if it simultaneously identifies multiple situations from (B1) to (B4), it may display navigation information in the first display area 6 to notify the content corresponding to all identified situations, or it may display navigation information in the first display area 6 to notify the content corresponding to the highest priority situation, according to the pre-set priority for each of the situations (B1) to (B4).

[0047] Similarly, when the control unit 12 changes the image 5 to a heterogeneous information priority mode, if it simultaneously identifies multiple situations from (C1) to (C3), it may display heterogeneous information in the third display area 8 to notify content corresponding to all identified situations, or it may display heterogeneous information in the third display area 8 to notify content corresponding to the highest priority situation, according to the pre-set priority for each of the situations (C1) to (C3). The above is the display mode change process.

[0048] Next, examples of image 5's appearance change according to the display appearance change process will be explained in order with reference to Figures 5 to 12. Each of Figures 5 to 12 shows an example of image 5's appearance change being performed by animation along a time axis from top to bottom, represented by three images of image 5 in the upper, middle, and lower sections. The upper section shows image 5 before the appearance change, the middle section shows image 5 during the transition, and the lower section shows image 5 after the appearance change. Note that in Figures 5 to 12, the dashed lines extending horizontally within image 5 merely indicate the boundaries between adjacent first display area 6, second display area 7, and third display area 8, and are not components of image 5.

[0049] (Example of changing to navigation priority mode) Figures 5 to 7 show examples of changing from the upper image 5 in the driver assistance priority mode, heterogeneous information priority mode, or default mode to the lower image 5 in the navigation priority mode. In other words, Figures 5 to 7 show the case in the display mode change process when the navigation priority condition is met and image 5 is changed to the navigation priority mode.

[0050] In the upper image 5 of Figures 5 to 7, (i) TBT information 6b, which shows the direction of travel at an intersection and the distance to the intersection, is displayed in the first display area 6 as navigation information; (ii) surrounding information of vehicle 1 7a is displayed in the second display area 7 as driving assistance information; and (iii) audio information 8a is displayed as different information in the third display area 8, which is located below the second display area 7.

[0051] Figure 5 shows the case where, while the upper image 5 is displayed, the control unit 12 identifies the situation described in (B1) above (the situation where the number of lanes on the road that vehicle 1 is traveling on is equal to or greater than the set number (however, the set number is 2 or more)), and the navigation priority condition is met. In this case, as shown in the middle image 5, destination information 6a and map information 6c are displayed in place of TBT information 6b in the gradually expanding first display area 6, the second display area 7 gradually shrinks, and the third display area 8 shrinks and disappears. Then, in the lower image 5, which has been changed to the navigation priority mode after the middle image 5, lane information 6d is also displayed in the first display area 6. In addition, in the second display area 7 after shrinking, setting information 7b, which shows the setting status of the driver assistance system 30, is displayed in place of surrounding information 7a. The image showing the setting information 7b is composed of, for example, an icon representing vehicle 1 with the ACC set speed written on it.

[0052] Figure 6 shows the case when the upper image 5 is displayed, the control unit 12 identifies the situation described in (B2) above (the situation where the number of lane changes required for vehicle 1 to reach the recommended driving lane is equal to or greater than the set number (however, the set number is 1 or more)), and the navigation priority condition is met. In this case, as shown in the middle image 5, destination information 6a and map information 6c are displayed in place of TBT information 6b in the gradually expanding first display area 6, the second display area 7 is gradually reduced in size, and the third display area 8 is reduced in size and then disappears. Then, in the lower image 5, which is the navigation priority mode after the middle image 5, lane information 6d is further displayed in the expanded first display area 6, and setting information 7b is displayed in place of surrounding information 7a in the reduced second display area 7.

[0053] Figure 7 shows the case where, while the upper image 5 is displayed, the control unit 12 identifies the situation described in (B3) above (the situation in which the vehicle 1 continues to change direction) and the navigation priority condition is met. In this case, as shown in the middle image 5, destination information 6a and map information 6c are displayed in place of TBT information 6b in the gradually expanding first display area 6, the second display area 7 gradually shrinks, and the third display area 8 shrinks and disappears. Then, in the lower image 5, which is the navigation priority mode after the middle image 5, lane information 6d is further displayed in the expanded first display area 6, and the second display area 7 disappears.

[0054] (Example of changing to a driver assistance priority setting) Figures 8 to 10 show examples of changing from the upper image 5 in the navigation priority mode, heterogeneous information priority mode, or default mode to the lower image 5 in the driver assistance priority mode. In other words, Figures 8 to 10 show the case in the display mode change process when the driver assistance priority condition is met and image 5 is changed to the driver assistance priority mode.

[0055] In the upper image 5 of Figures 8 and 9, (i) destination information 6a and map information 6c are displayed as navigation information in the first display area 6, (ii) there is no second display area 7, and (iii) audio information 8a (different information) of the first embodiment is displayed in the third display area 8 located below the first display area 6. This first embodiment is defined by comparison with the second embodiment described later.

[0056] Figure 8 shows the case where, while the upper image 5 is displayed, the control unit 12 identifies the situation described in (A1) above (a situation in which an object with a collision risk is detected in front of the vehicle) and the driver assistance priority condition is met. In this case, as shown in the middle image 5, the second display area 7 displaying the surrounding information 7a appears and gradually expands, while the first display area 6 and the third display area 8 gradually shrink. Then, in the lower image 5, which has been changed to the driver assistance priority mode after the middle image 5, the forward warning information 7c is displayed in the second display area 7 within the surrounding information 7a. Also, in the first display area 6 after shrinking, TBT information 6b is displayed instead of destination information 6a and map information 6c. In addition, in the third display area 8 after shrinking, audio information 8a (different type of information) in a second mode, which is simpler than the first mode, is displayed. With respect to such heterogeneous information, the second aspect being simpler than the first aspect means that (i) the second aspect contains less information than the first aspect, and (ii) images or icons used in the first aspect are omitted in the second aspect.

[0057] Figure 9 shows the case where, while the upper image 5 is displayed, the control unit 12 identifies the situation described in (A2) above (a situation in which an object with a collision risk is detected to the side or rear of the vehicle) and the driver assistance priority condition is met. In this case, as shown in the middle image 5, the second display area 7, which displays the setting information 7b and BSW information 7d, appears and gradually expands, while the first display area 6 and the third display area 8 gradually shrink. Then, after passing through the middle image 5, in the lower image 5, which has been changed to the driver assistance priority mode, the setting information 7b and BSW information 7d are clearly displayed in the second display area 7. In the third display area 8 after shrinking, the audio information 8a (different type of information) of the second mode, which is simpler than the first mode, is displayed.

[0058] In the upper image 5 of Figure 10, (i) destination information 6a and map information 6c are displayed as navigation information in the first display area 6, (ii) setting information 7b is displayed as driving assistance information in the second display area 7, and (iii) audio information 8a (different information) is displayed in the third display area 8, which is located below the second display area 7.

[0059] Figure 10 shows the case where, while the upper image 5 is displayed, the control unit 12 identifies the situation described in (A3) above (the situation in which vehicle 1 in autonomous driving mode is about to change lanes) and the driver assistance priority condition is met. In this case, as shown in the middle image 5, as the second display area 7 gradually expands, the display within the second display area 7 switches from setting information 7b to surrounding information 7a, and the first display area 6 gradually shrinks. Then, after passing through the middle image 5, in the lower image 5, which shows the change to the driver assistance priority mode, lane change information 7e indicating a lane change is displayed in the surrounding information 7a within the second display area 7, and the first display area 6 disappears.

[0060] Although not shown in the diagram, the control unit 12 may identify the situation described in (A4) above (the situation in which the transfer of driving authority from the automated driving state to the user 4 as the driver is about to take place) and, if the driving assistance priority conditions are met, change the driving assistance mode from the upper image 5 in Figure 10 to the lower image 5 in Figure 10, and alert the user 4 by showing an overview of the surrounding area 7a in the second display area 7.

[0061] (Example of change to a heterogeneous information priority mode) Figures 11 and 12 show examples of changing from the upper image 5 in the driver assistance priority mode, navigation priority mode, or default mode to the lower image 5 in the heterogeneous information priority mode. In other words, Figures 11 and 12 show the case in the display mode change process when the heterogeneous information priority condition is met and image 5 is changed to the heterogeneous information priority mode.

[0062] In the upper image 5 of Figures 11 and 12, (i) destination information 6a and map information 6c are displayed as navigation information in the first display area 6, (ii) setting information 7b is displayed as driving assistance information in the second display area 7, and (iii) audio information 8a of the second form is displayed as different information in the third display area 8, which is located below the second display area 7.

[0063] Figure 11 shows the case where, while the upper image 5 is displayed, the control unit 12 identifies the situation described in (C2) or (C3) above, and the heterogeneous information priority condition is met. In this case, as shown in the middle image 5, the first display area 6 gradually shrinks and the third display area 8 gradually expands, and the position of the second display area 7 moves upward as if being pushed by the expanding third display area 8. Then, in the lower image 5, which has been changed to the heterogeneous information priority mode after passing through the middle image 5, the audio information 8a of the first mode (that is, a more detailed mode than the audio information 8a of the second mode displayed in the upper image 5) is displayed in the expanded third display area 7, and the first display area 6 disappears.

[0064] Figure 12 shows the case where, while the upper image 5 is displayed, the control unit 12 identifies the situation described in (C1) and the heterogeneous information priority condition is met. In this case, as shown in the middle image 5, as the third display area 8 where the audio information 8a is displayed shrinks, a new third display area 8 displaying the current location-related information 8b appears above the first display area 6. Then, in the lower image 5, which has been changed to the heterogeneous information priority mode after the middle image 5, the third display area 8 where the audio information 8a was displayed disappears, and instead, the current location-related information 8b is clearly displayed in the third display area 8 that has appeared above the first display area 6. The current location-related information 8b shown in Figure 12 is, as an example, a notification to user 4 regarding a store 1.5 km away, stating, "We have a coupon. How about taking a break?" Thus, the control unit 12 may position the third display area 8 in a different position than immediately before the heterogeneous information priority condition is met.

[0065] The present invention is not limited by the embodiments and drawings described above. Modifications (including the deletion of components) can be made as appropriate without altering the essence of the invention.

[0066] The specific examples shown in Figures 5 to 12 are merely examples. The navigation information displayed in the first display area 6, the driving assistance information displayed in the second display area 7, and the different types of information displayed in the third display area 8 can be arbitrarily changed according to the purpose and are not limited to the specific examples shown in Figures 5 to 12.

[0067] This invention allows for various embodiments and modifications without departing from the broad spirit and scope of the invention. Furthermore, the embodiments described above are for illustrative purposes only and do not limit the scope of the invention. In other words, the scope of the invention is indicated not by the embodiments, but by the claims. Various modifications made within the scope of the claims and the equivalent scope of the meaning of the invention are considered to be within the scope of the invention. [Explanation of Symbols]

[0068] 1...Vehicle, 2...Dashboard, 3...Windshield, 4...User L...Indicator light, E...Eyebox, V...Virtual image 10…Head-Up Display Device 11...Display unit, 12...Control unit 20…Infotainment System 21…Navigation system, 22…Electronic equipment 30…Driving assistance systems 31... Situation analysis unit, 32... Motion detection unit, 33... ECU 5...Image, 5A...Area 6...1st display area 6a…Destination information, 6b…TBT information, 6c…Map information, 6d…Lane information 7…Second display area 7a...Surrounding information, 7b...Setting information, 7c...Forward warning information, 7d...BSW information, 7e...Lane change information 8…Third display area 8a…Audio information, 8b…Current location-related information

Claims

1. A head-up display device that projects display light representing an image onto the windshield of a vehicle, thereby displaying the image to the user on a virtual surface set in front of the windshield, The display unit that emits the aforementioned display light, The system includes a control unit that controls the image by controlling the operation of the display unit, and is capable of acquiring navigation information and other types of information different from the navigation information from the infotainment system installed in the vehicle, and is capable of acquiring driver assistance information related to driver assistance for the vehicle from the driver assistance system installed in the vehicle, The control unit, The area of ​​the image displayed on the virtual surface can be divided into a first display area, a second display area, and a third display area, each displaying a different type of information. When the navigation information, the heterogeneous information, and the driving support information are displayed simultaneously in the area of ​​the image, the navigation information is displayed in the first display area, the driving support information is displayed in the second display area which is visible to the user below the first display area, and the heterogeneous information is displayed in the third display area. Head-up display device.

2. The control unit, The proportions of the first display area, the second display area, and the third display area within the image region are changed according to at least one of the navigation information, the driving assistance information, and the heterogeneous information. When displaying the aforementioned different information in the third display area, the third display area is positioned so that it is visible to the user above the first display area, or so that it is visible to the user below the second display area. The head-up display device according to claim 1.

3. The control unit, when the priority of the driving assistance information is higher than that of the navigation information and the heterogeneous information, and when a predetermined driving assistance priority condition is met, The second display area is enlarged to a size greater than the size immediately before the driving assistance priority condition is met, or, if the second display area was not present immediately before the driving assistance priority condition is met, the second display area is made to appear. The first display area and at least one of the third display area are reduced to a size smaller than the size immediately before the driving assistance priority condition is met, or erased. The head-up display device according to claim 2.

4. The control unit, when the navigation information has a higher priority than the driving support information and the heterogeneous information, and when a predetermined navigation priority condition is met, Enlarge the first display area to a size greater than the size immediately before the navigation priority condition is met, or, if the first display area did not exist immediately before the navigation priority condition is met, make the first display area appear. Reduce the size of at least one of the second display area and the third display area to a size smaller than the size immediately before the navigation priority condition is met, or erase it. The head-up display device according to claim 3.

5. The control unit, when the priority of the heterogeneous information is higher than that of the navigation information and the driving support information, and when a predetermined heterogeneous information priority condition is met, Enlarge the third display area beyond its size immediately before the heterogeneous information priority condition is met, or position the third display area in a different location than immediately before the heterogeneous information priority condition is met, or, if the third display area was not present immediately before the heterogeneous information priority condition is met, make the third display area appear. The first display area and at least one of the second display area are reduced in size to or erased from their size immediately before the heterogeneous information priority condition is met. The head-up display device according to claim 4.

6. When the control unit is displaying map information as navigation information in the first display area, and the driving assistance priority condition or the heterogeneous information priority condition is met, and the first display area is reduced to a size smaller than the size immediately before the driving assistance priority condition or the heterogeneous information priority condition is met, In the reduced-size first display area, TBT (Turn-by-Turn) information is displayed as navigation information instead of the map information. The head-up display device according to claim 5.

7. When the control unit is displaying the vehicle's surrounding information as the driving assistance information in the second display area, and the navigation priority condition or the heterogeneous information priority condition is met, and the second display area is reduced to a size smaller than the size immediately before the navigation priority condition or the heterogeneous information priority condition is met, In the reduced second display area, instead of the surrounding information, setting information indicating the settings status of the driver assistance system is displayed as the driver assistance information. The head-up display device according to claim 5.

8. When the control unit is displaying the heterogeneous information in the third display area in the first manner, and the driving assistance priority condition or the navigation priority condition is met, and the third display area is reduced to a size smaller than the size immediately before the driving assistance priority condition or the navigation priority condition is met, The third display area after reduction is used to display the different types of information in a second mode that is simpler than the first mode. A head-up display device according to any one of claims 5 to 7.

Images