Vehicle display control device, method, program, and vehicle display system

Abstract

To make it easier for the crew to recognize when they need to take action. [Solution] The action plan creation ECU 60 creates the action plan required for the vehicle, which can switch between autonomous and manual driving. The HUD 56 and meter display 58 are located inside the vehicle's cabin. The display control ECU 42 displays the action plan created by the action plan creation ECU 60 on the HUD 56 and meter display 58, and also highlights the action plan performed during manual driving compared to the action plan performed during autonomous driving.

Description

Technical Field

[0001] The present disclosure relates to a vehicle display control device, a vehicle display control method, a vehicle display control program, and a vehicle display system.

Background Art

[0002] Patent Document 1 describes a technique for displaying, on a display, a route for guiding a vehicle to a destination such that an automatic driving section and a manual driving section can be distinguished from each other, and for displaying information indicating the behavior of the vehicle within the automatic driving section.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In a vehicle capable of switching between automatic driving and manual driving, in order to realize a smooth switch between automatic driving and manual driving, it is required to surely make the occupant recognize the timing when the operation of the occupant is necessary. On the other hand, the technique described in Patent Document 1 emphasizes the display of the automatic driving section more than the display of the manual driving section, and there is room for improvement in making the occupant recognize the timing when the operation of the occupant is necessary.

[0005] The present disclosure has been made in consideration of the above facts, and an object thereof is to obtain a vehicle display control device, a vehicle display control method, a vehicle display control program, and a vehicle display system capable of making the occupant easily recognize the timing when the operation of the occupant is necessary.

Means for Solving the Problems

[0006] The vehicle display control device according to the first embodiment includes a display control unit that, while displaying a plurality of action plans, each including an action plan performed in automatic driving and an action plan performed in manual driving, created by a creation unit that creates an action plan required for a vehicle capable of switching between automatic driving and manual driving, on a display unit provided inside the vehicle, emphasizes the display of the action plan performed in manual driving compared to the display of the action plan performed in automatic driving.

[0007] In the first embodiment, a vehicle capable of switching between autonomous and manual driving is required to create an action schedule by a creation unit. The display control unit then displays multiple action schedules created by the creation unit, including action schedules performed in autonomous driving and action schedules performed in manual driving, on a display unit installed in the vehicle's interior. Among the multiple action schedules, the display of the action schedules performed in manual driving is highlighted compared to the display of the action schedules performed in autonomous driving. By highlighting the action schedules performed in manual driving in this way, it becomes easier for the occupant to recognize when occupant operation is required.

[0008] In the second embodiment, in the first embodiment, the display control unit displays the action schedule on the display unit with information including a string indicating whether it is an automated or manual operation, and emphasizes the display of the action schedule performed in manual operation more than the display of the action schedule performed in automated operation by inverting the color of the string and the color of the background of the string.

[0009] According to the second embodiment, a limited color scheme can be used to clearly distinguish and allow the occupant to recognize between autonomous driving and manual driving. Furthermore, even when it is difficult to ensure sufficient screen contrast optically (for example, when the display unit is a HUD), it is possible to make it easier for the occupant to recognize when they need to take action.

[0010] In the third embodiment, in the first embodiment, the display control unit displays the action schedule on the display unit using information including a string of characters, and in the case of the display of the action schedule performed in manual operation, the color of the inner part of the string enclosed by a frame, which serves as the background of the string of characters, is made different from the color of the string of characters and the background color of the display area of ​​the display unit, thereby emphasizing the display of the action schedule performed in automatic operation.

[0011] According to the third embodiment, the display of the action schedule performed by manual operation can be emphasized with a limited number of colors.

[0012] A fourth aspect is that, in the first aspect, the display unit includes a meter display and a HUD, and the display control unit causes the action schedule to be displayed on the display unit as information including a string of characters, and with respect to the meter display, the display of the action schedule performed in manual driving is emphasized more than the display of the action schedule performed in autonomous driving by changing the color of at least one of the string of characters and the background of the string of characters, and with respect to the HUD, the display of the action schedule performed in manual driving is emphasized more than the display of the action schedule performed in autonomous driving by inverting the color of the string of characters and the background of the string of characters.

[0013] According to the fourth embodiment, it is possible to perform highlighting according to the respective characteristics of a meter display, which is relatively easy to change colors for, and a HUD with a limited color scheme.

[0014] The fifth embodiment is, in any one embodiment of the first to fourth, the display control unit causes the display unit to display an indication that manual operation has ended when the location or time of the action scheduled to be performed manually by the occupant has passed.

[0015] According to the fifth aspect, by clearly communicating the end of manual operation, the occupant can confidently release from the operation.

[0016] The sixth aspect is, in the first aspect, the creation unit creates an action plan including a plurality of action plans, the display unit includes a meter display and a HUD, and the display control unit displays on the meter display action plans in which the distance to the action location or the time until the action is performed is less than or equal to a first predetermined value, and displays on the HUD action plans in which the distance to the action location or the time until the action is performed is less than or equal to a second predetermined value which is smaller than the first predetermined value.

[0017] According to the sixth embodiment, the immediate action schedule and subsequent action schedules are displayed separately on the meter display and HUD, making it easier for the crew to recognize the action schedule.

[0018] The seventh embodiment is an embodiment of any one of the first to fifth, wherein the creation unit creates an action plan that includes multiple action plans, and the display control unit, when displaying multiple action plans on the display unit, displays the action plan with the shortest distance to the action location or the shortest time until the action is performed, enlarging it more than the other action plans.

[0019] According to the seventh aspect, the most important immediate action plans can be made easily recognizable to the occupants, regardless of whether the vehicle is in autonomous or manual driving mode.

[0020] The eighth aspect of the vehicle display control method involves displaying a plurality of action plans, each including an action plan performed under automatic driving and an action plan performed under manual driving, created by a creation unit that creates action plans required for a vehicle capable of switching between automatic and manual driving, on a display unit installed inside the vehicle, and having a computer perform a process that includes highlighting the display of the action plans performed under manual driving compared to the display of the action plans performed under automatic driving.

[0021] According to the eighth aspect, it is possible to make it easier for the crew to recognize when an action by the crew is required.

[0022] The vehicle display control program according to the ninth aspect causes a computer to execute a process including emphasizing the display of the action plan to be performed in manual driving compared to the display of the action plan to be performed in automated driving, in a state where a plurality of the action plans including the action plan to be performed in automated driving and the action plan to be performed in manual driving, which are created by a creation unit that creates an action plan required for a vehicle capable of switching between automated driving and manual driving, are displayed on a display unit provided in the vehicle interior.

[0023] According to the ninth aspect, it is possible to make it easier for a vehicle occupant to recognize the timing when the occupant's operation is required.

[0024] The vehicle display system according to the tenth aspect includes a creation unit that creates an action plan required for a vehicle capable of switching between automated driving and manual driving, a display unit provided in the vehicle interior, and a display control unit that emphasizes the display of the action plan to be performed in manual driving compared to the display of the action plan to be performed in automated driving, in a state where a plurality of the action plans including the action plan to be performed in automated driving and the action plan to be performed in manual driving, which are created by the creation unit, are displayed on the display unit.

[0025] According to the tenth aspect, it is possible to make it easier for a vehicle occupant to recognize the timing when the occupant's operation is required.

Advantages of the Invention

[0026] The present disclosure has an effect that it is possible to make it easier for a vehicle occupant to recognize the timing when the occupant's operation is required.

Brief Description of the Drawings

[0027] [Figure 1] It is a block diagram showing a schematic configuration of an in-vehicle system according to an embodiment. [Figure 2] It is an image diagram showing an example of display on a HUD and a MET. [Figure 3] It is a flowchart showing an example of HUD display control processing. [Figure 4] This is an image illustrating an example of how the HUD might display. [Figure 5] This is an image illustrating an example of how the HUD might display. [Figure 6] This is an image illustrating an example of how the HUD might display. [Figure 7] This is an image illustrating an example of displaying the second string with its colors inverted. [Figure 8] This is an image illustrating an example of how the HUD might display. [Figure 9] This is an image illustrating an example of how the HUD might display. [Figure 10] This is an image illustrating an example of how the HUD might display. [Figure 11] This flowchart shows an example of MET display control processing. [Figure 12] This is an image illustrating an example of changing the color of the second string when displaying it. [Figure 13] This is an illustrative diagram showing an example of a display indicating the end of manual operation. [Modes for carrying out the invention]

[0028] Hereinafter, an example of an embodiment of this disclosure will be described in detail with reference to the drawings. The in-vehicle system 10 shown in Figure 1 is equipped with a communication bus 12, to which a group of surrounding situation acquisition devices 14, a group of vehicle driving state detection sensors 26, an automatic driving ECU (Electronic Control Unit) 34, an action plan creation ECU 60, and a display control ECU 42 are connected. Note that Figure 1 shows only a part of the in-vehicle system 10. In the following, the vehicle on which the in-vehicle system 10 is installed will be referred to as the "self-vehicle". The self-vehicle is capable of switching between automatic driving and manual driving, as will be described later.

[0029] The surrounding environment acquisition device group 14 includes a GPS (Global Positioning System) device 16, an in-vehicle communication device 18, a radar device 22, and a camera 24, among others, as devices that acquire information indicating the conditions of the surrounding environment of the vehicle.

[0030] The GPS device 16 determines the position of its own vehicle by receiving GPS signals from multiple GPS satellites. The accuracy of positioning improves as the number of receivable GPS signals increases. The on-board communication device 18 is a communication device that performs at least one of vehicle-to-vehicle communication with other vehicles and vehicle-to-infrastructure communication with roadside units.

[0031] The radar system 22 includes multiple radar systems with different detection ranges, and detects objects such as pedestrians and other vehicles around the vehicle as point cloud information, and acquires the relative position and relative speed of the detected objects and the vehicle. The radar system 22 also incorporates a processing unit that processes the detection results of surrounding objects. Based on the changes in relative position and relative speed of individual objects included in the most recent multiple detection results, this processing unit excludes noise, roadside objects such as guardrails, etc. from the monitoring targets, and tracks and monitors specific objects such as pedestrians and other vehicles as the target objects. The radar system 22 then outputs information such as the relative position and relative speed of each target object. The camera 24 captures images of the area around the vehicle with multiple cameras and outputs the captured images.

[0032] Furthermore, the vehicle driving state detection sensor group 26 includes, as multiple sensors for acquiring the vehicle's driving state, a steering angle sensor 28 for detecting the vehicle's steering angle, a vehicle speed sensor 30 for detecting the vehicle's driving speed, and an acceleration sensor 32 for detecting the acceleration applied to the vehicle.

[0033] The autonomous driving ECU 34 is connected to a throttle ACT (actuator) 36, which changes the throttle opening of the vehicle, and a brake ACT 38, which changes the braking force generated by the vehicle's braking system. The autonomous driving ECU 34 is also connected to a steering ACT 40, which changes the amount of steering input from the vehicle's steering system.

[0034] The autonomous driving ECU 34 includes a CPU (Central Processing Unit), memory such as ROM (Read Only Memory) and RAM (Random Access Memory), non-volatile storage such as an HDD (Hard Disk Drive) and SSD (Solid State Drive), and a communication I / F (Interface). The memory stores autonomous driving software. When the autonomous driving mode is selected, the autonomous driving ECU 34 performs autonomous driving processing, which allows the vehicle to move automatically without driver intervention from the vehicle's occupants, by executing the autonomous driving software via the CPU. The autonomous driving processing involves determining the situation of the vehicle and its surroundings based on information obtained from the surrounding situation acquisition device group 14 and the vehicle driving state detection sensor group 26, and controlling the throttle ACT 36, brake ACT 38, and steering ACT 40.

[0035] In the embodiment, the automated driving system operates the vehicle automatically without any driving operations by the vehicle's occupants, as described above. On the other hand, manual driving in the embodiment includes cases where the automated driving ECU 34 performs some of the driving operations, and the vehicle's occupants perform the remaining operations. For example, in manual driving mode, the automated driving ECU 34 performs speed adjustment, and only the steering operation is performed by the vehicle's occupants.

[0036] The ECU 60 for creating the action plan includes a CPU, memory such as ROM and RAM, a non-volatile storage unit such as an HDD or SSD, and a communication interface. Map information is stored in the memory unit. The ECU 60 creates the action plan required by the vehicle. Specifically, when the vehicle's destination is set, the ECU 60 compares the vehicle's current position and the vehicle's destination position obtained from the GPS device 16 with the map information and searches for a route to the destination.

[0037] The action plan creation ECU 60 further subdivides the searched route (the action plan for the vehicle) into action plans such as right and left turns, lane changes, and merging. For each subdivided action plan, it also decides whether to perform the planned action using automated driving or manual driving. In this embodiment, the basic principle is to perform the planned action using automated driving by the automated driving ECU 34. However, for actions where automated driving is difficult, such as when the planned action is "merging" and the merging lane is short, it is decided to perform the action using manual driving.

[0038] Each action plan included in the action plan contains information indicating the action to be performed, such as turning right or left, or changing lanes; information indicating whether the action will be performed by automated driving or manual driving; and information indicating the location where the action will be performed (e.g., latitude and longitude). The action plan created by the action plan creation ECU 60 is transmitted to the automated driving ECU 34 and the display control ECU 42. The action plan creation ECU 60 functions as an example of a creation unit.

[0039] The display control ECU 42 includes a CPU 44, memory 46 such as ROM and RAM, a non-volatile storage unit 48 such as an HDD or SSD, and a communication interface 50. The CPU 44, memory 46, storage unit 48, and communication interface 50 are interconnected via an internal bus 52 to enable communication with each other. The storage unit 48 stores a display control program 54. The display control ECU 42 reads the display control program 54 from the storage unit 48 and loads it into the memory 46. The CPU 44 then executes the display control program 54 loaded into the memory 46, thereby performing the HUD display control processing and MET display control processing described later. The display control program 54 is an example of a vehicle display control program.

[0040] The display control ECU 42 is connected to a head-up display (hereinafter referred to as HUD) 56 and a meter display 58 (hereinafter referred to as MET), which are respectively installed in the interior of the vehicle. The HUD 56 in this embodiment is a small HUD that displays a portion of the forward field of view of the vehicle's occupants through reflection from the windshield glass, etc. (forming an image in the lower foreground). The MET 58 is a display installed on the instrument panel of the vehicle. The display control ECU 42 controls the display of information on the HUD 56 and MET 58.

[0041] In other words, the display control ECU 42 displays the action plan created by the action plan creation ECU 60 on the HUD 56 and MET 58, and also emphasizes the display of the action plan performed during manual driving compared to the display of the action plan performed during autonomous driving. Note that the display control ECU 42 is an example of a display control unit and a vehicle display control device, and the HUD 56 and MET 58 are examples of display units. An example of the display on the HUD 56 and MET 58 is shown in Figure 2. Furthermore, the HUD 56, MET 58, action plan creation ECU 60, and display control ECU 42 are an example of a vehicle display system.

[0042] Next, the operation of this embodiment will be explained. The display control ECU 42 performs the HUD display control processing shown in Figure 3 while the vehicle's ignition is on.

[0043] In step 100 of the HUD display control processing, the display control ECU 42 determines whether the vehicle's destination is set in the action plan creation ECU 60. If the vehicle's destination is set, the action plan creation ECU 60 creates an action plan for the vehicle that includes multiple action plans and transmits it to the display control ECU 42 or the like. Therefore, the display control ECU 42 makes the determination in step 100 based on whether or not it has received an action plan for the vehicle that includes multiple action plans from the action plan creation ECU 60.

[0044] If the determination in step 100 is affirmative, the process proceeds to step 102. In step 102, the display control ECU 42 refers to the action plan received from the action plan creation ECU 60 and determines whether the action plan includes an action where the planned location of the action is within a distance L1 from the vehicle's current position. An example of distance L1 is 10 km. Distance L1 is an example of a second predetermined value.

[0045] If the determination in step 100 or step 102 is negative, the process proceeds to step 134. In step 134, the display control ECU 42 does not display the action schedule on the HUD 56, as shown in Figure 4 as an example. After the processing in step 134, the process returns to step 100.

[0046] Furthermore, if the determination in step 102 is affirmative, the process proceeds to step 104. In step 104, the display control ECU 42 determines the number of planned actions included in the action plan whose planned locations are within a distance L1 from the vehicle's current position, and branches according to the determination result.

[0047] If the number of planned actions whose location is within a distance L1 from the vehicle's current position is "1", the system proceeds from step 104 to step 106. In step 106, the display control ECU 42 determines whether the most recent planned action whose location is within a distance L1 from the vehicle's current position is at a distance of L2 or more from the vehicle's current position. An example of distance L2 is 1 km.

[0048] If the determination in step 106 is affirmative, the system proceeds to step 108. In step 108, the display control ECU 42 determines whether the most recent action schedule is an action schedule to be performed by autonomous driving. If the determination in step 108 is affirmative, the system proceeds to step 110. In step 110, the display control ECU 42 displays the most recent action schedule 70 in the action schedule display area of ​​the HUD 56 (the rightmost area of ​​the display area of ​​the HUD 56), as shown in Figure 5 as an example, and returns to step 100.

[0049] The planned action 70 includes a first string of characters indicating the distance from the vehicle's current position to the planned location of the action (3.2km in the example in Figure 5) and an icon indicating the planned action (lane change in the example in Figure 5). The planned action 70 also includes a second string of characters indicating whether the planned action will be performed by automated driving or manual driving (ASSIST in the example in Figure 5, indicating automated driving). In this embodiment, when displaying "ASSIST" to indicate automated driving as the second string of characters, the second string of characters is displayed in a high-luminosity color (e.g., white), and the background of the second string of characters (the area inside the frame surrounding the second string of characters) is displayed in a low-luminosity color (e.g., black).

[0050] Furthermore, if the determination in step 108 is rejected, the process proceeds to step 112. In step 112, the display control ECU 42, as shown in Figures 6 and 7 as an example, inverts the most recent action schedule 72 in the action schedule display area of ​​the HUD 56 and returns to step 100. Specifically, if the action to be performed is to be driven manually, the second string will be "MANUAL". In this embodiment, when "MANUAL" indicating manual operation is displayed as the second string, the second string is displayed in a low-luminosity color (e.g., black), and the background of the second string is displayed in a high-luminosity color (e.g., white).

[0051] In this embodiment, the background color of the entire display area of ​​the HUD 56 is set to a low-luminosity color (for example, black). When displaying an action schedule performed during autonomous driving, the background color of the second string ("ASSIST," indicating autonomous driving) (the part inside the frame surrounding the second string) is almost the same as the background color of the entire display area of ​​the HUD 56, so the second string does not stand out much. In contrast, when displaying an action schedule performed during manual driving, the background color of the second string ("MANUAL," indicating manual driving) is different from the color of the second string and the background color of the entire display area of ​​the HUD 56, so the second string is highlighted. This makes it easier for the occupant to recognize when occupant intervention is required for the action schedule 72 performed during manual driving. Note that differentiating the colors can be achieved, for example, by selecting a color that is a predetermined distance or more away from the color of the second string and the background color of the entire display area of ​​the HUD 56 in an arbitrary color space as the background color of the second string.

[0052] Furthermore, if the location of the action to be performed is within a distance L1 from the vehicle's current position, and the most recent planned action is less than a distance L2 from the vehicle's current position, the determination in step 106 is negated and the system proceeds to step 114. In step 114, the display control ECU 42 determines whether the most recent planned action is an action to be performed by autonomous driving. If the determination in step 114 is affirmative, the system proceeds to step 116.

[0053] In step 116, the display control ECU 42 enlarges the most recent action plan 74 (second string = "ASSIST") in the action plan display area of ​​the HUD 56, as shown in Figure 8 as an example, and returns to step 100. This allows the occupants to recognize that the location where the action in the enlarged action plan 74 is scheduled to be performed is less than L2 away from the vehicle's current position.

[0054] Furthermore, if the determination in step 114 is rejected, the process proceeds to step 118. In step 118, the display control ECU 42 enlarges and inverts the most recent action plan 76 (second string = "MANUAL") in the action plan display area of ​​the HUD 56, as shown in Figure 9 as an example, and returns to step 100. This allows the occupant to recognize that the location where the action in the enlarged action plan 76 is scheduled to be performed is approaching within a distance of less than L2 from the vehicle's current position. In addition, by inverting the second string (= "MANUAL") of the action plan 76, it becomes easier for the occupant to recognize when occupant operation is required for action plans 76 that are performed manually.

[0055] Furthermore, in step 104, if the number of planned actions whose locations are within a distance L1 from the vehicle's current position is greater than one, the process proceeds from step 104 to step 120. In step 120, the display control ECU 42 determines whether the most recent planned action among the multiple planned actions whose locations are within a distance L1 from the vehicle's current position is at a distance of L2 or more from the vehicle's current position.

[0056] If the determination in step 120 is affirmative, the process proceeds to step 122. In step 122, the display control ECU 42 determines whether all of the multiple planned actions, whose locations are within a distance L1 from the vehicle's current position, are planned to be performed by autonomous driving. If the determination in step 122 is affirmative, the process proceeds to step 124.

[0057] In step 124, the display control ECU 42 displays n action plans in the action plan display area of ​​the HUD 56 and returns to step 100. "n" is the maximum number of action plans that can be displayed in the action plan display area of ​​the HUD 56; an example of the maximum number of displays n is n=2. If the number of action plans whose locations are within a distance L1 from the vehicle's current position is greater than n, the most recent n action plans are selected and displayed on the HUD 56.

[0058] Furthermore, if the determination in step 122 is rejected, the system proceeds to step 126. In step 126, the display control ECU 42 displays n action plans in the action plan display area of ​​the HUD 56, and inverts the manual driving action plans included among the n action plans, before returning to step 100. This makes it easier for the occupant to recognize when they need to take action regarding the manual driving action plans included among the n action plans.

[0059] Furthermore, if the determination in step 120 is negative, the process proceeds to step 128. In step 128, the display control ECU 42 determines whether all of the multiple planned actions, whose locations are within a distance L1 from the vehicle's current position, are planned to be performed by autonomous driving. If the determination in step 128 is positive, the process proceeds to step 130.

[0060] In step 130, the display control ECU 42 displays n action plans in the action plan display area of ​​the HUD 56, enlarges the most recent action plan, and returns to step 100. This allows the occupants to recognize that the location where the action in the enlarged most recent action plan is scheduled to be performed is less than L2 away from the vehicle's current position.

[0061] Furthermore, if the determination in step 128 is rejected, the process proceeds to step 132. In step 132, the display control ECU 42 displays n action plans 78 in the action plan display area of ​​the HUD 56, as shown in Figure 10 as an example, enlarges the most recent action plan, and inverts the manual driving action plans included in the n action plans 78. This makes it easier for the occupant to recognize when they need to take action regarding the manual driving action plans included in the n action plans 78. It also allows the occupant to recognize that the location where the action in the enlarged most recent action plan is scheduled to be performed is less than a distance L2 from the vehicle's current position.

[0062] Furthermore, the display control ECU 42 also performs the MET display control processing shown in Figure 11 while the vehicle's ignition is on. This MET display control processing is the same as the HUD display control processing (Figure 3) described above, except that it displays the planned actions on MET 58, applies the maximum number of displays m instead of the maximum number of displays n, and applies the distance L3 instead of the distance L1. For this reason, the same reference numeral is used for corresponding steps and their explanation is omitted. Note that the maximum number of displays m is m > n, and one example is m = 3. Also, the distance L3 is L3 ≥ L1, and one example is L3 = 20 km or L3 = 10 km. Distance L3 is an example of a first predetermined value.

[0063] As an example, Figure 2 shows the state where the MET58 displays the maximum number of action plans, m=3, as action plan 80. In action plan 80 as well, the action plan for manual driving (the second action plan) included in the m action plans is displayed in inverted. That is, for the action plan for manual driving, the background color of the second string ("MANUAL" indicating manual driving) is made different from the color of the second string and the background color of the entire display area of ​​the MET58, thereby highlighting the second string. This makes it easier for the crew to recognize when they need to take action regarding the manual driving action plans included in the m action plans.

[0064] As described above, in this embodiment, the action plan creation ECU 60 creates the action plan required for the vehicle, which can switch between autonomous and manual driving. The HUD 56 and MET 58 are located inside the vehicle's cabin. The display control ECU 42 displays the action plan created by the action plan creation ECU 60 on the HUD 56 and MET 58, and also highlights the action plan performed during manual driving compared to the action plan performed during autonomous driving. This makes it easier for the occupant to recognize when they need to take action.

[0065] Furthermore, in this embodiment, the display control ECU 42 displays the action schedule on the HUD 56 and MET 58 using information including text strings. The display control ECU 42 also emphasizes the action schedule displayed during manual driving by inverting the colors of the text strings and the background of the text strings, compared to the action schedule displayed during autonomous driving. This allows the occupant to clearly distinguish and recognize autonomous driving and manual driving with a limited color scheme. In addition, even with the HUD 56, where optical contrast is difficult to ensure, it is possible to make it easier for the occupant to recognize when an action is required.

[0066] Furthermore, in this embodiment, the display control ECU 42 emphasizes the display of the action schedule performed during manual driving by making the color of the area inside the frame surrounding the string, which serves as the background of the string, different from the color of the string and the background color of at least the area in the display area of ​​the HUD 56 or MET 58 where the string is displayed, thereby emphasizing it more than the display of the action schedule performed during autonomous driving. This makes it possible to emphasize the display of the action schedule performed during manual driving with fewer colors.

[0067] In this embodiment, the action plan creation ECU 60 creates an action plan that includes multiple action plans, and the display unit includes a MET 58 as the first display unit and a HUD 56 as the second display unit. The display control ECU 42 displays action plans on the MET 58 where the distance to the action point is less than or equal to distance L3, and displays action plans on the HUD 56 where the distance to the action point is less than distance L3, less than or equal to distance L1. By displaying the nearest action plan and subsequent action plans separately on the MET 58 and HUD 56, it is possible to make it easier for the occupant to recognize the action plan. In addition, by using the MET 58 as the first display unit and the HUD 56 as the second display unit, the amount of eye movement required for the occupant to view the first and second display units can be reduced.

[0068] Furthermore, in this embodiment, the action plan creation ECU 60 creates an action plan that includes multiple action plans. The display control ECU 42, when displaying multiple action plans on the HUD 56 or MET 58, displays the action plan with the shortest distance to the action point or the shortest time until the action is performed more enlarged than the other action plans. This makes it easier for the occupant to recognize the most important and immediate action plan, regardless of whether the vehicle is in autonomous or manual driving mode.

[0069] In the above, we described a method of emphasizing the display of the action schedule performed during manual operation by inverting the colors of the second string and the background of the second string, thereby emphasizing it more than the display of the action schedule performed during autonomous operation. However, emphasizing the display of the action schedule performed during manual operation more than the display of the action schedule performed during autonomous operation is not limited to inverting the colors of the second string and the background of the second string.

[0070] For example, the display of the action schedule performed during manual driving may be made more prominent than the display of the action schedule performed during autonomous driving by changing the color (at least one of the brightness, hue, and saturation) of the second string and the background of the second string. As an example, Figure 12 shows an example where the background color of the second string is changed to red. In this case as well, it is possible to make it easier for the occupant to recognize when occupant operation is required.

[0071] While changing the color of at least one of the second string and the background of the second string can also be applied to the HUD56, it is preferable to apply it to the MET58 because the HUD56 has fewer colors and it is difficult to ensure sufficient optical contrast on the screen. In other words, the display control ECU42 displays the action schedule on the display unit using information including the string. Furthermore, with respect to the MET58, the display of the action schedule performed during manual driving is emphasized more than the display of the action schedule performed during autonomous driving by changing the color of at least one of the second string and the background of the second string. Furthermore, with respect to the HUD56, the display of the action schedule performed during manual driving is emphasized more than the display of the action schedule performed during autonomous driving by inverting the color of the second string and the color of the background of the second string. According to this embodiment, it is possible to perform emphasis displays according to the respective characteristics of the MET58, which is relatively easy to change colors, and the HUD56, which has fewer colors.

[0072] Furthermore, for example, the display of the action schedule performed during manual operation may be emphasized more than the display of the action schedule performed during autonomous operation by enclosing the second string of characters or the action schedule line with a border. Alternatively, for example, the action schedule performed during manual operation may be emphasized more than the display of the action schedule performed during autonomous operation by making it flash.

[0073] Furthermore, while the above describes a configuration in which planned actions where the distance to the action point is less than or equal to distance L3 are displayed on MET58, and planned actions where the distance to the action point is less than or equal to distance L1 are displayed on HUD56, the system is not limited to this configuration. For example, planned actions where the time until the action is performed is less than or equal to a first predetermined value may be displayed on MET58, and planned actions where the time until the action is less than or equal to a second predetermined value (which is less than the first predetermined value) may be displayed on HUD56.

[0074] Furthermore, while the above describes a configuration in which no specific display is shown when manual operation by the occupant has ended, the system is not limited to this configuration. For example, the display control ECU 42 may be configured to display an indication of the end of manual operation on at least one of the HUD 56 and MET 58 when the occupant has passed the planned location or time for a manual operation. An example of an indication of the end of manual operation is shown in Figure 13. This clearly communicates the end of manual operation, allowing the occupant to confidently relinquish control.

[0075] Furthermore, although the above describes an embodiment in which the action plan is displayed on both the HUD56 and MET58, the invention is not limited to this, and the action plan may be displayed on only one of the HUD56 or MET58. Also, the display unit is not limited to the HUD56 or MET58, and for example, the action plan may be displayed on a central monitor located in the center of the vehicle's instrument panel.

[0076] Furthermore, while the above example describes a configuration in which the automated driving ECU 34 performs some of the driving operations in manual driving, and the occupants of the vehicle perform the remaining operations, the system is not limited to this configuration. For example, in manual driving mode, the occupants of the vehicle may perform all driving operations.

[0077] Furthermore, while the above describes an embodiment in which the background color of the entire display area of ​​HUD56 and MET58 is a low-luminosity color (e.g., black), it is not limited to this, and other colors may be used. Also, it is not limited to the entire display area of ​​HUD56 and MET58 having a single background color, and the background colors of the display areas of HUD56 and MET58 may differ in parts. In this case, it is preferable to make the color of the part inside the frame surrounding the second string different from the color of the second string and the background color of at least the area of ​​the HUD56 and MET58 display area in which the second string is displayed. This makes it possible to highlight the action schedule performed by manual driving with a limited color scheme.

[0078] Furthermore, the above describes an embodiment in which a display control program 54, which is an example of a vehicle display control program related to this disclosure, is pre-stored (installed) in the storage unit 48 of the display control ECU 42. However, the vehicle display control program related to this disclosure can also be provided in a form recorded on a non-temporary recording medium such as a CD-ROM, DVD-ROM, memory card, HDD, or SSD. [Explanation of symbols]

[0079] 10 In-vehicle systems 34 Autonomous driving ECU 42 Display Control ECU 56. Head-Up Display (HUD) 58 Meter Display (MET) 60. Action Plan Creation ECU

Claims

1. A vehicle display control device that includes a display control unit that, when a plurality of action plans, each including an action plan performed under autonomous driving and an action plan performed under manual driving, created by a creation unit that creates action plans required for a vehicle capable of switching between autonomous and manual driving, are displayed on a display unit installed inside the vehicle, the display of the action plans performed under manual driving is emphasized compared to the display of the action plans performed under autonomous driving.

2. The display control unit displays the planned actions on the display unit with information including a string indicating whether the driving is automated or manual, and the display of the planned actions performed in manual driving is emphasized more than the display of the planned actions performed in automated driving by inverting the colors of the string and the background of the string, as described in claim 1.

3. The display control unit displays the action schedule on the display unit using information including a string of characters, and, with respect to the display of the action schedule performed during manual driving, the display control unit further emphasizes the display of the action schedule performed during automatic driving by making the color of the inner part of the string of characters, which is the background of the string of characters, different from the color of the string of characters and the background color of the display area of ​​the display unit.

4. The display unit includes a meter display and a HUD. The display control unit displays the planned actions on the display unit using information including a string of characters, and with respect to the meter display, the display of the planned actions performed during manual driving is emphasized more than the display of the planned actions performed during automated driving by changing the color of at least one of the string of characters and the background of the string of characters, and with respect to the HUD, the display of the planned actions performed during manual driving is emphasized more than the display of the planned actions performed during automated driving by inverting the color of the string of characters and the background of the string of characters, according to claim 1.

5. The vehicle display control device according to any one of claims 1 to 4, wherein the display control unit causes the display unit to display an indication on the display unit that manual driving has ended when the location or time of the action scheduled to be performed manually by the occupant has passed.

6. The creation unit creates an action plan that includes multiple action plans, The display unit includes a meter display and a HUD. The display control unit causes the meter display to show, among the action plans, action plans in which the distance to the point where the action will be performed or the time until the action will be performed is less than or equal to a first predetermined value, and action plans in which the distance to the point where the action will be performed or the time until the action will be performed is less than or equal to a second predetermined value smaller than the first predetermined value, on the HUD.

7. The creation unit creates an action plan that includes multiple action plans, The vehicle display control device according to any one of claims 1 to 5, wherein when the display control unit displays multiple action plans on the display unit, the action plan with the shortest distance to the action location or the shortest time until the action is performed is displayed larger than the other action plans.

8. A vehicle display control method that involves a computer performing a process to highlight, compared to the display of the action schedule performed by the manual driving, while displaying a plurality of action schedules, each including an action schedule performed by the automatic driving and an action schedule performed by the manual driving, which have been created by a creation unit that creates action schedules required for a vehicle capable of switching between automatic and manual driving, on a display unit installed inside the vehicle's cabin.

9. On the computer, A vehicle display control program for causing a vehicle capable of switching between autonomous and manual driving to display a plurality of action plans, each containing an action plan performed under autonomous driving conditions and an action plan performed under manual driving conditions, created by a creation unit that creates action plans required for a vehicle capable of switching between autonomous and manual driving conditions, on a display unit installed inside the vehicle's cabin, and for causing a vehicle to perform a process that includes highlighting the display of the action plans performed under manual driving conditions compared to the display of the action plans performed under autonomous driving conditions.

10. A creation unit that creates the required action schedule for a vehicle that can switch between autonomous and manual driving, A display unit installed inside the vehicle, A display control unit displays a plurality of action schedules, each including an action schedule performed by automated driving and an action schedule performed by manual driving, created by the creation unit, on the display unit, and emphasizes the display of the action schedule performed by manual driving compared to the display of the action schedule performed by automated driving. A vehicle display system including this.

Images