Vehicle display control device, method, computer-readable storage medium, and vehicle display system

By highlighting the reservation of manual driving and autonomous driving actions in the display control system in the vehicle, the problem of difficulty for occupants to identify the operating timing is solved, and safe and smooth driving switching is achieved.

CN118953398APending Publication Date: 2024-11-15TOYOTA JIDOSHA KK
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411324309.6
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2020-08-31
Filing Date
2021-08-27
Publication Date
2024-11-15

AI Technical Summary

Technical Problem

In vehicles that switch between autonomous driving and manual driving, it is difficult for occupants to accurately identify the timing of operations. The prior art emphasizes interval display but is not sufficient to meet the identification needs.

Method used

Through the display control devices and systems in the vehicle, the pre-determined display of manual driving and autonomous driving actions is emphasized, and the color and background color reversal of string information, frame surround, color change and other methods are used to make manual driving display and autonomous driving display The distinction is obvious and when necessary shows that the manual driving ends, reduce the amount of sight movement, and amplify the important action reservation.

Benefits of technology

Effectively help occupants identify the timing of manual driving operations, ensure safe switching and smooth operation, reduce the need for color changes, and adapt to the characteristics of different monitors.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118953398A_ABST
    Figure CN118953398A_ABST
Patent Text Reader

Abstract

The invention relates to a vehicle display control device, a vehicle display control method, a computer readable storage medium, and a vehicle display system. An action schedule generation ECU (60) generates an action schedule requested by a host vehicle capable of switching between automatic driving and manual driving. In addition, the HUD (56) and the meter display (58) are provided in the cabin of the host vehicle. Furthermore, the display control ECU (42) causes the HUD (56) and the instrument display (58) to display the behavior schedule generated by the behavior schedule generation ECU (60), and causes the display of the behavior schedule by manual driving to be emphasized compared with the display of the behavior schedule by automatic driving.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] This application is a divisional application of the invention patent application with Chinese national application number 2021109927747, application date August 27, 2021, and invention name "Vehicle display control device, method, computer-readable storage medium and vehicle display system". Technical Field

[0002] The present disclosure relates to a vehicle display control device, a vehicle display control method, a computer-readable storage medium, and a vehicle display system. Background Art

[0003] Japanese Patent Publication No. 2018-100867 (Patent Document 1) describes a technology for displaying an autonomous driving section and a manual driving section in a distinguishable manner when a route that guides a vehicle to a destination is displayed on a display, and for displaying information indicating the behavior of the vehicle within the autonomous driving section. Summary of the invention

[0004] Problems to be solved by the invention

[0005] In a vehicle capable of switching between automatic driving and manual driving, in order to realize smooth switching between automatic driving and manual driving, it is necessary to allow the occupants to reliably recognize the timing when the occupants' operation is required. In this regard, the technology described in Patent Document 1 emphasizes the display of the automatic driving section compared with the display of the manual driving section, but there is still room for improvement in allowing the occupants to recognize the timing when the occupants' operation is required.

[0006] The present disclosure is completed in consideration of the above facts, and its purpose is to obtain a vehicle display control device, a vehicle display control method, a computer-readable storage medium, and a vehicle display system that enable passengers to easily identify the timing when the passengers' operations are required.

[0007] Methods for solving problems

[0008] The vehicle display control device involved in the first embodiment includes a display control unit, which causes a display unit arranged in a vehicle cabin capable of switching between automatic driving and manual driving to display the action plan generated by a generation unit for generating an action plan required by the vehicle, and to emphasize the display of the action plan performed by manual driving compared to the display of the action plan performed by automatic driving.

[0009] In the first embodiment, a planned action required by a vehicle capable of switching between automatic driving and manual driving is generated by a generating unit. Furthermore, a display control unit causes a display unit provided in a vehicle cabin to display the planned action generated by the generating unit, and causes the display of the planned action to be performed by manual driving to be emphasized compared to the display of the planned action to be performed by automatic driving. In this way, by emphasizing the display of the planned action to be performed by manual driving, it is possible for a passenger to easily recognize the timing at which the passenger's operation is required.

[0010] The second method is that in the first method, the display control unit uses information including a character string to cause the display unit to display the planned action, and by inverting the color of the character string and the color of the background portion of the character string for the display of the planned action to be performed by manual driving, the display of the planned action to be performed by manual driving is emphasized compared to the display of the planned action to be performed by automatic driving.

[0011] According to the second embodiment, the occupants can clearly distinguish and recognize the automatic driving and manual driving by using fewer colors. In addition, even in the case where it is difficult to optically ensure the contrast of the screen (for example, when the display unit is a head-up display (HUD)), the occupants can easily recognize the timing when the occupants' operation is required.

[0012] A third method is that in the second method, the display control unit makes the color of the inner part of the character string surrounded by a frame serving as the background part of the character string inconsistent with the color of the character string and the color of the background of at least an area in the display area of ​​the display unit where the character string is displayed, so that the display of the planned action to be performed by manual driving is emphasized compared with the display of the planned action to be performed by automatic driving.

[0013] According to the third aspect, the display of the planned action to be performed by manual driving can be emphasized with less color.

[0014] The fourth method is that in the first method, the display unit includes an instrument display and a head-up display, and the display control unit uses information including a character string to cause the display unit to display the planned action, and with respect to the instrument display, by changing the color of at least one of the character string and a background portion of the character string for displaying the planned action to be performed by manual driving, the display of the planned action to be performed by manual driving is emphasized compared to the display of the planned action to be performed by automatic driving, and with respect to the head-up display, by inverting the color of the character string and the color of the background portion of the character string for displaying the planned action to be performed by manual driving, the display of the planned action to be performed by manual driving is emphasized compared to the display of the planned action to be performed by automatic driving.

[0015] According to the fourth aspect, it is possible to implement an emphasis display that is suitable for the characteristics of the instrument display whose color is relatively easy to change and the head-up display whose color is relatively simple.

[0016] The fifth mode is that, in any one of the first to fourth modes, the display control unit causes the display unit to display a display indicating the end of manual driving when the passenger has exceeded the scheduled location of the action to be manually performed or the scheduled time of the action to be manually performed by the passenger.

[0017] According to the fifth aspect, by clearly notifying the end of manual driving, the occupant can be relieved from the operation.

[0018] The sixth mode is that, in any one of the first to fifth modes, the generating unit generates an action plan including a plurality of the action plans, the display unit includes a first display unit and a second display unit, and the display control unit causes the first display unit to display the action plans in which the distance to the location where the action is to be performed or the time to perform the action is less than a first predetermined value, and causes the second display unit to display the action plans in which the distance to the location where the action is to be performed or the time to perform the action is less than a second predetermined value that is smaller than the first predetermined value.

[0019] According to the sixth aspect, the most recent planned action and the subsequent planned action are displayed separately on the two display units, thereby making it easier for the occupant to recognize the planned action.

[0020] A seventh aspect is that, in the sixth aspect, the first display unit is a meter display, and the second display unit is a head-up display.

[0021] According to the seventh aspect, the amount of movement of the line of sight of the occupant who visually checks the first display unit and the second display unit can be reduced.

[0022] The eighth mode is that, in any one of the first to seventh modes, the generating unit generates an action plan including a plurality of the action plans, and the display control unit, when causing the display unit to display the plurality of the action plans, enlarges and displays the action plan having the shortest distance to the location where the action is to be performed or the shortest time to perform the action compared to the other action plans.

[0023] According to the eighth aspect, regardless of automatic driving or manual driving, it is possible to make it easy for the occupant to recognize the most important and immediate planned action.

[0024] The vehicle display control method involved in the ninth embodiment performs the following processing through a computer, and the processing includes: causing a display unit arranged in a vehicle cabin capable of switching between automatic driving and manual driving to display the action plan generated by a generation unit for generating an action plan required by the vehicle, and emphasizing the display of the action plan performed by manual driving compared to the display of the action plan performed by automatic driving.

[0025] According to the ninth aspect, it is possible to make it easy for the occupant to recognize the timing at which the occupant's operation is required.

[0026] The computer-readable storage medium involved in the tenth method stores a vehicle display control program for causing a computer to execute the following processing, the processing including: causing a display unit arranged in a vehicle cabin that can switch between automatic driving and manual driving to display the action plan generated by a generation unit that generates an action plan required by the vehicle, and emphasizing the display of the action plan performed by manual driving compared to the display of the action plan performed by automatic driving.

[0027] According to the tenth aspect, it is possible to make it easy for the occupant to recognize the timing at which the occupant's operation is required.

[0028] The vehicle display system involved in the eleventh embodiment includes: a generating unit, which generates an action plan required by a vehicle capable of switching between automatic driving and manual driving; a display unit, which is arranged in the cabin of the vehicle; and a display control unit, which causes the display unit to display the action plan generated by the generating unit, and to emphasize the display of the action plan to be performed by manual driving compared to the display of the action plan to be performed by automatic driving.

[0029] According to the eleventh aspect, it is possible to make it easy for the occupant to recognize the timing at which the occupant's operation is required.

[0030] Effects of the Invention

[0031] The present disclosure has an effect of enabling an occupant to easily recognize a timing at which an operation by the occupant is required. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] Figure 1 It is a block diagram showing a schematic structure of an in-vehicle system according to an embodiment.

[0033] Figure 2 This is an image diagram showing an example of display on a head-up display (HUD) and a meter display (MET).

[0034] Figure 3 : is a flowchart showing an example of HUD display control processing.

[0035] Figure 4 This is a diagram showing an example of a display on the HUD.

[0036] Figure 5 This is a diagram showing an example of a display on the HUD.

[0037] Figure 6 This is a diagram showing an example of a display on the HUD.

[0038] Figure 7 This is an image diagram showing an example of displaying the second character string with the color inverted.

[0039] Figure 8 This is a diagram showing an example of a display on the HUD.

[0040] Fig. 9 This is a diagram showing an example of a display on the HUD.

[0041] Fig.10 This is a diagram showing an example of a display on the HUD.

[0042] Fig.11 is a flowchart showing an example of the MET display control process.

[0043] Fig.12 This is an image diagram showing an example of displaying a second character string with the color of the second character string changed.

[0044] Fig.13 This is an image diagram showing an example of a display indicating the end of manual driving. DETAILED DESCRIPTION

[0045] Hereinafter, an example of an embodiment of the present disclosure will be described in detail with reference to the drawings. Figure 1The vehicle-mounted system 10 shown has a communication bus 12, to which are connected a peripheral condition acquisition device group 14, a vehicle driving state detection sensor group 26, an automatic driving ECU (Electronic Control Unit: Electronic Control Unit) 34, an action plan generation ECU 60, and a display control ECU 42. In addition, Figure 1 Only a part of the vehicle-mounted system 10 is shown. In addition, the vehicle equipped with the vehicle-mounted system 10 is hereinafter referred to as a host vehicle. As described later, the host vehicle is configured to be able to switch between automatic driving and manual driving.

[0046] The surrounding condition acquisition device group 14 includes a GPS (Global Positioning System) device 16, an on-vehicle communication device 18, a radar device 22, and a camera 24 as devices for acquiring information indicating the surrounding conditions of the vehicle.

[0047] The GPS device 16 receives GPS signals from multiple GPS satellites to measure the position of the vehicle. The GPS device 16 can measure the position more accurately as the number of GPS signals it can receive increases. The vehicle-mounted communicator 18 is a communication device that implements at least one of vehicle-to-vehicle communication with other vehicles and road-to-vehicle communication with roadside equipment.

[0048] The radar device 22 includes a plurality of radar devices with different detection ranges, which detect objects such as pedestrians and other vehicles around the vehicle as point group information, and obtain the relative position and relative speed of the detected objects and the vehicle. In addition, the radar device 22 is built with a processing device for processing the detection results of the surrounding objects. The processing device excludes roadside objects such as noise and guardrails from the monitoring objects based on the changes in the relative position and relative speed of each object contained in the recent multiple detection results, and follows and monitors specific objects such as pedestrians and other vehicles as monitoring objects. In addition, the radar device 22 outputs information such as the relative position and relative speed of each monitoring object. The camera 24 uses a plurality of cameras to shoot the surroundings of the vehicle and outputs the captured images.

[0049] In addition, the vehicle driving state detection sensor group 26 includes a steering angle sensor 28 for detecting the steering angle of the vehicle, a vehicle speed sensor 30 for detecting the driving speed of the vehicle, and an acceleration sensor 32 for detecting the acceleration applied to the vehicle as multiple sensors for obtaining the driving state of the vehicle.

[0050] The automatic driving ECU 34 is connected to a throttle ACT (actuator) 36 for changing the throttle opening of the vehicle and a brake ACT 38 for changing the braking force generated by the braking device of the vehicle. In addition, the automatic driving ECU 34 is connected to a steering ACT 40 for changing the steering amount achieved by the steering device of the vehicle.

[0051] The automatic driving ECU 34 includes a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory) and other memories, a non-volatile storage unit such as a HDD (Hard Disk Drive), a SSD (Solid State Drive), and a communication I / F (Interface). The automatic driving software is stored in the storage unit. The automatic driving ECU 34 executes the automatic driving software by the CPU, and when the automatic driving mode is selected, it implements the automatic driving process of making the vehicle automatically drive without the driving operation performed by the occupant of the vehicle. The automatic driving process is a process of judging the conditions of the vehicle and its surroundings based on the information obtained from the peripheral condition acquisition device group 14 and the vehicle driving state detection sensor group 26, thereby controlling the throttle ACT 36, the brake ACT 38 and the steering ACT 40.

[0052] In addition, as described above, in the automatic driving in the embodiment, the vehicle is automatically driven without the driving operation performed by the occupant of the vehicle. On the other hand, the manual driving in the embodiment includes a case where a part of the driving operation is performed by the automatic driving ECU 34, and the remaining part is performed by the occupant of the vehicle. As an example, in the manual driving mode, the speed adjustment is performed by the automatic driving ECU 34, and only the steering operation is performed by the occupant of the vehicle.

[0053] The action plan generation ECU 60 includes a CPU, a memory such as ROM and RAM, a non-volatile storage unit such as HDD and SSD, and a communication I / F, and the storage unit stores map information. The action plan generation ECU 60 generates an action plan required by the vehicle. That is, when the destination of the vehicle is set, the action plan generation ECU 60 compares the current position of the vehicle obtained from the GPS device 16 and the position of the destination of the vehicle with the map information to search for a path to the destination.

[0054] In addition, the action plan generation ECU 60 subdivides the searched path (action plan in the vehicle) into action plans such as left and right turns, lane changes, and merging, and determines whether to perform the action plan in automatic driving or manual driving for each of the subdivided action plans. In the present embodiment, the implementation of the planned action is basically performed by automatic driving realized by the automatic driving ECU 34, but for actions that are difficult to implement in automatic driving, such as when the planned action is "merging" and the merging road is short, it is determined to be performed in manual driving.

[0055] Each action plan included in the action plan includes information indicating the implementation of the action plan, such as left or right turn, lane change, etc., information indicating whether the action is to be performed by automatic driving or manual driving, and information indicating the location where the action is to be performed (e.g., latitude and longitude). The action plan generated by the action plan generation ECU 60 is sent to the automatic driving ECU 34 and the display control ECU 42. The action plan generation ECU 60 functions as an example of a generation unit.

[0056] The display control ECU 42 includes a CPU 44, a memory 46 such as a ROM or RAM, a non-volatile storage unit 48 such as a HDD or SSD, and a communication I / F 50. The CPU 44, the memory 46, the storage unit 48, and the communication I / F 50 are connected together via an internal bus 52 so as to be able to communicate with each other. A display control program 54 is stored in the storage unit 48. The display control ECU 42 implements the HUD display control process and the MET display control process to be described later by reading the display control program 54 from the storage unit 48 and expanding it into the memory 46, and executing the display control program 54 expanded in the memory 46 by the CPU 44. In addition, the display control program 54 is an example of a display control program for a vehicle.

[0057] The display control ECU 42 is connected to a head-up display (hereinafter referred to as HUD) 56 and a meter display 58 (hereinafter referred to as MET) provided in the vehicle compartment. The HUD 56 involved in this embodiment is a small HUD that uses a part of the front field of the occupant of the vehicle as a display range (forming an image in the lower part of the foreground) by reflection to the windshield, etc. In addition, the MET 58 is a display provided on the dashboard of the vehicle. The display control ECU 42 controls the information display to the HUD 56 and the MET 58.

[0058] That is, the display control ECU 42 causes the HUD 56 and the MET 58 to display the action plan generated by the action plan generation ECU 60, and to emphasize the display of the action plan performed by manual driving compared to the display of the action plan performed by automatic driving. In addition, the display control ECU 42 is an example of a display control unit and a vehicle display control device, and the HUD 56 and the MET 58 are an example of a display unit. Figure 2 An example of display on HUD 56 and MET 58 is shown in FIG. 5. HUD 56, MET 58, action plan generation ECU 60, and display control ECU 42 are an example of a vehicle display system.

[0059] Next, the operation of this embodiment will be described. The display control ECU 42 performs the following operation while the ignition switch of the vehicle is turned on. Figure 3 The HUD display control process shown.

[0060] In step 100 of the HUD display control process, the display control ECU 42 determines whether the destination of the host vehicle has been set by the action plan generation ECU 60. When the destination of the host vehicle has been set, the action plan generation ECU 60 generates an action plan of the host vehicle including a plurality of action plans and sends it to the display control ECU 42. Therefore, the display control ECU 42 performs the determination of step 100 based on whether the action plan of the host vehicle including a plurality of action plans has been received from the action plan generation ECU 60.

[0061] If the judgment of step 100 is affirmative, the process proceeds to step 102. In step 102, the display control ECU 42 refers to the action plan received from the action plan generation ECU 60 to determine whether the action plan includes an action plan in which the action plan execution location is located within a distance L1 from the current position of the vehicle. An example of the distance L1 is 10 km. The distance L1 is an example of the second predetermined value.

[0062] If the determination in step 100 or step 102 is negative, the process proceeds to step 134. In step 134, as an example, the control ECU 42 is displayed as follows: Figure 4 As shown, the planned action is not displayed on the HUD 56. When the process of step 134 is performed, the process returns to step 100.

[0063] If the determination in step 102 is affirmative, the process proceeds to step 104. In step 104, the display control ECU 42 determines the number of scheduled actions included in the action plan whose scheduled locations for action execution are within the distance L1 from the current position of the vehicle, and branches according to the determination result.

[0064] When the number of scheduled actions whose scheduled action locations are located within the distance L1 from the current position of the vehicle is "1", the process proceeds from step 104 to step 106. In step 106, the display control ECU 42 determines whether the nearest scheduled action whose scheduled action locations are located within the distance L1 from the current position of the vehicle is at a distance of L2 or more from the current position of the vehicle. An example of the distance L2 is 1 km.

[0065] If the determination in step 106 is affirmative, the process proceeds to step 108. In step 108, the display control ECU 42 determines whether the most recent action plan is an action plan to be performed by automatic driving. If the determination in step 108 is affirmative, the process proceeds to step 110. In step 110, as an example, the display control ECU 42 Figure 5 As shown, the most recent planned action 70 is displayed in the planned action display area of ​​the HUD 56 (the area at the right end of the display area of ​​the HUD 56 ), and the process returns to step 100 .

[0066] The action plan 70 includes a first character string (in the first character string) indicating the distance from the current position of the vehicle to the point where the action is to be performed. Figure 5 3.2 km in the example), and indicates the implementation of the planned action (in Figure 5 In addition, the action plan 70 includes a second character string (in the example of lane change) indicating whether the action to be performed is to be performed by automatic driving or manual driving. Figure 5 In the example of , "ASSIST" indicating autonomous driving is displayed as the second character string. In the present embodiment, when "ASSIST" indicating autonomous driving is displayed as the second character string, the second character string is displayed in a high-brightness color (e.g., white), and the background portion of the second character string (the portion inside the second character string surrounded by a frame) is displayed in a low-brightness color (e.g., black).

[0067] If the determination in step 108 is negative, the process proceeds to step 112. In step 112, as an example, the control ECU 42 displays the Figure 6 as well as Figure 7As shown, the planned action display area of ​​the HUD 56 is reversely displayed for the most recent planned action 72, and the process returns to step 100. Specifically, when the planned action is to be performed by manual driving, the second character string becomes "MANUAL". In the present embodiment, when "MANUAL" indicating manual driving is displayed as the second character string, the second character string is displayed in a low-brightness color (e.g., black), and the background portion of the second character string is displayed in a high-brightness color (e.g., white).

[0068] In the present embodiment, the background color of the entire display area of ​​the HUD 56 is set to a low-brightness color (for example, black). When displaying the action plan to be performed by automatic driving, the color of the background part (the inner part of the second character string surrounded by the frame) of the second character string ("ASSIST" indicating automatic driving) becomes approximately the same as the color of the background color of the entire display area of ​​the HUD 56, so the second character string is not so eye-catching. In contrast, when displaying the action plan to be performed by manual driving, the color of the background part of the second character string ("MANUAL" indicating manual driving) is inconsistent with the color of the second character string and the color of the background color of the entire display area of ​​the HUD 56, so the second character string is emphasized. As a result, for the action plan 72 to be performed by manual driving, it is possible to make it easy for the occupant to recognize the timing of the occupant's operation. In addition, the processing of making the color inconsistent can be achieved by, for example, selecting a color separated by a predetermined distance or more in an arbitrary color space from the color of the second character string and the color of the background color of the entire display area of ​​the HUD 56 as the color of the background part of the second character string.

[0069] In addition, if the nearest action plan to be performed at the scheduled location of the action is located within the distance L1 from the current position of the vehicle and is less than the distance L2 from the current position of the vehicle, the determination in step 106 is denied and the process proceeds to step 114. In step 114, the display control ECU 42 determines whether the nearest action plan is an action plan to be performed in automatic driving. If the determination in step 114 is affirmative, the process proceeds to step 116.

[0070] In step 116, as an example, the display control ECU 42 Figure 8 As shown, the planned action display area of ​​the HUD 56 is enlarged to display the nearest planned action 74 (second character string = "ASSIST"), and the process returns to step 100. Thus, the occupant can recognize that the planned location for the action in the enlarged planned action 74 is approaching to a point less than the distance L2 from the current position of the vehicle.

[0071] If the determination in step 114 is negative, the process proceeds to step 118. In step 118, the control ECU 42 is displayed as an example. Fig. 9 As shown, the planned action display area of ​​the HUD 56 is enlarged and reversely displayed for the most recent planned action 76 (second character string = "MANUAL"), and the process returns to step 100. Thus, the occupant can recognize that the planned location for the action in the enlarged planned action 76 is approaching to a point less than the distance L2 from the current position of the vehicle. In addition, by reversely displaying the second character string (="MANUAL") in the planned action 76, the occupant can easily recognize the timing at which the occupant's operation is required for the planned action 76 to be performed by manual driving.

[0072] Furthermore, in step 104, when the number of planned actions whose planned action execution locations are located within the distance L1 from the current position of the host vehicle is greater than 1, the process proceeds from step 104 to step 120. In step 120, the display control ECU 42 determines whether the nearest planned action among the plurality of planned actions whose planned action execution locations are located within the distance L1 from the current position of the host vehicle is at a distance L2 or more from the current position of the host vehicle.

[0073] If the determination in step 120 is affirmative, the process proceeds to step 122. In step 122, the display control ECU 42 determines whether all of the plurality of planned actions whose planned action locations are located within a distance L1 from the current position of the vehicle are planned actions to be performed by automatic driving. If the determination in step 122 is affirmative, the process proceeds to step 124.

[0074] In step 124, the display control ECU 42 displays n planned actions in the planned action display area of ​​the HUD 56, and returns to step 100. In addition, "n" is the maximum number of planned actions that can be displayed in the planned action display area of ​​the HUD 56, and an example of the maximum display number n is n=2. In addition, when the number of planned actions whose planned action locations are located within the distance L1 from the current position of the host vehicle is greater than n, the nearest n planned actions are selected and displayed on the HUD 56.

[0075] If the determination in step 122 is negative, the process proceeds to step 126. In step 126, the display control ECU 42 displays the n planned actions in the planned action display area of ​​the HUD 56, and displays the planned action for manual driving included in the n planned actions in reverse, and the process returns to step 100. Thus, the occupant can easily recognize the timing at which the occupant's operation is required for the planned action for manual driving included in the n planned actions.

[0076] If the determination in step 120 is negative, the process proceeds to step 128. In step 128, the display control ECU 42 determines whether all of the plurality of planned actions whose planned action locations are located within a distance L1 from the current position of the vehicle are planned actions to be performed by automatic driving. If the determination in step 128 is positive, the process proceeds to step 130.

[0077] In step 130, the display control ECU 42 displays n planned actions in the planned action display area of ​​the HUD 56, and displays the most recent planned action in an enlarged manner, and returns to step 100. Thus, the occupant can recognize that the planned location for the action in the most recent planned action displayed in an enlarged manner is approaching to a point less than the distance L2 from the current position of the vehicle.

[0078] If the determination in step 128 is negative, the process proceeds to step 132. In step 132, as an example, the control ECU 42 is displayed as follows: Fig.10 As shown, the planned action display area of ​​the HUD 56 displays n planned actions 78, and the most recent planned action is displayed in an enlarged manner, and the planned action for manual driving included in the n planned actions 78 is displayed in reverse. As a result, the occupant can easily recognize the timing at which the occupant's operation is required for the planned action for manual driving included in the n planned actions 78. In addition, the occupant can recognize that the planned location for the action in the most recent planned action displayed in an enlarged manner is approaching to a distance less than the distance L2 from the current position of the host vehicle.

[0079] In addition, the display control ECU 42 also performs the following operations while the ignition switch of the vehicle is on: Fig.11 The MET display control process shown in FIG. 1 is the same as the HUD display control process ( Figure 3), except that the action schedule is displayed on MET58, the maximum display number m is used instead of the maximum display number n, and the distance L3 is used instead of the distance L1, the rest are the same. Therefore, the corresponding steps are marked with the same symbols and the description is omitted. In addition, the maximum display number m is m>n, as an example, m=3. In addition, the distance L3 is L3≥L1, as an example, L3=20km or L3=10km. The distance L3 is an example of the first predetermined value.

[0080] As an example, in Figure 2 In the figure, a state in which a maximum number of m=3 action plans are displayed on MET58 is shown as action plans 80. In action plans 80, the action plan for manual driving (the second action plan) included in the m action plans is also displayed in reverse. That is, the color of the background part of the second character string ("MANUAL" indicating manual driving) for the action plan for manual driving is made inconsistent with the color of the second character string and the color of the background color of the entire display area of ​​MET58, thereby emphasizing the second character string. As a result, for the action plan for manual driving included in the m action plans, it is possible for the occupant to easily recognize the timing when the occupant's operation is required.

[0081] As described above, in the present embodiment, the action plan generation ECU 60 generates the action plan required by the vehicle capable of switching between automatic driving and manual driving. In addition, the HUD 56 and the MET 58 are provided in the cabin of the vehicle. Furthermore, the display control ECU 42 causes the HUD 56 and the MET 58 to display the action plan generated by the action plan generation ECU 60, and to emphasize the display of the action plan performed by manual driving compared to the display of the action plan performed by automatic driving. Thus, it is possible for the occupant to easily recognize the timing when the occupant's operation is required.

[0082] In addition, in the present embodiment, the display control ECU 42 uses the information including the character string to make the HUD 56 and the MET 58 display the action plan. In addition, the display control ECU 42 inverts the color of the character string and the color of the background part of the character string for the display of the action plan to be performed by manual driving, so that the action plan to be performed by manual driving is emphasized compared with the display of the action plan to be performed by automatic driving. As a result, the occupants can clearly distinguish and recognize automatic driving and manual driving with fewer colors. In addition, even if the HUD 56 is used, which is difficult to optically ensure the contrast of the screen, it is easy for the occupants to recognize the timing of the occupant's operation.

[0083] Furthermore, in the present embodiment, the display control ECU 42 makes the color of the inner portion of the character string surrounded by the frame as the background portion of the character string inconsistent with the color of the character string and the color of the background in at least the area where the character string is displayed in the display area of ​​the HUD 56 or the MET 58, so that the display of the action to be performed by manual driving is emphasized compared with the display of the action to be performed by automatic driving. In this way, the display of the action to be performed by manual driving can be emphasized with fewer colors.

[0084] In addition, in the present embodiment, the action plan generation ECU 60 generates an action plan including a plurality of action plans, and the display unit includes a MET 58 as a first display unit, and a HUD 56 as a second display unit. In addition, the display control ECU 42 causes the MET 58 to display the action plans in the action plan that are less than a distance L3 from the place where the action is to be performed, and causes the HUD 56 to display the action plans that are less than a distance L1 from the place where the action is to be performed, which is smaller than the distance L3. Thus, by distinguishing and displaying the closest action plans and the subsequent action plans on the MET 58 and the HUD 56, it is possible for the occupants to easily identify the action plans. In addition, by setting the first display unit to the MET 58 and the second display unit to the HUD 56, it is possible to reduce the amount of line of sight movement of the occupants who visually confirm the first display unit and the second display unit, respectively.

[0085] In addition, in the present embodiment, the action plan generation ECU 60 generates an action plan including a plurality of action plans. In addition, when the display control ECU 42 causes the HUD 56 or the MET 58 to display a plurality of action plans, the action plan with the shortest distance to the place where the action is to be performed or the shortest time to perform the action is displayed in a larger size than the other action plans. In this way, the occupant can easily identify the most important and recent action plan regardless of whether the action plan is driven automatically or manually.

[0086] In addition, in the above description, a method is described in which the color of the second character string and the color of the background portion of the second character string are inverted for the display of the planned action to be performed by manual driving, thereby emphasizing the display of the planned action to be performed by manual driving compared to the display of the planned action to be performed by automatic driving. However, the processing of emphasizing the display of the planned action to be performed by manual driving compared to the display of the planned action to be performed by automatic driving is not limited to the method of inverting the color of the second character string and the color of the background portion of the second character string.

[0087] For example, the following method may be adopted, that is, by changing the color (at least one of brightness, hue, and saturation) of at least one of the second character string and the background portion of the second character string in response to the display of the action planned to be performed by manual driving, so that the display of the action planned to be performed by manual driving is emphasized compared with the display of the action planned to be performed by automatic driving. As an example, Fig.12 An example in which the color of the background portion of the second character string is changed to red is shown. In this case as well, it is possible to make it easy for the occupant to recognize the timing at which the occupant's operation is required.

[0088] Although the process of changing the color of at least one of the second character string and the background part of the second character string can also be applied to HUD56, since HUD56 has fewer colors and it is difficult to optically ensure the contrast of the screen, it is preferred to apply the change process to MET58. That is, the display control ECU42 uses the information containing the character string to make the display unit display the action plan. In addition, with respect to MET58, by changing the color of at least one of the second character string and the background part of the second character string for the display of the action plan to be performed by manual driving, the display of the action plan to be performed by manual driving is emphasized compared with the display of the action plan to be performed by automatic driving. In addition, with respect to HUD56, by inverting the color of the second character string and the background part of the second character string for the display of the action plan to be performed by manual driving, the display of the action plan to be performed by manual driving is emphasized compared with the display of the action plan to be performed by automatic driving. According to this method, it is possible to implement an emphasized display adapted to the characteristics of MET58, which is relatively easy to change the color, and HUD56, which has fewer colors.

[0089] In addition, for example, the following method may be adopted, that is, by surrounding the second character string or the row of the planned action with a frame line for the display of the planned action to be performed by manual driving, so that the display of the planned action to be performed by manual driving is emphasized compared with the display of the planned action to be performed by automatic driving. In addition, for example, the following method may be adopted, that is, by flashing the planned action to be performed by manual driving, so that it is emphasized compared with the display of the planned action to be performed by automatic driving.

[0090] In addition, although the above content describes a method in which MET 58 displays a planned action when the distance to the place where the action is to be performed is less than the distance L3, and HUD 56 displays a planned action when the distance to the place where the action is to be performed is less than the distance L1 which is smaller than the distance L3, the present invention is not limited thereto. For example, the following method may be adopted, that is, MET 58 displays a planned action when the time to perform the action is less than a first predetermined value, and HUD 56 displays a planned action when the time to perform the action is less than a second predetermined value which is smaller than the first predetermined value.

[0091] In addition, although the above content describes a method in which no special display is performed when the manual driving performed by the occupant has ended, the present invention is not limited to this. For example, the following method may be adopted, that is, when the location of the action scheduled to be performed manually by the occupant or the time scheduled to be performed manually by the occupant has exceeded, the display control ECU 42 causes at least one of the HUD 56 and the MET 58 to display a display indicating the end of manual driving. Fig.13 An example of a display indicating the end of manual driving is shown in . Thus, by clearly conveying the end of manual driving, the occupant can be relieved from the operation.

[0092] In addition, although the above content describes the method of displaying the planned action on HUD 56 and MET 58 respectively, it is not limited to this, and the planned action may be displayed on only one of HUD 56 and MET 58. In addition, the display unit is not limited to HUD 56 and MET 58, and for example, the planned action may be displayed on a central monitor provided at the center of the dashboard of the vehicle.

[0093] In addition, although the above content lists as an example a method in which the automatic driving ECU 34 performs a part of the driving operation under manual driving and the occupant of the vehicle performs the remaining part, it is not limited to this. For example, it can also be set that the occupant of the vehicle performs all the driving operations in the manual driving mode.

[0094] In addition, although the above content describes a method of setting the background color of the entire display area of ​​HUD56 and MET58 to a low-brightness color (e.g., black), it is not limited to this, and the background color may also be another color. In addition, it is not limited to a method of setting the entire display area of ​​HUD56 and MET58 to a fixed background color, and the background color of the display area of ​​HUD56 and MET58 may be locally inconsistent. In this case, it is preferred that the color of the inner part of the second character string surrounded by the frame is inconsistent with the color of the second character string and the color of the background in the area of ​​the display area of ​​HUD56 and MET58 where at least the second character string is displayed. Thus, the display of the action planned to be implemented by manual driving can be emphasized with fewer colors.

[0095] In addition, although the above content describes that the display control program 54 as an example of the vehicle display control program involved in the present disclosure is pre-stored (installed) in the storage unit 48 of the display control ECU 42. However, the vehicle display control program involved in the present disclosure can also be provided in a form recorded in a non-temporary recording medium such as a CD-ROM, DVD-ROM, memory card, HDD, SSD, etc.

Claims

1. A display control device for a vehicle, wherein: It includes a display control unit, which generates an action plan for a vehicle and subdivides the action plan into a plurality of action plans required by the vehicle that is capable of switching between automatic driving and manual driving, which are planned to be performed by automatic driving and a plurality of action plans to be performed by manual driving, and causes a display unit provided in a cabin of the vehicle to display the plurality of action plans, and, in a case where the action plan is planned to be performed by manual driving, the display of the action plan to be performed by manual driving is emphasized compared to the display of the action plan to be performed by automatic driving.

2. The vehicle display control device according to claim 1, wherein: The display control unit uses information including a character string to cause the display unit to display the planned action, and by inverting the color of the character string and the color of a background portion of the character string for the display of the planned action to be performed by manual driving, the display of the planned action to be performed by manual driving is emphasized compared to the display of the planned action to be performed by automatic driving.

3. The vehicle display control device according to claim 2, wherein: The display control unit makes the color of the inner part of the character string surrounded by a frame serving as the background part of the character string inconsistent with the color of the character string and the color of the background of at least an area in the display area of ​​the display unit where the character string is displayed, so that the display of the planned action to be performed by manual driving is emphasized compared with the display of the planned action to be performed by automatic driving.

4. The vehicle display control device according to claim 1, wherein: The display unit includes an instrument display and a head-up display, The display control unit uses information including a character string to cause the display unit to display the planned action, and, with respect to the instrument display, by changing the color of at least one of the character string and a background portion of the character string for displaying the planned action to be performed by manual driving, the display of the planned action to be performed by manual driving is emphasized compared to the display of the planned action to be performed by automatic driving, and with respect to the head-up display, by inverting the color of the character string and the color of the background portion of the character string for displaying the planned action to be performed by manual driving, the display of the planned action to be performed by manual driving is emphasized compared to the display of the planned action to be performed by automatic driving.

5. The vehicle display control device according to any one of claims 1 to 4, wherein: The display control unit causes the display unit to display a display indicating the end of manual driving when a location where the occupant's action is scheduled to be performed manually or a time period where the occupant's action is scheduled to be performed manually has passed.

6. The vehicle display control device according to any one of claims 1 to 4, wherein: The display unit includes a first display unit and a second display unit. The display control unit generates an action plan including a plurality of the action plans, and causes the first display unit to display the action plans in which the distance to the location where the action is to be performed or the time to perform the action is less than a first predetermined value, and causes the second display unit to display the action plans in which the distance to the location where the action is to be performed or the time to perform the action is less than a second predetermined value that is smaller than the first predetermined value.

7. The vehicle display control device according to claim 6, wherein: The first display unit is an instrument display, and the second display unit is a head-up display.

8. The vehicle display control device according to any one of claims 1 to 4, wherein: The display control unit generates an action plan including a plurality of the planned actions, and when causing the display unit to display the plurality of the planned actions, displays the planned action having the shortest distance to a location to perform an action or the shortest time to perform an action in an enlarged manner compared to the other planned actions.

9. A vehicle display control method, which performs the following processing by a computer, the processing comprising: An action plan for a vehicle is generated, and the action plan is subdivided into a plurality of action plans required by the vehicle capable of switching between automatic driving and manual driving, which are planned to be performed by automatic driving and which are planned to be performed by manual driving, and a display unit provided in a cabin of the vehicle is caused to display the plurality of action plans, and, in a case where the action plan is planned to be performed by manual driving, the display of the action plan to be performed by manual driving is emphasized compared with the display of the action plan to be performed by automatic driving.

10. A non-transitory computer-readable storage medium storing a vehicle display control program for causing a computer to execute the following process, the process comprising: An action plan for a vehicle is generated, and the action plan is subdivided into a plurality of action plans required by the vehicle capable of switching between automatic driving and manual driving, which are planned to be performed by automatic driving and which are planned to be performed by manual driving, and a display unit provided in a cabin of the vehicle is caused to display the plurality of action plans, and, in a case where the action plan is planned to be performed by manual driving, the display of the action plan to be performed by manual driving is emphasized compared with the display of the action plan to be performed by automatic driving.

11. A display system for a vehicle, comprising: a display unit disposed in a vehicle compartment; A display control unit that generates an action plan for the vehicle and subdivides the action plan into a plurality of action plans to be performed by automatic driving and a plurality of action plans to be performed by manual driving, which are required of the vehicle capable of switching between automatic driving and manual driving, and causes the display unit to display the plurality of action plans, and, when the action plan is an action plan to be performed by manual driving, causes the display of the action plan to be performed by manual driving to be emphasized compared to the display of the action plan to be performed by automatic driving.