Vehicle display control device, method, program, and vehicle display system
The vehicle display system highlights manual driving operations through contrasting colors and prioritized action plans, addressing the lack of occupant awareness during mode transitions, ensuring smoother driving experiences.
Patent Information
- Application Number
- JP2024161384
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-09-18
- Publication Date
- 2024-12-05
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Existing vehicle display systems fail to effectively inform occupants when their operations are required during transitions between automatic and manual driving modes, with a focus on automated driving zones rather than manual driving zones.
A vehicle display system that emphasizes action schedules for manual driving over automatic driving by using contrasting colors, highlighting manual driving operations on the display, and separating and prioritizing action plans based on proximity and mode.
Enhances occupant awareness of when manual operations are needed, facilitating smoother transitions between automatic and manual driving modes.
Smart Images

Figure 2024169579000001_ABST
Abstract
Description
[Technical field]
[0001] The present disclosure relates to a vehicle display control device, a vehicle display control method, a vehicle display control program, and a vehicle display system. [Background technology]
[0002] Patent Document 1 describes a technology that, when showing a route to guide a vehicle to a destination on a display, displays autonomous driving sections and manual driving sections in a distinguishable manner, and also displays information showing the vehicle's behavior within the autonomous driving sections. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2018-100867 A Summary of the Invention [Problem to be solved by the invention]
[0004] In a vehicle capable of switching between automatic and manual driving, in order to achieve a smooth switch between automatic and manual driving, it is necessary to ensure that the occupant is aware of the timing when operation is required. In contrast, the technology described in Patent Document 1 emphasizes the display of automatic driving sections more than the display of manual driving sections, and there is room for improvement in terms of enabling the occupant to recognize the timing when operation is required.
[0005] The present disclosure has been made in consideration of the above-mentioned facts, and aims to provide a vehicle display control device, a vehicle display control method, a vehicle display control program, and a vehicle display system that can make it easier for occupants to recognize timing when operation is required. [Means for solving the problem]
[0006] A display control device for a vehicle according to a first aspect includes: a display unit provided in a vehicle cabin, the display unit displaying a plurality of action plans for automatic driving or manual driving, the action plans being created by a creation unit that creates an action plan required for a vehicle that can switch between automatic driving and manual driving, on the display unit provided in the vehicle cabin; Shown in The display control unit includes a display control unit that, in a state in which the display is displayed, highlights the display of the action schedule to be performed in manual driving compared to the display of the action schedule to be performed in automatic driving.
[0007] In a first aspect, a creation unit creates an action schedule required for a vehicle capable of switching between automatic driving and manual driving. Then, a display control unit displays the multiple action schedules for automatic driving or manual driving created by the creation unit on a display unit provided in a vehicle cabin. Shown in In this state, the display of the action schedule to be performed in manual driving is emphasized compared to the display of the action schedule to be performed in automatic driving. By highlighting the action schedule to be performed in manual driving in this manner, it is possible for the occupant to easily recognize the timing when an operation by the occupant is required.
[0008] In a second aspect, in the first aspect, the display control unit displays the action plan on the display unit with information including a string indicating whether the driving is autonomous or manual, and for the display of the action plan performed in manual driving, the color of the string and the color of the background of the string are inverted to emphasize the display of the action plan performed in autonomous driving more than the display of the action plan performed in autonomous driving.
[0009] According to the second aspect, the driver can clearly distinguish and recognize automatic driving from manual driving with a small number of colors. Also, even when it is difficult to ensure optical contrast of the screen (for example, when the display unit is a HUD), the driver can easily recognize the timing when the driver's operation is required.
[0010] The third aspect is 1In the embodiment, the display control unit causes the display unit to display the action schedule using information including a character string, and for the display of the action schedule performed during manual driving, changes the color of an inner part of the character string surrounded by a frame as a background part of the character string to the color of the character string and the display area of the display unit. In the region By making the color of the display different from the background color of the display, the display of the action plan to be performed during automatic driving is emphasized.
[0011] According to the third aspect, the display of the action schedule performed during manual driving can be emphasized using a small number of colors.
[0012] In a fourth aspect, in the first aspect, the display unit includes a meter display and a HUD, and the display control unit causes the display unit to display the planned action using information including a character string, and for the meter display, the display of the planned action performed in manual driving is emphasized more than the display of the planned action performed in autonomous driving by changing the color of at least one of the character string and a background of the character string, and for the HUD, the display of the planned action performed in manual driving is emphasized more than the display of the planned action performed in autonomous driving by inverting the color of the character string and the color of the background of the character string.
[0013] According to the fourth aspect, it is possible to perform highlighting according to the respective characteristics of a meter display, the color of which is relatively easy to change, and a HUD, the color scheme of which is limited.
[0014] A fifth aspect is any one of the first to fourth aspects, wherein the display control unit causes the display unit to display a message indicating the end of manual driving when the point at which the occupant plans to manually act or the time at which the occupant plans to manually act has passed.
[0015] According to the fifth aspect, by clearly informing the occupant of the end of manual driving, the occupant can feel at ease and let go of the operation.
[0016] In a sixth aspect, in the first aspect, the creation unit creates an action plan including a plurality of the action plans, the display unit includes a meter display and a HUD, and the display control unit causes the meter display to display, from the action plan, action plans in which the distance to the point where the action is to be performed or the time until the action is to be performed is equal to or less than a first predetermined value, and causes the display control unit to display, from the action plan, action plans in which the distance to the point where the action is to be performed or the time until the action is to be performed is equal to or less than a second predetermined value that is smaller than the first predetermined value. HUD Display it on.
[0017] According to the sixth aspect, the nearest planned action and subsequent planned actions are displayed separately on the meter display and the HUD, making it easier for the occupant to recognize the planned action.
[0018] A seventh aspect is any one of the first to fifth aspects, in which the creation unit creates an action plan including multiple scheduled actions, and when the display control unit causes multiple scheduled actions to be displayed on the display unit, the scheduled action having the shortest distance to a point where the action is to be performed or the shortest time until the action is to be performed is displayed enlarged compared to the other scheduled actions.
[0019] According to the seventh aspect, it is possible to make it easier for a passenger to recognize the most important upcoming action plan regardless of whether the vehicle is being driven automatically or manually.
[0020] A display control method for a vehicle according to an eighth aspect includes: displaying, on a display unit provided in a room of the vehicle, a plurality of action plans for automatic driving or manual driving, which are created by a creation unit that creates an action plan required for a vehicle that is switchable between automatic driving and manual driving, on the display unit provided in the room of the vehicle. Shown in In a state in which the action schedule is displayed, the computer executes a process including highlighting the display of the action schedule to be performed in manual driving compared to the display of the action schedule to be performed in automatic driving.
[0021] According to the eighth aspect, it is possible to make it easier for the occupant to recognize the timing when an operation by the occupant is required.
[0022] A display control program for a vehicle according to a ninth aspect includes a display unit provided in a vehicle cabin, the display unit displaying a plurality of action plans for automatic driving or manual driving, the action plans being created by a creation unit that creates an action plan required for a vehicle that is capable of switching between automatic driving and manual driving, on a display unit provided in a vehicle cabin. Shown in In a state in which the action schedule is displayed, a process including highlighting the display of the action schedule to be performed in manual driving compared to the display of the action schedule to be performed in automatic driving is executed.
[0023] According to the ninth aspect, it is possible to make it easier for the occupant to recognize the timing when an operation by the occupant is required.
[0024] A display system for a vehicle according to a tenth aspect includes a creation unit that creates an action schedule required for a vehicle capable of switching between automatic driving and manual driving, a display unit provided in a cabin of the vehicle, and a display unit that displays a plurality of the action schedules for automatic driving or manual driving created by the creation unit on the display unit. Shown in and a display control unit that, in a state in which the display is displayed, highlights the display of the action schedule to be performed in manual driving compared to the display of the action schedule to be performed in automatic driving.
[0025] According to the tenth aspect, it is possible to make it easier for the occupant to recognize the timing when an operation by the occupant is required. Effect of the Invention
[0026] The present disclosure has an effect of making it easier for an occupant to recognize the timing when an operation by the occupant is required. [Brief description of the drawings]
[0027] [Figure 1] 1 is a block diagram showing a schematic configuration of an in-vehicle system according to an embodiment; [Diagram 2] FIG. 1 is an image diagram showing an example of display on a HUD and a MET. [Diagram 3] 13 is a flowchart illustrating an example of a HUD display control process. [Figure 4] FIG. 13 is an image diagram showing an example of a display on a HUD. [Diagram 5] FIG. 13 is an image diagram showing an example of a display on a HUD. [Figure 6] FIG. 13 is an image diagram showing an example of a display on a HUD. [Figure 7] FIG. 13 is an image diagram showing an example in which the second character string is displayed in inverted color. [Figure 8] FIG. 13 is an image diagram showing an example of a display on a HUD. [Figure 9] FIG. 13 is an image diagram showing an example of a display on a HUD. [Figure 10] FIG. 13 is an image diagram showing an example of a display on a HUD. [Figure 11] 13 is a flowchart showing an example of a MET display control process. [Figure 12] FIG. 13 is an image diagram showing an example in which a second character string is displayed in a different color. [Figure 13] FIG. 13 is an image diagram showing an example of a display indicating the end of manual operation. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0028] An example of an embodiment of the present disclosure will be described in detail below with reference to the drawings. An in-vehicle system 10 shown in Fig. 1 includes a communication bus 12 to which a surrounding situation acquisition device group 14, a vehicle driving state detection sensor group 26, an automatic driving ECU (Electronic Control Unit) 34, an action schedule creation ECU 60, and a display control ECU 42 are connected. Note that Fig. 1 shows only a part of the in-vehicle system 10. In the following description, a vehicle equipped with the in-vehicle system 10 is referred to as a host vehicle. As will be described later, the host vehicle is capable of switching between automatic driving and manual driving.
[0029] The surrounding condition acquisition device group 14 includes a GPS (Global Positioning System) device 16, an in-vehicle communication device 18, a radar device 22, a camera 24, etc. as devices that acquire information indicating the condition of the surrounding environment of the vehicle.
[0030] The GPS device 16 receives GPS signals from multiple GPS satellites to determine the position of the vehicle. The positioning accuracy of the GPS device 16 improves as the number of GPS signals it can receive increases. The in-vehicle communication device 18 is a communication device that performs at least one of vehicle-to-vehicle communication with other vehicles and road-to-vehicle communication with a roadside device.
[0031] The radar device 22 includes a plurality of radar devices with different detection ranges, detects objects such as pedestrians and other vehicles around the vehicle as point cloud information, and acquires the relative position and relative speed of the detected objects and the vehicle. The radar device 22 also includes a processing device that processes the detection results of the surrounding objects. The processing device excludes noise, roadside objects such as guardrails, etc. from the monitoring targets based on the relative position and relative speed changes with respect to each object included in the most recent multiple detection results, and tracks and monitors specific objects such as pedestrians and other vehicles as monitoring targets. The radar device 22 then outputs information such as the relative position and relative speed with respect to each monitoring target object. The camera 24 captures the surroundings of the vehicle with multiple cameras and outputs the captured images.
[0032] In addition, the vehicle driving condition detection sensor group 26 includes a steering angle sensor 28 that detects the steering angle of the vehicle, a vehicle speed sensor 30 that detects the driving speed of the vehicle, and an acceleration sensor 32 that detects the acceleration applied to the vehicle, as multiple sensors that acquire the vehicle driving condition.
[0033] The autonomous driving ECU 34 is connected to a throttle ACT (actuator) 36 that changes the throttle opening of the vehicle and a brake ACT 38 that changes the braking force generated by the vehicle's braking device. The autonomous driving ECU 34 is also connected to a steering ACT 40 that changes the steering amount by the vehicle's steering device.
[0034] The autonomous driving ECU 34 includes a central processing unit (CPU), memories such as a read only memory (ROM) and a random access memory (RAM), non-volatile storage units such as a hard disk drive (HDD) and a solid state drive (SSD), and a communication interface (I / F). Autonomous driving software is stored in the storage unit. When an autonomous driving mode is selected, the autonomous driving ECU 34 performs autonomous driving processing to automatically drive the host vehicle without the driver's operation of the host vehicle when the autonomous driving mode is selected by the CPU executing the autonomous driving software. The autonomous driving processing is processing to determine the situation of the host vehicle and its surroundings based on information obtained from the surrounding situation acquisition device group 14 and the vehicle driving state detection sensor group 26, and to control the throttle ACT 36, the brake ACT 38, and the steering ACT 40.
[0035] In the automatic driving mode in the embodiment, as described above, the vehicle is automatically driven without the driver of the vehicle. On the other hand, the manual driving mode in the embodiment includes a case where the automatic driving ECU 34 performs a part of the driving operation and the driver of the vehicle performs the remaining part. As an example, in the manual driving mode, the automatic driving ECU 34 performs the speed adjustment and the driver of the vehicle performs only the steering operation.
[0036] The activity schedule creation ECU 60 includes a CPU, memories such as ROM and RAM, a non-volatile storage unit such as HDD and SSD, and a communication I / F, and map information is stored in the storage unit. The activity schedule creation ECU 60 creates an activity schedule required for the vehicle. That is, when the destination of the vehicle is set, the activity schedule creation ECU 60 checks the current position of the vehicle and the position of the destination of the vehicle obtained from the GPS device 16 against the map information, and searches for a route to the destination.
[0037] The action schedule creation ECU 60 also subdivides the searched route (action plan for the vehicle) into action schedules such as turning right or left, changing lanes, merging, etc., and determines whether the action to be performed is to be performed automatically or manually for each of the subdivided action schedules. In this embodiment, the action to be performed is basically performed by automatic driving using the automatic driving ECU 34, but for actions that are difficult to perform automatically, such as when the action to be performed is "merging" and the merging road is short, it is determined that the action should be performed manually.
[0038] Each scheduled action included in the action plan includes information indicating a scheduled action such as turning right or left or changing lanes, information indicating whether the action will be performed by automatic driving or manual driving, and information indicating a location where the action is scheduled to be performed (e.g., latitude and longitude). The action plan created by the action schedule creation ECU 60 is transmitted to the automatic driving ECU 34 and the display control ECU 42. The action schedule creation ECU 60 functions as an example of a creation unit.
[0039] The display control ECU 42 includes a CPU 44, a memory 46 such as a ROM or a RAM, a non-volatile storage unit 48 such as a HDD or an SSD, and a communication I / F 50. The CPU 44, the memory 46, the storage unit 48, and the communication I / F 50 are connected to each other via an internal bus 52 so as to be able to communicate with each other. A display control program 54 is stored in the storage unit 48. The display control ECU 42 performs a HUD display control process and a MET display control process, which will be described later, by reading the display control program 54 from the storage unit 48 and loading it into the memory 46, and executing the display control program 54 loaded into the memory 46 by the CPU 44. The display control program 54 is an example of a display control program for a vehicle.
[0040] The display control ECU 42 is connected to a head-up display (hereinafter referred to as HUD) 56 and a meter display (hereinafter referred to as MET) 58, each of which is provided in the interior of the vehicle. The HUD 56 according to this embodiment is a small HUD that displays a part of the forward field of vision of the vehicle occupant through reflection on the windshield glass or the like (forms an image below the foreground). The MET 58 is a display provided on the instrument panel of the vehicle. The display control ECU 42 controls the display of information on the HUD 56 and the MET 58.
[0041] That is, the display control ECU 42 displays the action schedule created by the action schedule creation ECU 60 on the HUD 56 and the MET 58, and emphasizes the display of the action schedule performed in manual driving compared to the display of the action schedule performed in automatic driving. The display control ECU 42 is an example of a display control unit and a vehicle display control device, and the HUD 56 and the MET 58 are an example of a display unit. An example of the display on the HUD 56 and the MET 58 is shown in FIG. 2. The HUD 56, the MET 58, the action schedule creation ECU 60, and the display control ECU 42 are an example of a vehicle display system.
[0042] Next, the operation of this embodiment will be described. While the ignition of the host vehicle is on, the display control ECU 42 performs the HUD display control process shown in FIG.
[0043] In step 100 of the HUD display control process, the display control ECU 42 determines whether or not the destination of the host vehicle is set in the activity schedule creating ECU 60. When the destination of the host vehicle is set, the activity schedule creating ECU 60 creates an activity plan for the host vehicle including multiple activity schedules and transmits it to the display control ECU 42, etc. Therefore, the display control ECU 42 makes the determination in step 100 based on whether or not the activity plan for the host vehicle including multiple activity schedules has been received from the activity schedule creating ECU 60.
[0044] If the determination in step 100 is positive, the process proceeds to step 102. In step 102, the display control ECU 42 refers to the action plan received from the action schedule creation ECU 60 and determines whether the action plan includes an action plan in which the planned execution location of the action is located within a distance L1 from the current position of the vehicle. An example of the distance L1 is 10 km. The distance L1 is an example of a second predetermined value.
[0045] If the determination in step 100 or step 102 is negative, the process proceeds to step 134, in which the display control ECU 42 does not display the action plan on the HUD 56, as shown in Fig. 4 for example. After the process in step 134 is performed, the process returns to step 100.
[0046] If the determination in step 102 is affirmative, the process proceeds to step 104. In step 104, the display control ECU 42 determines the number of scheduled actions that are included in the action plan and whose planned execution locations are located within a distance L1 from the current position of the vehicle, and branches according to the determination result.
[0047] If the number of scheduled actions whose planned action location is located within distance L1 from the current position of the vehicle is "1", the process proceeds from step 104 to step 106. In step 106, the display control ECU 42 determines whether or not the one nearest scheduled action whose planned action location is located within distance L1 from the current position of the vehicle is at least distance L2 from the current position of the vehicle. An example of distance L2 is 1 km.
[0048] If the determination in step 106 is positive, the process proceeds to step 108. In step 108, the display control ECU 42 determines whether the upcoming planned action is an action planned to be performed by autonomous driving. If the determination in step 108 is positive, the process proceeds to step 110. In step 110, the display control ECU 42 displays the upcoming planned action 70 in the planned action display area of the HUD 56 (the rightmost area of the display area of the HUD 56), as shown in FIG. 5 for example, and then returns to step 100.
[0049] The action schedule 70 includes a first character string ("3.2km" in the example of FIG. 5) indicating the distance from the current position of the vehicle to the location where the action is scheduled to be performed, and an icon indicating the action to be performed (changing lanes in the example of FIG. 5). The action schedule 70 also includes a second character string ("ASSIST" indicating automatic driving in the example of FIG. 5) indicating whether the action to be performed will be performed by automatic driving or manual driving. In this embodiment, when "ASSIST" indicating automatic driving is displayed as the second character string, the second character string is displayed in a high-brightness color (e.g., white), and the background of the second character string (the part inside the frame surrounding the second character string) is displayed in a low-brightness color (e.g., black).
[0050] Moreover, if the determination in step 108 is negative, the process proceeds to step 112. In step 112, the display control ECU 42 displays the upcoming planned action 72 inverted in the planned action display area of the HUD 56, as shown in Fig. 6 and Fig. 7 for example, and returns to step 100. Specifically, when the planned action is to be performed by manual driving, the second character string will be "MANUAL", but in this embodiment, when "MANUAL" indicating manual driving is displayed as the second character string, the second character string is displayed in a low-brightness color (for example, black), and the background of the second character string is displayed in a high-brightness color (for example, white).
[0051] In this embodiment, the background color of the entire display area of the HUD 56 is a low-brightness color (e.g., black). When displaying an action schedule to be performed in automatic driving, the color of the background part (the part inside the frame surrounding the second character string) of the second character string ("ASSIST" indicating automatic driving) is almost the same as the color of the background color of the entire display area of the HUD 56, so the second character string is not very noticeable. In contrast, when displaying an action schedule to be performed in manual driving, the color of the background part of the second character string ("MANUAL" indicating manual driving) is different from the color of the second character string and the color of the background color of the entire display area of the HUD 56, so the second character string is highlighted. This makes it easier for the occupant to recognize the timing when the occupant needs to operate the action schedule 72 to be performed in manual driving. Note that the difference in color can be realized, for example, by selecting a color that is separated by a predetermined distance or more from the color of the second character string and the color of the background color of the entire display area of the HUD 56 as the color of the background part of the second character string in an arbitrary color space.
[0052] In addition, if the one most recent scheduled action, whose planned execution location is located within distance L1 from the current position of the vehicle, is less than distance L2 from the current position of the vehicle, the determination in step 106 is negative and the process proceeds to step 114. In step 114, the display control ECU 42 determines whether the most recent scheduled action is an action to be performed by autonomous driving. If the determination in step 114 is positive, the process proceeds to step 116.
[0053] In step 116, the display control ECU 42 enlarges and displays the upcoming planned action 74 (second character string = "ASSIST") in the planned action display area of the HUD 56, as shown in Fig. 8 for example, and returns to step 100. This allows the occupant to recognize that the planned execution location of the action in the enlarged planned action 74 is approaching within the distance L2 from the current position of the vehicle.
[0054] Also, if the determination in step 114 is negative, the process proceeds to step 118. In step 118, the display control ECU 42 enlarges and highlights the upcoming action plan 76 (second character string = "MANUAL") in the action plan display area of the HUD 56, as shown in Fig. 9 for example, and returns to step 100. This allows the occupant to recognize that the planned execution location of the action in the enlarged action plan 76 is approaching within a distance L2 from the current position of the vehicle. Also, by highlighting the second character string (= "MANUAL") of the action plan 76, it is possible for the occupant to easily recognize the timing when the occupant needs to operate the action plan 76 that is performed in manual driving.
[0055] Furthermore, in step 104, if the number of scheduled actions whose planned action locations are located within distance L1 from the current position of the vehicle is greater than one, the process proceeds from step 104 to step 120. In step 120, the display control ECU 42 determines whether the nearest scheduled action among the multiple scheduled actions whose planned action locations are located within distance L1 from the current position of the vehicle is at least distance L2 from the current position of the vehicle.
[0056] If the determination in step 120 is positive, the process proceeds to step 122. In step 122, the display control ECU 42 determines whether or not all of the multiple scheduled actions, the locations of which are scheduled to be performed within a distance L1 from the current position of the vehicle, are scheduled to be performed by autonomous driving. If the determination in step 122 is positive, the process proceeds to step 124.
[0057] In step 124, the display control ECU 42 displays n scheduled actions in the scheduled action display area of the HUD 56, and returns to step 100. Note that "n" is the maximum number of scheduled actions that can be displayed in the scheduled action display area of the HUD 56, and an example of the maximum display number n is n = 2. Note that if the number of scheduled actions whose planned action locations are located within a distance L1 from the current position of the vehicle is greater than n, the nearest n scheduled actions are selected and displayed on the HUD 56.
[0058] Moreover, if the determination in step 122 is negative, the process proceeds to step 126. In step 126, the display control ECU 42 displays the n scheduled actions in the scheduled action display area of the HUD 56, highlights the scheduled action for manual driving included in the n scheduled actions, and returns to step 100. This makes it easier for the occupant to recognize the timing when the occupant's operation is required for the scheduled action for manual driving included in the n scheduled actions.
[0059] If the determination in step 120 is negative, the process proceeds to step 128. In step 128, the display control ECU 42 determines whether or not all of the multiple scheduled actions, the locations of which are scheduled to be performed within a distance L1 from the current position of the vehicle, are scheduled to be performed by autonomous driving. If the determination in step 128 is positive, the process proceeds to step 130.
[0060] In step 130, the display control ECU 42 displays n scheduled actions in the scheduled action display area of the HUD 56, enlarges the most recent scheduled action, and returns to step 100. This allows the occupant to recognize that the planned location of the action in the enlarged most recent scheduled action is approaching the current position of the vehicle within a distance L2.
[0061] Also, if the determination in step 128 is negative, the process proceeds to step 132. In step 132, the display control ECU 42 displays n scheduled actions 78 in the scheduled action display area of the HUD 56, enlarges the most recent scheduled action, and inverts the scheduled action for manual driving included in the n scheduled actions 78, as shown in Fig. 10 for example. This makes it easier for the occupant to recognize the timing when the occupant needs to operate the scheduled action for manual driving included in the n scheduled actions 78. Also, the occupant can be made to recognize that the planned location of the action in the enlarged most recent scheduled action is approaching within a distance L2 from the current position of the vehicle.
[0062] The display control ECU 42 also performs a MET display control process shown in FIG. 11 while the ignition of the vehicle is on. This MET display control process is the same as the HUD display control process (FIG. 3) described above, except that the planned action is displayed on the MET 58, the maximum number of displays is m instead of the maximum number of displays n, and the distance L3 is instead of the distance L1. For this reason, the same reference numerals are given to corresponding steps, and the description thereof is omitted. Note that the maximum number of displays m is m>n, and an example is m=3. Also, the distance L3 is L3≧L1, and an example is L3=20km or L3=10km. The distance L3 is an example of a first predetermined value.
[0063] As an example, FIG. 2 shows a state in which the maximum number of scheduled actions m=3 is displayed on the MET 58 as scheduled action 80. In the scheduled action 80, the scheduled action for manual driving (the second scheduled action) included in the m scheduled actions is also displayed in inverted color. That is, for the scheduled action for manual driving, the color of the background of the second character string ("MANUAL" indicating manual driving) is made different from the color of the second character string and the background color of the entire display area of the MET 58, thereby emphasizing the second character string. This makes it easier for the occupant to recognize the timing when the occupant needs to operate the scheduled action for manual driving included in the m scheduled actions.
[0064] As described above, in this embodiment, the action schedule creation ECU 60 creates an action schedule required for the vehicle that can switch between automatic driving and manual driving. The HUD 56 and the MET 58 are provided inside the vehicle. The display control ECU 42 displays the action schedule created by the action schedule creation ECU 60 on the HUD 56 and the MET 58, and emphasizes the display of the action schedule performed in manual driving compared to the display of the action schedule performed in automatic driving. This makes it easier for the occupant to recognize the timing when the occupant's operation is required.
[0065] In this embodiment, the display control ECU 42 displays the action plan on the HUD 56 and the MET 58 using information including character strings. The display control ECU 42 also inverts the color of the character string and the color of the background of the character string to emphasize the action plan to be performed in manual driving more than the action plan to be performed in automatic driving. This allows the occupant to clearly distinguish and recognize automatic driving and manual driving with a small color scheme. Also, even in the HUD 56 where it is difficult to ensure optical contrast of the screen, it is possible to make it easier for the occupant to recognize the timing when the occupant's operation is required.
[0066] In addition, in this embodiment, the display control ECU 42 emphasizes the display of the action schedule to be performed in manual driving more than the display of the action schedule to be performed in autonomous driving by making the color of the inner part of the frame surrounding the character string, which serves as the background part of the character string, different from the color of the character string and the color of the background of at least the area where the character string is displayed among the display areas of the HUD 56 or the MET 58. This allows the display of the action schedule to be performed in manual driving to be emphasized with a reduced color scheme.
[0067] In this embodiment, the action schedule creation ECU 60 creates an action plan including a plurality of action schedules, and the display unit includes the MET 58 as a first display unit and the HUD 56 as a second display unit. The display control ECU 42 displays, among the action plans, action schedules whose distance to the point where the action is performed is equal to or less than distance L3 on the MET 58, and action schedules whose distance to the point where the action is performed is equal to or less than distance L1, which is smaller than distance L3, on the HUD 56. This allows the occupant to easily recognize the action schedule by displaying the nearest action schedule and subsequent action schedules separately on the MET 58 and the HUD 56. In addition, by using the MET 58 as the first display unit and the HUD 56 as the second display unit, the amount of line-of-sight movement of the occupant viewing the first display unit and the second display unit can be reduced.
[0068] In this embodiment, the action schedule creation ECU 60 creates an action plan including multiple action schedules. When multiple action schedules are displayed on the HUD 56 or the MET 58, the display control ECU 42 displays the action schedule with the shortest distance to the action point or the shortest time to perform the action in an enlarged manner compared to the other action schedules. This makes it easier for the occupant to recognize the most important upcoming action schedule regardless of whether the vehicle is being driven automatically or manually.
[0069] In the above, a mode has been described in which the display of the action schedule performed in manual driving is emphasized more than the display of the action schedule performed in autonomous driving by inverting the color of the second character string and the color of the background of the second character string. However, emphasizing the display of the action schedule performed in manual driving more than the display of the action schedule performed in autonomous driving is not limited to inverting the color of the second character string and the color of the background of the second character string.
[0070] For example, the display of the action plan to be performed in manual driving may be emphasized more than the display of the action plan to be performed in autonomous driving by changing the color (at least one of brightness, hue, and saturation) of at least one of the second character string and the background of the second character string. As an example, FIG. 12 shows an example in which the color of the background of the second character string is changed to red. In this case, too, it is possible to make it easier for the occupant to recognize the timing when an operation by the occupant is required.
[0071] Changing the color of at least one of the second character string and the background of the second character string can be applied to the HUD 56, but since the HUD 56 has few colors and it is difficult to ensure the optical contrast of the screen, it is preferable to apply it to the MET 58. That is, the display control ECU 42 displays the action schedule on the display unit with information including the character string. In addition, for the MET 58, the display of the action schedule performed in manual driving is emphasized more than the display of the action schedule performed in automatic driving by changing the color of at least one of the second character string and the background of the second character string. In addition, for the HUD 56, the display of the action schedule performed in manual driving is emphasized more than the display of the action schedule performed in automatic driving by inverting the color of the second character string and the color of the background of the second character string. According to this embodiment, it is possible to perform highlighting according to the respective characteristics of the MET 58, which is relatively easy to change the color, and the HUD 56, which has few colors.
[0072] Also, for example, the display of the scheduled action to be performed in manual driving may be highlighted more than the display of the scheduled action to be performed in automatic driving by surrounding the second character string or the line of the scheduled action with a frame line. Also, for example, the scheduled action to be performed in manual driving may be highlighted more than the display of the scheduled action to be performed in automatic driving by flashing the scheduled action to be performed.
[0073] In the above description, a scheduled action whose distance to the point where the action is to be performed is equal to or less than distance L3 is displayed on the MET 58, and a scheduled action whose distance to the point where the action is to be performed is equal to or less than distance L1, which is smaller than distance L3, is displayed on the HUD 56. However, the present invention is not limited to this. For example, a scheduled action whose time until the action is to be performed is equal to or less than a first predetermined value may be displayed on the MET 58, and a scheduled action whose time until the action is to be performed is equal to or less than a second predetermined value, which is smaller than the first predetermined value, may be displayed on the HUD 56.
[0074] In addition, in the above, a mode in which no particular display is made when manual driving by the occupant ends has been described, but the present invention is not limited to this. For example, the display control ECU 42 may display a display indicating the end of manual driving on at least one of the HUD 56 and the MET 58 when the point where the occupant plans to manually perform an action or the time where the occupant plans to manually perform an action has passed. An example of a display indicating the end of manual driving is shown in FIG. 13. This clearly informs the occupant of the end of manual driving, allowing the occupant to leave the operation with peace of mind.
[0075] In addition, although the above describes a mode in which the action schedule is displayed on each of the HUD 56 and the MET 58, the present invention is not limited to this, and the action schedule may be displayed on only one of the HUD 56 and the MET 58. In addition, the display unit is not limited to the HUD 56 and the MET 58, and the action schedule may be displayed on, for example, a central monitor provided in the center of the instrument panel of the vehicle.
[0076] In the above, a case has been described in which the automatic driving ECU 34 performs some of the driving operations in manual driving and the vehicle occupant performs the remaining part, but the present invention is not limited to this. For example, in the manual driving mode, the vehicle occupant may perform all of the driving operations.
[0077] In the above, the background color of the entire display area of the HUD 56 and the MET 58 is a low-brightness color (e.g., black), but this is not limited to this, and another color may be used. Also, the entire display area of the HUD 56 and the MET 58 is not limited to a constant background color, and the background color of the display area of the HUD 56 and the MET 58 may be partially different. In this case, it is preferable to make the color of the inner part surrounding the second character string different from the color of the second character string and the color of the background of at least the area of the display area of the HUD 56 and the MET 58 where the second character string is displayed. This makes it possible to emphasize the display of the action schedule performed in manual driving with a small color scheme.
[0078] Also, in the above description, the display control program 54, which is an example of the vehicle display control program according to the present disclosure, is pre-stored (installed) in the storage unit 48 of the display control ECU 42. However, the vehicle display control program according to the present disclosure can also be provided in a form recorded on a non-transitory recording medium such as a CD-ROM, a DVD-ROM, a memory card, a HDD, or an SSD. [Explanation of symbols]
[0079] 10. In-vehicle systems 34 Autonomous Driving ECU 42 Display control ECU 56 Head-up Display (HUD) 58 Meter Display (MET) 60 Action Schedule Creation ECU
Claims
1. A display control device for a vehicle includes a display control unit that displays a plurality of action plans for automatic or manual driving, created by a creation unit that creates action plans required for a vehicle capable of switching between automatic and manual driving, on a display unit provided in the interior of the vehicle, and highlights the display of the action plans to be performed in manual driving compared to the display of the action plans to be performed in automatic driving.
2. The display control device for a vehicle as described in claim 1, wherein the display control unit displays the planned action on the display unit with information including a string indicating whether the driving is automatic or manual, and for the display of the planned action to be performed in manual driving, the color of the string and the color of the background of the string are inverted to emphasize the display of the planned action to be performed in automatic driving more than the display of the planned action to be performed in automatic driving.
3. The display control device for a vehicle as described in claim 1, wherein the display control unit displays the planned action on the display unit using information including a character string, and for the display of the planned action performed during manual driving, the color of the inner part of the frame surrounding the character string, which serves as the background part of the character string, is made different from the color of the character string and the color of the background in the display area of the display unit, thereby emphasizing the display of the planned action performed during automatic driving more than the display of the planned action performed during automatic driving.
4. The display unit includes a meter display and a HUD. The display control device for a vehicle according to claim 1, wherein the display control unit causes the display unit to display the planned action using information including a character string, and, with respect to the meter display, changes the color of at least one of the character string and a background of the character string to emphasize the display of the planned action performed during manual driving more than the display of the planned action performed during autonomous driving, and, with respect to the HUD, inverts the color of the character string and the color of the background of the character string to emphasize the display of the planned action performed during manual driving more than the display of the planned action performed during autonomous driving.
5. The display control device for a vehicle according to any one of claims 1 to 4, wherein the display control unit causes the display unit to display a display indicating the end of manual driving when the location where the occupant plans to manually perform an action or the time where the occupant plans to manually perform an action has passed.
6. The creation unit creates an action plan including a plurality of the action plans, The display unit includes a meter display and a HUD.
2. The display control device for a vehicle as described in claim 1, wherein the display control unit causes the meter display to display, from among the action plans, action plans in which the distance to the point where the action is to be performed or the time until the action is to be performed is equal to or less than a first predetermined value, and causes the HUD to display, from among the action plans, action plans in which the distance to the point where the action is to be performed or the time until the action is to be performed is equal to or less than a second predetermined value that is smaller than the first predetermined value.
7. The creation unit creates an action plan including a plurality of the action plans, A display control device for a vehicle as described in any one of claims 1 to 5, wherein when the display control unit displays multiple planned actions on the display unit, the planned action having the shortest distance to the point where the action is to be performed or the shortest time until the action is to be performed is displayed enlarged compared to the other planned actions.
8. A display control method for a vehicle, which causes a computer to execute a process including displaying a plurality of action plans for automatic or manual driving, created by a creation unit that creates an action plan required for a vehicle capable of switching between automatic and manual driving, on a display unit provided in the interior of the vehicle, and emphasizing the display of the action plans to be performed in manual driving compared to the display of the action plans to be performed in automatic driving.
9. On the computer, A display control program for a vehicle for executing a process including displaying a plurality of action plans for automatic driving or manual driving, created by a creation unit that creates an action plan required for a vehicle capable of switching between automatic driving and manual driving, on a display unit provided in the interior of the vehicle, and emphasizing the display of the action plans to be performed in manual driving compared to the display of the action plans to be performed in automatic driving.
10. A creation unit that creates an action schedule required for a vehicle that can switch between automatic driving and manual driving; A display unit provided in a passenger compartment of the vehicle; a display control unit that, in a state in which the plurality of action plans for automatic driving or manual driving created by the creation unit are displayed on the display unit, highlights the display of the action plans for manual driving compared to the display of the action plans for automatic driving; A display system for a vehicle comprising:
Citation Information
Patent Citations
Display device of navigation equipment
JP2002372432A
Drive support device, drive support method
JP2017170973A
Information display device, information display method, and information display program
JP2018077086A
Vehicle control system, vehicle control method, and vehicle control program
JP2018203013A
Display device for vehicle
JP2019031176A
