Vehicle display control device, vehicle display system, vehicle display control method, and vehicle display control program

Abstract

The objective is to obtain a vehicle display control device, a vehicle display system, a vehicle display control method, and a vehicle display control program that can make guidance images more prominent in situations where hands-on assistance is required, while reducing the inconvenience of guidance images in situations where hands-on assistance is not required. [Solution] Icons D3 and D4, which are displayed on the MET24 and HUD26 when requesting the occupant to take hands-on control before switching the vehicle 12 from autonomous driving to manual driving, are displayed more prominently than the icon used when requesting the occupant to continue taking hands-on control while autonomous driving is in progress. This makes icons D3 and D4 more noticeable than the other icon. Conversely, since the other icon is less noticeable than icons D3 and D4, the inconvenience of requesting the occupant to continue taking hands-on control while autonomous driving is in progress is reduced.

Description

Technical Field

[0001] The present invention relates to a vehicle display control device, a vehicle display system, a vehicle display control method, and a vehicle display control program.

Background Art

[0002] Patent Document 1 discloses a technique related to a driving support device mounted on a vehicle such as an automobile. For example, in a vehicle, when switching from automatic driving to manual driving, it is necessary to notify the driver (occupant) in advance that the driver wishes to change the driving. In this case, in the prior art described in Patent Document 1, a guiding image with a hand placed on the steering wheel is largely displayed at the center of the meter display to guide the occupant to grip the steering wheel (so-called hands-on request). That is, in order to make the occupant grip the steering wheel by this guiding image, the guiding image needs to be displayed prominently.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, the request for the occupant to grip the steering wheel, as described above, is displayed prominently, so if it is made frequently, it will cause annoyance. Therefore, there is room for improvement in this regard.

[0005] In consideration of the above facts, the present invention aims to provide a vehicle display control device, a vehicle display system, a vehicle display control method, and a vehicle display control program that can make guidance images more prominent in situations where there is a high need for the occupant to grip the steering wheel, and reduce the inconvenience of guidance images in situations where there is little need for the occupant to grip the steering wheel. [Means for solving the problem]

[0006] The vehicle display control device according to the first embodiment includes a display control unit that displays a guidance image requesting the occupant to grip the steering wheel when it is necessary for the occupant to grip the steering wheel, and the display control unit, when switching from automatic driving to manual driving by the automatic driving control unit, displays a second guidance image without displaying the first guidance image if the occupant is gripping the steering wheel, and displays the first guidance image without displaying the second guidance image if the occupant is not gripping the steering wheel.

[0007] The vehicle display control device according to the first embodiment includes a display control unit, which is configured to display a guidance image on a display unit installed inside the vehicle interior, prompting the occupant to grasp the steering wheel when it is necessary for the occupant to grasp the steering wheel.

[0008] In this embodiment, when the automatic driving control unit switches from automatic driving to manual driving, the display control unit displays different guidance images depending on whether the occupant is holding the steering wheel or not, in order to request the occupant to hold the steering wheel.

[0009] When a vehicle switches from autonomous to manual driving, it cannot switch to manual driving unless the occupant holds onto the steering wheel. In this case, the vehicle will be forced to stop. On the other hand, if the occupant is required to continue holding onto the steering wheel, the vehicle will not be forced to stop if the occupant does not hold onto the steering wheel.

[0010] Therefore, in this embodiment, the guidance image is configured to differ depending on whether the occupant is holding the steering wheel or not before switching from autonomous driving to manual driving.

[0011] For example, the first guidance image (first guidance image) for when the occupant is not holding the steering wheel is made more prominent than the second guidance image (second guidance image) for when the occupant is holding the steering wheel. On the other hand, in this embodiment, the second guidance image is less prominent than the first guidance image, so if the occupant is holding the steering wheel while autonomous driving continues, the annoyance is reduced.

[0012] The "display unit" includes head-up displays, meter displays, and center displays.

[0013] Furthermore, to emphasize the guidance image, the density or brightness of the guidance image can be increased to make it stand out, or its size, position, or blinking can be adjusted to make it more noticeable.

[0014] The vehicle display control device according to the second embodiment includes a display control unit that displays a guidance image requesting the occupant to grip the steering wheel when it is necessary for the occupant to grip the steering wheel, the display control unit, while the vehicle is in continuous autonomous driving, displays the guidance image before an event occurs in the vehicle, and if the occupant is gripping the steering wheel, it displays the fourth guidance image without displaying the third guidance image, and if the occupant is not gripping the steering wheel, it displays the third guidance image without displaying the fourth guidance image.

[0015] The vehicle display control device according to the second embodiment includes a display control unit, which is configured to display a guidance image on a display unit installed inside the vehicle interior, prompting the occupant to grasp the steering wheel when it is necessary for the occupant to grasp the steering wheel.

[0016] Here, "vehicle events" refer to, for example, vehicle merging, vehicle lane changes, and vehicle entering an intersection. In this embodiment, when the display control unit displays a guidance image before a vehicle event occurs while the vehicle is in autonomous driving mode, it changes the appearance of the guidance image depending on whether or not the occupant is holding the steering wheel.

[0017] In so-called vehicle events, anything can happen, so it is necessary to require occupants to hold onto the steering wheel before the event occurs in order to prepare for unpredictable situations.

[0018] Therefore, in this embodiment, the guidance image is configured to differ depending on whether the occupant is holding the steering wheel or not before an event occurs in a vehicle that is continuing to operate autonomously.

[0019] Thus, in this aspect, for example, the third guidance image (the third guidance image) when the occupant is not gripping the steering wheel is made more prominent than the fourth guidance image (the fourth guidance image) when the occupant is gripping the steering wheel. On the other hand, in this aspect, since the fourth guidance image is less prominent than the third guidance image, when the occupant is gripping the steering wheel during the continuation of the automatic driving, the annoyance is reduced.

[0020] The vehicle display control device according to the third aspect is the vehicle display control device according to the first aspect or the second aspect, wherein the display control unit emphasizes the guidance image and causes the display unit to display it when the occupant is not gripping the steering wheel as compared with the case where the occupant is gripping the steering wheel.

[0021] In the vehicle display control device according to the third aspect, the display control unit causes the guidance image when the occupant is not gripping the steering wheel to be displayed more prominently than the guidance image when the occupant is gripping the steering wheel.

[0022] Therefore, in this aspect, for example, the first guidance image (the first guidance image) when the occupant is not gripping the steering wheel is made more prominent than the second guidance image (the second guidance image) when the occupant is gripping the steering wheel.

[0023] On the other hand, in this aspect, since the second guidance image is less prominent than the first guidance image, when the occupant is gripping the steering wheel during the continuation of the automatic driving, the annoyance is reduced.

[0024] The vehicle display control device according to the fourth aspect is the vehicle display control device according to the first aspect, wherein the display control unit emphasizes the guidance image and causes the display unit to display it when the occupant is not gripping the steering wheel before switching from automatic driving to manual driving, as compared with the case where the occupant is not gripping the steering wheel before the occurrence of an event of the vehicle.

[0025] When the vehicle switches from automatic driving to manual driving, if the occupant does not hold the steering wheel, the vehicle cannot be switched to manual driving. In this case, the vehicle will be forced to stop. On the other hand, before an event occurs during the continuation of automatic driving, the occupant is required to hold the steering wheel. However, in this case, the possibility that the vehicle will be forced to stop because the occupant does not hold the steering wheel is low. That is, when asking the occupant to hold the steering wheel before switching from automatic driving to manual driving and when asking the occupant to hold the steering wheel before an event occurs during the continuation of automatic driving, the former has a higher necessity to require the occupant to hold the steering wheel than the latter.

[0026] In the vehicle display control device according to the fourth aspect, when the occupant does not hold the steering wheel before the vehicle switches from automatic driving to manual driving (the first guidance image), it is displayed on the display unit more prominently than the guidance image (the third guidance image) when the occupant does not hold the steering wheel before an event occurs during the continuation of automatic driving.

[0027] Thereby, in this aspect, the first guidance image is made more prominent than the third guidance image. That is, in this aspect, according to the degree of necessity for the occupant to hold the steering wheel, by changing the guidance image, it is possible to make the guidance image more prominent in a scene where the necessity for the occupant to hold the steering wheel is high.

[0028] The vehicle display control device according to the fifth aspect is the vehicle display control device according to any one of the first aspect, the third aspect, and the fourth aspect. The display control unit calculates at least one of the distance and time until the switch from automatic driving to manual driving. When at least one of the distance and time becomes shorter than a preset threshold value, the guidance image is displayed on the display unit more prominently than when at least one of the distance and time is longer than the threshold value.

[0029] In the vehicle display control device according to the fifth embodiment, the display control unit calculates at least one of the distance and time required to switch from automatic driving to manual driving. When at least one of the distance and time falls below a preset threshold, the need to request the occupant to grip the steering wheel increases compared to when at least one of the distance and time falls below a preset threshold.

[0030] Therefore, in this embodiment, the guidance image (fifth guidance image) displayed when at least one of the distance and time from automatic driving to manual driving is shorter than a preset threshold is emphasized on the display unit compared to the guidance image (sixth guidance image) displayed when at least one of the distance and time is longer than a preset threshold. In other words, in this embodiment, the sixth guidance image is made more prominent than the fifth guidance image, making it possible to draw the attention of the occupants.

[0031] A vehicle display control device according to the sixth embodiment is a vehicle display control device according to any one of the second, third, or fifth embodiments, wherein the display control unit calculates at least one of the distance and time until an event occurs in the vehicle, and when at least one of the distance and time becomes shorter than a preset threshold, it displays the guidance image on the display unit with more emphasis than when at least one of the distance and time is longer than the threshold.

[0032] In the sixth embodiment of the vehicle display control device, the display control unit calculates at least one of the distance and time until an event occurs in the vehicle while it is in autonomous driving mode. When at least one of the distance and time becomes shorter than a preset threshold, the need to request the occupant to hold the steering wheel increases compared to when at least one of the distance and time is longer than a preset threshold.

[0033] Therefore, in this embodiment, the guidance image (fifth guidance image) displayed when at least one of the distance and time until the occurrence of a vehicle event is shorter than a preset threshold is emphasized on the display unit compared to the guidance image (sixth guidance image) displayed when at least one of the distance and time is longer than a preset threshold. In other words, in this embodiment, the sixth guidance image is made more prominent than the fifth guidance image, making it possible to draw the attention of the occupants.

[0034] The vehicle display control device according to the seventh embodiment is a vehicle display control device according to any one of the first to sixth embodiments, wherein when the occupant is not gripping the steering wheel, the size of the guidance image is increased, the brightness of the guidance image is increased, or the guidance image is displayed in a more conspicuous position to emphasize the guidance image compared to when the occupant is gripping the steering wheel.

[0035] In the vehicle display control device according to the seventh embodiment, when the occupant is not gripping the steering wheel, the guidance image can be emphasized by increasing the size of the guidance image compared to when the occupant is gripping the steering wheel. In addition, the guidance image can also be emphasized by increasing the brightness of the guidance image or by displaying the guidance image in a prominent position. The eighth embodiment of the vehicle display control device is a vehicle display control device according to the first or second embodiment, wherein the display control unit determines whether or not the occupant is holding the steering wheel before displaying the guidance image. In the eighth aspect of the vehicle display control device, the guidance image displayed can be changed depending on whether or not the occupant is holding the steering wheel.

[0036] A vehicle display system according to the ninth embodiment comprises a vehicle display control device according to the first embodiment and a display unit provided in the vehicle interior that displays guidance images requesting the occupant to grip the steering wheel.

[0037] The ninth embodiment of the vehicle display system comprises a vehicle display control device and a display unit. The vehicle display control device is configured to display guidance images when the occupant is not holding the steering wheel before the automatic driving control unit switches from automatic driving to manual driving while the vehicle is in continuous automatic driving mode, with greater emphasis than guidance images when the occupant is holding the steering wheel. When it is necessary for the occupant to hold the steering wheel, a guidance image requesting the occupant to hold the steering wheel is displayed on a display unit located inside the vehicle.

[0038] Therefore, in this embodiment, the guidance image (first guidance image) used when requesting the occupant to hold the steering wheel before switching from autonomous driving to manual driving can be displayed on the display unit with more emphasis (more prominence) than the guidance image (second guidance image) used when requesting the occupant to continue holding the steering wheel while autonomous driving is in progress.

[0039] On the other hand, in this embodiment, the second guidance image is less conspicuous than the first guidance image, thus reducing the inconvenience if the occupant is holding the steering wheel while autonomous driving continues.

[0040] The vehicle display system according to the tenth embodiment comprises a vehicle display control device according to the second embodiment and a display unit provided in the vehicle interior that displays guidance images requesting the occupant to grip the steering wheel.

[0041] The vehicle display system according to the tenth embodiment comprises a vehicle display control device and a display unit. The vehicle display control device is configured to display guidance images that are emphasized more when the occupant is not holding the steering wheel before a vehicle event occurs, while the vehicle is in continuous autonomous driving, than guidance images that are emphasized when the occupant is holding the steering wheel. When it is necessary for the occupant to hold the steering wheel, a guidance image requesting the occupant to hold the steering wheel is displayed on a display unit located inside the vehicle.

[0042] Therefore, in this embodiment, the guidance image (third guidance image) for requesting the occupant to hold the steering wheel before an event occurs in a vehicle that is continuing to operate autonomously can be displayed on the display unit with more emphasis (more prominence) than the guidance image (fourth guidance image) for requesting the occupant to continue holding the steering wheel while autonomous driving is continuing.

[0043] On the other hand, in this embodiment, the fourth guidance image is less conspicuous than the third guidance image, thus reducing the inconvenience if the occupant is holding the steering wheel while autonomous driving continues.

[0044] The 11th embodiment of the vehicle display control method involves having a computer perform a process that includes displaying a second guidance image without displaying a first guidance image when the occupant is gripping the steering wheel before switching from automatic driving to manual driving by the automatic driving control unit, and displaying the first guidance image without displaying the second guidance image when the occupant is not gripping the steering wheel.

[0045] In the 11th embodiment of the vehicle display control method, the need for the occupant to grip the steering wheel can be made more easily recognizable to the occupant according to its importance.

[0046] The vehicle display control method according to the 12th embodiment involves having a computer perform a process during the continuation of autonomous driving of the vehicle, which includes displaying a fourth guidance image without displaying a third guidance image if the occupant is holding the steering wheel before an event occurs in the vehicle, and displaying the third guidance image without displaying the fourth guidance image if the occupant is not holding the steering wheel.

[0047] In the vehicle display control method according to the 12th embodiment, the need for the occupant to grip the steering wheel can be made more easily recognizable to the occupant according to its importance.

[0048] The vehicle display control program according to the 13th embodiment causes the computer to perform a process that includes displaying a second guidance image without displaying a first guidance image when the occupant is holding the steering wheel before the automatic driving control unit switches from automatic driving to manual driving, and displaying the first guidance image without displaying the second guidance image when the occupant is not holding the steering wheel.

[0049] In the 13th embodiment of the vehicle display control program, the need for the occupant to grip the steering wheel can be made more easily recognizable to the occupant according to its importance.

[0050] The vehicle display control program according to the 14th embodiment causes the computer to perform a process that includes displaying a fourth guidance image without displaying a third guidance image if the occupant is holding the steering wheel before an event occurs in the vehicle while the vehicle is in continuous autonomous driving, and displaying the third guidance image without displaying the fourth guidance image if the occupant is not holding the steering wheel.

[0051] In the 14th embodiment of the vehicle display control program, the need for the occupant to grip the steering wheel can be made more easily recognizable to the occupant according to its importance. [Effects of the Invention]

[0052] As described above, the vehicle display control device, vehicle display system, vehicle display control method, and vehicle display control program according to the present invention have the excellent effect of making guidance images more prominent in situations where it is considered necessary for the occupant to grip the steering wheel, and reducing the inconvenience of guidance images in situations where it is not necessary for the occupant to grip the steering wheel. [Brief explanation of the drawing]

[0053] [Figure 1] This is a schematic perspective view of the front part of the passenger compartment of a vehicle to which the vehicle display control device according to the embodiment is applied, as seen from the rear of the vehicle. [Figure 2] This is a block diagram showing the hardware configuration of a vehicle display control device according to an embodiment. [Figure 3] This is a block diagram showing the functional configuration of a vehicle display control device according to an embodiment. [Figure 4] (A) is a front view showing an example of the HUD display during normal driving of a vehicle to which the vehicle display control device according to the embodiment is applied, and (B) is a front view showing an example of the MET display. [Figure 5] (A) is a front view showing an example of the display of icon D2 on the HUD, and (B) is a front view showing an example of the display of icon D1 on the MET, in a vehicle to which the vehicle display control device according to the embodiment is applied, before switching from automatic driving to manual driving. [Figure 6] (A) is a front view showing an example of the display of icon D4 on the HUD, and (B) is a front view showing an example of the display of icon D3 on the MET, in a vehicle to which the vehicle display control device according to the embodiment is applied, before switching from automatic driving to manual driving. [Figure 7] This is a front view showing an example of the MET display during normal driving of a vehicle to which the vehicle display control device according to the embodiment is applied. [Figure 8] This is a front view showing an example of the display of MET icons D5 and D6 for hands-on requests made before an event in a vehicle to which the vehicle display control device according to the embodiment is applied. [Figure 9] This is a front view showing an example of the display of the MET icon D5 for a hands-on request made before an event in a vehicle to which the vehicle display control device according to the embodiment is applied. [Figure 10] This is a front view showing an example of the display of the MET icon D7 for a hands-on request made before an event in a vehicle to which the vehicle display control device according to the embodiment is applied. [Figure 11] This is a front view showing an example of the display of MET icon D8, which requests continued hands-on operation in a vehicle to which the vehicle display control device according to the embodiment is applied. [Figure 12]This flowchart shows an example of the display processing flow in the embodiment. [Figure 13] This flowchart shows an example of the display processing flow in the embodiment. [Modes for carrying out the invention]

[0054] A vehicle 12 to which a vehicle display control device 10 according to one embodiment of the present invention is applied will be described with reference to the drawings. In this embodiment, the vehicle 12 is configured to be switchable between automatic driving and manual driving. Here, automatic driving is a mode of driving in which some or all of the driving operations (operations such as accelerator, brake, turn signal, steering wheel, and pedal operation) are performed automatically. Manual driving is a mode of driving in which the driver performs all of the said driving operations.

[0055] As shown in Figure 1, an instrument panel 14 is provided at the front of the passenger compartment 13 in the vehicle 12. The instrument panel 14 extends in the vehicle width direction, and a steering wheel 16 is provided on the right side of the instrument panel 14. In other words, in this embodiment, as an example, the steering wheel 16 is provided on the right side, making it a so-called right-hand drive vehicle, and the driver's seat is set on the right side of the vehicle. A windshield glass 18 is also provided at the front end of the instrument panel 14.

[0056] The windshield glass 18 extends upward from the front end of the instrument panel 14, separating the exterior of the vehicle 12 from the interior 13. The ends of the windshield glass 18 in the vehicle width direction are attached to the front ends of the front pillars 20, and the front ends of the front side glass 22 are fixed to the rear ends of the front pillars 20. Furthermore, the upper end of the windshield glass 18 is attached to a front header panel (not shown) which is positioned with the vehicle width direction as its longitudinal direction at the front end of the roof panel (not shown) that covers the interior 13 from above.

[0057] Here, the instrument panel 14 is provided with a meter display (display unit; hereinafter referred to as "MET") 24 located on the back side of the steering wheel 16, in a position that is within the driver's (occupant's) field of vision when they are looking forward at the vehicle.

[0058] On the other hand, a head-up display (HUD) 26 is provided on the windshield glass 18. The HUD 26 is set on the upper side of the MET 24 and is composed of a projection surface projected by a head-up display device 44 (see Figure 2). The head-up display device 44 is located further forward than the instrument panel 14, and is configured to project images from this head-up display device 44 onto the HUD 26 on the windshield glass 18.

[0059] (Hardware configuration of the vehicle display control device 10) The vehicle 12 is equipped with an ECU (Electronic Control Unit) 28, which serves as the control unit for the vehicle display control device 10. Figure 2 is a block diagram showing the hardware configuration of the vehicle display control device 10.

[0060] As shown in Figure 2, the ECU 28 of the vehicle display control device 10 includes a CPU (Central Processing Unit: processor) 30, ROM (Read Only Memory) 32, RAM (Random Access Memory) 34, storage 36, communication interface (communication I / F) 38, and input / output interface. It is configured to include an (input / output interface) 40. Each component is connected to the others via a bus 42 so that they can communicate with each other.

[0061] The CPU 30 is a central processing unit that, for example, executes the vehicle display control program and controls various components. Specifically, the CPU 30 reads the vehicle display control program from the ROM 32 or storage 36 and executes the vehicle display control program using the RAM 34 as a working area. The CPU 30 controls each of the above components and performs various calculations according to the vehicle display control program recorded in the ROM 32 or storage 36.

[0062] ROM 32 stores the vehicle display control program and various data. RAM 34 temporarily stores the vehicle display control program or data as a working area. Storage 36 is composed of an HDD (Hard Disk Drive) or SSD (Solid State Drive) and stores the vehicle display control program, including the operating system, and various data. In this embodiment, ROM 32 or storage 36 stores the vehicle display control program for display processing, and various data.

[0063] Communication I / F38 is an interface for the vehicle display control device 10 to communicate with servers and other devices (not shown), and standards such as Ethernet®, LTE, FDDI, and Wi-Fi® are used.

[0064] The input / output interface 40 is connected to the MET 24, a head-up display device (HUD device) 44 that projects images onto the HUD 26, an actuator 46, and a gripping sensor 48. In addition, the input / output interface 40 is connected to various sensors (not shown) and a GPS device for the purpose of automatically driving the vehicle 12 (see Figure 1).

[0065] Here, the actuator 46 is composed of a steering actuator, an accelerator actuator, and a brake actuator. The steering actuator steers the vehicle 12, the accelerator actuator accelerates the vehicle 12, and the brake actuator decelerates the vehicle 12 by controlling the brakes.

[0066] On the other hand, the grip sensor 48 is capable of detecting when the steering wheel 16 is gripped by an occupant. For this reason, the grip sensor 48 could be, for example, a pressure sensor capable of detecting the pressure acting on the steering wheel 16 when it is gripped by an occupant. In addition to this, the grip sensor 48 could also be a contact sensor capable of detecting contact between the occupant and the steering wheel 16, or a vital sensor capable of detecting the occupant's pulse, blood pressure, sweating, etc., when the steering wheel 16 is gripped.

[0067] (Functional configuration of the vehicle display control device 10) The vehicle display control device 10 implements various functions using the above-mentioned hardware resources. The functional configuration implemented by the vehicle display control device 10 will be explained with reference to Figure 3.

[0068] As shown in Figure 3, the vehicle display control device 10 is configured as follows: a communication unit 50, an automatic driving control unit 54, a MET display instruction unit 56, a HUD display instruction unit 58, a grip determination unit 60, and a display control unit 62. Each of these functional configurations is realized by the CPU 30 shown in Figure 2 reading and executing a vehicle display control program stored in the ROM 32 or storage 36.

[0069] The communication unit 50 transmits and receives data with external servers and other devices via the communication interface 38 (see Figure 2). For example, it transmits and receives data such as map data and traffic conditions stored on the server. The communication unit 50 may also be configured to perform vehicle-to-vehicle communication with surrounding vehicles.

[0070] The automatic driving control unit 54 drives the vehicle 12 automatically while taking into account the position information and the surrounding environment information of the vehicle 12 (see Figure 1). Specifically, it drives the vehicle 12 automatically by controlling the actuator 46 (see Figure 2). The automatic driving control unit 54 also switches between automatic driving and manual driving of the vehicle 12.

[0071] The MET display instruction unit 56 displays a third-person multi-lane display image on the MET 24 (see Figure 2). The third-person multi-lane display image is an image that shows the vehicle's own lane and the lanes adjacent to it on the left and right, as if viewed from above and behind the vehicle. By excluding non-existent lanes from the display, it can generally show up to three lanes, but is not limited to this. The vehicle itself is displayed as an icon in the third-person multi-lane display image. The third-person multi-lane display image can show, for example, the approach of another vehicle or the situation when the lane change is postponed due to the approach of another vehicle from the right rear or left rear, and the lane change is postponed until the other vehicle has passed before the lane change is performed.

[0072] Here, Figure 4(B) shows an example of the MET24 display during normal driving of vehicle 12. As shown in Figure 4(B), the upper part of the MET24 display area shows the set speed for cruise control and the current speed of vehicle 12. The set speed and vehicle speed are displayed in the center of the MET24 display area in the vehicle width direction. The set speed is displayed in small letters at the bottom, and in this example it is set to 100 km / h. The current vehicle speed is displayed at the top, and is shown as 98 km / h. Therefore, vehicle 12 is set to travel at a speed of up to 100 km / h while maintaining a constant distance from the vehicle in front.

[0073] Furthermore, in the central part of the MET24 display area, an icon V1 representing the vehicle itself, and icons V2 and V3 representing surrounding vehicles are displayed. Looking at icon V1, it can be seen that the vehicle is traveling in the middle lane of a three-lane road. Icons V2 and V3 are displayed based on information detected by sensors (not shown) mounted on the vehicle 12. By looking at icons V2 and V3, it can be seen that there are vehicles traveling in front of the vehicle and to the right and slightly in front of the vehicle.

[0074] The vehicle's own position can be detected by a GPS device mounted on vehicle 12. In addition, a combination of sensors such as a stereo camera, ultrasonic sensor, millimeter-wave radar, and laser radar are used to detect surrounding vehicles. Furthermore, the system may be configured to determine the position of the vehicle itself and surrounding vehicles by communicating with them.

[0075] The HUD display instruction unit 58 displays a first-person single-lane display image on the HUD 26 (see Figure 2). The first-person single-lane display image is an image that closely resembles what the driver sees ahead through the windshield of their vehicle, and the lanes adjacent to the left and right of the current lane are excluded from the display. The first-person single-lane display image displays the current lane as large as possible, while omitting the display of information that is not important for monitoring driving, thereby minimizing distractions.

[0076] Here, Figure 4(A) shows an example of the display on the HUD26 during normal driving of the vehicle 12. As shown in Figure 4(A), the lower part of the HUD26 display area shows the set speed for cruise control and the current speed of the vehicle 12. The set speed and vehicle speed are displayed in the center of the HUD26 display area in the vehicle width direction.

[0077] The set speed is displayed in small text on the right, and in this example, it is set to 100 km / h. The current vehicle speed is displayed on the left, showing 98 km / h. Therefore, vehicle 12 is set to travel at a speed of up to 100 km / h while maintaining a constant distance from the vehicle in front. The display of the set speed and vehicle speed is synchronized with the contents of MET24. In addition, only icon V2, which represents the vehicle traveling in front of the current vehicle, is displayed on HUD26.

[0078] The grip determination unit 60 determines whether or not the occupant is gripping the steering wheel 16 (see Figure 1) based on the output of the grip sensor 48 (see Figure 2). For example, if the grip sensor 48 is a pressure sensor, the grip determination unit 60 determines whether or not the occupant is gripping the steering wheel 16 based on the pressure exerted when the occupant grips the steering wheel 16 by the grip sensor 48. The grip determination unit 60 then outputs information indicating the determination result to the display control unit 62.

[0079] Based on the determination result from the grip determination unit 60, the display control unit 62 displays guidance images on the MET24 and HUD26 to guide the occupant to grip the steering wheel 16, as needed. For example, while the vehicle 12 is in autonomous driving mode, it is necessary to request the occupant to grip the steering wheel 16, or to perform so-called hands-on driving, before the vehicle 12 switches from autonomous driving to manual driving.

[0080] Therefore, as shown in Figures 5(A) and (B), the display control unit 62 displays icons D1 (second guidance image) and D2 (second guidance image), which represent the steering wheel being grasped with both hands, in the center of the display areas of the MET24 and HUD26, respectively, to guide the occupant to grasp the steering wheel 16.

[0081] In this way, the display control unit 62 displays icons D1 and D2, representing the steering wheel being grasped with both hands, on the MET24 and HUD26, respectively, visually communicating to the occupant the need to grasp the steering wheel 16, making it possible to understand the content at a glance.

[0082] Furthermore, the display control unit 62 displays specific messages such as "Please drive" and "Advanced Drive will end" on the MET24 and HUD26, respectively, above icons D1 and D2. Icons D1 and D2 are displayed on the MET24 and HUD26 even when the occupant is holding the steering wheel 16.

[0083] Then, if at least one of the distance and time until vehicle 12 switches from automatic to manual driving falls below a predetermined value (threshold), icons D1 and D2 shown in Figures 5(A) and (B) change to icons D3 and D4 (first guidance images) shown in Figures 6(A) and (B). In other words, the guidance images change to icons D3 and D4, which are more conspicuous than icons D1 and D2.

[0084] To explain the difference between icons D1 and D2 and icons D3 and D4 in detail, in this embodiment, as shown in Figures 5(A) and (B), the steering wheel and hands are outlined in white in icons D1 and D2, while in icons D3 and D4 shown in Figures 6(A) and (B), the steering wheel and hands are colored (for example, filled with a conspicuous color such as amber or fluorescent). In other words, the color of the steering wheel and hands is changed to make icons D3 and D4 stand out more than icons D1 and D2. In addition to changing the color, you may also make icons D3 and D4 blink.

[0085] In this embodiment, the display control unit 62 displays icons D1 to D4, which are used when requesting the occupant to take hands-on control before switching the vehicle 12 from automatic to manual driving, on the MET24 and HUD26, respectively, with greater emphasis than icon D8 (fourth guidance image; see Figure 11), which is used when requesting the occupant to continue taking hands-on control while automatic driving is in progress. Although only an example of the MET24 display is shown in Figure 11, the HUD26 displays essentially the same information as the MET24. The same applies to Figures 8 to 10.

[0086] Furthermore, while the vehicle 12 is continuing to operate autonomously, the display control unit 62 displays icons D5, D6 (third guidance image; see Figure 8), and D7 (third guidance image; see Figure 10) on the MET24 and HUD26, respectively, with greater emphasis than icon D8 (fourth guidance image; see Figure 11), which requests the occupant to continue hands-on operation while the vehicle 12 is merging, changing lanes, or entering an intersection, before any events occur involving the vehicle 12.

[0087] For example, Figures 7 to 11 show examples of MET24 displays. Figure 7 shows an example of MET24 displays during normal driving in autonomous mode, where the steering wheel icon is not displayed.

[0088] On the other hand, when occupant hands-on operation is required, such as before an event occurs in vehicle 12, the display control unit 62 displays icons D5 and D6 on MET24 to request hands-on operation from the occupant, as shown in Figures 8 and 9. The display control unit 62 also displays the message "Please hold the steering wheel."

[0089] Icon D5 is displayed to the left of the third-person multi-lane display image shown in the center of the MET24 display area, and icon D6 is displayed to the left of the current vehicle 12 speed display shown at the top of the MET24 display area. In addition, the hand portion of icon D5 flashes, while the icon itself flashes in icon D6. Figures 8 and 9 are displayed alternately. Furthermore, in this embodiment, the steering wheel is labeled with the familiar term "handle" for general users.

[0090] Furthermore, when the occupant grips the steering wheel 16 (see Figure 1), the display control unit 62 displays an animation in which icon D5 moves and disappears (icon D7), as shown in Figure 10. Then, when the animation ends, the display control unit 62 lights up icon D8, as shown in Figure 11, to request the occupant to continue hands-on. In this embodiment, icons D3 and D4 correspond to the "first guidance image" described in claim 1, etc., and icons D1 and D2 correspond to the "second guidance image" described in claim 1, etc. Furthermore, icons D5 and D6 correspond to the "third guidance image" described in claim 2, etc., and icon D8 corresponds to the "fourth guidance image" described in claim 2, etc. Also, the "second guidance image" and the "fourth guidance image" may be the same guidance image.

[0091] (Operation and effects of vehicle display control devices) Next, the operation and effects of the vehicle display control device according to this embodiment will be described.

[0092] First, the display processing of MET24 and HUD26 shown in Figure 2 will be explained using the flowcharts shown in Figures 12 and 13. This display processing is performed by the CPU 30 shown in Figure 2 reading the vehicle display control program from ROM 32 or storage 36, loading it into RAM 34, and executing it.

[0093] First, we will explain the display process before switching vehicle 12 from automatic to manual operation.

[0094] As shown in Figure 12, in step S100, the CPU 30 determines whether or not the vehicle 12 (see Figure 1) is in autonomous driving mode. If the system determines that vehicle 12 is in autonomous driving mode (step S100:Y), it proceeds to step S102. If the CPU 30 determines in step S100 that vehicle 12 is not in autonomous driving mode (step S100:N), it terminates the display process. In other words, as shown in Figures 4(A) and (B), vehicle 12 maintains the display for normal driving.

[0095] Next, in step S102, the CPU 30 determines whether or not the vehicle 12 will switch to manual operation. If the CPU 30 determines in step S102 that the vehicle 12 will switch to manual operation (step S102: Y), it proceeds to the process in step S104. In step S102, this process is continued until the CPU 30 determines that the vehicle 12 will switch to manual operation.

[0096] In step S104, the CPU 30 determines whether the occupant is gripping the steering wheel 16 (see Figure 1). If the CPU 30 determines in step S104 that the occupant is gripping the steering wheel 16 (step S104: Y), it proceeds to step S106.

[0097] Next, in step S106, the CPU 30 displays icons D1 and D2 on the MET 24 and HUD 26, respectively (see Figures 5(A) and (B)). Then, in step S108, the CPU 30 switches the vehicle 12 from automatic to manual operation, and the flow ends.

[0098] On the other hand, if the CPU 30 determines in step S104 that the steering wheel 16 is not being held (step S104:N), it proceeds to the process in step S110. Then, in step S110, the CPU 30 displays icons D3 and D4 on the MET 24 and HUD 26, respectively (see Figures 6(A) and (B)).

[0099] Next, in step S112, the CPU 30 determines whether or not the steering wheel 16 is being gripped. If the CPU 30 determines in step S112 that the steering wheel 16 is being gripped (step S112: Y), it proceeds to the process in step S108.

[0100] On the other hand, if the CPU 30 determines in step S112 that the steering wheel 16 is not being held (step S112:N), it proceeds to step S114. Then, in step S114, the CPU 30 automatically stops the vehicle 12, and the flow ends. When automatically stopping the vehicle 12, the vehicle 12 is moved to a position such as the side of the road where it will not obstruct other vehicles, and then the vehicle 12 is automatically stopped.

[0101] As described above, in this embodiment, in order to request the occupant to take hands-on control before the vehicle 12 (see Figure 1) switches from automatic driving to manual driving, icons D1 and D2 shown in Figures 5(A) and (B), and icons D3 and D4 shown in Figures 6(A) and (B) are displayed in stages on the MET24 and HUD26, respectively.

[0102] Next, we will explain the display process for vehicle 12 before an event occurs.

[0103] As shown in Figure 13, in step S200, the CPU 30 determines whether or not the vehicle 12 (see Figure 1) is in autonomous driving mode. If the CPU 30 determines in step S200 that the vehicle 12 is in autonomous driving mode (step S200:Y), it proceeds to step S202. If the CPU 30 determines in step S200 that the vehicle 12 is not in autonomous driving mode (step S200:N), it terminates the display process. As shown in Figures 4(A) and 4(B), the vehicle 12 maintains its normal operating display.

[0104] Next, in step S202, the CPU 30 determines whether or not an event occurs for vehicle 12. If the CPU 30 determines in step S202 that an event occurs for vehicle 12 (step S202: Y), it proceeds to step S204. In step S202, this process is continued until the CPU 30 determines that an event occurs for vehicle 12.

[0105] In step S204, the CPU 30 determines whether or not the occupant is gripping the steering wheel 16 (see Figure 1). If the CPU 30 determines in step S204 that the occupant is gripping the steering wheel 16 (step S204:Y), it proceeds to the process in step S206.

[0106] Next, in step S206, the CPU 30 displays icon D8 (see Figure 11) on MET24 and HUD26, respectively. Then, in step S208, the CPU 30 terminates the flow when an event occurs in vehicle 12.

[0107] On the other hand, if the CPU 30 determines in step S204 that the occupant is not gripping the steering wheel 16 (step S204:N), it proceeds to step S210. Then, in step S210, the CPU 30 displays icons D5 and D6 (see Figures 8 and 9) on the MET 24 and HUD 26, respectively.

[0108] Next, in step S212, the CPU 30 determines whether or not the occupant is gripping the steering wheel 16. If the CPU 30 determines in step S212 that the occupant is gripping the steering wheel 16 (step S212: Y), it proceeds to the process in step S214.

[0109] In step S214, the CPU 30 displays icon D7 (see Figure 10) on both the MET 24 and the HUD 26. Then, it proceeds to the process in step 206. On the other hand, if the CPU 30 determines in step S212 that the occupant is not gripping the steering wheel 16 (step S212:N), this process is continued until the CPU 30 determines that the occupant is gripping the steering wheel 16.

[0110] As described above, in this embodiment, in order to request the occupant to take a hands-on look before an event occurs in the vehicle 12 (see Figure 1), icons D8 to D7 shown in Figures 8 to 10 are set to be displayed on the MET24 and HUD26, respectively.

[0111] In this embodiment, icons D3 and D4 shown in Figures 6(A) and (B) are displayed with greater emphasis than icons D1 and D2 shown in Figures 5(A) and (B). This indicates that at least one of the distance and time until the vehicle 12 switches from autonomous driving to manual driving is below a predetermined value (threshold), indicating a high level of urgency. This makes it possible to promptly have the occupants perform hands-on training.

[0112] Thus, when at least one of the distance and time required for vehicle 12 to switch from autonomous driving to manual driving falls below a predetermined value (threshold), the need for hands-on assistance increases compared to when at least one of the distance and time is longer than a preset threshold.

[0113] Therefore, in this embodiment, when at least one of the distance and time from automatic driving to manual driving becomes shorter than a preset threshold, icons D3 and D4 (5th The guidance images are displayed on the MET24 and HUD26, respectively, with greater emphasis than icons D1 and D2 (sixth guidance image) when at least one of the distance and time is longer than a preset threshold. In other words, the present invention makes icons D1 and D2 more conspicuous than icons D3 and D4, thereby further prompting attention from the occupants.

[0114] Here, we have explained the relationship between the distance and time until vehicle 12 switches from autonomous to manual driving and the icon, but the relationship between the distance and time until an event occurs for vehicle 12 and the icon is approximately the same.

[0115] In this case, when vehicle 12 switches from autonomous driving to manual driving, it cannot be switched to manual driving unless the occupant takes hands-on control, so in this case, vehicle 12 will be forced to stop. On the other hand, when vehicle 12 is in autonomous driving mode, if the occupant is required to continue taking hands-on control, vehicle 12 will not be forced to stop if the occupant does not take hands-on control.

[0116] Therefore, in this embodiment, the need for hands-on request is greater when requesting the occupant to maintain hands-on control before switching the vehicle 12 from automated driving to manual driving than when requesting the occupant to continue hands-on control while automated driving is in progress.

[0117] Therefore, in this embodiment, icons D1 to D4 (see Figures 5(A), (B), 6(A), (B)) used when requesting the occupant to take hands-on control before switching the vehicle 12 from autonomous driving to manual driving are displayed on the MET24 and HUD26 with greater emphasis than icon D8 (see Figure 11) used when requesting the occupant to continue taking hands-on control while autonomous driving is in progress.

[0118] As a result, in this embodiment, icons D1 to D4 are made more prominent than icon D8. Conversely, in this embodiment, icon D8 is less prominent than icons D1 to D4, so if the occupant is asked to continue hands-on operation while autonomous driving is in progress, the inconvenience is reduced.

[0119] Furthermore, in this embodiment, when the display control unit 62 requests the occupant to take hands-on control before an event occurs in the vehicle 12 while the vehicle 12 is continuing to operate autonomously, the need for the hands-on request is higher in the former case than in the latter case.

[0120] Therefore, in this embodiment, icons D5, D6 (see Figure 8), and D7 (see Figure 10) that request the occupant to take hands-on control before an event occurs in a vehicle that is continuing to operate autonomously are displayed on MET24 and HUD26 with more emphasis (making them more prominent) than icon D8 (see Figure 11) that requests the occupant to continue taking hands-on control while autonomous driving is continuing.

[0121] In other words, in this embodiment, icons D5 to D7 are made more prominent than icon D8. Conversely, in this embodiment, icon D8 is less prominent than icons D5 to D7, so when it is necessary to ask the occupant to continue hands-on driving while autonomous driving is in progress, the inconvenience is reduced.

[0122] Incidentally, as mentioned above, when vehicle 12 switches from autonomous driving to manual driving, it cannot be switched to manual driving unless the occupant takes hands-on control, in which case vehicle 12 will be forced to stop. On the other hand, before an event occurs while autonomous driving is in progress, the occupant is requested to take hands-on control, but in this case, the possibility of vehicle 12 being forced to stop due to failure to take hands-on control is low.

[0123] In other words, the need for hands-on assistance is greater when requesting hands-on assistance from the occupants before switching from autonomous driving to manual driving of vehicle 12 compared to requesting hands-on assistance from the occupants before an event occurs while vehicle 12 is still operating autonomously.

[0124] Therefore, in this embodiment, icons D1 to D4, which are used when requesting the occupant to take hands-on control before switching the vehicle 12 from autonomous driving to manual driving, are displayed more prominently on the MET24 and HUD26 than icons D5 and D7, which are used when requesting the occupant to take hands-on control before an event occurs in the vehicle 12 while autonomous driving is continuing. In this embodiment, icons D1 to D4 are made more noticeable than icons D5 and D7.

[0125] In other words, in this embodiment, by changing the icon according to the degree of need for hands-on instruction, the icon is made more prominent in situations where there is a high need for hands-on instruction, while the inconvenience of the icon is reduced in situations where there is a low need for hands-on instruction.

[0126] Although the vehicle display control device according to the embodiment has been described above, it goes without saying that the invention can be implemented in various forms without departing from the spirit of the present invention. For example, in the above embodiment, the MET24 is provided in front of the driver's seat on the instrument panel 14, and the HUD26 is the projection surface projected by the head-up display device 44, but the invention is not limited to this. That is, the display unit may be a center display provided in the center of the instrument panel 14 in the vehicle width direction.

[0127] Furthermore, the display processing that the CPU 30 reads and executes in the above embodiment may be executed by various processors other than the CPU 30. Examples of such processors include PLDs (Programmable Logic Devices) such as FPGAs (Field-Programmable Gate Arrays) whose circuit configuration can be changed after manufacturing, and dedicated electrical circuits that are processors with circuit configurations specifically designed to execute specific processing, such as ASICs (Application Specific Integrated Circuits). The display processing may be executed by one of these various processors, or by a combination of two or more processors of the same or different types (for example, multiple FPGAs, and a combination of a CPU and an FPGA). More specifically, the hardware structure of these various processors is an electrical circuit that combines circuit elements such as semiconductor elements.

[0128] Furthermore, although the above embodiment uses a configuration in which various data is stored in the storage 36, the system is not limited to this. For example, recording media such as CD (Compact Disk), DVD (Digital Versatile Disk), and USB (Universal Serial Bus) memory may be used as storage units. In this case, vehicle display control programs and data will be stored in these recording media. [Explanation of Symbols]

[0129] 10. Vehicle display control device 12 vehicles 13 Inside the vehicle 24 MET (Meter Display, Display Unit) 26. HUD (Head-Up Display, Display Unit) 48 The gripping sensor 48. Gripping Sensor 50 Communications Department 54 Automatic Driving Control Unit 56 Display instruction section 58 Display instruction section 60 Grip determination section 62 Display Control Unit D1 Icon (Guidance Image) D2 Icon (Guidance Image) D3 Icon (Guidance Image) D4 Icon (Guidance Image) D5 Icon (Guidance Image) D6 Icon (Guidance Image) D7 Icon (Guidance Image) D8 Icon (Guidance Image)

Claims

1. The system includes a display control unit that displays a guidance image on a display unit located inside the vehicle cabin, prompting the occupant to grasp the steering wheel when it is necessary for the occupant to grasp the steering wheel. The display control unit is a vehicle display control device that, when the automatic driving control unit switches from automatic driving to manual driving, displays a second guidance image without displaying a first guidance image if the occupant is holding the steering wheel, and displays the first guidance image without displaying the second guidance image if the occupant is not holding the steering wheel.

2. The system includes a display control unit that displays a guidance image on a display unit located inside the vehicle cabin, prompting the occupant to grasp the steering wheel when it is necessary for the occupant to grasp the steering wheel. The display control unit, while the vehicle is in continuous autonomous driving, displays the guidance image before an event occurs in the vehicle, and if the occupant is holding the steering wheel, it displays the fourth guidance image without displaying the third guidance image, and if the occupant is not holding the steering wheel, it displays the third guidance image without displaying the fourth guidance image.

3. The vehicle display control device according to claim 1 or 2, wherein the display control unit causes the guidance image to be displayed on the display unit with greater emphasis when the occupant is not gripping the steering wheel compared to when the occupant is gripping the steering wheel.

4. The vehicle display control device according to claim 1, wherein the display control unit causes the occupant not to be holding the steering wheel before switching from automatic driving to manual driving, to display the guidance image on the display unit with greater emphasis compared to the case where the occupant was not holding the steering wheel before the occurrence of a vehicle event.

5. The display control unit calculates at least one of the distance and time from automatic driving to manual driving, and when at least one of the distance and time becomes shorter than a preset threshold, it displays the guidance image on the display unit with greater emphasis than when at least one of the distance and time is longer than the threshold, according to any one of claims 1, 3, or 4.

6. The vehicle display control device according to claim 2, 3, and 5, wherein the display control unit calculates at least one of the distance and time until an event occurs in the vehicle, and when at least one of the distance and time becomes shorter than a preset threshold, the guidance image is displayed on the display unit with greater emphasis than when at least one of the distance and time is longer than the threshold.

7. A vehicle display control device according to any one of claims 1 to 6, wherein, when the occupant is not holding the steering wheel, the size of the guidance image is increased, the brightness of the guidance image is increased, or the guidance image is displayed in a more prominent position to emphasize the guidance image compared to when the occupant is holding the steering wheel.

8. The vehicle display control device according to claim 1 or 2, wherein the display control unit determines whether or not the occupant is holding the steering wheel before displaying the guidance image.

9. A vehicle display control device according to claim 1, A display unit is provided inside the vehicle cabin and displays guidance images that prompt the occupant to grip the steering wheel, A vehicle display system having the following features.

10. A vehicle display control device according to claim 2, A display unit is provided inside the vehicle cabin and displays guidance images that prompt the occupant to grip the steering wheel, A vehicle display system having the following features.

11. A vehicle display control method that causes a computer to perform a process including displaying a second guidance image without displaying a first guidance image if the occupant is holding the steering wheel before switching from automatic driving to manual driving by the automatic driving control unit, and displaying the first guidance image without displaying the second guidance image if the occupant is not holding the steering wheel.

12. A vehicle display control method that, while the vehicle is in continuous autonomous driving, causes a computer to perform a process that includes displaying a fourth guidance image without displaying a third guidance image if the occupant is holding the steering wheel before an event occurs in the vehicle, and displaying the third guidance image without displaying the fourth guidance image if the occupant is not holding the steering wheel.

13. On the computer, A vehicle display control program for causing the automatic driving control unit to perform a process that includes displaying a second guidance image without displaying a first guidance image if the occupant is holding the steering wheel before switching from automatic driving to manual driving, and displaying the first guidance image without displaying the second guidance image if the occupant is not holding the steering wheel.

14. On the computer, A vehicle display control program for causing a vehicle to perform a process that includes displaying a fourth guidance image without displaying a third guidance image if the occupant is holding the steering wheel before an event occurs in the vehicle while the vehicle is in autonomous driving mode, and displaying the third guidance image without displaying the fourth guidance image if the occupant is not holding the steering wheel.

Images