Vehicle display control device, vehicle display control method and program

The vehicle display control device addresses the risk of driver intervention during autonomous driving by detecting and responding with visual notifications, ensuring safe operation and maintaining driving assistance functions.

JP7740314B2Active Publication Date: 2025-09-17TOYOTA JIDOSHA KK
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
JP2023184195
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2023-10-26
Publication Date
2025-09-17
Estimated Expiration
2040-08-31

AI Technical Summary

Technical Problem

During automatic driving, if a driver unconsciously intervenes in driving operations, there is a risk that part of the driving operations may be inadvertently transferred to the driver, posing a safety concern.

Method used

A vehicle display control device that detects intervention in driving operations during autonomous driving, stops relevant driving assistance functions, and displays warning images or changes background information on the display unit to notify the occupant of the intervention.

Benefits of technology

The device effectively notifies occupants of driving operation interventions, preventing unintended takeover of driving tasks and maintaining safety during autonomous driving.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007740314000001
    Figure 0007740314000001
  • Figure 0007740314000002
    Figure 0007740314000002
  • Figure 0007740314000003
    Figure 0007740314000003
Patent Text Reader

Abstract

To provide a vehicular display control device capable of informing an occupant of intervention in driving operation during automated driving.SOLUTION: In a vehicle configured such that, when a driving mode of the vehicle is an automated driving mode and when intervention by an occupant in driving operation is detected, a driving support function related to an operation device with its operation detected is stopped, and the driving operation in which the intervention is performed is overridden, a vehicular display control device 10 includes a display control section 54 which displays vehicle peripheral information on a display section provided inside a cabin at least when the driving mode is the automated driving mode. The display control section 54 displays, on the display section, the peripheral information with its background information changed when the driving mode is the automated driving mode and when the intervention by the occupant in the driving operation is detected.SELECTED DRAWING: Figure 3
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present invention relates to a vehicle display control device, a vehicle display control method, and a program. [Background technology]

[0002] Patent Document 1 discloses a display device that displays an image in a display area in front of the driver's seat, informing the driver of an upcoming change in the vehicle's driving mode, in a vehicle that can be driven in a plurality of driving modes. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2019-119262 Summary of the Invention [Problem to be solved by the invention]

[0004] However, if a driver performs driving operations during automatic driving, a configuration may be considered in which the driver's driving operations are prioritized. In such a configuration, if the driver unconsciously intervenes in driving operations (overrides) during automatic driving, there is a risk that part of the driving operations may be inadvertently transferred to the driver.

[0005] An object of the present invention is to provide a vehicle display control device, a vehicle display control method, and a program that can notify occupants of driving operation intervention during autonomous driving. [Means for solving the problem]

[0006] The vehicle display control device according to claim 1 is a vehicle that, when an intervention in a driving operation by an occupant is detected while the driving mode of the vehicle is an autonomous driving mode, stops a driving assistance function related to the operating device whose operation is detected and overrides the intervening driving operation, and is configured to display information about the surroundings of the vehicle on a display unit provided in a vehicle cabin at least when the driving mode is an autonomous driving mode.a warning display unit that, when an intervention in a driving operation by an occupant is detected, displays on the display unit a warning image corresponding to the driving operation in which the intervention is detected; and when the driving mode is the automatic driving mode and an intervention of a driving operation by a passenger is detected, the display control unit ,before The background information of the peripheral information is changed and displayed on the display unit. The warning display unit does not display the warning image when the driving mode is the automatic driving mode and the intervention of the driving operation by the occupant is not detected. .

[0007] In the vehicle display control device according to claim 1, when the driving mode is in the autonomous driving mode and an occupant's intervention in driving is detected, the display control unit changes the background information of the vehicle's surrounding information displayed on the display unit inside the vehicle cabin. As a result, if an occupant unconsciously performs a driving operation while driving in the autonomous driving mode, the background of the display unit changes in relation to the intervention, thereby visually notifying the occupant of the intervention in driving. Furthermore, even if a driving assistance function related to the operating device whose operation was detected is stopped, other driving assistance functions can continue to operate.

[0008] A vehicle display control method according to claim 2 includes a vehicle that, when an intervention of a driving operation by an occupant is detected while the driving mode of the vehicle is an autonomous driving mode, stops a driving assistance function related to an operating device whose operation is detected and overrides the intervening driving operation, and displays surrounding information of the vehicle on a display unit provided in a vehicle cabin at least while the driving mode is an autonomous driving mode; When an intervention in a driving operation by a passenger is detected, a warning image corresponding to the detected intervention in the driving operation is displayed on the display unit; When the driving mode is the automatic driving mode and the driver's intervention in the driving operation is detected, ,before The background information of the peripheral information is changed and displayed on the display unit. When the driving mode is the automatic driving mode, the warning image is not displayed if the driver's intervention in the driving operation is not detected. .

[0009] A program according to claim 3 is a vehicle that, when an intervention in a driving operation by an occupant is detected while the driving mode of the vehicle is an autonomous driving mode, stops a driving assistance function related to an operating device whose operation is detected and overrides the intervening driving operation, and displays surrounding information of the vehicle on a display unit provided in a vehicle cabin at least while the driving mode is an autonomous driving mode; When an intervention in a driving operation by a passenger is detected, a warning image corresponding to the detected intervention in the driving operation is displayed on the display unit; When the driving mode is the automatic driving mode and the driver's intervention in the driving operation is detected, ,beforeThe background information of the peripheral information is changed and displayed on the display unit. When the driving mode is the automatic driving mode, the warning image is not displayed if the driver's intervention in the driving operation is not detected. , and have the computer execute the processing. [Effects of the Invention]

[0010] As described above, the vehicle display control device, vehicle display control method, and program according to the present invention can notify the occupant of the intervention of driving operations during autonomous driving. [Brief explanation of the drawings]

[0011] [Figure 1] 1 is a schematic diagram illustrating a state in which a front portion of a passenger compartment of a vehicle according to an embodiment is viewed from the rear side of the vehicle. [Figure 2] 1 is a block diagram showing a hardware configuration of a vehicle display control device according to an embodiment; [Figure 3] 1 is a block diagram showing a functional configuration of a vehicle display control device according to an embodiment; [Figure 4] FIG. 10 is a diagram showing an example of the display screen of the second display unit during autonomous driving, in which no steering operation or accelerator operation is performed. [Figure 5] FIG. 10 is a diagram showing an example of the display screen of the second display unit during autonomous driving, showing a state in which accelerator operation is being performed. [Figure 6] FIG. 10 is a diagram showing an example of the display screen of the second display unit during autonomous driving, in which a steering operation is being performed. [Figure 7] FIG. 10 is a diagram showing an example of a display screen during autonomous driving in a modified example, in which accelerator operation is being performed. [Figure 8] 10 is a flowchart illustrating an example of the flow of a display process according to an embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0012] A vehicle 12 to which a vehicular display control device 10 according to an embodiment is applied will be described with reference to the drawings. Note that the vehicle 12 according to the present embodiment is configured to be switchable between automatic driving and manual driving, as an example.

[0013] 1, an instrument panel 14 is provided in the front portion of the cabin of a vehicle 12. The instrument panel 14 extends in the vehicle width direction, and a steering wheel 16 is provided on the right side of the instrument panel 14. That is, in this embodiment, as an example, the vehicle is a right-hand drive vehicle in which the steering wheel 16 is provided on the right side, and the driver's seat is located on the right side of the vehicle.

[0014] A windshield glass 18 is provided at the front end of the instrument panel 14. The windshield glass 18 extends in the vertical and lateral directions of the vehicle, and separates the interior of the vehicle from the exterior of the vehicle.

[0015] The right end of the windshield glass 18 is fixed to a front pillar 20 on the right side of the vehicle. The front pillar 20 extends in the vertical direction of the vehicle, and the windshield glass 18 is fixed to the inner end of the front pillar 20 in the vehicle width direction. In addition, the front ends of front side windows 22 are fixed to the outer end of the front pillar 20 in the vehicle width direction. The left end of the windshield glass 18 is fixed to a front pillar on the left side of the vehicle (not shown).

[0016] Here, a first display unit 24 is provided on the windshield glass 18. The first display unit 24 is configured as a projection surface onto which an image is projected by a head-up display device 23 shown in Fig. 2. Specifically, the head-up display device 23 is provided further forward than the instrument panel 14 of the vehicle, and an image is projected from the head-up display device 23 onto the first display unit 24 of the windshield glass 18.

[0017] A second display unit 26 is provided below the first display unit 24. The second display unit 26 is a display unit displayed on a meter 25, which is located in front of the driver's seat on the instrument panel 14. The first display unit 24 and the second display unit 26 are provided in positions visible to the driver and correspond to the "display unit" of the present invention. The vehicular display control device 10, the first display unit 24, and the second display unit 26 form a "vehicular display system" of the present invention.

[0018] (Hardware configuration of the vehicle display control device 10) As shown in FIG. 2, the vehicle display control device 10 of this embodiment includes an ECU (Electronic Control Unit) .

[0019] The ECU 28 includes a CPU (Central Processing Unit: processor) 30, a ROM (Read Only Memory) 32, a RAM (Random Access Memory) 34, a storage 36, and an input / output interface 38. Each component is connected to each other via an internal bus 39 so as to be able to communicate with each other.

[0020] The CPU 30 is a central processing unit that executes various programs and controls each part. That is, the CPU 30 reads programs from the ROM 32 or storage 36 and executes the programs using the RAM 34 as a work area. The CPU 30 also controls the above-mentioned components and performs various arithmetic processing in accordance with the programs recorded in the ROM 32 or storage 36.

[0021] The ROM 32 stores various programs and various data. The RAM 34 temporarily stores programs or data as a working area. The storage 36 is configured by an HDD (Hard Disk Drive) or an SSD (Solid State Drive), and is a non-temporary recording medium that stores various programs including an operating system and various data. In this embodiment, the ROM 32 or the storage 36 stores a display program for performing display processing, etc. Furthermore, various input / output devices are connected to the input / output interface 38.

[0022] Here, the ECU 28 is electrically connected to the autonomous driving ECU 40. Like the ECU 28, the autonomous driving ECU 40 is configured to include a CPU, a ROM, a RAM, a storage, an input / output interface, and the like, all of which are not shown.

[0023] The autonomous driving ECU 40 is connected to a group of sensors 42 that detects the current situation of the vehicle and a group of actuators 44 that control the traveling of the vehicle. The group of sensors 42 includes a plurality of sensors selected from various types of sensors, such as a camera, radar, LIDAR (Light Detection and Ranging or Laser Imaging Detection and Ranging), and a GPS (global positioning system) sensor. The camera captures images of the surroundings of the vehicle. The radar uses radio waves to detect the distance and direction of objects around the vehicle. The LIDAR uses laser light to detect the distance and direction of objects around the vehicle. The GPS sensor detects the current position of the vehicle. In addition to these, the group of sensors 42 is configured to include sensors that detect the state of the occupant. For example, the group of sensors 42 may be configured to include biological sensors that detect the occupant's heart rate, alertness, etc.

[0024] The actuator group 44 includes an acceleration / deceleration actuator that adjusts the acceleration / deceleration of the vehicle, and a steering actuator that drives the vehicle's steering device. The autonomous driving ECU 40 controls the operation of the actuator group 44 in accordance with the current situation of the vehicle detected by the sensor group 42, thereby performing autonomous driving of the vehicle. Note that a planned route indicating the route along which the vehicle is planned to travel is stored in a memory unit of the autonomous driving ECU 40, and the autonomous driving ECU 40 causes the vehicle to travel along the planned route stored in the memory unit.

[0025] An accelerator position sensor 46 and a steering sensor 48 are connected to the ECU 28. The accelerator position sensor 46 is a sensor that detects the position of an accelerator pedal (not shown) that is provided below the driver's seat. The steering sensor 48 is a sensor that detects the load applied to the steering wheel 16 by the occupant. That is, the steering sensor 48 of this embodiment is configured not to detect the load when the steering wheel 16 is operated by the autonomous driving ECU 40 during autonomous driving, but to detect the load when the occupant is operating the steering wheel 16.

[0026] (Functional configuration of the vehicle display control device 10) The vehicular display control device 10 uses the above hardware resources to realize various functions. The functional configuration realized by the vehicular display control device 10 will be described with reference to FIG.

[0027] 3, the vehicle display control device 10 includes, as functional components, a driving mode acquisition unit 52, a peripheral information display unit 54, an operation intervention detection unit 56, a display change unit 58, and a warning display unit 60. Each functional component is realized by the CPU 30 of the ECU 28 reading and executing a program. The display control unit of the present invention is a function that includes the peripheral information display unit 54 and the display change unit 58.

[0028] The driving mode acquisition unit 52 acquires whether the driving mode of the vehicle 12 is a manual driving mode or an automatic driving mode. Here, the manual driving mode in this embodiment refers to a driving mode in which the vehicle 12 is driven through driving operations by the occupant. Furthermore, the automatic driving mode in this embodiment refers to a driving mode in which the vehicle 12 is driven without the occupant operating the steering wheel 16 or the accelerator. The driving mode acquisition unit 52 may acquire information related to the driving mode based on a signal from the automatic driving ECU 40, for example.

[0029] The surrounding information display unit 54 constituting the display control unit displays surrounding information of the vehicle 12 on the first display unit 24 and the second display unit 26 provided in the vehicle cabin when the driving mode acquired by the driving mode acquisition unit 52 is at least the autonomous driving mode. Specifically, the surrounding information display unit 54 acquires signals from the sensor group 42, and displays surrounding information of the vehicle 12 based on the acquired signals on the first display unit 24 and the second display unit 26.

[0030] FIG. 4 shows a portion of the display screen of the second display unit 26 in the autonomous driving mode. As shown in FIG. 4, in the autonomous driving mode, a host vehicle image M1 simulating the vehicle 12 is displayed at the bottom of the second display unit 26. Also, a leading vehicle image M2 simulating a leading vehicle traveling ahead of the vehicle 12 is displayed. Also, a peripheral vehicle image M3 simulating a peripheral vehicle traveling in a lane adjacent to the lane in which the vehicle 12 is traveling is displayed. Here, the leading vehicle image M2 and the peripheral vehicle image M3 are displayed on the second display unit 26 by the function of the peripheral information display unit 54. Also, if the leading vehicle and the peripheral vehicles are not traveling within a predetermined range relative to the vehicle 12, the leading vehicle image M2 and the peripheral vehicle image M3 are not displayed on the second display unit 26.

[0031] An image M4 indicating the current speed of the vehicle 12 is displayed at the top of the second display section 26, and an image M5 indicating the set speed is displayed below this image M4.

[0032] Furthermore, between the host vehicle image M1 and the preceding vehicle image M2, a trajectory image M6 indicating the planned driving route of the vehicle 12 and a speed mark M7 indicating the speed of the vehicle 12 are displayed. The trajectory image M6 is displayed in a roughly band-like shape, and when the vehicle 12 is traveling straight, it is displayed in a roughly linear shape in the up-down direction. Furthermore, although not shown, when the vehicle 12 turns right or left or along a curve, the trajectory image M6 is displayed in a curved state along the planned driving route of the vehicle 12. This trajectory image M6 is displayed on the second display unit 26 by the function of the surrounding information display unit 54.

[0033] The speed marks M7 are displayed at intervals superimposed on the trajectory image M6, and four speed marks M7 are displayed in FIG. 4. The speed marks M7 are displayed so that their intervals change depending on the speed of the vehicle 12. For example, if the speed of the vehicle 12 is slower than in the state of FIG. 4, the speed marks M7 are displayed so that their intervals become narrower. Conversely, if the speed of the vehicle 12 is faster than in the state of FIG. 4, the speed marks M7 are displayed so that their intervals become wider. The speed marks M7 are displayed on the second display unit 26 by the function of the surrounding information display unit 54.

[0034] The first display unit 24 displays an image similar to that of the second display unit 26. In this embodiment, the display area of ​​the first display unit 24 is smaller than that of the second display unit 26, and therefore the first display unit 24 is configured to display a portion of the image of the second display unit 26. For example, the first display unit 24 displays a leading vehicle image M2, a trajectory image M6, and a speed mark M7.

[0035] The operation intervention detection unit 56 shown in FIG. 3 detects an occupant's intervention in a driving operation when the driving mode acquired by the driving mode acquisition unit 52 is an automatic driving mode. That is, the operation intervention detection unit 56 functions only when the driving mode is an automatic driving mode, and does not function when the driving mode is a manual driving mode. Furthermore, in the automatic driving mode, the operation intervention detection unit 56 determines that an occupant has intervened in an accelerator operation when it detects that the accelerator pedal has moved from its initial position based on a signal from the accelerator position sensor 46. Furthermore, in the automatic driving mode, the operation intervention detection unit 56 determines that an occupant has intervened in a steering operation when it detects that the occupant has applied a load to the steering wheel 16 based on a signal from the steering sensor 48.

[0036] The display change unit 58, which constitutes the display control unit, changes the background color of the surrounding information of the vehicle 12 displayed on the first display unit 24 and the second display unit 26 when the operation intervention detection unit 56 detects intervention in driving operations by the occupant.

[0037] In the present embodiment, as an example, when the operation intervention detection unit 56 detects an intervention in a driving operation, the display change unit 58 changes the background color of the second display unit 26 from the state shown in Fig. 4 to the state shown in Fig. 5. Note that the background color is not particularly specified, and the display change unit 58 changes the background color to an extent that can alert the occupants.

[0038] For example, as shown in Fig. 4, in a normal state where no driving operation intervention is detected, the background color of the second display unit 26 is colorless. In contrast, as shown in Fig. 5, when a driving operation intervention is detected, the display change unit 58 tones down the background color of the second display unit 26 to gray. At this time, the host vehicle image M1 and the lane are not toned down, and only the colors of the surroundings are toned down.

[0039] Furthermore, the display change unit 58 displays the preceding vehicle in a toned-down color when the operation intervention detection unit 56 detects an accelerator operation. Furthermore, the display change unit 58 hides the speed mark M7 when the operation intervention detection unit 56 detects an accelerator operation.

[0040] Fig. 5 shows the display screen of the second display unit 26 when accelerator operation is being performed during autonomous driving. As shown in Fig. 5, the color of the preceding vehicle image M2 is toned down by the display change unit 58. By toning down the color of the preceding vehicle image M2 in this way, it is indicated that the driving assistance function that automatically adjusts the distance from the preceding vehicle is not enabled.

[0041] Additionally, the speed mark M7 that was superimposed on the trajectory image M6 of the planned travel route is hidden by the display change unit 58. This indicates that the speed of the vehicle 12 is not being controlled because the driver is depressing the accelerator pedal.

[0042] Furthermore, when accelerator operation is performed during autonomous driving, the display change unit 58 displays the set speed image M5 in a toned-down manner, thereby indicating that the set speed function is not enabled.

[0043] The display change unit 58 hides the trajectory image M6 when the operation intervention detection unit 56 detects an intervention in a steering operation. Fig. 6 shows the display screen of the second display unit 26 in a state in which an intervention in a steering operation is being performed during autonomous driving. As shown in Fig. 6, the trajectory image M6 is hidden by the display change unit 58. Furthermore, as the trajectory image M6 is hidden, the speed mark M7 is also hidden.

[0044] 6, the preceding vehicle image M2 is not toned down and is displayed in the same manner as in FIG. 4. That is, in FIG. 6, the driving assistance function for adjusting the distance to the preceding vehicle is activated because the accelerator pedal is not being operated. Also, the function for traveling along the planned route is disabled because the steering wheel 16 is being operated.

[0045] The warning display unit 60 shown in Figure 3 displays a warning indicating the intervention of a driving operation on the first display unit 24 and the second display unit 26 when the operation intervention detection unit 56 detects the intervention of a steering operation and the intervention of an accelerator operation.

[0046] 5 and 6, when at least one of a steering operation and an accelerator operation is being performed, a warning image M8 is displayed to the left of the image M4 that displays the speed of the vehicle 12. In this embodiment, the warning image M8 is, as an example, an image that shows a state in which the steering wheel is being gripped, but is not limited to this. For example, the warning image M8 may be displayed as a modified example shown in FIG. 7.

[0047] (Variation) FIG. 7 shows a modified example of the display screen of the second display unit 26 when an accelerator operation is being performed during autonomous driving. As shown in FIG. 7, the display change unit 58 displays a toned-down version of the preceding vehicle image M2 and the set speed image M5. The warning display unit 60 also displays a warning image M9 to the left of the image M4 that displays the speed of the vehicle 12. The warning image M9 is an image of the accelerator pedal being depressed. In this way, the warning display unit 60 may display different images when the operation intervention detection unit 56 detects a steering operation and when the operation intervention detection unit 56 detects an accelerator operation.

[0048] (action) Next, the operation of this embodiment will be described.

[0049] (Example of display processing) 8 is a flowchart showing an example of the flow of display processing by the vehicle display control device 10. This display processing is executed by the CPU 30 of the ECU 28 reading a program from the ROM 32 or the storage 36, expanding it in the RAM 34, and executing it.

[0050] 8, the CPU 30 acquires the driving mode in step S102. Specifically, the CPU 30 acquires, through the function of the driving mode acquisition unit 52, whether the driving mode of the vehicle 12 is the manual driving mode or the automatic driving mode.

[0051] In step S104, the CPU 30 determines whether the driving mode of the vehicle 12 is the automatic driving mode. If the driving mode of the vehicle 12 acquired by the driving mode acquisition unit 52 is the automatic driving mode, the CPU 30 makes a positive determination in step S104 and proceeds to processing in step S106. On the other hand, if the driving mode of the vehicle 12 acquired by the driving mode acquisition unit 52 is the manual driving mode, the CPU 30 ends the display processing.

[0052] The CPU 30 displays the surrounding information in step S106. Specifically, the CPU 30 acquires signals from the sensor group 42 using the function of the surrounding information display unit 54, and displays the surrounding information of the vehicle 12 based on the acquired signals on the first display unit 24 and the second display unit 26. For example, as shown in FIG. 4 , the CPU 30 displays an image of the subject vehicle M1, an image of a leading vehicle M2, an image of a surrounding vehicle M3, a trajectory image M6, a speed mark M7, and the like on the second display unit 26 in step S106. The CPU 30 also displays the same images as those on the second display unit 26 on the first display unit 24.

[0053] In step S108, the CPU 30 determines whether or not an accelerator operation has been performed. Specifically, when the CPU 30 detects an accelerator operation based on a signal from the accelerator position sensor 46 using the function of the operation operation detection unit 56, the CPU 30 makes an affirmative determination in step S108 and proceeds to processing in step S110.

[0054] On the other hand, if the operation intervention detection unit 56 has not detected an accelerator operation intervention in step S108, the CPU 30 makes a negative determination in step S108 and proceeds to the process of step S112.

[0055] In step S110, the CPU 30 performs a display when an accelerator operation is intervened. Specifically, the CPU 30 changes the background color of the second display unit 26 as shown in FIG. 5 using the function of the display change unit 58. The CPU 30 also uses the function of the display change unit 58 to tone down the preceding vehicle image M2 and the set speed image M5 and hide the speed mark M7. Furthermore, in step S110, the CPU 30 displays a warning image M8 using the function of the warning display unit 60. Although not shown, a similar display change is also performed on the first display unit 24.

[0056] In step S112, the CPU 30 determines whether or not a steering operation has been performed. Specifically, when the operation intervention detection unit 56 detects that a steering operation has been performed based on a signal from the steering sensor 48, the CPU 30 makes an affirmative determination in step S112 and proceeds to processing in step S114.

[0057] On the other hand, if the operation intervention detection unit 56 has not detected an intervention of a steering operation in step S112, the CPU 30 makes a negative determination in step S112 and ends the display process.

[0058] In step S114, the CPU 30 performs a display when a steering operation is intervened. Specifically, the CPU 30 changes the background color of the second display unit 26 as shown in FIG. 6 using the function of the display change unit 58. The CPU 30 also hides the trajectory image M6 indicating the planned driving route and the speed mark M7 using the function of the display change unit 58. Furthermore, in step S114, the CPU 30 displays a warning image M8 using the function of the warning display unit 60. Although not shown, the display is also changed in the first display unit 24 in a similar manner. Then, the CPU 30 ends the display process.

[0059] The state shown in FIG. 6 is the display when the determination in step S108 is negative and the determination in step S112 is positive. That is, FIG. 6 shows an example of a display when there is no accelerator operation but steering operation. On the other hand, when the determination in step S108 is positive and the determination in step S112 is positive, i.e., when both accelerator operation and steering operation are performed, the display in FIG. 5 and the display in FIG. 6 are combined. In this case, the CPU 30 changes the background color of the second display unit 26 as shown in FIG. 5 or 6 using the function of the display change unit 58. Furthermore, the CPU 30 uses the function of the display change unit 58 to tone down the preceding vehicle image M2 and the set speed image M5, and hides the trajectory image M6 and the speed mark M7 indicating the planned driving route. Furthermore, the CPU 30 uses the function of the warning display unit 60 to display a warning image M8.

[0060] As described above, in the vehicle display control device 10 according to this embodiment, when the driving mode acquired by the driving mode acquisition unit is at least the autonomous driving mode, the peripheral information display unit 54 displays peripheral information about the vehicle 12 on the first display unit 24 and the second display unit 26. As a result, in the autonomous driving mode, the occupant can check peripheral information about the vehicle 12 by looking at the first display unit 24 and the second display unit 26.

[0061] Furthermore, in this embodiment, when the operation intervention detection unit 56 detects an intervention in a driving operation, the display change unit 58 changes the background information of the peripheral information of the vehicle 12 displayed on the first display unit 24 and the second display unit 26. As a result, if the occupant unconsciously performs a driving operation while traveling in autonomous driving mode, the background of the first display unit 24 and the second display unit 26 changes, thereby visually notifying the occupant of the intervention in a driving operation. For example, if the occupant unconsciously presses the accelerator pedal with their foot that was previously on the accelerator pedal, the occupant can be alerted that an intervention in accelerator operation is occurring.

[0062] Here, in this embodiment, visually alerting occupants can prevent other occupants from feeling uncomfortable, compared to a configuration in which frequent audio notifications are given.

[0063] Furthermore, in this embodiment, the surrounding information display unit 54 displays the planned driving route on the first display unit 24 and the second display unit 26, so that the occupant can grasp the planned driving route at a glance even in the autonomous driving mode. Furthermore, when a steering operation is performed, the display change unit 58 hides the image M6 of the planned driving route, so that the occupant can recognize that the steering wheel 16 is being operated.

[0064] Furthermore, in this embodiment, the surrounding information display unit 54 displays the preceding vehicle image M2 on the first display unit 24 and the second display unit 26, so that the occupant can recognize the presence of the preceding vehicle at a glance even in the autonomous driving mode. Furthermore, when an accelerator operation is performed, the display change unit 58 displays the preceding vehicle image M2 in a toned-down color, so that the occupant can recognize that the accelerator operation is being performed.

[0065] In this embodiment, the surrounding information display unit 54 displays the speed mark M7 on the first display unit 24 and the second display unit 26, so that the occupant can check the speed of the vehicle 12 simply by checking the interval between the speed marks M7, even in the autonomous driving mode. Furthermore, when an accelerator operation is performed, the display change unit 58 hides the speed mark M7, so that the occupant can recognize that an accelerator operation is being performed.

[0066] Furthermore, in this embodiment, the warning display unit 60 displays the warning image M8 on the first display unit 24 and the second display unit 26, thereby effectively notifying the occupant that a driving operation will be intervened. In this case, as in the modified example shown in Fig. 7, by changing the warning image depending on whether an accelerator operation is intervened or a steering operation is intervened, the occupant can easily understand the type of driving operation.

[0067] The above describes the vehicle display control device 10 according to the embodiment. However, it goes without saying that the present invention can be embodied in various forms without departing from the spirit and scope of the present invention. For example, in the above embodiment, the display change unit 58 is configured to change the background information of the first display unit 24 and the second display unit 26 when an accelerator operation and a steering operation are performed. However, this is not limited to this. The background information of the first display unit 24 and the second display unit 26 may also be changed when other driving operations are performed. For example, the display change unit 58 may change the background information of the first display unit 24 and the second display unit 26 when a turn signal is operated. Furthermore, the display change unit 58 may change the background information of the first display unit 24 and the second display unit 26 when the brake pedal is depressed.

[0068] In the above embodiment, the intervention of accelerator operation is detected based on the signal from the accelerator position sensor 46, but this is not limiting. For example, in a vehicle in which acceleration and deceleration are performed by operating an operating unit such as a button or lever instead of an accelerator pedal, the intervention of accelerator operation may be detected based on a signal from this operating unit.

[0069] Furthermore, in the above embodiment, the intervention of a steering operation is detected based on the signal from the steering sensor 48, but this is not limiting. For example, in a vehicle in which steering is performed by operating an operating unit such as a button or lever instead of the steering wheel 16, the intervention of a steering operation may be detected based on a signal from this operating unit.

[0070] Furthermore, in the above embodiment, the vehicle surroundings information is displayed on both the first display unit 24 and the second display unit 26. However, this is not limited to this. For example, the surroundings information display unit 54 may be configured to display the vehicle surroundings information only on the first display unit 24.

[0071] In the above embodiment, the display change unit 58 changes the background color of the entire second display unit 26, but this is not limiting. For example, even if the display change unit 58 is configured to change the background color of only a part of the second display unit 26, the same effect as in the above embodiment can be obtained as long as the driver's attention is alerted to the need to intervene in the driving operation.

[0072] Furthermore, in the above embodiment, the display change unit 58 is configured to change the background color of the first display unit 24 and the second display unit 26 when a driving operation is performed, but this is not limiting. For example, the display change unit 58 may change the background information by displaying a predetermined pattern on the background of the first display unit 24 and the second display unit 26 when a driving operation is performed. [Explanation of symbols]

[0073] 10. Vehicle display control device 12 vehicles 24 First display section 26 Second display section 54 Peripheral information display unit (display control unit) 58 Display change unit (display control unit)

Claims

1. In a vehicle in which, when an intervention in a driving operation by an occupant is detected while the driving mode of the vehicle is in an automated driving mode, a driving assistance function related to the operating device in which the operation is detected is stopped to override the intervening driving operation, a display control unit that displays surrounding information of the vehicle on a display unit provided in a vehicle cabin at least when the driving mode is an autonomous driving mode; a warning display unit that, when an intervention in a driving operation by an occupant is detected, displays on the display unit a warning image corresponding to the driving operation in which the intervention is detected; Equipped with the display control unit, when the driving mode is the autonomous driving mode and an intervention of a driving operation by an occupant is detected, changes background information of the surrounding information and displays it on the display unit; The warning display unit does not display the warning image when the driving mode is an automatic driving mode and an intervention of a driving operation by an occupant is not detected. Vehicle display control device.

2. In a vehicle in which, when an intervention in a driving operation by an occupant is detected while the driving mode of the vehicle is in an automated driving mode, a driving assistance function related to the operating device in which the operation is detected is stopped to override the intervening driving operation, displaying surrounding information of the vehicle on a display unit provided in a vehicle cabin at least when the driving mode is an autonomous driving mode; When an intervention in a driving operation by a passenger is detected, a warning image corresponding to the detected intervention in the driving operation is displayed on the display unit; When the driving mode is an automatic driving mode and an intervention of a driving operation by a passenger is detected, background information of the surrounding information is changed and displayed on the display unit; When the driving mode is an automatic driving mode, the warning image is not displayed when no intervention of a driving operation by an occupant is detected. A display control method for a vehicle.

3. In a vehicle in which, when an intervention in a driving operation by an occupant is detected while the driving mode of the vehicle is in an automated driving mode, a driving assistance function related to the operating device in which the operation is detected is stopped to override the intervening driving operation, displaying surrounding information of the vehicle on a display unit provided in a vehicle cabin at least when the driving mode is an autonomous driving mode; When an intervention in a driving operation by a passenger is detected, a warning image corresponding to the detected intervention in the driving operation is displayed on the display unit; When the driving mode is an automatic driving mode and an intervention of a driving operation by a passenger is detected, background information of the surrounding information is changed and displayed on the display unit; When the driving mode is an automatic driving mode, the warning image is not displayed when no intervention of a driving operation by an occupant is detected. A program that causes a computer to perform a process.

Citation Information

Patent Citations

  • Drive support method, drive support device using the same, automatic drive control device, vehicle, and program

    JP2017178267A

  • Alarm apparatus, alarm system, and portable terminal

    JP2018132533A

  • Head-up display device

    JP2019119262A

  • Vehicle information display control device, and method for displaying automatic driving information

    WO2017072953A1

  • Operation authority management device and operation authority management method

    WO2018025414A1