Vehicle display control device, vehicle display control method, and vehicle display control program

Abstract

The present invention provides a vehicle display control device, a vehicle display device, a display control method, and a display control program that reduce the inconvenience experienced by the occupant when switching between hands-on and hands-off modes, allow the occupant to recognize the hands-on and hands-off modes, and maintain a consistent display style between the hands-on and hands-off modes. [Solution] The vehicle display control device includes a display control unit that indicates the direction of the display design, including the atmosphere corresponding to the purpose of the vehicle's driving mode, when the vehicle is in hands-on mode, which requires gripping the steering wheel, and when it is in hands-off mode, which does not require gripping the steering wheel, and changes the display manner of the auxiliary image showing the trajectory of the preceding vehicle, without changing the overall display taste of the main image including the own vehicle, other vehicles, and lanes, and displays it on the display unit mounted on the vehicle.

Description

Technical Field

[0001] The present invention relates to a vehicle display control device, a vehicle display control method, and a vehicle display control program.

Background Art

[0002] Patent Document 1 discloses a meter graphic when the driving assistance degree is different. In the meter graphic described in Patent Document 1, the display mode is changed according to the contribution degree of the automatic driving function.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the technology described in Patent Document 1 above, since the layout and design of the entire meter are changed, the amount of change in the display screen is large, which may make the passengers feel bothered. In addition, the connection between each mode of the automatic driving function may become weak.

[0005] In consideration of the above facts, an object of the present invention is to obtain a vehicle display control device, a vehicle display control method, and a vehicle display control program that can suppress the passengers from feeling bothered when switching between the hands-on and hands-off modes, enable the passengers to recognize the hands-on mode and the hands-off mode, and maintain the connection of the display taste between the hands-on mode and the hands-off mode.

Means for Solving the Problems

[0006] The vehicle display control device according to claim 1 includes a display control unit that indicates the direction of the display design, including an atmosphere corresponding to the purpose of the vehicle's driving mode, in hands-on mode, which requires gripping the vehicle's steering wheel, and in hands-off mode, which does not require gripping the steering wheel, and changes the display mode of an auxiliary image showing the trajectory of a preceding vehicle, without changing the overall display taste of the main image, including the vehicle itself, other vehicles, and lanes, and displays it on a display unit mounted on the vehicle. In the present invention, "display taste" refers to the direction of the display design, including an atmosphere corresponding to the purpose, such as sport mode, eco mode, and drive mode.

[0007] In the vehicle display control device according to claim 1, the display control unit indicates the direction of the display design, including the atmosphere corresponding to the purpose of the vehicle's driving mode, for both hands-on mode and hands-off mode, and displays on the vehicle's display unit the display manner of the auxiliary image showing the trajectory of the preceding vehicle without changing the overall display taste of the main image, including the own vehicle, other vehicles, and lanes. As a result, since the overall display taste of the main image is the same for both hands-on mode and hands-off mode, the amount of change in the display screen for the entire main image can be suppressed. Therefore, it is possible to suppress the feeling of inconvenience experienced by the occupant when switching between hands-on and hands-off modes. Furthermore, since the overall display taste of the main image is the same for both hands-on mode and hands-off mode, the connection of the display taste between hands-on mode and hands-off mode can be maintained. In addition, since the display manner of the auxiliary image is changed for both hands-on mode and hands-off mode, the occupant can be made aware of the hands-on mode and hands-off mode.

[0008] Furthermore, in the vehicle display control device according to claim 1, since the main image is an image including the own vehicle, other vehicles, and lanes, the display style including the own vehicle, other vehicles, and lanes is not changed, so the occupants can visually confirm the positional relationship of their own vehicle, other vehicles, and lanes without being bothered by changes in the display style.

[0009] Furthermore, in the vehicle display control device according to claim 1, since the auxiliary image is an image showing the trajectory of a preceding vehicle, the occupant can recognize the switching between hands-on mode and hands-off mode by changing the display mode of the image showing the trajectory of a preceding vehicle.

[0010] The vehicle display control device according to claim 2, in the configuration described in claim 1, wherein the hands-on mode includes a manual driving mode and an automatic driving mode, and the display control unit further displays the display unit with a common display style for the entire main image in the manual driving mode and the automatic driving mode in the hands-on mode.

[0011] In the vehicle display control device according to claim 2 of the present invention, the display control unit displays the overall display style of the main image on the display unit mounted on the vehicle, with the same style in both manual driving mode and automatic driving mode, in hands-on mode. As a result, in hands-on mode, the overall display style of the main image is the same in both manual driving mode and automatic driving mode, so the amount of change in the display screen of the main image can be suppressed. Therefore, it is possible to suppress the inconvenience felt by the occupant when switching between manual driving and automatic driving modes. In addition, since the overall display style of the main image is the same in both manual driving mode and automatic driving mode, the connection of the display style between the manual driving mode and automatic driving mode can be maintained.

[0012] The vehicle display control device according to claim 3, in the configuration described in claim 1, wherein the hands-on mode includes a driver assistance mode and an automated driving mode.

[0013] In the vehicle display control device according to claim 3, the hands-on mode includes a driver assistance mode and an automated driving mode, so that the amount of change in the display manner of the main image and auxiliary images between the driver assistance mode and the automated driving mode can be suppressed. Therefore, in hands-on mode, it is possible to suppress the inconvenience felt by the occupant when switching between the driver assistance mode and the automated driving mode.

[0014] The vehicle display control device according to claim 4, in the configuration described in claim 3, wherein the driving assistance mode includes auto cruise control and lane tracing assist.

[0015] In the vehicle display control device according to claim 4 of the present invention, the driving assistance mode includes auto cruise control and lane tracing assist, so the amount of change in the display manner of the main image and auxiliary images can be suppressed when switching between auto cruise control and lane tracing assist and the autonomous driving mode. Therefore, it is possible to suppress the inconvenience felt by the occupant when switching between auto cruise control and lane tracing assist and the autonomous driving mode.

[0016] The vehicle display control method according to claim 5 indicates the direction of the display design, including the atmosphere corresponding to the purpose of the vehicle's driving mode, when the vehicle's steering wheel is gripped and when the steering wheel is not gripped, and without changing the overall display taste of the main image including the vehicle itself, other vehicles, and lanes, the display mode of the auxiliary image showing the trajectory of a preceding vehicle is changed and displayed on the display unit mounted on the vehicle.

[0017] In the vehicle display control method according to claim 5 of the present invention, the direction of the display design, including the atmosphere corresponding to the purpose of the vehicle's driving mode, is indicated for both hands-on mode and hands-off mode. Without changing the overall display taste of the main image, including the own vehicle, other vehicles, and lanes, the display manner of the auxiliary image showing the trajectory of the preceding vehicle is changed and displayed on the display unit mounted on the vehicle. As a result, since the overall display taste of the main image is common in both hands-on mode and hands-off mode, the amount of change in the display screen of the main image can be suppressed. Therefore, it is possible to suppress the feeling of inconvenience experienced by the occupant when switching between hands-on and hands-off modes. Furthermore, since the overall display taste of the main image is common in both hands-on mode and hands-off mode, the connection of the display taste between hands-on mode and hands-off mode can be maintained. In addition, since the display manner of the auxiliary image is changed in both hands-on mode and hands-off mode, the occupant can be made aware of the hands-on mode and hands-off mode.

[0018] Furthermore, in the vehicle display control method according to claim 5, since the main image is an image that includes the own vehicle, other vehicles, and lanes, the display style including the own vehicle, other vehicles, and lanes is not changed, so the occupants can visually perceive the relative positions of their own vehicle, other vehicles, and lanes without being bothered by changes in the display style.

[0019] Furthermore, in the vehicle display control method according to claim 5 of the present invention, since the auxiliary image is an image showing the trajectory of the preceding vehicle, the occupant can recognize the switching between hands-on mode and hands-off mode by changing the display mode of the image showing the trajectory of the preceding vehicle.

[0020] The vehicle display control program according to claim 6 of the present invention causes a computer to function as a display control unit that indicates the direction of the display design, including the atmosphere corresponding to the purpose of the vehicle's driving mode, when the vehicle's steering wheel is to be held and when the steering wheel is not to be held, and changes the display manner of an auxiliary image showing the trajectory of a preceding vehicle without changing the overall display taste of the main image including the own vehicle, other vehicles, and lanes, and displays it on a display unit mounted on the vehicle.

[0021] The vehicle display control program according to claim 6 of the present invention indicates the direction of the display design, including the atmosphere corresponding to the purpose of the vehicle's driving mode, for both hands-on mode and hands-off mode. Without changing the overall display taste of the main image, including the own vehicle, other vehicles, and lanes, the display manner of the auxiliary image showing the trajectory of the preceding vehicle is changed and displayed on the display unit mounted on the vehicle. As a result, since the overall display taste of the main image is common in both hands-on and hands-off modes, the amount of change in the display screen of the main image can be suppressed. Therefore, it is possible to suppress the feeling of inconvenience experienced by the occupant when switching between hands-on and hands-off modes. Furthermore, since the overall display taste of the main image is common in both hands-on and hands-off modes, the connection of the display taste between hands-on and hands-off modes can be maintained. In addition, since the display manner of the auxiliary image is changed in both hands-on and hands-off modes, the occupant can be made aware of the hands-on and hands-off modes.

[0022] Furthermore, in the vehicle display control program according to claim 6, since the main image is an image including the own vehicle, other vehicles, and lanes, the display style including the own vehicle, other vehicles, and lanes is not changed, so the occupants can visually perceive the relative positions of their own vehicle, other vehicles, and lanes without being bothered by changes in the display style.

[0023] In addition, in the vehicle display control program according to the present invention described in claim 6, since the auxiliary image is an image showing the trajectory line of the preceding vehicle, by changing the display mode of the image showing the trajectory line of the preceding vehicle, the occupant can recognize the mode switching between the hands-on mode and the hands-off mode.

Effect of the Invention

[0024] As described above, the vehicle display control device, the vehicle display control method, and the vehicle display control program according to the present invention suppress the occupant from feeling annoyance when switching between the hands-on and hands-off modes, enable the occupant to recognize the hands-on mode and the hands-off mode, and can maintain the connection of the display taste between the hands-on mode and the hands-off mode, and have excellent effects.

Brief Description of the Drawings

[0025] [Figure 1] It is a schematic view of the front part of the vehicle interior in a vehicle to which a vehicle display device according to an embodiment is applied, as viewed from the rear side of the vehicle. [Figure 2] It is a block diagram showing the hardware configuration of a vehicle according to an embodiment. [Figure 3] It is a block diagram showing the functional configuration of a display control ECU according to an embodiment. [Figure 4] It is a diagram for explaining the hands-on mode and the hands-off mode. [Figure 5] It is a diagram showing an example of display 1 in the display area of the first display unit in the hands-on mode in an embodiment. [Figure 6] It is a diagram showing an example of display 2 in the display area of the first display unit in the hands-off mode in an embodiment. [Figure 7] It is a diagram showing an example of a display taste different from display 1 in the display area of the first display unit in the hands-on mode in an embodiment. [Figure 8] It is a flowchart showing an example of the flow of display control processing in an embodiment. [Figure 9] This figure shows an example of the display in the display area of ​​the third display unit. [Modes for carrying out the invention]

[0026] A vehicle 10 to which a display control ECU (Electronic Control Unit) 30 and a driver assistance ECU 28, etc., as a vehicle display control device according to one embodiment of the present invention are applied will be described with reference to the drawings. In Figure 1, the arrow UP indicates the upper side in the vertical direction of the vehicle, and the arrow RH indicates the right side in the vehicle width direction. In the following description, the vertical direction and the left-right direction refer to the vertical direction of the vehicle and the left-right direction in the vehicle width direction, respectively.

[0027] As shown in Figure 1, an instrument panel 14 is provided in the front part of the passenger compartment 13 of the vehicle 10. The instrument panel 14 extends in the vehicle width direction, and a steering wheel 16 is provided on the right side of the instrument panel 14. In other words, in this embodiment, as an example, the steering wheel 16 is provided on the right side, making it a so-called right-hand drive vehicle, and the driver's seat is set on the right side of the vehicle. A windshield glass 18 is also provided at the front end of the instrument panel 14.

[0028] The windshield glass 18 extends upward from the front end of the instrument panel 14, separating the exterior of the vehicle 10 from the interior of the vehicle 13. The right-side end of the windshield glass 18 is fixed to the right-side front pillar 20. The front pillar 20 extends vertically, and the windshield glass 18 is fixed to the inner end of the front pillar 20 in the vehicle width direction. The front end of the front side glass 22 is fixed to the outer end of the front pillar 20 in the vehicle width direction. The left-side end of the windshield glass 18 is fixed to the left-side front pillar (not shown).

[0029] Here, the instrument panel 14 is provided with a first display unit 24, which has an image display area 24A. The first display unit 24 is composed of a meter display located on the right side of the vehicle of the instrument panel 14, in front of the driver's seat. The first display unit 24 is connected to various meter devices mounted on the vehicle 10 and is positioned within the driver's field of vision when the driver is looking forward.

[0030] The instrument panel 14 is provided with a second display unit 25, which has an image display area 25A. The second display unit 25 is composed of a center display located in the center of the instrument panel 14 in the vehicle width direction.

[0031] The windshield glass 18 is provided with a third display unit 26, which has an image display area 26A. The third display unit 26 is set on the vehicle's upper side of the first display unit 24, and the display area 26A is composed of a projection surface projected by a head-up display device 40 (see Figure 2). Specifically, the head-up display device 40 is provided on the vehicle's front side of the instrument panel 14, and the head-up display device 40 is configured to project an image onto the display area 26A of the third display unit 26 on the windshield glass 18. In other words, the third display unit 26 is a part of the windshield glass 18 that serves as the projection surface for the head-up display device 40.

[0032] (Hardware configuration of vehicle 10) Block diagram showing the hardware configuration of vehicle 10.

[0033] As shown in Figure 2, the vehicle 10 is equipped with a communication bus 10A in the passenger compartment 13, to which the information sensor group 27A, the driving sensor group 27B, the driver assistance ECU 28, and the display control ECU 30 are connected. In addition to the driver assistance ECU 28 and the display control ECU 30, various other ECUs may also be connected.

[0034] The information sensor group 27A, although not shown in the diagram, includes a camera, radar, or lidar (light). The system includes a detection and randomizing (or laser imaging) system, a GPS (global positioning system) device, an in-vehicle communication device, a navigation device, and the like. The camera captures images of the area around the vehicle 10. The camera in this embodiment includes at least a front camera that captures images in front of the vehicle 10 and a rear camera that captures images behind the vehicle 10. The number of cameras is not limited to this, and for example, it may further include a right side camera that captures images to the right of the vehicle 10 and a left side camera that captures images to the left of the vehicle 10.

[0035] The radar detects the distance and direction of objects around the vehicle 10 using radio waves. The lidar detects the distance and direction of objects around the vehicle 10 using laser light. In this embodiment, the radar and lidar are equipped with a signal processing unit (not shown) that has the function of processing the detection results of surrounding objects. Based on changes in the relative position and relative speed of individual objects included in the most recent multiple detection results, the signal processing unit excludes noise, roadside objects such as guardrails, etc. from the monitoring targets and tracks specific objects such as surrounding vehicles present around the vehicle 10 as surrounding targets.

[0036] The GPS device receives GPS signals from multiple GPS satellites to detect the current position of the vehicle 10. The in-vehicle communication device is a communication device that performs at least one of vehicle-to-vehicle communication with other vehicles and vehicle-to-infrastructure communication with roadside units. The navigation device includes a map information storage unit that stores map information, and performs processing to display the position of the vehicle 10 on a map and guide the vehicle to a destination based on the position information obtained from the GPS device and the map information stored in the map information storage unit.

[0037] The driving sensor group 27B, although not shown in the diagram, includes a steering angle sensor, a vehicle speed sensor, an acceleration sensor, a yaw rate sensor, an accelerator pedal sensor, and a brake pedal sensor, as multiple sensors for acquiring the driving state of the vehicle 10. The steering angle sensor is a device for detecting the steering angle of the vehicle 10, and is provided, for example, on the steering wheel 16 to detect the steering angle of the steering wheel 16. The vehicle speed sensor is a device for detecting the driving speed of the vehicle 10, and is provided, for example, on the wheels of the vehicle 10 or on a drive shaft that rotates integrally with the wheels to detect the rotational speed of the wheels.

[0038] An acceleration sensor is a device that detects the acceleration applied to the vehicle 10. For example, a 3-axis acceleration sensor can be used to detect acceleration applied in the vehicle's longitudinal direction as the X-axis, the vehicle's width direction as the Y-axis, and the vehicle's height direction as the Z-axis. A yaw rate sensor is a device that detects the yaw rate (rotational angular velocity) around the vertical axis of the vehicle 10's center of gravity. For example, a gyro sensor can be used.

[0039] The accelerator pedal sensor is installed on the shaft portion of the accelerator pedal of the vehicle 10 and is a device that detects the amount the accelerator pedal is pressed down and outputs an accelerator operation signal according to the detected amount the accelerator pedal is pressed down. The brake pedal sensor is installed on the shaft portion of the brake pedal of the vehicle 10 and is a device that detects the amount the brake pedal is pressed down and outputs a brake operation signal according to the detected amount the brake pedal is pressed down.

[0040] Information detected by the information sensor group 27A and the driving sensor group 27B is output via the communication bus 10A to various ECUs such as the driver assistance ECU 28 and the display control ECU 30.

[0041] (Configuration of the driver assistance ECU28) The driver assistance ECU28, although not shown in the diagram, consists of a CPU (Central Processing Unit: processor), memory such as ROM (Read Only Memory) and RAM (Random Access Memory), non-volatile storage such as HDD (Hard Disk Drive) and SSD (Solid State Drive), a communication interface (communication I / F), and an input / output interface (input / output I / F). Each component is connected to the others via a bus so that they can communicate with each other.

[0042] The driver assistance ECU 28 implements various functions to support the driving of the vehicle 10, including at least drive control and braking control of the vehicle 10, by having the CPU execute one or more software programs stored in the storage. In this embodiment, the storage contains, as an example, autonomous driving software (hereinafter simply referred to as autonomous driving) 29A that implements the function of autonomous driving, ACC software (hereinafter simply referred to as ACC) 29B that implements the function of ACC (Adaptive Cruise Control), and LTA software 29C that implements the function of LTA (Lane Tracing Assist).

[0043] Automated driving 29A is an application that enables the vehicle 10 to drive automatically, and ACC 29B is an application that enables adaptive cruise control (ACC) to maintain a constant distance from the vehicle ahead. In addition, LTA 29C is an application that enables the vehicle to recognize lanes and surrounding vehicles when driving on a road with lane markings, and to assist in the operation of the steering wheel 16 necessary for lane keeping.

[0044] Furthermore, the storage may also contain automatic parking software to implement automatic parking functions, and ADAS software to implement advanced driver assistance functions. The ADAS software includes an application that calculates a corrected trajectory from the vehicle's position to a predetermined target trajectory in order to make the vehicle 10 follow a predetermined target trajectory. The ADAS software also includes an application that implements collision avoidance support functions (such as PCS (Pre-Collision System)) and lane keeping support functions (such as LKA (Lane Keeping Assist)) to maintain the vehicle in its lane. The ADAS software also includes an application that implements collision mitigation braking functions (such as AEB (Autonormal Emergency Braking)) that automatically applies the brakes to reduce the damage of a collision, and an application that implements lane departure warning functions (such as LDW (Lane Departure Warning) and LDA (Lane Departure Alert)) that warn the vehicle of deviating from its lane.

[0045] Furthermore, the driver assistance ECU 28 is connected to various actuators used for controlling the vehicle 10, such as the drive actuator 28A, brake actuator 28B, and steering actuator 28C.

[0046] The drive actuator 28A controls the amount of air supplied to the engine (throttle opening) in accordance with a control signal from the driver assistance ECU 28, thereby controlling the driving force of the vehicle 10. If the vehicle 10 is a hybrid vehicle, in addition to the amount of air supplied to the engine, a control signal from the driver assistance ECU 28 is input to the motor, which serves as a power source, to control its driving force. If the vehicle 10 is an electric vehicle, a control signal from the driver assistance ECU 28 is input to the motor, which serves as a power source, to control its driving force. In these cases, the motor, which serves as a power source, constitutes the various actuators described above.

[0047] The brake actuator 28B controls the brake system in accordance with the control signal from the driver assistance ECU 28, and controls the braking force applied to the wheels of the vehicle 10. As the brake system, for example, a hydraulic brake system can be used.

[0048] The steering actuator 28C controls the drive of the assist motor that controls the steering torque in the electric power steering system according to a control signal from the driver assistance ECU 28. In this way, the steering actuator 28C controls the steering torque of the vehicle 10.

[0049] The driver assistance ECU 28 performs an automatic driving process that allows the vehicle 10 to move automatically without driver operation by the vehicle's occupants when the automatic driving mode is selected, by having the CPU execute the automatic driving 29A. The automatic driving process determines the situation of the vehicle 10 and its surroundings based on information obtained from the information sensor group 27A and the driving sensor group 27B, and controls the drive actuator 28A, brake actuator 28B, and steering actuator 28C.

[0050] In this embodiment, when the automatic driving mode is selected, the driver assistance ECU 28 performs automatic driving processing, which allows the vehicle 10 to move automatically without driver operation by the occupants of the vehicle 10, by having the CPU execute automatic driving 29A. The automatic driving processing is a process that determines the situation of the vehicle 10 and its surroundings based on information obtained from the information sensor group 27A and the driving sensor group 27B, and controls the throttle ACT 29A, brake ACT 29B, and steering ACT 29C. The automatic driving mode is configured to be switchable between an activated state and an inactivated state by operating a switch (not shown) located in a position where the occupant seated in the driver's seat can operate it. In this embodiment, when the automatic driving mode is activated, the CPU outputs a signal indicating that the automatic driving function is activated to the display control ECU 30 via the communication bus 10A. Here, known technologies can be used for the automatic driving processing.

[0051] Furthermore, in this embodiment, when ACC mode is selected, the driver assistance ECU 28 performs ACC processing to enable adaptive cruise control (ACC) driving, which maintains a constant distance between the vehicle 10 and the preceding vehicle, by executing ACC 29B on the CPU. The ACC processing determines the distance between the vehicle 10 and the preceding vehicle based on information obtained from the information sensor group 27A and the driving sensor group 27B, and controls the throttle ACT 29A, brake ACT 29B, and steering ACT 29C. The ACC mode is configured to be switchable between an activated and deactivated state by operating a switch (not shown) located in a position accessible to the occupant seated in the driver's seat, similar to the automatic driving mode. In this embodiment, when ACC mode is activated, the CPU outputs a signal indicating that the ACC function is activated to the display control ECU 30 via the communication bus 10A. Here, known technologies can be used for the ACC processing.

[0052] Furthermore, in this embodiment, when the LTA mode is selected, the driver assistance ECU 28 performs LTA processing by having the CPU execute LTA 29C, which recognizes the lane and surrounding vehicles of the vehicle 10 while driving on a road with lane markings, and applies the steering torque necessary for lane maintenance to support the driver's steering operation, i.e., lane keeping operation.

[0053] (Configuration of the display control ECU30) As shown in Figure 2, the display control ECU 30 consists of a CPU 30A, ROM 30B, RAM 30C, storage 30D, communication I / F 30E, and input / output I / F 30F. Each component is connected to the others via bus 30G so that they can communicate with each other.

[0054] The CPU 30A is the central processing unit, which executes various programs and controls various components. Specifically, the CPU 30A reads programs from ROM 30B or storage 30D and executes them using RAM 30C as the working area. The CPU 30A controls the above components and performs various calculations according to the programs recorded in ROM 30B or storage 30D.

[0055] ROM30B stores various programs and data. RAM30C temporarily stores programs or data as a working area. Storage30D is composed of an HDD (Hard Disk Drive) or SSD (Solid State Drive) and stores various programs, including the operating system, and various data. In this embodiment, ROM30B or storage30D stores a vehicle display control program for performing vehicle display control processing, and various data.

[0056] The communication interface 30E is an interface for the display control ECU 30 to communicate with servers and other devices (not shown), and standards such as Ethernet®, LTE, FDDI, and Wi-Fi® are used.

[0057] The input / output interface 30F is connected to the first display unit 24, the second display unit 25, the head-up display device (HUD) 40, and the communication bus 10A. In this embodiment, the head-up display device 40 projects an image onto the third display unit 26.

[0058] (Functional configuration of the display control ECU30) The display control ECU 30 implements various functions using the hardware resources described above. The functional configuration implemented by the display control ECU 30 will be explained with reference to Figure 3.

[0059] As shown in Figure 3, the display control ECU 30 is configured to include a hands-on / off detection unit 32 and a display control unit 34 as its functional configuration. Each functional configuration is realized when the CPU 30A reads and executes a vehicle display control program stored in the ROM 30B or storage 30D.

[0060] The hands-on / off detection unit 32 detects whether the system is in hands-on mode, which requires gripping the steering wheel 16, or hands-off mode, which does not require gripping the steering wheel 16. Specifically, it detects the operating status of each application in the driver assistance ECU 28. For example, when the automatic driving mode is activated, the hands-on / off detection unit 32 detects a signal output from the driver assistance ECU 28 via the communication bus 10A indicating that the automatic driving function is activated. Similarly, the hands-on / off detection unit 32 detects a signal output from the driver assistance ECU 28 via the communication bus 10A indicating that the ACC function is activated. Similarly, the hands-on / off detection unit 32 detects a signal output from the driver assistance ECU 28 via the communication bus 10A indicating that the LTA function is activated.

[0061] Figure 4 is a diagram illustrating hands-on mode and hands-off mode. As shown in Figure 4, in this embodiment, for example, when the vehicle is in manual driving mode, to the left of the line indicated by arrow A in Figure 4, i.e., when manual driving mode is activated, it is in hands-on mode. Also, when the vehicle is in automatic driving mode, i.e., to the right of the line indicated by arrow A, both hands-on mode and hands-off mode exist. In this embodiment, for example, automatic driving corresponds to Level 2.

[0062] In autonomous driving mode, hands-on and hands-off modes coexist. In this embodiment, as an example, autonomous driving 1 and autonomous driving 2 to the left of the line indicated by arrow B in Figure 4 are in hands-on mode. On the other hand, autonomous driving 2 to the right of the line indicated by arrow B in Figure 4 is in hands-on mode. For example, autonomous driving 1 has ACC mode and LTA mode activated. Autonomous driving 2 is further enhanced by activating other applications in addition to those in autonomous driving 1. Autonomous driving 3 is further enhanced by activating other applications in addition to those in autonomous driving 2, enabling hands-off driving.

[0063] The hands-on / off detection unit 32 detects the operating status of each application of the driver assistance ECU 28 and determines which of the driving modes shown in Figure 4 corresponds to the current driving state, thereby determining whether it is hands-on mode or hands-on mode.

[0064] The display control unit 34 controls the display on the display area 24A of the first display unit 24 based on the currently operating mode detected by the hands-on / off detection unit 32. Specifically, it makes the overall display style of the main image the same and changes the display pattern of the auxiliary image between hands-on mode and hands-off mode. In this embodiment, as an example, the hands-on mode occurs when the manual driving, automatic driving 1, and automatic driving 2 modes to the left of the line indicated by arrow B in Figure 4 are selected. Therefore, the display control unit 34 displays "Display 1" on the first display unit 24 when manual driving, automatic driving 1, or automatic driving 2 is selected.

[0065] Figure 5 shows an example of "Display 1" in the display area 24A of the first display unit 24 during hands-on mode. As shown in Figure 5, the display control unit 34 displays a vehicle image 60, which is a three-dimensional image of the vehicle 10, in the display area 24A of the first display unit 24, approximately in the left-right center and below the top-bottom center. The display control unit 34 also displays lane images 62 indicating lanes on both the left and right sides of the vehicle image 60. In this embodiment, as an example, the display control unit 34 displays the lane images 62 adjacent to both the left and right sides of the vehicle image 60 in a darker color than the other lane images 62. However, if it is possible to make the lane images 62 adjacent to both the left and right sides of the vehicle image 60 stand out, other methods may be used to emphasize them.

[0066] Furthermore, the display control unit 34 displays a status image 64 on the lower right side indicating the status of the driving assistance functions. The status image 64 includes an image indicating the status of the ACC function, a steering image 66 indicating that it is a hands-on mode requiring the steering wheel 16 to be held, an image indicating the status of the automatic driving mode, and an image 65 indicating the status of the LTA function. In this embodiment, as an example, if a hand image 66A representing a hand is displayed in the steering image 66, it indicates that it is a hands-on mode. Conversely, if a hand image 66A is not displayed in the steering image 66 (see Figure 6), it indicates that it is a hands-off mode.

[0067] Furthermore, the display control unit 34 displays images indicating functions in an operating state more prominently than images indicating functions in an inactive state in the status image 64. As an example of how to highlight, colors can be emphasized, but other known highlighting methods can also be used. In addition, the display control unit 34 displays a driver image 68, for example, driver information, approximately in the center of the left side in the vertical direction.

[0068] Furthermore, as shown in Figure 5, if there is a preceding vehicle traveling ahead of vehicle 10 in the same lane, the display control unit 34 displays a preceding vehicle image 70 as a three-dimensional image, for example, representing the preceding vehicle. In this embodiment, the preceding vehicle image 70 is represented as a three-dimensional shape showing the outer shape of the preceding vehicle. If, for example, there is a vehicle behind vehicle 10 as a surrounding vehicle, the display control unit 34 can similarly display a rear vehicle image as a three-dimensional shape showing the outer shape of the rear vehicle behind the vehicle image 60.

[0069] Furthermore, if there is an oncoming vehicle traveling in the opposite lane of vehicle 10, the display control unit 34 displays an oncoming vehicle image 72 representing the oncoming vehicle as a three-dimensional image showing the outer shape of the oncoming vehicle. In this embodiment, as an example, the display control unit 34 selects and displays a three-dimensional image of the relevant surrounding vehicle from three-dimensional image data that has been pre-stored in the storage 30D and classified by vehicle size, vehicle type, vehicle name, etc.

[0070] Furthermore, the display control unit 34 highlights the area surrounding the vehicle image 60, which includes the lane image 62, in a different color from other areas, namely the area surrounding the vehicle 63. The area surrounding the vehicle 63 is given a gradient such that the color becomes lighter as it moves further away from the vehicle 10. As described above, "Display 1" is displayed in the manner shown in Figure 5.

[0071] Furthermore, in this embodiment, for example, the hands-off mode occurs when the automatic driving mode 3 to the right of the line indicated by arrow B in Figure 4 is selected. Therefore, the display control unit 34 displays "Display 2" on the first display unit 24 when automatic driving mode 3 is selected.

[0072] Figure 6 shows an example of "Display 2" in the display area 24A of the first display unit 24 in hands-off mode. The display of "Display 2" shown in Figure 6 shares the same overall display style as the display of "Display 1" shown in Figure 5, while changing the display manner of the auxiliary images. In this embodiment, as an example, the main image 80 is an image that includes a vehicle image 60, a lane image 62, a preceding vehicle image 70, and an oncoming vehicle image 72. Here, Figure 7 shows an example of a display style different from "Display 1" in the display area 24A of the first display unit 24 in hands-on mode. In this embodiment, "display style" refers to a direction of display design that includes an atmosphere corresponding to a purpose such as sport mode, eco mode, and drive mode.

[0073] In Figures 5 and 6, the main image 80 is displayed across the entire central part of the display area 24A, whereas in Figure 7, shown as an example of a different display style, the tachometer image 69, which indicates engine speed, is displayed across the entire central part of the display area 24A. The main image 80 is then displayed within the tachometer image 69. In other words, the size and position of the main image 80 differ within the display area 24A. Thus, Figures 5 and 7 differ in the direction of the display design, including the overall atmosphere of the display area 24A, i.e., the display style.

[0074] In this embodiment, as described above, the display of "Display 2" shown in Figure 6 shares the same overall display style as the display of "Display 1" shown in Figure 5 for the main image 80. Furthermore, as shown in Figure 6, the display control unit 34 changes the display mode of the auxiliary image 90, which includes the area around the vehicle 63 and the trajectory line image 74, which is the trajectory line of the preceding vehicle shown in the preceding vehicle image 70, from "Display 1" shown in Figure 5. In this embodiment, "changing the display mode" also includes changing from hidden to displayed.

[0075] Specifically, in "Display 2" of Figure 6, the display control unit 34 emphasizes the area around the vehicle 63 by displaying it in a darker color than in "Display 1" of Figure 5. Furthermore, in "Display 2" of Figure 6, the display control unit 34 displays the trajectory line image 74, which was not displayed in "Display 1" of Figure 5. The trajectory line image 74 is formed by a band-shaped line extending from the preceding vehicle image 70 to the vehicle image 60. The outer edge in the width direction is emphasized more than the inner edge.

[0076] (action) Next, the effects and advantages of this embodiment will be described.

[0077] (Display control processing) An example of a display control process for displaying an image in the display area 24A of the first display unit 24 will be explained using the flowchart shown in Figure 8. This display control process is performed by the CPU 30A reading a display control program from the ROM 30B or storage 30D, loading it into the RAM 30C, and executing it.

[0078] As shown in Figure 8, in step S11, the CPU 30A causes the display area 24A of the first display unit 24 to start displaying in the "Display 1" mode using the function of the display control unit 34. Next, in step S12, the CPU 30A determines whether or not the automatic driving mode has been detected. Specifically, the CPU 30A determines whether or not the automatic driving mode has been detected based on the signal output from the driver assistance ECU 28 indicating that the automatic driving function is in operation.

[0079] If the automatic driving mode is not detected, step S12 results in a negative determination, and the CPU 30A proceeds to step S11 to continue displaying in the manner of "Display 1". On the other hand, if the automatic driving mode is detected, step S12 results in a positive determination, and the CPU 30A proceeds to step S13.

[0080] In step S13, the CPU 30A detects whether the system is in hands-on mode or hands-off mode. Specifically, the CPU 30A, using the function of the hands-on / hands-off detection unit 32, detects whether the system is in hands-on mode or hands-off mode based on the operating status of each application output from the driver assistance ECU 28, as described above.

[0081] In step S14, the CPU 30A determines whether or not it is in hands-on mode. Specifically, the CPU 30A determines whether or not it is in hands-on mode based on the mode detected by the hands-on / off detection unit 32. If it is in hands-on mode, the CPU 30A determines that step S14 is positive, and the CPU 30A proceeds to step S15. In step S15, the CPU 30A uses the display control unit 34 to continue displaying in the manner of "Display 1" shown in Figure 5, as described above.

[0082] On the other hand, if it is not hands-on mode, i.e., hands-off mode, the CPU 30A determines that step S14 is negative, and proceeds to step S16. In step S16, the CPU 30A, using the functions of the display control unit 34, changes the display to the "Display 2" mode shown in Figure 6, which maintains the display style of "Display 1" while changing the display mode of the auxiliary image 90, as described above.

[0083] After steps S15 and S16 are completed, the CPU 30A then determines whether or not the display has been instructed to end in step S17. Specifically, the CPU 30A determines that the display has been instructed to end if, for example, the power to the vehicle 10 is stopped.

[0084] If the display is instructed to end, the CPU 30A determines that step S17 is positive, and the CPU 30A terminates the display control process. On the other hand, if the display is not instructed to end, the CPU 30A determines that step S17 is negative, and the CPU 30A proceeds to step S12.

[0085] As described above, in the display control ECU 30 as a vehicle display control device according to this embodiment, the display control unit 34 makes the overall display style of the main image 80 the same in hands-on mode and hands-off mode, and changes the display pattern of the auxiliary image 90, and displays them in the display area 24A of the first display unit 24 mounted on the vehicle 10. As a result, since the overall display style of the main image 80 is the same in hands-on mode and hands-off mode, the amount of change in the display screen of the main image 80 as a whole can be suppressed. Therefore, it is possible to suppress the feeling of inconvenience that the occupant will experience when switching between hands-on and hands-off modes. In addition, since the overall display style of the main image 80 is the same in hands-on mode and hands-off mode, the connection of the display style between hands-on mode and hands-off mode can be maintained. Furthermore, since the display pattern of the auxiliary image 90 is changed in hands-on mode and hands-off mode, the occupant can be made aware of hands-on mode and hands-off mode.

[0086] Furthermore, in this embodiment, the display control unit 34, in hands-on mode, makes the overall display style of the main image 80 the same for both manual driving mode and automatic driving mode, and changes the display mode of the auxiliary image 90, displaying them in the display area 24A of the first display unit 24 mounted on the vehicle 10. As a result, in hands-on mode, since the overall display style of the main image 80 is the same for both manual driving mode and automatic driving mode, the amount of change in the display screen of the main image 80 as a whole can be suppressed. Therefore, it is possible to suppress the inconvenience felt by the occupant when switching between manual driving and automatic driving modes. In addition, since the overall display style of the main image 80 is the same for both manual driving mode and automatic driving mode, the connection of the display style between the manual driving mode and automatic driving mode can be maintained.

[0087] Furthermore, in this embodiment, the hands-on mode includes the driver assistance mode shown in Automated Driving 1 in Figure 4 and the automated driving mode shown in Automated Driving 2 in Figure 4. Therefore, the amount of change in the display of the main image 80 as a whole and the auxiliary image 90 between the driver assistance mode and the automated driving mode can be suppressed. As a result, in hands-on mode, it is possible to suppress the inconvenience felt by the occupant when switching between the driver assistance mode and the automated driving mode.

[0088] Furthermore, since the above-mentioned driver assistance modes include ACC and LTA, the amount of change in the display of the main image 80 and auxiliary image 90 can be suppressed when switching between ACC and LTA and the autonomous driving mode. Therefore, it is possible to reduce the inconvenience that occupants feel when switching between ACC and LTA and the autonomous driving mode.

[0089] Furthermore, in this embodiment, the main image 80 is an image that includes the vehicle image 60 (representing the own vehicle), the preceding vehicle image 70 and the oncoming vehicle image 72 (representing other vehicles), and the lane image 62. Therefore, the display style including the vehicle image 60, the lane image 62, the preceding vehicle image 70, and the oncoming vehicle image 72 is not changed. As a result, the occupants can visually confirm the relative positions of the vehicle image 60, the lane image 62, the preceding vehicle image 70, and the oncoming vehicle image 72 without being bothered by changes in the display style.

[0090] Furthermore, in this embodiment, the display control unit 34 changes the color of the area 63 surrounding the vehicle, which is the auxiliary image 90, and displays it in the display area 24A of the first display unit 24. Therefore, without changing the color of the main image 80, the occupant can recognize the switching between hands-on mode and hands-off mode by changing the color of the area 63 surrounding the vehicle.

[0091] Furthermore, in this embodiment, by changing the display mode of the auxiliary image 90, which is the trajectory line image 74, the occupant can recognize the switching between hands-on mode and hands-off mode.

[0092] [supplementary explanation] In the above embodiment, the display control unit 34 emphasizes the area around the vehicle 63 by displaying it in a darker color than "Display 1" in Figure 5, as a means of changing the display mode of the area around the vehicle 63. However, the present invention is not limited to this. For example, as a means of changing the display mode, the area around the vehicle 63 may be hidden in "Display 2" in Figure 6, or it may be displayed in a lighter color than "Display 1" in Figure 5. It may also be displayed in a different color than "Display 1" in Figure 5, or known highlighting methods may be used.

[0093] Furthermore, in the above embodiment, the display control unit 34, as a means of changing the display mode of the trajectory line image 74, hides the trajectory line image 74 in "Display 1" of Figure 5 and displays the trajectory line image 74 in "Display 2" of Figure 6. However, the present invention is not limited thereto. For example, as a means of changing the display mode, the trajectory line image 74 may be displayed in "Display 1" of Figure 5 as well, and then in "Display 2" of Figure 6, the trajectory line image 74 may be displayed in a lighter or darker color than in "Display 1" of Figure 5, or in a different color than in "Display 1" of Figure 5. Also, known highlighting techniques may be used.

[0094] Furthermore, in the above embodiment, the display control unit 34 changes the display mode of both the vehicle surrounding area 63 and the trajectory line image 74 as auxiliary images 90, but the present invention is not limited thereto. The display control unit 34 may change the display mode of only the vehicle surrounding area 63 as auxiliary images 90, or it may change the display mode of only the trajectory line image 74 as auxiliary images 90. In addition, other images may be added as auxiliary images 90.

[0095] Furthermore, in the above embodiment, the hands-on mode includes a manual driving mode and an automatic driving mode, but the present invention is not limited thereto. For example, the display control unit 34 may, only in the case of automatic driving mode, make the display style of the entire main image 80 the same for both hands-on mode and hands-off mode, and change the display style of the auxiliary image 90. In this case, the display control unit 34 may, for example, in manual driving mode, display the display area 24A of the first display unit 24 with the display style shown in Figure 7, that is, a different display style from that of automatic driving mode.

[0096] Furthermore, in the above embodiment, the automatic driving 1 in Figure 4 is assumed to have both ACC mode and LTA mode activated, but the present invention is not limited to this. For example, other driving assistance functions may be activated. Also, in this embodiment, the Level 2 hands-on driving located between the line indicated by arrow A and the line indicated by arrow B as shown in Figure 4 is assumed to be automatic driving 1 and automatic driving 2, but the present invention is not limited to this. For example, it may be only automatic driving 2, or only automatic driving 1. In other words, Level 2 hands-on driving only requires driving in hands-on mode.

[0097] Furthermore, although the above-described embodiment described a case in which a display area showing the foreground of the vehicle 10 is displayed in the display area 24A of the first display unit 24, the present invention is not limited to this. For example, as shown in the modified example in Figure 9, a display area showing the foreground of the vehicle 10 may be displayed in the display area 25A of the second display unit 25, which is a display provided on the instrument panel 14.

[0098] As shown in Figure 9, in this modified example, the display area 25A of the second display unit 25 is divided vertically. In the second display unit 25 shown in Figure 9, a map image N showing the current location of the vehicle 10 is displayed in the lower part of the display area, and a surrounding area image 82 and a status image 64 are displayed in the upper part of the display area.

[0099] As described above, in this modified example, the surrounding image 82 and the status image 64 are displayed on the second display unit 25 provided on the instrument panel 14. This makes it easier for occupants to recognize the operating status of the driver assistance function, regardless of their seating position, by looking at the second display unit 25, similar to the embodiment described above.

[0100] Similarly, the surrounding image 82 and the status image 64 may be displayed in the display area 26A of the third display unit 26, which is formed by the projection surface of the head-up display device 40. Since the display area 26A is the projection surface projected by the head-up display device 40 in front of the vehicle from the driver's seat, the surrounding image 82 and the status image 64 are displayed superimposed on the foreground from the driver's seat, so that the occupant in the driver's seat can recognize the operating status of the driver assistance function without moving their eyes significantly.

[0101] Furthermore, in this embodiment, the processes that the CPU 30 shown in Figure 2 reads and executes software (programs) may be executed by various processors other than the CPU. Examples of such processors include PLDs (Programmable Logic Devices) such as FPGAs (Field-Programmable Gate Arrays) whose circuit configuration can be changed after manufacturing, and dedicated electrical circuits such as ASICs (Application Specific Integrated Circuits) which have a circuit configuration specifically designed to execute a particular process. In addition, each process may be executed by one of these various processors, or by a combination of two or more processors of the same or different types (for example, multiple FPGAs, and a combination of a CPU and an FPGA). More specifically, the hardware structure of these various processors is an electrical circuit that combines circuit elements such as semiconductor elements.

[0102] Furthermore, each program described in this embodiment may be provided in the form of being recorded on a recording medium such as a CD-ROM (Compact Disc Read Only Memory), DVD-ROM (Digital Versatile Disc Read Only Memory), or USB (Universal Serial Bus) memory. Alternatively, the programs may be provided in the form of being downloaded from an external device via a network.

[0103] Although one embodiment of the present invention has been described above, it goes without saying that the present invention is not limited to the above, and can be implemented in various other ways without departing from the spirit of the invention. [Explanation of Symbols]

[0104] 10 vehicles 13 Cabin 24 First display section (display section) 25 Second display section (display section) 26 Third display section (display section) 30 Display Control ECU (Vehicle Display Control Unit) 34 Display Control Unit 80 Main Images 90 auxiliary images

Claims

1. A vehicle display control device including a display control unit that indicates the direction of the display design, including the atmosphere corresponding to the purpose of the vehicle's driving mode, when the vehicle's steering wheel is gripped and when the steering wheel is not gripped, and changes the display manner of an auxiliary image showing the trajectory of a preceding vehicle, without changing the overall display taste of the main image including the own vehicle, other vehicles, and lanes, and displays it on a display unit mounted on the vehicle.

2. The aforementioned hands-on mode includes a manual driving mode and an automatic driving mode. The vehicle display control device according to claim 1, wherein the display control unit further causes the display taste of the entire main image to be common to the display unit in the manual driving mode during the hands-on mode and in the automatic driving mode during the hands-on mode.

3. The vehicle display control device according to claim 1, wherein the hands-on mode includes a driver assistance mode and an automated driving mode.

4. The vehicle display control device according to claim 3, wherein the driving assistance mode includes automatic cruise control and lane tracing assist.

5. A vehicle display control method that indicates the direction of the display design, including the atmosphere corresponding to the purpose of the vehicle's driving mode, when the vehicle is in hands-on mode, which requires gripping the steering wheel, and when it is in hands-off mode, which does not require gripping the steering wheel, and changes the display manner of an auxiliary image showing the trajectory of a preceding vehicle, without changing the overall display taste of the main image, including the own vehicle, other vehicles, and lanes, and displays it on a display unit mounted on the vehicle.

6. Computers, A display control program that functions as a display control unit to indicate the direction of the display design, including the atmosphere corresponding to the purpose of the vehicle's driving mode, when the vehicle is in hands-on mode, which requires gripping the steering wheel, and when it is in hands-off mode, which does not require gripping the steering wheel, and to change the display manner of the auxiliary image showing the trajectory of the preceding vehicle, without changing the overall display taste of the main image, including the vehicle itself, other vehicles, and lanes, and to display it on the display unit mounted on the vehicle.

Images