Display control device and display control method

Abstract

This display control device comprises: a switch (10) which outputs an operation command in response to a preliminary operation and a confirmation operation after the preliminary operation; and a controller (30) which controls a display device (2). The controller (30) acquires vehicle state information indicating the current state of a vehicle (1) and / or the state of environment surrounding the vehicle (1), and in the case where the switch (10) has been operated by the preliminary operation, specifies, on the basis of the vehicle state information, the details of control to be executed on the vehicle (1) by the operation command and displays the details of control on the display device (2) before the confirmation operation.

Description

[Technical field]

[0001] The present invention relates to a display control device and a display control method. This application claims priority based on Japanese patent application No. 2022-078800, filed on May 12, 2022, and for designated states where incorporation by reference of literature is permitted, the contents of the above application are incorporated by reference into this application and made part of the description of this application. [Background technology]

[0002] Vehicle information display devices that allow easy understanding of the operation state have been known (for example, Patent Document 1). The vehicle information display device described in Patent Document 1 has operation switches arranged on the steering wheel for controlling devices to be operated, such as an air conditioner device, installed in the vehicle. On the windshield WS of the vehicle, switch images corresponding to the operation switches are displayed, and the display of the operation state of the steering wheel is displayed. Operation switch The layout is reflected in the display. The operation switches are equipped with touch sensors, and when the user touches them, the corresponding switch image is highlighted. When the operation switch is operated, an operation signal is sent to the device, which performs an operation according to the operation signal and returns its operating status, and an operation response image showing the operating status is displayed on the windshield WS. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2007-106353 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, vehicle information display devices simply display switch images reflecting the layout of the operating switches on the windshield, and the problem is that the occupants cannot recognize the vehicle control content that is executed by operating the operating switches until they have performed a confirmation operation to confirm the operating command for vehicle control.

[0005] The problem to be solved by the present invention is to provide a display control device and a display control method that enable an occupant to recognize the vehicle control content to be executed by operating a switch before the switch is confirmed. [Means for solving the problem]

[0006] The present invention obtains vehicle state information, and when the switch is operated as a preliminary operation, executes the switch operation command based on the vehicle state information. The device to be operated Vehicle control details and automatic driving is deactivated. Identify the switch and before confirming the switch operation, Autonomous driving is cancelled The above problem is solved by displaying the above on a display device. Effect of the Invention

[0007] According to the present invention, it is possible to allow an occupant to recognize the vehicle control content that will be executed by operating the switch before the switch is confirmed. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a block diagram of a vehicle including a display control device according to the present embodiment. [Figure 2A] FIG. 2A is a conceptual diagram showing the state of the interior of the vehicle in front of the driver. [Figure 2B] FIG. 2B is a conceptual diagram showing the state of the interior of the vehicle in front of the driver. [Figure 2C] FIG. 2C is a conceptual diagram showing the state of the interior of the vehicle in front of the driver. [Figure 3A] FIG. 3A is a conceptual diagram showing the state of the interior of the vehicle in front of the driver. [Figure 3B] FIG. 3B is a conceptual diagram showing the state of the interior of the vehicle in front of the driver. [Figure 3C] FIG. 3C is a conceptual diagram showing the state of the interior of the vehicle in front of the driver. [Figure 4] FIG. 4 is a flowchart showing a process flow of display control by the controller. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] An embodiment of a display control device according to the present invention will be described with reference to the drawings. FIG. 1 is a block diagram showing an example of the configuration of a vehicle including a display control device according to this embodiment. As shown in FIG. 1, a vehicle 1 has a display device 2, a camera 3, a distance measuring device 4, a GPS 5, a vehicle speed sensor 6, a map database 7, a switch 10, a drive control device 20, and a controller 30. The display control device according to this embodiment is a device including a controller 30, and receives an operation command from a switch 10 capable of at least two-stage operation, and displays on the display device 2 the control content executed by the operation command of the switch 10 in the first stage operation. In addition, the display control device executes control processing of an in-vehicle device with the control content based on the operation command in the second stage operation of the switch 10. That is, in order to confirm the operation command for vehicle control, the display control device displays on the display device 2 the control content executed by the operation command before performing the second stage switch operation. Since the occupant of the vehicle 1 can recognize the vehicle control content executed by the second stage switch operation through the display device 2 before performing the second stage switch operation, the occupant can operate the switch 10 with confidence.

[0010] The display device 2 is a display for displaying the control contents of the vehicle 1 executed by an operation command of the switch 10, and is, for example, at least one of a head-up display, a display installed in an instrument panel, and a display included in a navigation system. The head-up display is a display device that displays an image on glass or a projection board located in front of the vehicle. The display device 2 displays the control contents of the vehicle 1 as a message image formed of a character string or a graphic image such as an icon. The display device 2 generates an image for display based on a control command transmitted from the controller 30 and displays it on the screen.

[0011] The camera 3 is a camera for capturing images of the surrounding environment of the vehicle 1, and is installed on the vehicle 1, and includes a front camera, a rear camera, and / or a side camera of the vehicle 1. The captured image of the camera 3 includes vehicle state information indicating the state of the surrounding environment of the vehicle 1, and 1 It is used for automatic driving control.

[0012] The distance measuring device 4 is a sensor for detecting the surrounding environment of the vehicle, and is installed on the vehicle 1. It includes a forward radar for detecting obstacles in front of the vehicle, and / or a rear radar for detecting obstacles behind the vehicle, and a side radar for detecting obstacles on the left and right sides of the vehicle. The detection data of the distance measuring device 4 includes vehicle state information indicating the state of the surrounding environment of the vehicle, and 1 It is used for automatic driving control.

[0013] The GPS (navigation system) 5 has a GPS receiver (GPS) that receives signals from satellites, and is a system that locates the current position of the vehicle 1. The vehicle speed sensor 6 detects the speed of the vehicle 1 as the current state (traveling state) of the vehicle. Note that, although the vehicle speed sensor 6 is given as an example of a sensor that detects the current state of the vehicle in Fig. 1, other sensors such as an acceleration sensor and a torque sensor may also be used.

[0014] The map database 7 stores three-dimensional high-precision map information including the position information of various facilities and specific points. The three-dimensional high-precision map information is three-dimensional map information based on road shapes detected when a data acquisition vehicle is used to travel on actual roads. The three-dimensional high-precision map information is map information in which detailed and highly accurate position information such as curved roads and the magnitude of the curves (e.g., curvature or curvature radius), road junctions, branching points, toll booths, and positions where the number of lanes decreases is associated as three-dimensional information along with map information. Note that high-precision maps do not cover all roads, and the map database 7 stores standard maps (SD maps) to cover information on roads and the like that is not covered by high-precision maps (HD maps).

[0015] The switch (SW) 10 is a switch for operating a device to be operated, and is a switch capable of multi-stage operation. The switch 10 has at least two stages of operation. Of the two stages of operation of the switch 10, the first operation corresponds to the preliminary operation, and the second operation corresponds to the final operation. When the switch 10 is operated as the preliminary operation by the occupant, the switch 10 outputs a preliminary command indicating the preliminary operation to the controller 30, and when the switch 10 is operated as the final operation, the switch 10 outputs an operation command indicating the final operation (operation final command) to the controller 30. The switch 10 has an operation mechanism that allows the operation method of the preliminary operation and the operation method of the final operation to be different from each other. The switch 10 is a switch such as a switch equipped with an electrostatic or pressure-sensitive touch sensor (electrostatic switch, pressure-sensitive switch), a two-stage switch that allows half-pressing and full-pressing (mechanical switch), etc.

[0016] For example, when the switch 10 is a switch equipped with a touch sensor, the switch 10 detects an input operation by a touch operation as a preparatory operation, and outputs a preparatory command to the controller 30. The switch 10 also detects a touch operation with a longer contact time than the touch operation for the preparatory operation as a confirmation operation, and outputs a confirmation command to the controller 30. The touch operation for the preparatory operation is, for example, a tap operation with a short contact time, and the touch operation for the confirmation operation is, for example, a touch operation with a long contact time. Note that it is preferable that the touch operation for the preparatory operation and the touch operation for the confirmation operation are different operation methods from each other, and for example, the preparatory operation may be a tap operation and the confirmation operation may be a double tap operation.

[0017] For example, when the switch 10 is a two-stage switch, the switch 10 detects an input operation (half-press) by a touch operation as a preliminary operation, and outputs a preliminary command to the controller 30. The switch 10 also detects an operation of pressing the part touched in the preliminary operation (full press) as a confirmation operation, and outputs an operation command to the controller 30.

[0018] The switches 10 are various switches mounted on the vehicle 1, and include a steering switch (steering SW) 11, a VDC switch (VDCSW) 12, a driving mode switch (driving mode SW) 13, an automatic driving switch (automatic driving SW) 14, and a lane change switch (lane change SW) 15. The steering SW 11 is a switch provided on the steering wheel, and is, for example, a touch sensor installed on the rim or a mechanical switch installed on a spoke. The touch sensor on the rim detects when the driver (passenger) touches the steering wheel. Spoke Part The switches include switches for operating navigation systems, video / audio systems, etc., switches for switching driving modes in autonomous driving control, switches for adjusting the set vehicle speed in autonomous driving control, switches for adjusting the distance between vehicles in autonomous driving control, etc.

[0019] The VDCSW 12 is a switch for switching on and off a system (vehicle dynamics control system: VDC system) that prevents skidding of the vehicle 1. The driving mode SW 13 is a switch for switching on and off driving modes such as snow mode and sports mode. The autonomous driving switch 14 is a switch for switching on and off autonomous driving. The lane change switch 15 is a switch for switching on and off a lane change assist function during autonomous driving. It is not necessary that all of the switches included in the switch 10, such as the steering switch 11, be switches that can be operated in multiple stages.

[0020] The drive control device 20 controls the running of the host vehicle. For example, when the host vehicle runs at a constant speed at a set speed due to the automatic speed control function, the drive control device 20 controls the operation of the drive mechanism and the brake operation to accelerate and decelerate the host vehicle to the set speed, and to maintain the running speed. In addition, the drive control device 20 also controls the operation of the drive mechanism and the brake in the same manner when the host vehicle runs following a preceding vehicle due to the automatic speed control function. Note that the operation control of the drive mechanism includes the operation of the internal combustion engine in an engine vehicle, and the operation of the driving motor in an electric vehicle. In addition, in a hybrid vehicle, it includes the torque distribution between the internal combustion engine and the driving motor.

[0021] Moreover, the drive control device 20 performs steering control of the host vehicle by controlling the operation of the steering actuator in addition to the operation control of the drive mechanism and the brakes by the automatic steering control function. For example, when performing lane keeping control by the automatic steering control function, the drive control device 20 detects lane markers of the host vehicle's lane in which the host vehicle is traveling, and controls the traveling position of the host vehicle in the width direction so that the host vehicle travels at a predetermined position within the host vehicle's lane. Furthermore, when performing a lane change support function, an overtaking support function, or a route driving support function by the automatic steering control function, the drive control device 20 controls the traveling position of the host vehicle in the width direction so that the host vehicle changes lanes. Furthermore, when performing a right / left turn support function by the automatic steering control function, the drive control device 20 performs driving control to turn right or left at an intersection or the like. Moreover, the drive control device 20 can also perform automatic driving depending on the hands-on mode and the hands-off mode. The hands-on mode refers to a mode in which the automatic steering control does not operate unless the driver holds the steering wheel, and the hands-off mode refers to a mode in which the automatic steering control operates even if the driver takes his / her hands off the steering wheel. The drive control device 20 controls the running of the host vehicle according to a control command from the controller 30. Note that other known methods can also be used as a running control method by the drive control device 20.

[0022] The controller 30 has a function of acquiring vehicle state information, a function of identifying vehicle control contents, a function of controlling the display device 2, a function of controlling automatic driving, and the like. The controller 30 has a processor that executes the display control method according to this embodiment, and includes at least an information acquisition unit 31, a control content identification unit 32, a display control unit 33, and an automatic driving control unit 34 as functional blocks. Each functional block executes each function by cooperation between software and hardware (processor). Note that the functional blocks of the controller 30 do not necessarily need to be divided into functional blocks as shown in FIG. 1, and the number of functional blocks is not limited. The controller 30 also has a CPU, a ROM, a RAM, and the like to operate each functional block.

[0023] The information acquisition unit 31 acquires vehicle state information from the camera 3 etc. The vehicle state information indicates at least one of the current state of the vehicle 1 and the state of the surrounding environment of the vehicle 1, and corresponds to the image captured by the camera 3, the detection value of the distance measuring device 4, the vehicle position measured by the GPS 5, and the vehicle speed detected by the vehicle speed sensor 6. The vehicle state information also includes information on the automatic driving controlled by the drive control device 20. The current state of the vehicle 1 is or This is a parked state, and is represented by, for example, the current position of the vehicle 1, the vehicle speed, or the acceleration of the vehicle 1. The information acquisition unit 31 acquires the current position of the vehicle from the GPS 5, and the vehicle speed from the vehicle speed sensor 6. The state of the surrounding environment of the vehicle 1 is represented by an image captured by the camera 3 or a detection value of the distance measuring device 4.

[0024] When the switch 10 is operated in a preparatory operation, the control content identification unit 32 identifies the control content of the vehicle 1 to be executed by an operation command for the switch 10 based on the vehicle state information. When an occupant operates the switch 10 in a preparatory operation, the control content identification unit 32 receives a preparatory command from the switch 10. Since the switch 10 is a switch that allows multi-stage operation, by receiving the preparatory command, the control content identification unit 32 can identify the possibility that the switch 10 will be operated in a definitive operation after the preparatory command. For example, when a preparatory operation of the steering switch 11 is performed, the control content identification unit 32 determines the possibility that the switch 10 will be operated in a definitive operation after the preparatory operation of the steering switch 11. 1 It can be determined that the confirmation operation is performed.

[0025] The control content specification unit 32 specifies the control content of the vehicle 1 to be executed by the operation command of the switch 10 based on the standby command of the switch 10. 10 Before receiving the operation command, the control content of the vehicle 1 is identified. The control content of the vehicle 1 includes at least the control content of the device to be operated by the switch 10. Furthermore, if the operation command affects the control of an in-vehicle device other than the device to be operated, the control content of the vehicle 1 also includes the control content of the affected in-vehicle device. An example will be described below.

[0026] As an example of a condition for maintaining the autonomous driving, the condition is that the VDCSW 12 is on. While the vehicle 1 is traveling in the autonomous driving mode, the driver performs a standby operation of the VDCSW 12 to switch the VDCSW 12 from on to off. When the control content specification unit 32 receives a standby command from the VDCSW 12, the control content specification unit 32 acquires vehicle state information at the time of the standby operation from the information acquisition unit 31. If the vehicle is in the autonomous driving mode, the vehicle state information includes information indicating that the autonomous driving is being performed. The control content specification unit 32 specifies, from the standby operation of the VDCSW 12, that the VDC system, which is the control target of the VDCSW 12, is switched from on to off. The switching of the VDC system from on to off is the control content specified by the control content specification unit 32.

[0027] Furthermore, the control content identifying unit 32 identifies, from the preliminary operation of the VDCSW 12, that the autonomous driving is cancelled by switching the VDC system from on to off. That is, the drive control device 20 corresponds to an in-vehicle device other than the operation target device that is affected by the operation command of the VDCSW 12. Cancellation of the autonomous driving is the control content identified by the control content identifying unit 32. This allows the control content identifying unit 32 to identify the control content of the operation target device (VDC system) that is executed by the operation command of the VDCSW 12 before the confirmation operation of the VDCSW 12. Furthermore, the control content identifying unit 32 can identify the control content of the device (drive control device 20) that is executed by the operation command of the VDCSW 12, among the in-vehicle devices other than the operation target device (VDC system), before the confirmation operation of the VDCSW 12.

[0028] The display control unit 33 causes the display device 2 to display the control content identified by the control content identification unit 32 before the confirmation operation of the switch 10. spareThe control contents are displayed on the display device 2 so that the driver can recognize the control contents of the vehicle 1 by performing the operation. As in the above example, it is assumed that the driver performs a preliminary operation of the VDCSW 12 to switch the VDCSW 12 from on to off while the vehicle 1 is traveling in an autonomous driving mode. The control content identification unit 32 identifies "switching the VDC system from on to off" and "cancellation of autonomous driving" as the control contents of the vehicle 1. Then, the display control unit 33 causes the display device 2 to display an image indicating that the VDC system is switched from on to off and that the autonomous driving is cancelled. Specifically, the display control unit 33 displays message images such as "The VDC system is switched from on to off" and "The autonomous driving is cancelled". Since the display of the control contents is performed before the confirmation operation of the switch 10, the driver recognizes that the confirmation operation of the switch 10 switches the VDC system from on to off and also cancels the autonomous driving. This allows the driver to understand the vehicle state that will result from the confirmation operation of the switch 10 related to vehicle control before the driver performs the confirmation operation of the switch 10, and therefore allows the driver to operate the switch 10 with peace of mind.

[0029] The automatic driving control unit 34 controls the drive control device 20 in response to an operation command of the switch 10. For example, when a confirmation operation is performed to switch the lane change switch 15 from on to off during automatic driving, the automatic driving control unit 34 transmits a control command to the drive control device 20 to execute the lane change assistance function. When automatic driving is to be cancelled by an operation command of the switch 10, the automatic driving control unit 34 transmits a control command to cancel automatic driving to the drive control device 20. For example, as in the above example, while the vehicle 1 is traveling in automatic driving, the driver performs a preliminary operation of the VDCSW 12 to switch the VDCSW 12 from on to off, and the display control unit 33 causes the display device 2 to display an image indicating that the VDC system is switched from on to off and that automatic driving is cancelled. After that, when the driver performs a confirmation operation of the VDCSW 12, the automatic driving control unit 34 transmits a control command to the VDC system to switch the VDC system from on to off, and transmits a control command to the drive control device 20 to cancel automatic driving.

[0030] 2A to 2C and 3A to 3C, specific examples of the control process by the controller 30 and the display screen of the display device 2 will be described. FIGS. 2A to 2C and 3A to 3C are conceptual diagrams showing the state of the interior of the vehicle in front of the driver. FIGS. 2A to 2C and 3A to 3C are diagrams for explaining the transition of the display screen that is switched in response to the operation of the switch 10. In the specific examples described below, the display device 2 is a head-up display. The steering SW 11 is a switch for increasing the set speed in automatic driving, and the set speed increases by 10 km / h with one confirmation operation.

[0031] In the example of FIG. 2A, the set speed in the automatic driving is set to 80 km / h, and the current vehicle speed of the vehicle 1 is 80 km / h. The speed limit is also 80 km / h. The information acquisition unit 31 acquires vehicle state information from the GPS 5, the vehicle speed sensor 6, the map database 7, and the drive control device 20 while the vehicle is traveling. The vehicle state information includes, as information indicating the current state of the vehicle, the current position of the vehicle, the current vehicle speed, and the fact that automatic driving is being performed, and includes map information as information indicating the state of the surrounding environment of the vehicle 1. Note that the information indicating the current state of the vehicle 1 may include, for example, the current steering angle, and the information indicating the surrounding environment of the vehicle 1 may include an image captured by the camera 3.

[0032] The control content identification unit 32 identifies the current set speed and the legal speed from the vehicle state information. Then, as shown in Fig. 2A, the display control unit 33 displays a message image 41 of the current set speed (80km / h) and an icon image 42 indicating the speed limit (80km / h) on the display device 2 as images indicating the current control content of the vehicle 1.

[0033] When the driver touches the steering SW11, the steering SW11 detects the backup operation and outputs a backup command to the controller 30. The control content specification unit 32 specifies how the control content of the vehicle 1 changes by performing a confirmation operation of the steering SW11 from the vehicle state information at the time of receiving the backup command. In the example of FIG. 2A, when the driver performs a confirmation operation of the steering SW11, the set vehicle speed becomes 90 km / h, which is higher than the speed limit (80 km / h), and the automatic driving is released. The control content specification unit 32 specifies that the set speed becomes higher than the legal speed due to the confirmation operation of the steering SW11 and that the automatic driving is released, as the control content of the vehicle executed by the operation command of the steering SW11. As shown in FIG. 2B, the display control unit 33 displays a message image "Automatic driving is released because the speed limit will be exceeded" 43 on the display device 2 in addition to the icon image 42 as an image indicating the control content executed in response to the operation command of the steering SW11.

[0034] When the driver presses the steering SW11, the steering SW11 detects the confirmation operation and outputs an operation command to the controller 30. The drive control device 20 changes the set speed from 80km / h to 90km / h based on the operation command of the steering SW11 and cancels the automatic driving. The information acquisition unit 31 acquires vehicle state information from the drive control device 20. The vehicle state information includes the change of the set speed from 80km / h to 90km / h and the cancellation of the automatic driving. The control content identification unit 32 identifies the current set speed, the legal speed, and the cancellation of the automatic driving from the vehicle state information. Then, as shown in FIG. 2C, the display control unit 33 causes the display device 2 to display the current set speed (90km / h) and a message image 44 indicating the cancellation of the automatic driving and an icon image 42 as images showing the current control contents of the vehicle 1.

[0035] In addition, when the driver touches the steering SW11 and the display device 2 displays the image shown in Figure 2B, when the driver releases his / her finger from the steering SW11, the display control unit 33 returns the display screen of the display device 2 to the state of Figure 2A.

[0036] Next, a specific example of the control process by the controller 30 and the display screen of the display device 2 will be described with reference to Figures 3A to 3C. The specific example of Figures 3A to 3C differs from the specific example described above with reference to Figures 2A to 2C in that the speed limit is 100 km / h, but the other vehicle conditions are the same. In the following description, differences from the specific example of Figures 2A to 2C will be described.

[0037] As shown in FIG. 3A, the display control unit 33 displays a message image 51 of the current set speed (80 km / h) and an icon image 52 of the speed limit (100 km / h) on the display device 2 as images showing the current control contents of the vehicle 1. When the driver touches the steering SW 11 and the controller 30 receives an emergency command for the steering SW 11, the control content specification unit 32 specifies how the control contents of the vehicle 1 will change by performing a confirmation operation of the steering SW 11 from the vehicle state information at the time of receiving the emergency command. In the example of FIG. 3A, when the driver performs a confirmation operation of the steering SW 11, the set vehicle speed becomes 90 km / h, but since the changed set vehicle speed (90 km / h) is lower than the speed limit (100 km / h), automatic driving is maintained. The control content specification unit 32 specifies that the state in which the set speed is lower than the legal speed due to the confirmation operation of the steering SW 11 is maintained as the control contents of the vehicle executed by the operation command of the steering SW 11. As shown in FIG. 3B, the display control unit 33 displays the icon image 52 In addition, as an image showing the control content executed in response to the operation command of the steering SW 11, a message image "Accelerating up to 90km / h" 53 is displayed on the display device 2. The driver can understand from the message image 53 what the vehicle state will be as a result of the confirmation operation of the steering SW 11.

[0038] When the driver presses the steering SW 11, the drive control device 20 changes the set speed from 80km / h to 90km / h based on the operation command of the steering SW 11, and maintains the automatic driving. The control content identification unit 32 identifies the current set speed, the legal speed, and the fact that automatic driving is being executed from the vehicle state information. Then, as shown in FIG. 3C, the display control unit 33 causes the display device 2 to display a message image 54 of the current set speed (90km / h) and an icon image 52 as images showing the current control content of the vehicle 1.

[0039] A specific example of the switch 10 other than the steering SW 11 will be described. For example, the drive control device 20 measures the distance to the preceding vehicle by the automatic speed control function and the automatic steering control function, and controls the accelerator / brake operation and the steering actuator operation so that the vehicle travels while maintaining a vehicle distance according to the vehicle speed with a set speed as the upper limit. As an example of a condition for maintaining such automatic driving, the driving mode is the normal mode. While the vehicle 1 is traveling in automatic driving, the driver performs a preliminary operation of the driving mode switch 13 to switch the driving mode switch 13 from the normal mode to the snow mode. The information acquisition unit 31 acquires vehicle state information at the time of receiving a preliminary command from the driving mode switch 13. The vehicle state information includes information indicating that automatic driving is being performed. The control content specification unit 32 specifies that automatic driving is released by switching from the normal mode to the snow mode based on the vehicle state information. That is, the control content specification unit 32 specifies "switching the driving mode from the normal mode to the snow mode" and "cancellation of automatic driving" as the control content of the vehicle 1. Then, the display control unit 33 causes the display device 2 to display an image indicating that the driving mode is switched from the normal mode to the snow mode and that the autonomous driving is cancelled.

[0040] A specific example of the automatic driving switch 14 will be described. For example, the conditions for executing automatic driving by the automatic steering control function are that the lane can be detected from the captured image of the camera 3 and that the position of the vehicle 1 can be measured by the GPS 5. When the vehicle 1 is traveling in normal driving rather than automatic driving, the driver performs a preliminary operation of the automatic driving switch 14 to switch from normal driving to automatic driving. At this time, the surrounding environment is in a state where the lane cannot be detected from the captured image of the camera 3 due to bad weather (lane detection impossible state). The information acquisition unit 31 acquires vehicle state information at the time of receiving a preliminary command from the automatic driving switch 14. The vehicle state information includes the captured image of the camera 3. The automatic driving control unit 34 identifies the lane detection impossible state from the captured image of the camera 3 and determines that automatic driving cannot be executed. The control content identification unit 32 identifies "automatic driving execution impossible" as the control content of the vehicle 1. Then, the display control unit 33 causes the display device 2 to display an image indicating that automatic driving cannot be executed.

[0041] Furthermore, when the position of the vehicle 1 cannot be determined by the GPS 5, the information acquisition unit 31 acquires, as vehicle state information, information indicating that positioning is not possible from the GPS 5. The autonomous driving control unit 34 identifies the state in which positioning is not possible from the positioning result of the GPS 5, and determines that autonomous driving cannot be performed. The control content identification unit 32 identifies "autonomous driving cannot be performed" as the control content of the vehicle 1. Then, the display control unit 33 causes the display device 2 to display an image indicating that autonomous driving cannot be performed.

[0042] As another example, if sensors such as the distance measuring device 4 and the vehicle speed sensor 6 do not operate normally, the autonomous driving cannot be performed. Ranging device 4 and vehicle speed sensor 6, etc., and obtain sensor detection results as vehicle state information. The sensor detection result indicates a detection error. The autonomous driving control unit 34 identifies the sensor detection error and determines that autonomous driving cannot be performed. The control content identification unit 32 identifies "autonomous driving cannot be performed" as the control content of the vehicle 1. Then, the display control unit 33 causes the display device 2 to display an image indicating that autonomous driving cannot be performed.

[0043] As another example, if the current position of the vehicle 1 is not covered by the high-precision map, the hands-off mode cannot be maintained. Upon receiving a backup command from the automatic driving switch 14, the information acquisition unit 31 acquires the current position of the vehicle 1 from the GPS 5 and map information from the map database 7 as vehicle status information. The automatic driving control unit 34 determines whether the current position of the vehicle is covered by the high-precision map, and if it is not covered by the high-precision map, determines that automatic driving in the hands-off mode is not possible. The control content specification unit 32 specifies the automatic driving control Part 34 From the determination result, "automated driving in hands-off mode cannot be executed" is specified as the control content of the vehicle 1. Then, the display control unit 33 causes the display device 2 to display an image indicating that automatic driving in hands-off mode cannot be executed.

[0044] As another example, when another vehicle is approaching vehicle 1, autonomous driving using the lane change assist function cannot be performed. When an emergency command is received from lane change switch 15 during autonomous driving, information acquisition unit 31 acquires the image captured by camera 3 and / or the detection result of distance measurement device 4 as vehicle state information. From the image captured by camera 3 and / or the detection result of distance measurement device 4, autonomous driving control unit 34 determines whether or not another vehicle is approaching the periphery of vehicle 1, and if another vehicle is approaching the periphery of vehicle 1, determines that lane changing by autonomous driving is not possible. Control content identification unit 32 determines the autonomous driving control Part 34 From the determination result, "lane change by autonomous driving is not possible" is specified as the control content of the vehicle 1. Then, the display control unit 33 causes the display device 2 to display an image indicating that lane change control by autonomous driving cannot be executed.

[0045] Next, a display control method executed by the controller 30 will be described with reference to Fig. 4. Fig. 4 is a flowchart showing the flow of control processing by the controller 30.

[0046] In step S1, when the driver touches the switch 10 to operate the switch 10 as a backup operation, the controller 30 receives a backup command from the switch 10. In step S2, the information acquisition unit 31 of the controller 30 acquires vehicle state information at the time of receiving the backup command. In step S3, the control content identification unit 32 of the controller 30 identifies the control content of the vehicle 1 to be executed in response to the operation command of the switch 10, based on the vehicle state information.

[0047] In step S4, the display control unit 33 of the controller 30 32 The control content specified by the is displayed on the display device 2. In step S5, the controller 30 judges whether or not an operation command for the switch 10 has been received, and judges whether or not a confirmation operation for the switch 10 has been performed. If it is determined that the switch 10 has not been confirmed, in step S6, the controller 30 judges whether or not the state in which the switch 10 is being touched (touch state) has been released. For example, if the controller 30 does not receive an operation command within a predetermined time from the time when it received a standby command for the switch 10, the touch state is released. situation It is determined that the touch state has been released. If the touch state has not been released, the controller 30 executes the control process of step S4. If the touch state has been released, in step S7, the display control unit 33 of the controller 30 returns the display screen displayed in the control process of step S3 to the original display screen. Then, the controller 30 ends the control flow.

[0048] When it is determined in the determination process of step S5 that the confirmation operation of the switch 10 has been performed, in step S8, the automatic driving control unit 34 of the controller 30 executes the control content according to the operation command of the switch 10. Then, the controller 30 ends the control flow.

[0049] As described above, the display control method and display control device according to the present embodiment acquire vehicle state information indicating at least one of the current state of the vehicle 1 and the state of the surrounding environment of the vehicle 1, and when the switch 10 is operated as a preliminary operation, specifies the control content of the vehicle 1 to be executed by the operation command based on the vehicle state information, and displays the control content of the vehicle 1 on the display device 2 before the confirmation operation of the switch 10. This allows the occupant to recognize the control content of the vehicle 1 before the confirmation operation of the operation switch. As a result, the driver can grasp the vehicle state that occurs after the confirmation operation of the switch 10, and can operate the switch 10 with confidence.

[0050] In this embodiment, among the in-vehicle devices other than the device to be operated by the switch 10, the control contents of the devices executed by the operation command of the switch 10 are displayed on the display device 2 before the confirmation operation of the switch 10. This allows the occupant to recognize the control contents of the in-vehicle devices other than the device to be operated that are affected by the operation of the switch 10 before the confirmation operation of the operation switch.

[0051] The above-described embodiments are described for the purpose of facilitating understanding of the present invention, and are not described for the purpose of limiting the present invention. Therefore, the elements disclosed in the above embodiments are intended to include all design modifications and equivalents that fall within the technical scope of the present invention. [Explanation of symbols]

[0052] 1. Vehicle 2...Display device 3. Camera 4…Distance measuring device 5...Operation switch 6...Vehicle speed sensor 7. Map database 10...Switch (SW) 11...Steering switch (steering SW) 12...VDC switch (VDCSW) 13...Driving mode switch (Driving mode SW) 14...Automatic driving switch (Automatic driving SW) 15...Lane change switch (lane change SW) 20...Drive control device 30…Controller 31…Information acquisition department 32...Control content specification unit 33...Display control unit 34...Automatic driving control unit

Claims

1. a switch that is operated by a preliminary operation and outputs an operation command to an operation target device by a confirmation operation after the preliminary operation; a controller for controlling a display device and an in-vehicle device other than the operation target device, The controller: Acquire vehicle state information indicating at least one of a current state of a vehicle and a state of an environment surrounding the vehicle; When the switch is operated by the preliminary operation, it is determined based on the vehicle state information that the control content of the operation target device to be executed by the operation command and that the operation of the in-vehicle device affected by the operation command among the in-vehicle devices other than the operation target device is to be released; a display control device that causes the display device to display, before the confirmation operation, the control content and a message indicating that the operation of the in-vehicle device affected by the operation command will be released.

2. 2. The display control device according to claim 1, The controller: Specifying that the automatic driving is cancelled when the switch is operated by the preliminary operation, A display control device that displays on the display device, before the confirmation operation, that the automatic driving will be canceled.

3. 3. The display control device according to claim 1, The display device is a display control device which is at least one of a head-up display which displays an image on glass or a projection panel located in front of the vehicle, a display installed in an instrument panel, and a display included in a navigation system.

4. In the display control device according to any one of claims 1 to 3, A display control device, wherein an operating method for the preliminary operation and an operating method for the confirmation operation are different from each other.

5. The display control device according to any one of claims 1 to 4, The switch detects a touch operation as the preparatory operation, and detects either a touch operation with a longer contact time than the touch operation for the preparatory operation or an operation of pressing the part touched during the preparatory operation as the confirmation operation.

6. The display control device according to any one of claims 1 to 5, the switch is a switch for operating the operation target device, The controller: a display control device that displays, on the display device before the confirmation operation, the control content of a device that is to be controlled by the operation command, among the in-vehicle devices other than the device to be operated;

7. A display control method executed by a processor, comprising: The processor, Acquire vehicle state information indicating at least one of a current state of a vehicle and a state of an environment surrounding the vehicle; when a switch that outputs an operation command to an operation target device by a confirmation operation after a preliminary operation is operated in the preliminary operation, it is determined based on the vehicle state information that the control content of the operation target device to be executed by the operation command and that the operation of the in-vehicle device that is affected by the operation command among the in-vehicle devices other than the operation target device is to be released; a display control method for displaying, on a display device, the control content and a message indicating that the operation of the in-vehicle device affected by the operation command will be released, before the confirmation operation;