Display control device and display control method

Abstract

This display control device comprises: a switch (10) which outputs an operation command in response to a preliminary operation and a confirmation operation after the preliminary operation; and a controller (30) which controls a display device (2). The controller (30) acquires vehicle state information indicating the current state of a vehicle (1) and / or the state of environment surrounding the vehicle (1), and in the case where the switch (10) has been operated by the preliminary operation, specifies, on the basis of the vehicle state information, the details of control to be executed on the vehicle (1) by the operation command and displays the details of control on the display device (2) before the confirmation operation.

Description

[Technical Field]

[0001] The present invention relates to a display control device and a display control method. This application claims priority based on Japanese Patent Application No. 2022-078800, filed on May 12, 2022, and for designated states where incorporation by reference of documents is permitted, the contents of the above application are incorporated by reference into this application and made part of the description of this application. [Background technology]

[0002] Vehicle information display devices that allow easy understanding of the operation status have been known (for example, Patent Document 1). The vehicle information display device described in Patent Document 1 has operation switches arranged on the steering wheel for controlling devices to be operated, such as an air conditioner device, installed inside the vehicle. On the windshield WS of the vehicle, switch images corresponding to the operation switches are displayed, and the display on the steering wheel Operation switch The display reflects the layout. The operation switches are also equipped with touch sensors, so when the user touches them, the corresponding switch image is highlighted. When an operation switch is operated, an operation signal is sent to the device, which performs an operation according to the operation signal and returns its operating status, and an operation response image indicating the operating status is displayed on the windshield WS. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2007-106353 Summary of the Invention [Problem to be solved by the invention]

[0004] However, the vehicle information display device simply displays a switch image on the windshield that reflects the layout of the operation switches, and the occupant cannot recognize the vehicle control content that is executed by operating the operation switch until after the occupant has performed a confirmation operation to confirm the operation command for vehicle control.

[0005] The problem to be solved by the present invention is to provide a display control device and a display control method that enable an occupant to recognize the vehicle control content that will be executed by operating a switch before the switch is confirmed. [Means for solving the problem]

[0006] The present invention acquires vehicle status information, Based on the vehicle status information at the time of receiving the backup command from the switch, the confirmation operation of the switch indicates that the set speed after the change will be higher than the legal speed limit, and that automatic driving will be canceled. Identify this and before confirming the switch operation, The speed set by the confirmation operation exceeds the legal speed limit. Autonomous driving is cancelled Image showing The above problem is solved by displaying the above on a display device. [Effects of the Invention]

[0007] According to the present invention, it is possible to make the occupant aware of the vehicle control content that will be executed by operating the switch before the switch is confirmed. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a block diagram of a vehicle including a display control device according to this embodiment. [Figure 2A] FIG. 2A is a conceptual diagram showing the state of the interior of the vehicle in front of the driver. [Figure 2B] FIG. 2B is a conceptual diagram showing the state of the interior of the vehicle in front of the driver. [Figure 2C] FIG. 2C is a conceptual diagram showing the state of the interior of the vehicle in front of the driver. [Figure 3A] FIG. 3A is a conceptual diagram showing the state of the interior of the vehicle in front of the driver. [Figure 3B]FIG. 3B is a conceptual diagram showing the state of the interior of the vehicle in front of the driver. [Figure 3C] FIG. 3C is a conceptual diagram showing the state of the interior of the vehicle in front of the driver. [Figure 4] FIG. 4 is a flowchart showing a processing flow of display control by the controller. DETAILED DESCRIPTION OF THE INVENTION

[0009] An embodiment of a display control device according to the present invention will be described with reference to the accompanying drawings. FIG. 1 is a block diagram illustrating an example of the configuration of a vehicle including a display control device according to this embodiment. As illustrated in FIG. 1, the vehicle 1 includes a display device 2, a camera 3, a distance measuring device 4, a GPS 5, a vehicle speed sensor 6, a map database 7, a switch 10, a drive control device 20, and a controller 30. The display control device according to this embodiment is a device including the controller 30, and receives an operation command from a switch 10 capable of at least two-stage operation. In a first-stage operation, the display control device displays on the display device 2 the control details to be executed in response to the operation command of the switch 10. In addition, in a second-stage operation of the switch 10, the display control device executes control processing of in-vehicle devices based on the control details based on the operation command. In other words, in order to confirm the operation command for vehicle control, the display control device displays on the display device 2 the control details to be executed in response to the operation command before the second-stage switch operation. Because the occupant of the vehicle 1 can recognize the vehicle control details to be executed by the second-stage switch operation through the display device 2 before the second-stage switch operation, the occupant of the vehicle 1 can operate the switch 10 with confidence.

[0010] The display device 2 is a display for displaying the control details of the vehicle 1 executed in response to an operation command from the switch 10, and is, for example, at least one of a head-up display, a display installed on an instrument panel, and a display included in a navigation system. The head-up display is a display device that displays images on glass or a projection board located in front of the vehicle. The display device 2 displays the control details of the vehicle 1 as message images formed of character strings or graphic images such as icons. Based on a control command transmitted from the controller 30, the display device 2 generates an image for display and displays it on the screen.

[0011] The camera 3 is a camera for capturing images of the surrounding environment of the vehicle 1, and is installed on the vehicle 1, and includes a front camera, a rear camera, and / or a side camera of the vehicle 1. The captured image of the camera 3 includes vehicle state information indicating the state of the surrounding environment of the vehicle 1, and 1 It is used for automatic driving control.

[0012] The distance measuring device 4 is a sensor for detecting the surrounding environment of the vehicle, and is installed on the vehicle 1. It includes a forward radar for detecting obstacles ahead of the vehicle, and / or a rearward radar for detecting obstacles behind the vehicle, and a side radar for detecting obstacles on the left and right sides of the vehicle. The detection data of the distance measuring device 4 includes vehicle state information indicating the state of the surrounding environment of the vehicle, and 1 It is used for automatic driving control.

[0013] The GPS (navigation system) 5 has a GPS receiver (GPS) that receives signals from satellites, and is a system that measures the current position of the vehicle 1. The vehicle speed sensor 6 detects the speed of the vehicle 1 as the current state (traveling state) of the vehicle. Note that, although the vehicle speed sensor 6 is given as an example in FIG. 1 as a sensor that detects the current state of the vehicle, other sensors such as an acceleration sensor and a torque sensor may also be used.

[0014] The map database 7 stores three-dimensional high-precision map information including location information of various facilities and specific points. The three-dimensional high-precision map information is based on road shapes detected when a data acquisition vehicle travels on actual roads. The three-dimensional high-precision map information is map information that associates detailed and highly accurate location information, such as curved roads and the size of those curves (for example, curvature or curvature radius), road junctions, branching points, toll booths, and locations where the number of lanes decreases, together with map information, as three-dimensional information. Note that high-precision maps do not cover all roads, and the map database 7 stores standard maps (SD maps) to cover information on roads and other areas not covered by high-precision maps (HD maps).

[0015] The switch (SW) 10 is a switch for operating a device to be operated and is capable of multi-stage operation. The switch 10 has at least two stages of operation. Of the two stages of operation of the switch 10, the first operation corresponds to a preliminary operation, and the second operation corresponds to a final operation. When the switch 10 is operated as a preliminary operation by an occupant, it outputs a preliminary command indicating the preliminary operation to the controller 30, and when it is operated as a final operation, it outputs an operation command indicating the final operation (operation finalization command) to the controller 30. The switch 10 has an operation mechanism that allows the operation methods for the preliminary operation and the final operation to be different from each other. The switch 10 is a switch such as a switch equipped with an electrostatic or pressure-sensitive touch sensor (electrostatic switch, pressure-sensitive switch), a two-stage switch (mechanical switch) that can be pressed halfway and fully.

[0016] For example, if the switch 10 is a switch equipped with a touch sensor, the switch 10 detects an input operation by a touch operation as a preparatory operation and outputs a preparatory command to the controller 30. The switch 10 also detects a touch operation with a longer contact time than the touch operation for the preparatory operation as a confirmation operation and outputs a confirmation command to the controller 30. The touch operation for the preparatory operation is, for example, a tap operation with a short contact time, and the touch operation for the confirmation operation is, for example, a touch operation with a long contact time. Note that it is preferable that the touch operation for the preparatory operation and the touch operation for the confirmation operation be different operation methods; for example, the preparatory operation may be a tap operation and the confirmation operation may be a double-tap operation.

[0017] For example, when the switch 10 is a two-stage switch, the switch 10 detects an input operation (half-press) by a touch operation as a preliminary operation, and outputs a preliminary command to the controller 30. The switch 10 also detects an operation (full press) of pressing the part touched in the preliminary operation as a confirmation operation, and outputs an operation command to the controller 30.

[0018] The switches 10 are various switches mounted on the vehicle 1, and include a steering switch (steering SW) 11, a VDC switch (VDCSW) 12, a driving mode switch (driving mode SW) 13, an automatic driving switch (automatic driving SW) 14, and a lane change switch (lane change SW) 15. The steering SW 11 is a switch provided on the steering wheel, such as a touch sensor installed on the rim or a mechanical switch installed on a spoke. The touch sensor on the rim detects when the driver (passenger) touches the steering wheel. Spoke part The switches include switches for operating the navigation system, video / audio system, etc., switches for switching driving modes in autonomous driving control, switches for adjusting the set vehicle speed in autonomous driving control, and switches for adjusting the distance between vehicles in autonomous driving control.

[0019] The VDCSW 12 is a switch that switches on and off a system (vehicle dynamics control system: VDC system) that prevents skidding of the vehicle 1. The driving mode SW 13 is a switch that switches on and off driving modes such as snow mode and sport mode. The autonomous driving switch 14 is a switch that switches on and off autonomous driving. The lane change switch 15 is a switch that switches on and off a lane change assist function during autonomous driving. Note that not all switches included in the switch 10, such as the steering switch 11, need to be switches that can be operated in multiple stages.

[0020] The drive control device 20 controls the running of the host vehicle. For example, when the host vehicle is running at a constant speed using the automatic speed control function, the drive control device 20 controls the operation of the drive mechanism and the brakes to accelerate and decelerate the host vehicle so that the set speed is reached, and to maintain the running speed. The drive control device 20 also controls the operation of the drive mechanism and the brakes in a similar manner when the host vehicle is running following a preceding vehicle using the automatic speed control function. Note that the control of the operation of the drive mechanism includes the operation of the internal combustion engine in an engine vehicle and the operation of the traction motor in an electric vehicle. In addition, in a hybrid vehicle, it also includes the torque distribution between the internal combustion engine and the traction motor.

[0021] Furthermore, the drive control device 20 performs steering control of the host vehicle by controlling the operation of the steering actuator in addition to the operation of the drive mechanism and brakes using an automatic steering control function. For example, when performing lane keeping control using the automatic steering control function, the drive control device 20 detects lane markers for the host vehicle's lane and controls the host vehicle's traveling position in the vehicle's width direction so that the host vehicle travels at a predetermined position within the lane. When performing a lane change assist function, an overtaking assist function, or a route driving assist function using the automatic steering control function, the drive control device 20 controls the host vehicle's traveling position in the vehicle's width direction so that the host vehicle changes lanes. Furthermore, when performing a right / left turn assist function using the automatic steering control function, the drive control device 20 performs driving control to turn right or left at an intersection, etc. The drive control device 20 can also perform automatic driving depending on whether the mode is a hands-on mode or a hands-off mode. The hands-on mode refers to a mode in which the automatic steering control does not operate unless the driver holds the steering wheel, and the hands-off mode refers to a mode in which the automatic steering control operates even if the driver takes his or her hands off the steering wheel. The drive control device 20 controls the driving of the host vehicle according to control commands from the controller 30. Note that other known driving control methods can also be used by the drive control device 20.

[0022] The controller 30 has functions such as acquiring vehicle state information, identifying vehicle control content, controlling the display device 2, and controlling autonomous driving. The controller 30 has a processor that executes the display control method according to this embodiment, and includes at least an information acquisition unit 31, a control content identification unit 32, a display control unit 33, and an autonomous driving control unit 34 as functional blocks. Each functional block executes its function through cooperation between software and hardware (processor). Note that the functional blocks of the controller 30 do not necessarily need to be divided into functional blocks as shown in FIG. 1, and the number of functional blocks is not limited. The controller 30 also has a CPU, ROM, RAM, etc. to operate each functional block.

[0023] The information acquisition unit 31 acquires vehicle state information from the camera 3, etc. The vehicle state information indicates at least one of the current state of the vehicle 1 and the state of the surrounding environment of the vehicle 1, and corresponds to the image captured by the camera 3, the detection value of the distance measurement device 4, the vehicle position measured by the GPS 5, and the vehicle speed detected by the vehicle speed sensor 6. The vehicle state information also includes information on the automatic driving controlled by the drive control device 20. The current state of the vehicle 1 is or This is the state of the vehicle while it is parked and is represented, for example, by the current position of the vehicle 1, the vehicle speed, or the acceleration of the vehicle 1. The information acquisition unit 31 acquires the current position of the vehicle from the GPS 5 and the vehicle speed from the vehicle speed sensor 6. The state of the environment around the vehicle 1 is represented by the image captured by the camera 3 or the detection value of the distance measuring device 4.

[0024] When the switch 10 is operated in a preparatory operation, the control content identification unit 32 identifies the control content of the vehicle 1 to be executed by the operation command of the switch 10 based on the vehicle state information. When the occupant operates the switch 10 in a preparatory operation, the control content identification unit 32 receives a preparatory command from the switch 10. Since the switch 10 is a switch that allows multi-stage operation, by receiving the preparatory command, the control content identification unit 32 can identify the possibility that the switch 10 will be operated in a definitive operation after the preparatory command. For example, when a preparatory operation of the steering switch 11 is performed, the control content identification unit 32 identifies the possibility that the switch 10 will be operated in a definitive operation after the preparatory operation of the steering switch 11. 1 It can be determined that the confirmation operation will be performed.

[0025] The control content specifying unit 32 specifies the control content of the vehicle 1 to be executed in response to the operation command of the switch 10, based on the backup command of the switch 10. 10 Before receiving the operation command, the control content of the vehicle 1 is identified. The control content of the vehicle 1 includes at least the control content of the device to be operated by the switch 10. Furthermore, if the operation command affects the control of an in-vehicle device other than the device to be operated, the control content of the vehicle 1 also includes the control content of the affected in-vehicle device. An example will be described below.

[0026] An example of a condition for maintaining autonomous driving is that the VDCSW 12 is on. While the vehicle 1 is traveling in autonomous driving mode, the driver performs a preparatory operation of the VDCSW 12 to switch the VDCSW 12 from on to off. When a preparatory command is received from the VDCSW 12, the control content identification unit 32 acquires vehicle state information at the time of the preparatory operation from the information acquisition unit 31. If the vehicle is in autonomous driving mode, the vehicle state information includes information indicating that autonomous driving is being performed. From the preparatory operation of the VDCSW 12, the control content identification unit 32 identifies that the VDC system, which is the control target of the VDCSW 12, is switching from on to off. The switching of the VDC system from on to off is the control content identified by the control content identification unit 32.

[0027] Furthermore, the control content identification unit 32 identifies, from the preliminary operation of the VDCSW 12, that the switching of the VDC system from on to off will result in the cancellation of autonomous driving. That is, the engine control device 20 corresponds to an in-vehicle device other than the operation target device that is affected by the operation command of the VDCSW 12. Cancellation of autonomous driving is the control content identified by the control content identification unit 32. As a result, the control content identification unit 32 can identify the control content of the operation target device (VDC system) that will be executed by the operation command of the VDCSW 12 before the confirmation operation of the VDCSW 12. Furthermore, the control content identification unit 32 can identify the control content of the device (engine control device 20) that will be executed by the operation command of the VDCSW 12, among the in-vehicle devices other than the operation target device (VDC system), before the confirmation operation of the VDCSW 12.

[0028] The display control unit 33 causes the display device 2 to display the control content identified by the control content identification unit 32 before the driver performs the confirmation operation of the switch 10. spareBy performing an operation, the control content is displayed on the display device 2 so that the driver can recognize the control content of the vehicle 1. As in the above example, assume that the driver performs a preliminary operation of the VDCSW 12 to switch the VDCSW 12 from on to off while the vehicle 1 is traveling in autonomous driving. The control content identification unit 32 identifies "switching the VDC system from on to off" and "cancelling autonomous driving" as the control content of the vehicle 1. The display control unit 33 then causes the display device 2 to display images indicating that the VDC system will be switched from on to off and that autonomous driving will be canceled. Specifically, the display control unit 33 displays message images such as "The VDC system will be switched from on to off" and "Autonomous driving will be canceled." Because the display of the control content is performed before the confirmation operation of the switch 10, the driver recognizes that the confirmation operation of the switch 10 will not only switch the VDC system from on to off but also cancel autonomous driving. This allows the driver to understand the vehicle state that will occur as a result of the confirmation operation before the driver confirms the operation of the switch 10 related to vehicle control, and therefore allows the driver to operate the switch 10 with peace of mind.

[0029] The autonomous driving control unit 34 controls the drive control device 20 in response to an operation command for the switch 10. For example, if a confirmation operation for switching the lane change switch 15 from on to off is performed during autonomous driving, the autonomous driving control unit 34 transmits a control command for executing the lane change assist function to the drive control device 20. Furthermore, if an operation command for the switch 10 is performed to cancel autonomous driving, the autonomous driving control unit 34 transmits a control command for canceling autonomous driving to the drive control device 20. For example, as in the above example, while the vehicle 1 is traveling in autonomous driving mode, the driver performs a preparatory operation for the VDCSW 12 to switch the VDCSW 12 from on to off, and the display control unit 33 causes the display device 2 to display an image indicating that the VDC system is switching from on to off and that autonomous driving is being canceled. Thereafter, if the driver performs a confirmation operation for the VDCSW 12, the autonomous driving control unit 34 transmits a control command for switching the VDC system from on to off to the VDC system, and transmits a control command for canceling autonomous driving to the drive control device 20.

[0030] Specific examples of control processing by the controller 30 and display screens of the display device 2 will be described with reference to Figures 2A to 2C and Figures 3A to 3C. Figures 2A to 2C and Figures 3A to 3C are conceptual diagrams showing the state of the interior of the vehicle ahead as seen from the driver. Figures 2A to 2C and Figures 3A to 3C are diagrams for explaining the transition of display screens that are switched in response to the operation of the switch 10. In the specific examples described below, the display device 2 is a head-up display. The steering switch 11 is a switch for increasing the set speed in autonomous driving, and the set speed increases by 10 km / h with one confirmation operation.

[0031] In the example of FIG. 2A , the set speed for autonomous driving is set to 80 km / h, and the current speed of the vehicle 1 is 80 km / h. The speed limit is also 80 km / h. While the vehicle is traveling, the information acquisition unit 31 acquires vehicle state information from the GPS 5, the vehicle speed sensor 6, the map database 7, and the drive control device 20. The vehicle state information includes, as information indicating the current state of the vehicle, the current position of the vehicle, the current vehicle speed, and the fact that autonomous driving is being performed, and also includes map information as information indicating the state of the environment surrounding the vehicle 1. Note that the information indicating the current state of the vehicle 1 may include, for example, the current steering angle, and the information indicating the environment surrounding the vehicle 1 may include an image captured by the camera 3.

[0032] The control content identification unit 32 identifies the current set speed and the legal speed from the vehicle state information. Then, as shown in Fig. 2A, the display control unit 33 displays a message image 41 of the current set speed (80 km / h) and an icon image 42 of the speed limit (80 km / h) on the display device 2 as images indicating the current control content of the vehicle 1.

[0033] When the driver touches the steering SW 11, the steering SW 11 detects a preparatory operation and outputs a preparatory command to the controller 30. The control content identification unit 32 identifies how the control content of the vehicle 1 will change when the steering SW 11 is confirmed, based on vehicle state information at the time the preparatory command is received. In the example of FIG. 2A, when the driver confirms the steering SW 11, the set vehicle speed becomes 90 km / h, which is higher than the speed limit (80 km / h), and therefore autonomous driving is canceled. The control content identification unit 32 identifies that the confirmation operation of the steering SW 11 causes the set speed to be higher than the legal speed and that autonomous driving is canceled as the vehicle control content to be executed in response to the steering SW 11 operation command. As shown in FIG. 2B, the display control unit 33 displays a message image 43, "Automated driving will be canceled because the speed limit will be exceeded," on the display device 2 in addition to the icon image 42, as an image indicating the control content to be executed in response to the steering SW 11 operation command.

[0034] When the driver presses the steering switch 11, the steering switch 11 detects the confirmation operation and outputs an operation command to the controller 30. Based on the operation command from the steering switch 11, the drive control device 20 changes the set speed from 80 km / h to 90 km / h and cancels autonomous driving. The information acquisition unit 31 acquires vehicle state information from the drive control device 20. The vehicle state information includes the change in the set speed from 80 km / h to 90 km / h and the cancellation of autonomous driving. The control content identification unit 32 identifies the current set speed, the legal speed, and the cancellation of autonomous driving from the vehicle state information. Then, as shown in FIG. 2C , the display control unit 33 displays the current set speed (90 km / h), a message image 44 indicating the cancellation of autonomous driving, and an icon image 42 on the display device 2 as images indicating the current control content of the vehicle 1.

[0035] Furthermore, when the driver touches the steering SW11 and the display device 2 displays the image shown in Figure 2B, and then the driver removes his / her finger from the steering SW11, the display control unit 33 returns the display screen of the display device 2 to the state shown in Figure 2A.

[0036] Next, specific examples of the control process by the controller 30 and the display screen of the display device 2 will be described with reference to Figures 3A to 3C. The specific example of Figures 3A to 3C differs from the specific example described above with reference to Figures 2A to 2C in that the speed limit is 100 km / h, but the other vehicle conditions are the same. Note that the following description will focus on the differences from the specific example of Figures 2A to 2C.

[0037] As shown in FIG. 3A, the display control unit 33 displays on the display device 2 a message image 51 of the current set speed (80 km / h) and an icon image 52 of the speed limit (100 km / h) as images indicating the current control content of the vehicle 1. When the driver touches the steering SW 11 and the controller 30 receives an emergency command for the steering SW 11, the control content specification unit 32 specifies how the control content of the vehicle 1 will change as a result of the confirmation operation of the steering SW 11, based on the vehicle state information at the time the emergency command was received. In the example of FIG. 3A, when the driver confirms the steering SW 11, the set vehicle speed becomes 90 km / h, but since the changed set vehicle speed (90 km / h) is lower than the speed limit (100 km / h), automatic driving is maintained. The control content specification unit 32 specifies that the confirmation operation of the steering SW 11 will maintain the set speed lower than the legal speed as the control content of the vehicle to be executed by the operation command of the steering SW 11. As shown in FIG. 3B, the display control unit 33 displays the icon image 52 In addition, a message image "Accelerating up to 90 km / h" 53 is displayed on the display device 2 as an image showing the control content executed in response to the operation command of the steering SW 11. The message image 53 allows the driver to understand what state the vehicle will be in as a result of the confirmation operation of the steering SW 11.

[0038] When the driver presses the steering switch 11, the drive control device 20 changes the set speed from 80 km / h to 90 km / h based on the operation command of the steering switch 11, and maintains autonomous driving. The control content identification unit 32 identifies the current set speed, the legal speed, and the fact that autonomous driving is being executed from the vehicle state information. Then, as shown in FIG. 3C, the display control unit 33 displays a message image 54 of the current set speed (90 km / h) and an icon image 52 on the display device 2 as images indicating the current control content of the vehicle 1.

[0039] Specific examples of switches 10 other than the steering switch 11 will be described. For example, the drive control device 20 uses an automatic speed control function and an automatic steering control function to measure the distance to a preceding vehicle and control the accelerator / brake operation and the steering actuator operation so that the vehicle travels while maintaining a vehicle-to-vehicle distance according to the vehicle speed, with a set speed as the upper limit. One example of a condition for maintaining such autonomous driving is that the driving mode is normal mode. While the vehicle 1 is traveling in autonomous driving mode, the driver performs a preliminary operation of the driving mode switch 13 to switch the driving mode switch 13 from normal mode to snow mode. The information acquisition unit 31 acquires vehicle state information at the time of receiving a preliminary command from the driving mode switch 13. The vehicle state information includes information indicating that autonomous driving is being performed. Based on the vehicle state information, the control content identification unit 32 identifies that switching from normal mode to snow mode will result in cancellation of autonomous driving. That is, the control content identification unit 32 identifies "switching the driving mode from normal mode to snow mode" and "cancellation of autonomous driving" as control contents of the vehicle 1. Then, the display control unit 33 causes the display device 2 to display an image indicating that the driving mode is switched from the normal mode to the snow mode and that the automatic driving is canceled.

[0040] A specific example of the autonomous driving switch 14 will be described. For example, conditions for executing autonomous driving using the automatic steering control function include the ability to detect lanes from images captured by the camera 3 and the ability to locate the position of the vehicle 1 using the GPS 5. While the vehicle 1 is traveling in normal driving mode rather than autonomous driving mode, the driver performs a preliminary operation of the autonomous driving switch 14 to switch from normal driving mode to autonomous driving mode. At this time, assume that the surrounding environment is in a state where lanes cannot be detected from images captured by the camera 3 (lane detection impossible state) due to bad weather. The information acquisition unit 31 acquires vehicle state information at the time a preliminary command is received from the autonomous driving switch 14. The vehicle state information includes images captured by the camera 3. The autonomous driving control unit 34 identifies the lane detection impossible state from the images captured by the camera 3 and determines that autonomous driving is not executable. The control content identification unit 32 identifies "autonomous driving execution impossible" as the control content for the vehicle 1. The display control unit 33 then displays an image indicating that autonomous driving is not executable on the display device 2.

[0041] Furthermore, if the position of the vehicle 1 cannot be determined by the GPS 5, the information acquisition unit 31 acquires, as vehicle state information, information indicating that positioning is not possible from the GPS 5. The autonomous driving control unit 34 identifies the state in which positioning is not possible from the positioning results of the GPS 5 and determines that autonomous driving cannot be performed. The control content identification unit 32 identifies "autonomous driving cannot be performed" as the control content for the vehicle 1. Then, the display control unit 33 causes the display device 2 to display an image indicating that autonomous driving cannot be performed.

[0042] As another example, if sensors such as the distance measuring device 4 and the vehicle speed sensor 6 do not operate normally, the autonomous driving cannot be performed. Ranging device 4 and vehicle speed sensor 6, etc., and acquires the sensor detection results as vehicle state information. The sensor detection results indicate a detection error. The autonomous driving control unit 34 identifies the sensor detection error and determines that autonomous driving cannot be performed. The control content identification unit 32 identifies "autonomous driving cannot be performed" as the control content for the vehicle 1. Then, the display control unit 33 causes the display device 2 to display an image indicating that autonomous driving cannot be performed.

[0043] As another example, if the current position of the vehicle 1 is not covered by a high-precision map, the hands-off mode cannot be maintained. When the information acquisition unit 31 receives a backup command from the automatic driving switch 14, it acquires the current position of the vehicle 1 from the GPS 5 and map information from the map database 7 as vehicle status information. The automatic driving control unit 34 determines whether the current position of the vehicle is covered by a high-precision map, and if it is not covered by a high-precision map, it determines that automatic driving in hands-off mode is not possible. The control content specification unit 32 determines whether the automatic driving control Part 34 From the determination result, "automated driving cannot be performed in hands-off mode" is identified as the control content of the vehicle 1. Then, the display control unit 33 causes the display device 2 to display an image indicating that automated driving cannot be performed in hands-off mode.

[0044] As another example, when another vehicle is approaching the vehicle 1, the autonomous driving using the lane change assist function cannot be performed. During autonomous driving, the information acquisition unit 31 acquires the captured image of the camera 3 and / or the detection result of the distance measurement device 4 as vehicle state information at the time of receiving a preliminary command from the lane change switch 15. The autonomous driving control unit 34 determines whether or not another vehicle is approaching the periphery of the vehicle 1 from the captured image of the camera 3 and / or the detection result of the distance measurement device 4, and if another vehicle is approaching the periphery of the vehicle 1, determines that lane changing by autonomous driving is not possible. The control content specification unit 32 specifies the autonomous driving control Part 34 From the determination result, "lane change by autonomous driving is not permitted" is identified as the control content of the vehicle 1. Then, the display control unit 33 causes the display device 2 to display an image indicating that lane change control by autonomous driving cannot be executed.

[0045] Next, a display control method executed by the controller 30 will be described with reference to Fig. 4. Fig. 4 is a flowchart showing the flow of control processing by the controller 30.

[0046] In step S1, when the driver touches switch 10 to operate the switch 10 as a backup operation, controller 30 receives a backup command from switch 10. In step S2, information acquisition unit 31 of controller 30 acquires vehicle state information at the time the backup command is received. In step S3, control content identification unit 32 of controller 30 identifies the control content of vehicle 1 to be executed in response to the operation command of switch 10, based on the vehicle state information.

[0047] In step S4, the display control unit 33 of the controller 30 32 The control content specified by the command is displayed on the display device 2. In step S5, the controller 30 determines whether or not a confirmation operation of the switch 10 has been received, by determining whether or not an operation command for the switch 10 has been received. If it is determined that a confirmation operation of the switch 10 has not been received, in step S6, the controller 30 determines whether or not the state in which the switch 10 is being touched (touch state) has been released. For example, if the controller 30 does not receive an operation command within a predetermined time from the time when it received a preliminary command for the switch 10, the controller 30 releases the touch state. situation If the touch state is not released, the controller 30 executes the control process of step S4. If the touch state is released, in step S7, the display control unit 33 of the controller 30 returns the display screen displayed in the control process of step S3 to the original display screen. Then, the controller 30 ends the control flow.

[0048] If it is determined in the determination process of step S5 that a confirmation operation of the switch 10 has been performed, then in step S8, the automatic driving control unit 34 of the controller 30 executes control content according to the operation command of the switch 10. Then, the controller 30 ends the control flow.

[0049] As described above, the display control method and display control device according to this embodiment acquire vehicle state information indicating at least one of the current state of the vehicle 1 and the state of the surrounding environment of the vehicle 1, and when the switch 10 is operated as a preliminary operation, identify the control content of the vehicle 1 to be executed by the operation command based on the vehicle state information, and display the control content of the vehicle 1 on the display device 2 before the confirmation operation of the switch 10. This allows the occupant to recognize the control content of the vehicle 1 before the confirmation operation of the operation switch. As a result, the driver can understand the vehicle state that will occur after the confirmation operation of the switch 10, and can operate the switch 10 with confidence.

[0050] Furthermore, in this embodiment, among the in-vehicle devices other than the device to be operated by the switch 10, the control content of the device to be executed by the operation command of the switch 10 is displayed on the display device 2 before the confirmation operation of the switch 10. This allows the occupant to recognize the control content of the in-vehicle devices other than the device to be operated that will be affected by the operation of the switch 10 before the confirmation operation of the operation switch.

[0051] It should be noted that the above-described embodiments have been described to facilitate understanding of the present invention, and are not intended to limit the present invention. Therefore, each element disclosed in the above-described embodiments is intended to include all design modifications and equivalents that fall within the technical scope of the present invention. [Explanation of symbols]

[0052] 1...Vehicle 2...Display device 3. Camera 4…Distance measuring device 5...Operation switch 6...Vehicle speed sensor 7. Map database 10...Switch (SW) 11...Steering switch (steering SW) 12...VDC switch (VDCSW) 13...Driving mode switch (Driving mode SW) 14...Automatic driving switch (automatic driving SW) 15...Lane change switch (lane change SW) 20...Drive control device 30...Controller 31…Information acquisition department 32...Control content specification unit 33...Display control unit 34...Automatic driving control unit

Claims

1. a switch that, when operated as a preliminary operation, outputs a preliminary command indicating the preliminary operation, and outputs an operation command to an operation target device when a confirmation operation is performed after the preliminary operation; a controller that controls the display device and controls automatic operation, The switch is a switch for adjusting a set speed in automatic driving, The controller Acquire vehicle state information indicating at least one of a current state of the vehicle and a state of the surrounding environment of the vehicle; Identifying the current set speed and legal speed from the vehicle state information; Identifying, from the vehicle state information at the time of receiving the preliminary command, that the set speed after the change will be higher than the legal speed due to the confirmation operation and that the automatic driving will be canceled; A display control device that displays on the display device, before the confirmation operation, an image indicating that the automatic driving will be canceled because the set speed set by the confirmation operation exceeds the legal speed.

2. 2. The display control device according to claim 1, The display device is a display control device that is at least one of a head-up display that displays an image on glass or a projection panel located in front of the vehicle, a display installed on an instrument panel, and a display included in a navigation system.

3. 3. The display control device according to claim 1, A display control device, wherein an operation method for the preliminary operation and an operation method for the confirmation operation are different from each other.

4. 3. The display control device according to claim 1, The switch detects a touch operation as the preparatory operation, and detects either a touch operation with a longer contact time than the touch operation for the preparatory operation or an operation of pressing the part touched in the preparatory operation as the confirmation operation.

5. A display control method executed by a processor, comprising: The processor: Acquire vehicle state information indicating at least one of a current state of the vehicle and a state of the surrounding environment of the vehicle; Identifying the current set speed and legal speed from the vehicle state information; a switch that, when operated by a preparatory operation, outputs a preparatory command indicating the preparatory operation, and outputs an operation command to an operation target device by a confirmation operation after the preparatory operation, and when the switch for adjusting the set speed in autonomous driving is operated by the preparatory operation, it is determined from the vehicle state information at the time of receiving the preparatory command that, by the confirmation operation, the set speed after the change will be higher than the legal speed, and that autonomous driving will be canceled; A display control method that displays on a display device, before the confirmation operation, an image indicating that the set speed set by the confirmation operation exceeds the legal speed and therefore the automatic driving will be canceled.

Images