Vehicle display control device and vehicle display control method

Abstract

This vehicle display control device comprises: a travel control specifying section (102) that specifies that prescribed travel control, which is predetermined travel control, is performed in autonomous driving; and a display control section (107) that controls a display on a driver-side display device, which is a display device dedicated to a driver and mounted in a host vehicle, and a display on a passenger-side display device, which is a display device mounted in the host vehicle and can be used by a passenger of the host vehicle other than the driver. The display control section (107) causes not only the driver-side display device but also the passenger-side display device to show a control content display, which is a display indicating the implementation contents of the prescribed travel control, on the basis of a fact that the travel control specifying section (102) specifies that the prescribed travel control is performed during autonomous driving without an obligation of supervision.

Description

Vehicle display control device and vehicle display control method CROSS-REFERENCE TO RELATED APPLICATIONS

[0001] This application is based on Patent Application No. 2024-61001 filed in Japan on April 4, 2024, the contents of which are incorporated by reference in their entirety.

[0002] The present disclosure relates to a vehicle display control device and a vehicle display control method.

[0003] Autonomous driving technology that allows vehicles to drive autonomously is known. The SAE defines levels of automation ranging from levels 0 to 5. Level 0 is a level where the driver performs all driving tasks without system intervention. Level 0 corresponds to so-called manual driving. Level 1 is a level where the system assists with either steering or acceleration / deceleration. Level 2 is a level where the system assists with both steering and acceleration / deceleration. Levels 1 and 2 are autonomous driving in which the driver has the supervisory responsibility for safe driving (hereinafter simply referred to as supervisory responsibility). Level 3 is a level where the system can perform all driving tasks in specific locations such as highways, and the driver takes over driving operations in emergencies. Level 4 is a level where the system can perform all driving tasks except under specific circumstances such as inoperable roads or extreme environments. Level 5 is a level where the system can perform all driving tasks in all environments. Levels 3 and above are non-supervisory autonomous driving in which the driver has no supervisory responsibility. For example, Patent Document 1 discloses a technology for controlling lane changes (hereinafter referred to as lane change control) during autonomous driving.

[0004] Furthermore, in automated driving without supervisory obligation, the driver is permitted to perform a second task other than driving. The driver can perform the second task using an in-vehicle display device dedicated to the driver (hereinafter referred to as the driver's display device). Meanwhile, passengers other than the driver can also perform actions equivalent to the second task using an in-vehicle display device that can be used by passengers (hereinafter referred to as the passenger's display device).

[0005] JP 2011-162132 A

[0006] During autonomous driving, in addition to lane changes, offset control may also be implemented, which involves moving forward, backward, left, or right within the same lane to maintain a safe distance from surrounding vehicles. Lane change control and offset control are performed by the system's judgment, not by driver operation. During autonomous driving without a monitoring obligation, the driver performs a second task, and situations arise where the driver is not aware of the vehicle's operation. Therefore, during autonomous driving without a monitoring obligation, passengers are more likely to feel uneasy about the driving control than when the driver is driving the vehicle.

[0007] One object of this disclosure is to provide a vehicle display control device and a vehicle display control method that make it possible for passengers to feel less anxious about driving control even during autonomous driving without a monitoring obligation.

[0008] The symbols in parentheses in the claims indicate a correspondence with the specific means described in the embodiments described below as one aspect, and do not limit the technical scope of the present disclosure.

[0009] In order to achieve the above object, the vehicle display control device disclosed herein is a vehicle display control device that can be used in a vehicle that performs autonomous driving, and is equipped with a driving control identification unit that identifies that a predetermined driving control will be performed during autonomous driving, and a display control unit that controls the display on a driver's side display device, which is a display device provided in the vehicle exclusively for the driver, and the display on a passenger's side display device, which is a display device provided in the vehicle that can be used by passengers other than the driver.Based on the identification by the driving control identification unit that a predetermined driving control will be performed during autonomous driving without a monitoring obligation, which is autonomous driving without a monitoring obligation for the surroundings, the display control unit causes not only the driver's side display device but also the passenger's side display device to display a control content display, which is a display showing the implementation content of the predetermined driving control.

[0010] In order to achieve the above object, the vehicle display control method disclosed herein is a vehicle display control method that can be used in a vehicle that performs autonomous driving, and includes a driving control identification process executed by at least one processor that identifies that a predetermined driving control will be performed during autonomous driving, and a display control process that controls the display on a driver's side display device that is a display device provided in the vehicle exclusively for the driver, and the display on a passenger's side display device that is a display device provided in the vehicle that can be used by passengers other than the driver of the vehicle.In the display control process, based on the identification in the driving control identification process that a predetermined driving control will be performed during autonomous driving without a monitoring obligation, which is autonomous driving without a monitoring obligation for the surroundings, not only the driver's side display device but also the passenger's side display device display a control content display that shows the implementation content of the predetermined driving control.

[0011] According to the above configuration, when predetermined driving control is performed during automated driving without a monitoring obligation, it is possible to display a control content display, which indicates the implementation content of the predetermined driving control, not only on the driver's display device but also on the passenger's display device. Therefore, passengers can understand the driving content from the control content display on the passenger's display device. Therefore, even when the driver performs a second task during automated driving without a monitoring obligation and does not understand the driving content of the vehicle, passengers are less likely to feel anxious about the driving control. As a result, it is possible to make passengers less likely to feel anxious about the driving control even during automated driving without a monitoring obligation.

[0012] 1 is a diagram showing an example of a schematic configuration of a vehicle system in embodiment 1. FIG. 2 is a diagram showing an example of a schematic configuration of an information presentation device in embodiment 1. FIG. 3 is a diagram showing an example of a schematic configuration of an HCU in embodiment 1. FIG. 4 is a flowchart showing an example of a flow of control content display-related processing in an HCU. FIG. 5 is a diagram showing an example of a correspondence relationship between a type of predetermined driving control and whether or not control content is displayed on a passenger-side display device. FIG. 6 is a diagram showing an example of a correspondence relationship between an offset direction in offset control and whether or not control content is displayed on a passenger-side display device. FIG. 7 is a diagram showing an example of a correspondence relationship between whether or not the driver is monitoring the surroundings and whether or not obstacle detection information is displayed on a driver-side display device and a passenger-side display device. FIG. 8 is a diagram showing an example of a correspondence relationship between a type of predetermined driving control and a display on a passenger-side display device. FIG. 9 is a diagram showing an example of a correspondence relationship between a type of predetermined driving control, whether or not a passenger is in the front seat, and whether or not control content is displayed on a passenger-side display device. FIG. 10 is a diagram showing an example of a schematic configuration of an HCU in embodiment 2. FIG. 11 is a diagram showing an example of a schematic configuration of a vehicle system in embodiment 2. FIG. 12 is a diagram showing an example of a schematic configuration of an information presentation device in embodiment 2. FIG. 13 is a diagram showing an example of a schematic configuration of a voice input device. FIG. 10 is a diagram showing an example of a schematic configuration of an HCU in embodiment 3. FIG. 11 is a diagram showing an example of a schematic configuration of an HCU in embodiment 4. FIG. 12 is a diagram showing an example of a schematic configuration of an HCU in embodiment 5. FIG. 13 is a diagram showing an example of a schematic configuration of an HCU in embodiment 6. FIG. 14 is a diagram showing an example of a schematic configuration of an HCU in embodiment 7.

[0013] A number of embodiments for the purpose of disclosure will be described with reference to the drawings. For the sake of convenience, parts having the same functions as parts shown in the drawings used in the previous explanations in the number of embodiments will be given the same reference numerals, and their description may be omitted. For parts given the same reference numerals, the explanations in other embodiments may be referred to.

[0014] (Embodiment 1) <Outline of Vehicle System 1> Hereinafter, a first embodiment of the present disclosure will be described with reference to the drawings. The vehicle system 1 shown in FIG. 1 can be used in a vehicle capable of autonomous driving (hereinafter, an autonomous driving vehicle). As shown in FIG. 1, the vehicle system 1 includes an HCU (Human Machine Interface Control Unit) 10, a communication module 20, a locator 30, a map database (hereinafter, a map DB) 40, a vehicle state sensor 50, a perimeter monitoring sensor 60, a vehicle control ECU 70, an autonomous driving ECU 80, an interior camera 91, and an information presentation device 92. For example, the HCU 10, the communication module 20, the locator 30, the map DB 40, the vehicle state sensor 50, the perimeter monitoring sensor 60, the vehicle control ECU 70, and the autonomous driving ECU 80 may be configured to be connected to an in-vehicle LAN (LAN) (see the LAN in FIG. 1). Although the vehicle using the vehicle system 1 is not necessarily limited to an automobile, the following description will be given taking an example of use in an automobile.

[0015] There are multiple levels of autonomous driving for autonomous vehicles (hereinafter referred to as "automation levels"), as defined by the SAE, for example. The automation levels are classified into LV0 to LV5 as follows:

[0016] LV0 is a level at which the driver performs all driving tasks without system intervention. The driving task may also be referred to as a dynamic driving task. The driving task may be, for example, steering, acceleration / deceleration, and periphery monitoring. LV0 corresponds to so-called manual driving. LV1 is a level at which the system assists with either steering or acceleration / deceleration. LV1 corresponds to so-called driving assistance. LV2 is a level at which the system assists with both steering and acceleration / deceleration. LV2 corresponds to so-called partial driving automation. LV1 to LV2 are also considered to be part of autonomous driving. Note that in this embodiment, driving with an automation level of LV2 or higher may also be considered autonomous driving. In other words, the explanation will continue using an example where the vehicle system 1 is used in a vehicle that performs autonomous driving with assistance in both steering and acceleration / deceleration.

[0017] For example, automated driving at levels 1 to 2 is automated driving in which the driver has the obligation to monitor the surroundings (hereinafter simply referred to as the monitoring obligation) for safe driving. Automated driving with a monitoring obligation is hereinafter referred to as automated driving with a monitoring obligation. The monitoring obligation includes visual monitoring of the surroundings. Automated driving at levels 1 to 2 can also be described as automated driving in which a second task is not permitted. A second task is an action other than driving that is permitted for the driver and is a specific, pre-defined action. A second task can also be referred to as a secondary activity, other activity, etc. A second task must not prevent the driver from responding to a request from the automated driving system to take over driving operations. Examples of second tasks include watching content such as videos, operating a smartphone, reading, and eating. Furthermore, actions equivalent to a second task performed by a passenger in the vehicle other than the driver are referred to as second task-equivalent actions. A second task-equivalent action is similar to a second task, except that it is performed by a passenger. The second task equivalent action is an action of a passenger, and can be performed even while the driver is driving.

[0018] Level 3 autonomous driving is a level where the system can perform all driving tasks under certain conditions, with the driver taking over driving operations in an emergency. Level 3 autonomous driving requires the driver to be able to respond quickly when the system requests a driver-to-drive takeover. This driver-to-drive takeover can also be described as the transfer of the responsibility for monitoring the surroundings from the vehicle's system to the driver. Level 3 corresponds to so-called conditional automated driving. Level 4 autonomous driving is a level where the system can perform all driving tasks except under certain circumstances, such as on inoperable roads or in extreme environments. Level 4 corresponds to so-called highly automated driving. Level 5 autonomous driving is a level where the system can perform all driving tasks in any environment. Level 5 corresponds to so-called fully automated driving. Level 4 and LV5 autonomous driving may be performed, for example, on driving sections where high-precision map data is available. High-precision map data will be described later.

[0019] For example, autonomous driving at level 3 or higher is autonomous driving in which the driver has no monitoring obligation. Autonomous driving without a monitoring obligation will be referred to hereinafter as autonomous driving without a monitoring obligation. Autonomous driving at level 3 or higher can also be rephrased as autonomous driving in which a second task is permitted. In this embodiment, the presence or absence of a monitoring obligation is switched by switching between an automation level of level 3 or higher and an automation level of level 2 or lower. Automation levels of level 2 or lower also include level 0, which corresponds to manual driving.

[0020] The communication module 20 transmits and receives information to and from a center external to the vehicle via wireless communication. That is, it performs wide-area communication. The communication module 20 receives traffic congestion information and the like from the center via wide-area communication. The communication module 20 may transmit and receive information to and from other vehicles via wireless communication. That is, it may perform vehicle-to-vehicle communication. The communication module 20 may transmit and receive information to and from a roadside device installed on the roadside via wireless communication. That is, it may perform road-to-vehicle communication. When performing road-to-vehicle communication, the communication module 20 may receive information about surrounding vehicles transmitted from surrounding vehicles of the vehicle via the roadside device. Furthermore, the communication module 20 may receive information about surrounding vehicles transmitted from surrounding vehicles of the vehicle via wide-area communication via the center.

[0021] The locator 30 includes a GNSS (Global Navigation Satellite System) receiver and an inertial sensor. The GNSS receiver receives positioning signals from multiple positioning satellites. The inertial sensor includes, for example, a gyro sensor and an acceleration sensor. The locator 30 sequentially determines the vehicle position of the vehicle (hereinafter referred to as the vehicle position) by combining the positioning signals received by the GNSS receiver with the measurement results of the inertial sensor. The vehicle position may be expressed, for example, in latitude and longitude coordinates. Note that the vehicle position may also be determined using a travel distance calculated from signals sequentially output from a vehicle speed sensor mounted on the vehicle.

[0022] The map DB 40 is a non-volatile memory that stores high-precision map data. The high-precision map data is map data with higher accuracy than the map data used for route guidance in the navigation function. The high-precision map data includes information usable for automated driving, such as three-dimensional road shape information, information on the number of lanes, and information indicating the permitted driving direction for each lane. The high-precision map data may also include node point information indicating the positions of both ends of road markings such as lane markings. The map DB 40 may also store map data used for route guidance. Note that the locator 30 may be configured to use the three-dimensional road shape information without using a GNSS receiver. For example, the locator 30 may be configured to determine the vehicle's position using the three-dimensional road shape information and the detection results from the perimeter monitoring sensor 60. The three-dimensional road shape information may be generated based on captured images using REM (Road Experience Management).

[0023] The map data distributed from the center may be received by wide-area communication via the wide-area communication module and stored in the map DB 40. In this case, the map DB 40 may be configured as a volatile memory, and the wide-area communication module may successively acquire map data for an area corresponding to the vehicle's position.

[0024] The vehicle condition sensor 50 is a group of sensors for detecting various conditions of the vehicle. The vehicle condition sensor 50 includes a vehicle speed sensor, a seating sensor, etc. The vehicle speed sensor detects the speed of the vehicle. The seating sensor detects whether an occupant is seated in each seat. The seating sensor may be a pressure-sensitive sensor provided on the seat surface. The vehicle condition sensor 50 outputs the detected sensing information to an in-vehicle LAN. The sensing information detected by the vehicle condition sensor 50 may be configured to be output to the in-vehicle LAN via an ECU installed in the vehicle.

[0025] The perimeter monitoring sensor 60 monitors the environment surrounding the vehicle. As an example, the perimeter monitoring sensor 60 detects obstacles around the vehicle. Examples of obstacles include moving objects such as pedestrians and other vehicles. Examples of obstacles include objects fallen on the road and stationary objects such as roadside traffic lights. The perimeter monitoring sensor 60 also detects road markings such as lane markings around the vehicle. The perimeter monitoring sensor 60 is, for example, a perimeter monitoring camera that captures an image of a predetermined range around the vehicle, or a search wave sensor that transmits search waves within a predetermined range around the vehicle. Examples of search wave sensors include millimeter-wave radar, sonar, and LIDAR (Light Detection and Ranging / Laser Imaging Detection and Ranging). The predetermined range may be a range that at least partially includes the front, rear, left, and right of the vehicle. For example, the predetermined range may be a range that at least includes the area ahead of the vehicle. The perimeter monitoring camera sequentially captures and outputs the captured images as sensing results to the autonomous driving ECU 80. The search wave sensor sequentially outputs the scanning results based on the received signals obtained when receiving the reflected waves reflected by an obstacle to the automatic driving ECU 80 as the sensing results.

[0026] The vehicle control ECU 70 is an electronic control device that controls the driving of the vehicle. Examples of driving control include acceleration / deceleration control and / or steering control. The vehicle control ECU 70 includes a steering ECU that controls steering, a power unit control ECU that controls acceleration / deceleration, and a brake ECU. The vehicle control ECU 70 controls driving by outputting control signals to each driving control device mounted on the vehicle. Examples of driving control devices include an electronically controlled throttle, a brake actuator, and an EPS (Electric Power Steering) motor.

[0027] The autonomous driving ECU 80 includes, for example, a processor, memory, I / O, and a bus connecting these, and executes control programs stored in the memory to perform autonomous driving-related processing. The memory referred to here is a non-transitory tangible storage medium that non-temporarily stores computer-readable programs and data. The non-transitory tangible storage medium is realized by a semiconductor memory, a magnetic disk, or the like. The autonomous driving ECU 80 includes, as functional blocks, a driving environment recognition unit, an action determination unit, and a control execution unit.

[0028] The driving environment recognition unit recognizes the driving environment of the vehicle from the vehicle position acquired from the locator 30, the map data acquired from the map DB 40, and the sensing results acquired from the periphery monitoring sensor 60. As an example, the driving environment recognition unit uses this information to recognize the positions, shapes, and movement states of objects around the vehicle, and generates a virtual space that reproduces the actual driving environment. The driving environment recognition unit may also recognize the presence, relative positions, and relative speeds of surrounding vehicles from the sensing results acquired from the periphery monitoring sensor 60 as the driving environment. The driving environment recognition unit may recognize the vehicle's position on the map from the vehicle position and map data. If position information, speed information, etc. of surrounding vehicles can be acquired via the communication module 20, the driving environment recognition unit may also use this information to recognize the driving environment.

[0029] The behavior determination unit switches the control entity for driving operations between the driver and the system of the host vehicle. When the system has control of driving operations, the behavior determination unit determines a driving plan for driving the host vehicle based on the recognition results of the driving environment by the driving environment recognition unit. As driving plans, a long-term / mid-term driving plan and a short-term driving plan are generated. In the long-term / mid-term driving plan, a planned driving route for directing the host vehicle to a set destination is generated. This planned driving route is a route consisting of multiple links. The autonomous driving ECU 80 may generate this planned driving route in a manner similar to route search performed by a navigation function. This route search may be performed, for example, by cost calculation using the Dijkstra algorithm. In the short-term driving plan, the behavior determination unit generates a driving plan for realizing driving in accordance with the long-term / mid-term driving plan using a virtual space around the generated host vehicle. Specifically, the behavior determination unit determines the execution of driving control according to the situation at hand. Examples of such driving control include lane change control, offset control, obstacle avoidance control, weaving control, and automatic parking control.

[0030] Lane change control (hereinafter referred to as LC control) is a driving control that causes a lane change to an adjacent lane. In LC control, a lane change can be performed by performing acceleration / deceleration control and steering control. Offset control is a driving control that changes the position of a vehicle within its own lane to maintain a gap between the vehicle and a surrounding vehicle. In offset control, at least one of acceleration / deceleration control and steering control can be performed to maintain a gap between the vehicle and a surrounding vehicle. Examples of offset control include lateral offset control, which performs a lateral offset by moving the vehicle widthwise. In lateral offset control, the body of the vehicle is moved closer to the lane boundary line in the opposite direction to the direction in which the surrounding vehicle, which is the target of the gap, is located within the own lane. In lateral offset control, the body of the vehicle is offset to maintain a gap between the vehicle and the left and right surrounding vehicles. Examples of offset control include longitudinal offset control, which performs a longitudinal offset by moving the vehicle forward and backward. In longitudinal offset control, the body of the vehicle is moved by accelerating and decelerating in the opposite direction to the direction in which the surrounding vehicle, which is the target of the gap, is located within the own lane. The longitudinal offset control is an offset control for increasing the distance between the vehicle and the surrounding vehicles in front and behind.

[0031] Obstacle avoidance control is driving control that avoids obstacles on the intended path of the host vehicle. Obstacle avoidance control may avoid an obstacle by braking the host vehicle to slow down or stop it. An example of obstacle avoidance control by braking is automatic emergency braking (AEB). Obstacle avoidance control may also avoid an obstacle by steering. An example of obstacle avoidance control by steering is automatic emergency steering (AES). Passing-through control is driving control that allows the host vehicle to pass an object when the distance between the host vehicle and the object is equal to or less than a specified value. The specified value here may be, for example, approximately the distance between vehicles passing each other on a road without a center line, and may be set arbitrarily. The target of passing-through control may be an oncoming vehicle. The target of passing-through control may also include moving objects other than oncoming vehicles, such as toll booth structures, and stationary objects. Passing-through control may allow the host vehicle to pass the object at a low speed by braking, for example. The low speed may be, for example, a slow speed of 10 km / h or less. Automatic parking control is driving control that automatically parks the vehicle. In automatic parking control, the vehicle is automatically parked in a parking space adjacent to or surrounded by parked vehicles, structures, demarcation lines, etc. In automatic parking control, the vehicle is automatically parked by performing acceleration / deceleration control and steering control.

[0032] The behavior determination unit also switches the automation level of the autonomous driving of the vehicle as needed. The behavior determination unit can lower the automation level when it determines that a lowering of the automation level is necessary. Examples of situations in which it determines that a lowering of the automation level is necessary include when an override is detected, when there is a planned driver change, and when there is an unplanned driver change.

[0033] When the control authority for driving operations is in the vehicle's system, the control execution unit works in cooperation with the vehicle control ECU 70 to execute acceleration / deceleration control, steering control, etc. of the vehicle in accordance with the driving plan determined by the action judgment unit.

[0034] The interior camera 91 captures an image of a predetermined range within the vehicle interior. Preferably, the interior camera 91 captures an image of an area including the driver's seat of the vehicle. Preferably, the interior camera 91 also captures an image of an area including the passenger seat of the vehicle. More preferably, the interior camera 91 also captures an image of an area including the rear seats of the vehicle. The interior camera 91 is configured, for example, with a near-infrared light source, a near-infrared camera, and a control unit that controls them. The interior camera 91 uses the near-infrared camera to capture an image of an occupant of the vehicle illuminated with near-infrared light by the near-infrared light source. The image captured by the near-infrared camera is subjected to image analysis by the control unit. The control unit analyzes the captured image to detect features such as the face of the occupant. The control unit may detect the presence of the occupant, the driver's facial orientation, the driver's line of sight, etc. based on the detected features of the upper body including the face of the occupant.

[0035] The information presentation device 92 is provided in the vehicle and presents information to the interior of the vehicle. That is, the information presentation device 92 notifies the occupants of the vehicle. The information presentation device 92 presents information in accordance with instructions from the HCU 10. As shown in FIG. 2 , the information presentation device 92 includes a display device 921 and an audio output device 922.

[0036] The display device 921 presents information by displaying it. The display device 921 is, for example, a pillar-to-pillar type display (hereinafter, PtoP display). The PtoP display is a display device whose display area extends between the left and right pillars located on both sides of the front windshield. The PtoP display may be realized by arranging multiple displays in a horizontal row on the instrument panel. As shown in FIG. 2 , the display device 921 includes, for example, a meter MID (Multi Information Display) 9211, a CID (Center Information Display) 9212, and a passenger display (hereinafter, passenger DP) 9213. The meter MID 9211 is a display provided in front of the driver's seat inside the vehicle. As an example, the meter MID 9211 may be configured to be provided on a meter panel. The meter MID 9211 is a display device exclusively for the driver. The meter MID 9211 corresponds to the driver's side display device. The CID 9212 is a display located in the center of the vehicle's instrument panel. The CID 9212 is a display device that can be used by the driver and passengers. The CID 9212 corresponds to a passenger-side display device. The passenger DP 9213 is a display provided in front of the passenger seat inside the vehicle. In the following, the passenger DP 9213 will be described using an example in which the passenger DP 9213 is a display for the passenger seat. Note that the passenger DP 9213 may include a display provided for passengers in the rear seats. The passenger DP 9213 also corresponds to a passenger-side display device.

[0037] The display device 921 may be a head-up display (HUD). The HUD is provided in the vehicle interior, for example, on an instrument panel. The HUD projects a display image formed by a projector onto a predetermined projection area on a windshield serving as a projection member. The light of the image reflected by the windshield toward the interior of the vehicle is perceived by the occupant sitting in the seat. This allows the occupant to view a virtual image of the display image formed in front of the windshield superimposed on a portion of the foreground. The HUD may be configured to project the display image onto a combiner instead of the windshield. When a HUD is used, the HUD that displays a virtual image for the occupant sitting in the driver's seat corresponds to the driver's side display device. On the other hand, the HUD that displays a virtual image for the occupant sitting in the passenger seat corresponds to the passenger's side display device.

[0038] The audio output device 922 presents information by outputting audio. A speaker or the like may be used as the audio output device 922. The audio output device 922 may include a driver's side speaker and a passenger's side speaker. The driver's speaker is a speaker provided on the driver's seat side of the interior of the vehicle. The passenger's speaker is a speaker provided on the passenger's seat side of the interior of the vehicle. A passenger's speaker may also be provided on the rear seat side.

[0039] The HCU 10 is mainly composed of a computer including, for example, a processor, a volatile memory, a non-volatile memory, an I / O, and a bus connecting these. The HCU 10 executes various processes related to the interaction between the occupant and the vehicle's system by executing a control program stored in the non-volatile memory. This HCU 10 corresponds to a vehicle display control device. The configuration of the HCU 10 will be described in detail below. The HCU 10 controls the presentation of information from the information presentation device 92. The HCU 10 controls the display on the display device 921. The HCU 10 acquires the imaging results and detection results from the interior camera 91.

[0040] <Overall Configuration of HCU 10> Next, the overall configuration of the HCU 10 will be described with reference to Figure 3. As shown in Figure 3, the HCU 10 includes functional blocks, such as an AD information acquisition unit 101, a driving control identification unit 102, an obstacle identification unit 103, a monitoring identification unit 104, a passenger status identification unit 105, a sensing result acquisition unit 106, and a display control unit 107. The execution of processing by a computer of each functional block of the HCU 10 corresponds to the execution of a vehicle display control method. Some or all of the functions executed by the HCU 10 may be configured as hardware using one or more ICs, etc. Some or all of the functional blocks included in the HCU 10 may be implemented by a combination of software executed by a processor and hardware components.

[0041] The AD information acquisition unit 101 acquires information output from the autonomous driving ECU 80. The AD information acquisition unit 101 may acquire, for example, information on the automation level currently set in the autonomous driving ECU 80. The AD information acquisition unit 101 may acquire, for example, the recognition results of the driving environment recognized by the autonomous driving ECU 80. The AD information acquisition unit 101 may acquire, for example, information on the driving plan planned by the autonomous driving ECU 80. The AD information acquisition unit 101 may acquire, for example, the sensing results obtained by the perimeter monitoring sensor 60 via the autonomous driving ECU 80.

[0042] The driving control identification unit 102 identifies that a predetermined driving control (hereinafter, "predetermined driving control") will be performed during autonomous driving. The predetermined driving control may be any driving control related to autonomous driving. The predetermined driving control may be any driving control that is different from the driving control performed during autonomous driving up to that point. In other words, when the driving control during autonomous driving is switched, the newly performed driving control may be identified as the predetermined driving control. The processing performed by the driving control identification unit 102 corresponds to a driving control identification step.

[0043] The driving control specifying unit 102 preferably specifies LC control as the predetermined driving control. The driving control specifying unit 102 preferably specifies offset control as the predetermined driving control. The driving control specifying unit 102 preferably specifies obstacle avoidance control as the predetermined driving control. The driving control specifying unit 102 preferably specifies slip-through control as the predetermined driving control. The driving control specifying unit 102 preferably specifies automatic parking control as the predetermined driving control. The driving control specifying unit 102 preferably specifies driving control that moves the host vehicle in the vehicle width direction as the predetermined driving control. Driving controls that move the host vehicle in the vehicle width direction include, for example, LC control, lateral offset control, obstacle avoidance control by steering, etc.

[0044] The obstacle identification unit 103 identifies the presence or absence of an obstacle around the vehicle. The obstacle identification unit 103 may identify the presence or absence of an obstacle around the vehicle from the recognition result of the driving environment acquired by the AD information acquisition unit 101. The obstacle identification unit 103 may identify the presence or absence of an obstacle located within a specified range from the vehicle among the obstacles detected by the perimeter monitoring sensor 60. The obstacle identification unit 103 may identify the presence or absence of an obstacle located within a specified range ahead, for example. The specified range may be arbitrarily designed depending on the range of obstacles located around the vehicle that the driver should be notified of. Identifying the presence of an obstacle by the obstacle identification unit 103 may also be said to have detected an obstacle. Identifying the presence of an obstacle located within a specified range by the obstacle identification unit 103 may also be said to have detected an obstacle that is the target of notification.

[0045] The monitoring identification unit 104 determines whether or not the driver of the vehicle is monitoring the surroundings. The monitoring identification unit 104 may determine whether or not the driver is monitoring the surroundings from the detection results of the indoor camera 91. For example, the monitoring identification unit 104 may determine whether or not the driver is monitoring the surroundings from the facial direction, gaze direction, etc. of the driver detected by the indoor camera 91. Here, an example has been given in which the facial direction and gaze direction of the driver are detected by the control unit of the indoor camera 91, but this is not necessarily limited to this. The monitoring identification unit 104 may also detect the facial direction and gaze direction of the driver from the image capture results of the indoor camera 91 and determine whether or not the driver is monitoring the surroundings.

[0046] The passenger state identification unit 105 identifies the state of a passenger of the vehicle. The passenger state identification unit 105 may identify the state of the passenger from the image capture results of the interior camera 91. The passenger state identification unit 105 may identify the presence or absence of a passenger, the seating position of the passenger, etc. The presence or absence of a passenger and the seating position of the passenger may be identified from the detection results of seating sensors for each seat.

[0047] The sensing result acquisition unit 106 acquires the sensing results from the perimeter monitoring sensor 60. The sensing results include images captured by a perimeter monitoring camera, scanning results from a search wave sensor, and the like.

[0048] The display control unit 107 controls the display on the display device 921. The display control unit 107 controls the display on the meter MID 9211, the CID 9212, and the passenger DP 9213. The display control unit 107 controls the display on the driver's side display device and the display on the passenger's side display device. The driver's side display device is the meter MID 9211. The passenger's side display device is the passenger DP 9213. The passenger's side display device may be configured to include the CID 9212, but the following explanation will be given using an example where the passenger's side display device does not include the CID 9212.

[0049] The display control unit 107, based on the determination by the driving control determination unit 102 that a predetermined driving control will be performed during automated driving without a monitoring obligation, causes not only the driver's display device but also the passenger's display device to display a control content. The control content display is a display indicating the implementation content of the predetermined driving control. This allows passengers to understand the driving content from the control content display on the passenger's display device. Therefore, even in a situation where the driver is performing a second task during automated driving without a monitoring obligation and the driver is not aware of the driving content of the vehicle, passengers are less likely to feel anxious about the driving control. As a result, even during automated driving without a monitoring obligation, passengers are less likely to feel anxious about the driving control. The control content display may be a display of an icon for each type of driving control that simplifies the implementation content of the driving control. The control content display may also be a display of text that briefly explains the implementation content of the driving control. The processing by the display control unit 107 corresponds to a display control process.

[0050] It is preferable that the predetermined cruise control be different from the cruise control in the previous autonomous driving. This allows passengers to understand the driving details under this cruise control when a cruise control different from the cruise control in the previous autonomous driving is performed. As a result, even during autonomous driving without a monitoring obligation, passengers can be less likely to feel anxious about the cruise control being different from the cruise control in the previous autonomous driving.

[0051] It is preferable that the display control unit 107 changes whether or not to cause the passenger-side display device to display control details depending on the type of predetermined driving control identified by the driving control identification unit 102. The likelihood of passengers feeling anxious may vary depending on the type of predetermined driving control. In contrast, the above configuration makes it possible to change whether or not to cause control details display depending on whether the predetermined driving control type is one that is likely to make passengers feel anxious. Therefore, it is possible to prevent unnecessary display of control details for predetermined driving control types that are unlikely to make passengers feel anxious.

[0052] Here, an example of the flow of processing related to whether or not to display control details on the passenger-side display device according to the type of predetermined driving control in the HCU 10 (hereinafter, "control content display related processing") will be described using the flowchart of Figure 4. The flowchart of Figure 4 may be configured to be started when automatic driving without monitoring obligation is started. Here, the type of predetermined driving control that causes the passenger-side display device to display control details will be referred to as the "target type." In this description, the driver-side display device is the meter MID 9211, and the passenger-side display device is the passenger DP 9213.

[0053] First, in step S1, if the driving control specification unit 102 specifies that predetermined driving control is to be performed (YES in S1), the process proceeds to step S2. On the other hand, if the driving control specification unit 102 does not specify that predetermined driving control is to be performed (NO in S1), the process proceeds to step S5.

[0054] In step S2, if the type of predetermined driving control identified by the driving control identification unit 102 is the target type (YES in S2), the process proceeds to step S3. On the other hand, if the type of predetermined driving control identified by the driving control identification unit 102 is not the target type (NO in S2), the process proceeds to step S4.

[0055] In step S3, the display control unit 107 causes the meter MID 9211 and the passenger DP 9213 to display the control content of the predetermined driving control identified in S1, and then the process proceeds to step S5. In step S4, the display control unit 107 causes the meter MID 9211 to display the control content of the predetermined driving control identified in S1, and then the process proceeds to step S5. In S4, the display control unit 107 does not cause the passenger DP 9213 to display the control content of the predetermined driving control identified in S1.

[0056] In step S5, if it is time to end the control content display related processing (YES in S5), the control content display related processing is ended. On the other hand, if it is not time to end the control content display related processing (NO in S5), the process returns to S1 and is repeated. Examples of timings to end the control content display related processing include switching to automatic driving with supervisory obligation or manual driving, and turning off the power switch. The power switch is a switch for starting the internal combustion engine or motor generator of the vehicle.

[0057] FIG. 5 shows a specific example of a change in whether or not to display control details on the passenger-side display device depending on the type of predetermined driving control. FIG. 5 illustrates an example of the correspondence between the type of predetermined driving control and whether or not to display control details on the passenger-side display device. As shown in FIG. 5, display control unit 107 may cause the passenger-side display device to display the control details when the type of predetermined driving control identified by driving control identification unit 102 is offset control. On the other hand, as shown in FIG. 5, display control unit 107 preferably does not cause the passenger-side display device to display the control details when the type of predetermined driving control identified by driving control identification unit 102 is LC control. This is because offset control tends to make passengers feel more uneasy than LC control. Alternatively, display control unit 107 may cause the passenger-side display device to display the control details when the type of predetermined driving control is pass-through control. This is because pass-through control at a toll gate or the like also tends to make passengers feel uneasy.

[0058] The display control unit 107 may cause the passenger-side display device to display the control content based on the fact that the type of predetermined driving control identified by the driving control identification unit 102 is offset control. In other words, even when the type of predetermined driving control is offset control, the display control unit 107 may not cause the passenger-side display device to display the control content. This example will be described with reference to FIG. 6 . FIG. 6 is a diagram showing an example of the correspondence between the offset direction in offset control and whether or not the control content is displayed on the passenger-side display device. When the type of predetermined driving control is offset control and the host vehicle is moved to the side where the passenger is located by the offset control, as shown in FIG. 6 , the display control unit 107 may cause the passenger-side display device to display the control content. The side of the host vehicle where the passenger is located is hereinafter referred to as the passenger side. When the passenger is located in the passenger seat provided on the left side of the host vehicle, the passenger side is the left side of the host vehicle. The passenger side is the right side of the vehicle when the passenger is seated in the passenger seat located on the right side of the vehicle. If the passenger DP 9213 is configured to include a display for a passenger in the rear seat, the passenger side may also be configured to include the rear side of the vehicle. In this case, when a passenger is seated in the rear seat of the vehicle, the passenger side is the rear side of the vehicle. On the other hand, even if the type of predetermined driving control is offset control, as shown in FIG. 6, the display control unit 107 does not need to display the control content on the passenger side display device when the vehicle is moved to a position other than the passenger side by offset control.

[0059] Even when offset control is performed, the tendency for the passenger to feel uneasy varies depending on whether the offset direction is toward the passenger side or not. When the offset direction is toward the passenger side, the passenger tends to feel uneasy, while when the offset direction is not toward the passenger side, the passenger tends not to feel uneasy. In contrast, with the above configuration, even when offset control is performed, it is possible to suppress unnecessary control content displays depending on whether the passenger tends to feel uneasy.

[0060] When the obstacle identification unit 103 identifies the presence of an obstacle, the display control unit 107 preferably performs the following operation. The display control unit 107 may display information indicating that an obstacle has been detected (hereinafter, "obstacle detection information") on the driver's display device. In addition, when the monitoring identification unit 104 identifies that the driver is not monitoring the surroundings, the display control unit 107 may also display the obstacle detection information on the passenger's display device. The necessity for the passenger to have the obstacle detection information displayed on the passenger's display device differs depending on whether the driver is monitoring the surroundings. Specifically, when the driver is not monitoring the surroundings, the passenger is less likely to feel uneasy if the obstacle detection information is displayed on the passenger's display device. This is because the display of the obstacle detection information lets the passenger know that the vehicle's system is able to recognize obstacles, allowing the passenger to feel more confident in the system. On the other hand, when the driver is monitoring the surroundings, the display of the obstacle detection information on the passenger's display device may be annoying to the passenger. This is because, when the driver is monitoring the surroundings, the passengers can feel sufficiently safe even if the passenger-side display device does not display obstacle detection information. In contrast, with the above configuration, it is possible to reduce the passengers' anxiety as needed while minimizing the inconvenience to the passengers.

[0061] Here, a specific example of displaying obstacle detection information will be described with reference to FIG. 7 . FIG. 7 is a diagram showing an example of the correspondence between whether or not the driver is monitoring the surroundings and the presence or absence of obstacle detection information on the driver's display device and the passenger's display device. In the example of FIG. 7 , the driver's display device is the meter MID 9211, and the passenger's display device is the passenger DP 9213. When the display control unit 107 determines that an obstacle is present and that the driver is not monitoring the surroundings, it may display the obstacle detection information on both the meter MID 9211 and the passenger DP 9213, as shown in FIG. 7 . When the display control unit 107 determines that an obstacle is present and that the driver is monitoring the surroundings, it may do the following. As shown in FIG. 7 , the display control unit 107 may display the obstacle detection information on the meter MID 9211, but not on the passenger DP 9213. The obstacle detection information may be, for example, an icon indicating that an obstacle has been detected. The obstacle detection information may also include information indicating the position of an obstacle relative to the vehicle. Alternatively, the obstacle detection information may be information indicating the position of an obstacle in front of the vehicle or on a schematic map.

[0062] When the driving control identification unit 102 determines that pass-through control will be performed during autonomous driving without a monitoring obligation, the display control unit 107 preferably performs the following. The display control unit 107 may display, on the passenger-side display device, the sensing results acquired by the sensing result acquisition unit 106 or the recognition results of the surroundings of the vehicle using the sensing results, rather than the control content display. The recognition results of the surroundings of the vehicle using the sensing results are hereinafter referred to as the surrounding recognition results. When pass-through control is performed, it is considered that, for peace of mind, passengers want to know more about whether the pass-through is likely to be completed successfully rather than the content of the driving control. In contrast, with the above configuration, by displaying the sensing results or the surrounding recognition results, passengers can more easily recognize whether the vehicle is likely to be able to complete the pass-through successfully. Therefore, it is possible to make passengers feel more secure. The surrounding recognition results may be obtained by the driving environment recognition unit of the autonomous driving ECU 80 using the sensing results.

[0063] Examples of displaying the sensing results include the following. For example, the sensing result may be a captured image of the surroundings of the vehicle captured by a perimeter monitoring camera. This captured image may be one that has undergone viewpoint transformation, such as bird's-eye view transformation. This makes it easier to understand the distance between the vehicle and an object that the vehicle is passing. Furthermore, vehicle width extension lines indicating an extension of the vehicle width of the vehicle may be superimposed on this captured image. This makes it easier for passengers to recognize whether they will be able to successfully pass through an obstacle. An example of displaying the perimeter recognition result may be an image that schematically shows the positional relationship between the vehicle and surrounding vehicles.

[0064] When the driving control specification unit 102 specifies that automatic parking control will be performed during autonomous driving without a monitoring obligation, the display control unit 107 preferably performs the following. The display control unit 107 may display the sensing results or surrounding recognition results acquired by the sensing result acquisition unit 106 on the passenger's side display device. When automatic parking control is performed, it is considered that passengers want to know more about the vehicle environment outside their side rather than the details of the driving control, for peace of mind. In contrast, with the above configuration, displaying the sensing results or surrounding recognition results on the passenger's side makes it easier for passengers to recognize the vehicle environment outside their side. Therefore, it is possible to make passengers feel more secure. Examples of displaying the sensing results and surrounding recognition results may be similar to those described above, except that the range is narrowed to the passenger's side. For example, if the passenger's side is the left side of the vehicle, an image of the left side of the vehicle captured by a surrounding monitoring camera may be displayed on the passenger's side display device in the passenger seat located on the left side of the vehicle. If the passenger side is on the right side of the vehicle, the captured image of the right side of the vehicle taken by the perimeter monitoring camera can be displayed on the passenger side display device in the passenger seat located on the right side of the vehicle.If the passenger side is on the rear side of the vehicle, the captured image of the rear side of the vehicle taken by the perimeter monitoring camera can be displayed on the passenger side display device located in the rear seat of the vehicle.

[0065] Here, a specific example of how to use different displays depending on the type of predetermined driving control will be described using FIG. 8 . FIG. 8 is a diagram showing an example of the correspondence between the type of predetermined driving control and the display on the passenger-side display device. In the example of FIG. 8 , an example will be described in which an image captured by a periphery monitoring camera is displayed as a display of a sensing result or a periphery recognition result. In the example of FIG. 8 , the passenger-side display device will be described as the passenger DP 9213. When the display control unit 107 determines that offset control will be performed by the driving control specification unit 102 during autonomous driving without a monitoring obligation, the display control unit 107 may cause the passenger DP 9213 to display the control content, as shown in FIG. 8 . Note that, as described above, the display control unit 107 may selectively display or not display the control content depending on the offset direction in the offset control. Furthermore, when the display control unit 107 determines that LC control will be performed by the driving control specification unit 102 during autonomous driving without a monitoring obligation, the display control unit 107 may cause the passenger DP 9213 to display the control content. Additionally, when the display control unit 107 determines that obstacle avoidance control will be performed by the driving control specification unit 102 during autonomous driving without a monitoring obligation, the display control unit 107 may cause the passenger DP 9213 to display the control content. When the display control unit 107 determines that slip-through control will be performed by the driving control specification unit 102 during autonomous driving without a monitoring obligation, the display control unit 107 may cause the passenger DP 9213 to display an image of the surroundings of the vehicle captured by a periphery monitoring camera, as shown in FIG. 8. When the display control unit 107 determines that automatic parking control will be performed by the driving control specification unit 102 during autonomous driving without a monitoring obligation, the display control unit 107 may cause the passenger DP 9213 to display an image of the passenger's side captured by a periphery monitoring camera, as shown in FIG. 8.

[0066] Even when there is no passenger in the passenger seat of the host vehicle, the display control unit 107 preferably causes the passenger-side display device to display control details based on the fact that the driving control specification unit 102 has determined that driving control for moving the host vehicle in the vehicle width direction is to be performed. When driving control for moving the host vehicle in the vehicle width direction is performed, the driver's line of sight may be directed to the left or right direction, which is the direction of movement, rather than forward. In this case, if the control details are not displayed on the passenger-side display device, the driver will have to return their line of sight to the driver-side display device to check the control details display, which is a hassle. In contrast, the above configuration makes it possible to reduce the driver's line of sight movement, improving convenience for the driver. Examples of driving control for moving the host vehicle in the vehicle width direction include LC control, lateral offset control, and avoidance control using steering.

[0067] When there is no passenger in the passenger seat of the vehicle and the driving control identification unit 102 has not identified that driving control for moving the vehicle in the vehicle width direction will be performed, the display control unit 107 may do the following. The display control unit 107 may either not display anything on the passenger side display device or may display an image with fixed display content (hereinafter, a fixed image) on the passenger side display device. The fixed image is different from the control content display. Furthermore, the display control unit 107 may determine whether there is a passenger in the passenger seat of the vehicle from the passenger state identification result by the passenger state identification unit 105.

[0068] Here, using FIG. 9 , a specific example of whether or not to display control details on the passenger-side display device depending on the type of predetermined driving control and the presence or absence of a passenger in the passenger seat will be described. FIG. 9 is a diagram showing an example of the correspondence between the type of predetermined driving control, the presence or absence of a passenger in the passenger seat, and the presence or absence of control details on the passenger-side display device. In the example of FIG. 9 , the passenger-side display device will be described as the passenger DP 9213. When the driving control specification unit 102 specifies that LC control will be performed, the display control unit 107 may cause the passenger DP 9213 to display the control details, as shown in FIG. 9 , regardless of whether or not a passenger is present in the passenger seat. When the driving control specification unit 102 specifies that lateral offset control will be performed, the display control unit 107 may cause the passenger DP 9213 to display the control details, as shown in FIG. 9 , regardless of whether or not a passenger is present in the passenger seat. Note that the display control unit 107 may also perform the same when obstacle avoidance control is performed by steering. Furthermore, when the driving control specification unit 102 specifies that obstacle avoidance control by braking will be performed and there is a passenger in the passenger seat, the display control unit 107 may cause the passenger DP 9213 to display the control content. On the other hand, when the driving control specification unit 102 specifies that obstacle avoidance control by braking will be performed and there is no passenger in the passenger seat, the display control unit 107 may not cause the passenger DP 9213 to display the control content. Note that the display control unit 107 may also perform the same processing when longitudinal offset control is performed.

[0069] (Embodiment 2) The configuration of the vehicle system 1 of the embodiment 2 may be adopted instead of the configuration of the above-described embodiment. An example of the configuration of the embodiment 2 will be described below with reference to the drawings. The vehicle system 1 of the embodiment 2 is similar to the vehicle system 1 of the embodiment 1, except that the vehicle system 1 of the embodiment 2 includes an HCU 10a instead of the HCU 10.

[0070] <General Configuration of HCU 10a> Next, the general configuration of the HCU 10a will be described using FIG. 10 . The HCU 10a is similar to the HCU 10 of the first embodiment except for some differences in processing. The HCU 10a includes, as functional blocks, an AD information acquisition unit 101, a driving control identification unit 102, an obstacle identification unit 103, a monitoring identification unit 104, a passenger state identification unit 105a, a sensing result acquisition unit 106, a display control unit 107a, and a usage determination unit 108. The HCU 10a includes the passenger state identification unit 105a instead of the passenger state identification unit 105. The HCU 10a includes the display control unit 107a instead of the display control unit 107. The HCU 10a includes the usage determination unit 108. Except for these differences, the HCU 10a is similar to the HCU 10 of the first embodiment. The HCU 10a also corresponds to a vehicle display control device. The execution of the processing of each functional block of the HCU 10a by a computer corresponds to the execution of a vehicle display control method. As described in the first embodiment, specific examples of the passenger-side display device include the CID 9212 and the passenger DP 9213.

[0071] The passenger state identification unit 105a is the same as the passenger state identification unit 105 of the first embodiment, except for some differences in processing. The differences will be described below. The passenger state identification unit 105a identifies the facial direction of the passenger from the image capture results of the interior camera 91. The passenger state identification unit 105a may also identify the line of sight of the passenger from the image capture results of the interior camera 91.

[0072] The usage determination unit 108 determines whether a passenger is using the passenger-side display device (hereinafter, usage determination). Examples of usage determination include the following. The usage determination unit 108 may determine that the passenger is using the passenger-side display device if the passenger-side display device is powered on, and determine that the passenger is not using the passenger-side display device if the passenger is powered off. The usage determination unit 108 may be configured to determine that the passenger is not using the passenger-side display device even if the passenger is powered on. For example, with regard to the passenger DP9213 among the passenger-side display devices, the usage determination unit 108 may determine that the passenger is not using the passenger DP9213 if the screen has not been operated from the initial screen, and determine that the passenger is using the passenger DP9213 if the screen has been operated from the initial screen. In this case, the usage determination unit 108 may perform usage determination based on a signal from an operating device that operates the screen display of the passenger DP9213. Alternatively, the usage determination unit 108 may determine that the passenger is using the passenger DP9213 if the passenger's face direction and line of sight are directed toward the passenger-side display device, and determine that the passenger is not using the passenger DP9213 if the passenger's face direction and line of sight are not directed toward the passenger-side display device. In this case, the facial orientation and gaze direction of the passenger identified by the passenger state identification unit 105a may be used. Alternatively, if information provided for an action equivalent to a second task is presented on the passenger-side display device, it may be determined that the passenger is using the second task, while if information provided for an action equivalent to a second task is not presented on the passenger-side display device, it may be determined that the passenger is not using the second task. An action equivalent to a second task is an action for a passenger that corresponds to a second task, which is an action other than driving that the driver is permitted to do during autonomous driving without a monitoring obligation. An example of an action equivalent to a second task is watching content such as a video.

[0073] The display control unit 107a is the same as the display control unit 107 of the first embodiment, except for some differences in processing. The following describes these differences. The processing by the display control unit 107a also corresponds to a display control step. When the usage determination unit 108 determines that a passenger is not using the passenger-side display device based on the fact that the driving control identification unit 102 has identified that a predetermined driving control will be performed during autonomous driving without a monitoring obligation, the display control unit 107a causes not only the driver-side display device but also the passenger-side display device to display the control content.

[0074] When a passenger is not using the passenger-side display device, displaying control details on the passenger-side display device does not prevent the passenger from using the passenger-side display device. Therefore, the passenger does not feel inconvenienced. Therefore, with the above configuration, it is possible to make the passenger less likely to feel anxious about the driving control even during automatic driving without a monitoring obligation, without causing inconvenience to the passenger.

[0075] (Embodiment 3) The configuration is not limited to the above-described embodiments, and may be that of the following embodiment 3. An example of the configuration of embodiment 3 will be described below with reference to the drawings.

[0076] <Overall Configuration of Vehicle System 1b> Hereinafter, a third embodiment of the present disclosure will be described with reference to the drawings. As shown in FIG. 11 , the vehicle system 1b includes an HCU 10b, a communication module 20, a locator 30, a map DB 40, a vehicle state sensor 50, a perimeter monitoring sensor 60, a vehicle control ECU 70, an autonomous driving ECU 80, an interior camera 91, an information presentation device 92b, and a voice input device 93. The vehicle system 1b includes an HCU 10b instead of the HCU 10. The vehicle system 1b includes an information presentation device 92b instead of the information presentation device 92. The vehicle system 1b includes the voice input device 93. Except for these points, the vehicle system 1b is similar to the vehicle system 1 of the first embodiment.

[0077] Next, the schematic configuration of the information presentation device 92b will be described using FIG. 12 . The information presentation device 92b is similar to the information presentation device 92 of embodiment 1 except for some differences. The information presentation device 92b includes a display device 921 and an audio output device 922b. The information presentation device 92b is similar to the information presentation device 92 of embodiment 1 except for including the audio output device 922b instead of the audio output device 922. The audio output device 922b includes a driver's side speaker (hereinafter referred to as driver SP) 9221 and a passenger's side speaker (hereinafter referred to as passenger SP) 9222. The driver SP 9221 is a speaker provided on the driver's seat side of the interior of the vehicle. The passenger SP 9222 is a speaker provided on the passenger's seat side of the interior of the vehicle (hereinafter referred to as passenger seat SP). The passenger SP 9222 may include a speaker (hereinafter referred to as a rear SP) provided on the rear seat side. The passenger SP 9222 corresponds to a passenger-side audio output device. For example, audio related to the display on the meter MID 9211 may be output from the driver SP 9221. For example, audio related to the display on the passenger DP 9213 may be output from the passenger SP 9222. For example, audio related to the display on the CID 9212 may be output from the driver SP 9221 and the passenger SP 9222. The audio output device 922b is similar to the audio output device 922 of the first embodiment, except that it is essential to include both the driver SP 9221 and the passenger SP 9222.

[0078] The voice input device 93 collects the speech of the occupants, converts the collected speech into speech data, which is a digital audio signal, and outputs it to the HCU 10b. A digital microphone or the like may be used as the voice input device 93. The following description will be given taking as an example a case where the voice input device 93 is a microphone. As shown in FIG. 13 , the voice input device 93 includes a driver microphone 931 and a passenger microphone 932. The driver microphone 931 is a microphone provided on the driver's seat side of the interior of the vehicle. The passenger microphone 932 is a microphone provided on the passenger seat side of the interior of the vehicle (hereinafter referred to as the passenger seat microphone). The passenger microphone 932 may also include a microphone provided on the rear seat side (hereinafter referred to as the rear microphone).

[0079] <General Configuration of HCU 10b> Next, the general configuration of the HCU 10b will be described using FIG. 14 . The HCU 10b is similar to the HCU 10 of the first embodiment, except for some differences in processing. The HCU 10b includes, as functional blocks, an AD information acquisition unit 101, a driving control identification unit 102, an obstacle identification unit 103, a monitoring identification unit 104, a passenger state identification unit 105b, a sensing result acquisition unit 106, and a presentation control unit 109. The HCU 10b includes the passenger state identification unit 105b instead of the passenger state identification unit 105. The HCU 10b includes the presentation control unit 109 instead of the display control unit 107. Except for these differences, the HCU 10b is similar to the HCU 10 of the first embodiment. This HCU 10b also corresponds to a vehicle display control device. The execution of the processing of each functional block of the HCU 10b by the computer corresponds to the execution of the vehicle display control method. As described in the first embodiment, specific examples of the passenger-side display device include the CID 9212 and the passenger DP 9213.

[0080] The passenger state identification unit 105b is similar to the passenger state identification unit 105 of the first embodiment, except for some differences in processing. The following describes these differences. The passenger state identification unit 105b identifies the passenger's psychological state as the passenger's state. The passenger state identification unit 105b may identify at least whether the passenger is anxious or not as the passenger's psychological state. The passenger state identification unit 105b may identify the passenger's psychological state from facial features detected by the interior camera 91. As an example, the passenger's psychological state may be identified from the facial features by using a learning device that has machine-learned the correspondence between the facial features and the psychological state. The passenger state identification unit 105b may identify the passenger's psychological state not only from the detection results of the interior camera 91, but also from the detection results of a biosensor that detects breathing, pulse, heart rate, etc.

[0081] The presentation control unit 109 controls the presentation of information on a passenger-side information presentation device, which is an information presentation device available to passengers. Examples of the passenger-side information presentation device include the passenger-side display device and the passenger SP9222, which serves as a passenger-side audio output device. The presentation control unit 109 includes a display control unit 107, an audio output control unit 110, and a dialogue control unit 111 as sub-functional blocks. This display control unit 107 is the same as that described in the first embodiment. The presentation control unit 109 can present information by audio, in addition to the display on the passenger-side display device by the display control unit 107.

[0082] The audio output control unit 110 controls audio output from the audio output device 922. The audio output control unit 110 controls audio output from the driver SP 9221 as a driver-side audio output device. The audio output control unit 110 controls audio output from the passenger SP 9222 as a passenger-side audio output device. The dialogue control unit 111 performs dialogue information presentation, which is information presentation that prompts a dialogue with an occupant of the vehicle by having the driver speak to the occupant. In other words, the presentation control unit 109 can also perform dialogue information presentation. The dialogue control unit 111 may cause the voice output control unit 110 to output the utterance for dialogue information presentation. The dialogue control unit 111 causes the driver SP 9221 to present dialogue information. The dialogue control unit 111 causes the passenger SP 9222 to present dialogue information. The dialogue control unit 111 may cause the dialogue control unit 111 to perform dialogue using, for example, an AI model (i.e., artificial intelligence). The AI ​​model uses natural language processing (NLP) technology to understand the speech data input from the voice input device 93 and generate a response according to the speech content. The dialogue control unit 111 is not limited to a configuration using an AI model, and may be configured to make a response according to the speech content indicated by the speech data input from the voice input device 93 in accordance with a preset dialogue scenario.

[0083] When the presentation control unit 109 causes the display control unit 107 to display the control details on the passenger-side display device based on the fact that the driving control identification unit 102 has identified that a predetermined driving control will be performed during autonomous driving without a monitoring obligation, the presentation control unit 109 performs the following operations. The presentation control unit 109 also includes the implementation details of the predetermined driving control in the speech to the passenger SP9222 in the dialogue information presentation. As an example, the speech with the passenger may include a speech explaining the implementation details of the predetermined driving control. This allows the passenger to understand the driving details of the predetermined driving control not only through the display but also through the dialogue. As a result, it is possible to make the passenger feel less anxious about the driving control even during autonomous driving without a monitoring obligation.

[0084] The presentation control unit 109 can also provide control content guidance, which is a voice output indicating the implementation content of a predetermined driving control, as information presentation different from the dialogue information presentation by controlling the voice output at the passenger SP 9222. The control content guidance is provided by the voice output control unit 110 of the presentation control unit 109. The control content guidance is information presentation different from the dialogue information presentation in that it does not require the occupant to speak.

[0085] When the presentation control unit 109 causes the display control unit 107 to also display control content on the passenger-side display device based on the fact that the driving control identification unit 102 has identified that a predetermined driving control will be performed during autonomous driving without a monitoring obligation, and when the passenger state identification unit 105b has identified anxiety of the passenger, it is preferable that the presentation control unit 109 does the following. In addition to causing the passenger-side display device to display the control content, the presentation control unit 109 also causes the passenger SP 9222 to provide control content guidance. The display of the control content from the passenger-side display device is performed by the display control unit 107 of the presentation control unit 109. The control content guidance from the passenger SP 9222 is performed by the audio output control unit 110 of the presentation control unit 109. When the passenger state identification unit 105b has not identified anxiety of the passenger, the presentation control unit 109 need not provide control content guidance.

[0086] According to this, if a passenger feels anxious, the driving content of the predetermined driving control can be understood not only through the display and dialogue but also through the control content guidance. On the other hand, if the passenger does not feel anxious and the need for control content guidance is low, the control content guidance is not provided, making it possible to make the passenger feel less annoyed. As a result, even during autonomous driving without a monitoring obligation, it is possible to make the passenger feel less anxious about the driving control and less annoyed.

[0087] (Fourth embodiment) The configuration of the vehicle system 1 of the fourth embodiment is not limited to the configuration of the above-described embodiments, and may be the configuration of the following fourth embodiment. An example of the configuration of the fourth embodiment will be described below with reference to the drawings. The vehicle system 1 of the fourth embodiment is similar to the vehicle system 1 of the first embodiment, except that it includes an HCU 10c instead of the HCU 10.

[0088] <General Configuration of HCU 10c> Next, the general configuration of the HCU 10c will be described using FIG. 15 . The HCU 10c is similar to the HCU 10 of the first embodiment, except for some differences in processing. The HCU 10c includes, as functional blocks, an AD information acquisition unit 101, a driving control identification unit 102, an obstacle identification unit 103, a monitoring identification unit 104, a passenger state identification unit 105, a sensing result acquisition unit 106, a display control unit 107c, and an initial identification unit 112. The HCU 10c includes the display control unit 107c instead of the display control unit 107. The HCU 10c includes the initial identification unit 112. Except for these differences, the HCU 10c is similar to the HCU 10 of the first embodiment. This HCU 10c also corresponds to a vehicle display control device. Furthermore, the execution of processing by a computer of each functional block of the HCU 10c corresponds to the execution of a vehicle display control method. As described in the first embodiment, specific examples of the passenger side display device include the CID 9212 and the passenger DP 9213.

[0089] When the driving control specification unit 102 specifies that a predetermined driving control will be performed, the initial specification unit 112 specifies whether the predetermined driving control is the first predetermined driving control in a set period (hereinafter, the set period). The set period may be any value that can be set. For example, the set period may be a period divided into time periods such as one day or one week. If the set period is one day, the number of times the predetermined driving control will be performed may be reset at each time set as the start time of the day. If the set period is one week, the number of times the predetermined driving control will be performed may be reset at each reference date and time set as the start date and time of the week. The same applies to set periods such as one month, one year, or the number of years since the purchase of the vehicle. The set period may also be a period divided by an event, such as one trip from when the vehicle is turned on to when it is turned off. In this case, the number of times the predetermined driving control will be performed may be reset at the end of each trip.

[0090] The display control unit 107c is similar to the display control unit 107 of the first embodiment, except for some differences in processing. The following describes these differences. The processing by the display control unit 107c also corresponds to a display control step. During autonomous driving without a monitoring obligation, based on the fact that the driving control identification unit 102 has identified that a predetermined driving control will be performed, if the initial identification unit 112 has identified that the predetermined driving control is the first predetermined driving control in a set period, the display control unit 107c also causes the passenger-side display device to display the control content.

[0091] Passengers' anxiety about driving control during automated driving without a supervisory obligation tends to decrease as they become accustomed to automated driving without a supervisory obligation. Therefore, with the above configuration, while passengers are not yet accustomed to automated driving without a supervisory obligation, the passenger-side display device can also display control details to reduce passenger anxiety, and once passengers become accustomed to automated driving without a supervisory obligation, it is possible to reduce annoyance by not displaying control details.

[0092] The initial identification unit 112 may be configured to identify whether or not this is the first predetermined driving control for the passenger during the set period. In this case, the number of times the predetermined driving control has been performed for each passenger may be recorded in memory until the above-described reset is performed. Identifying each passenger may be performed, for example, by image recognition using facial images captured by the interior camera 91. This allows for more accurate display of the control details on the passenger-side display device while the passenger is still accustomed to the autonomous driving without supervision obligation, thereby reducing the passenger's anxiety, and, once the passenger has become accustomed to the autonomous driving without supervision obligation, suppressing the display of the control details to reduce the passenger's annoyance.

[0093] (Embodiment 5) The configuration is not limited to the above-described embodiments, and may be the configuration of the following embodiment 5. An example of the configuration of embodiment 5 will be described below with reference to the drawings. The vehicle system 1 of embodiment 5 includes an HCU 10d instead of the HCU 10. The vehicle system 1 of embodiment 5 includes an information presentation device 92b instead of the information presentation device 92. The vehicle system 1 of embodiment 5 includes a voice input device 93. Except for these points, the vehicle system 1 of embodiment 5 is similar to the vehicle system 1 of embodiment 1. The information presentation device 92b and the voice input device 93 are similar to those described in embodiment 3.

[0094] <General Configuration of HCU 10d> Next, the general configuration of the HCU 10d will be described using FIG. 16 . The HCU 10d is similar to the HCU 10 of the first embodiment, except for some differences in processing. The HCU 10d includes, as functional blocks, an AD information acquisition unit 101, a driving control identification unit 102, an obstacle identification unit 103, a monitoring identification unit 104, a passenger state identification unit 105, a sensing result acquisition unit 106, a presentation control unit 109d, and an initial identification unit 112. The HCU 10d includes the presentation control unit 109d instead of the display control unit 107. The HCU 10d includes the initial identification unit 112. The initial identification unit 112 is similar to that described in the fourth embodiment. Except for these differences, the HCU 10d is similar to the HCU 10 of the first embodiment. This HCU 10d also corresponds to a vehicle display control device. Furthermore, the execution of the processing of each functional block of the HCU 10d by the computer corresponds to the execution of the vehicle display control method. As described in the first embodiment, specific examples of the passenger-side display device include the CID 9212 and the passenger DP 9213.

[0095] The presentation control unit 109d includes a display control unit 107, an audio output control unit 110, and an interaction control unit 111 as sub-functional blocks. The display control unit 107 is the same as that described in the first embodiment. The audio output control unit 110 and the interaction control unit 111 are the same as those described in the third embodiment. The presentation control unit 109d is the same as the presentation control unit 109 of the third embodiment, except for some differences in processing. These differences will be described below.

[0096] When the display control unit 107 causes the passenger-side display device to display control content based on the driving control specification unit 102 specifying that a predetermined driving control will be performed during automated driving without a monitoring obligation, and when the initial specification unit 112 specifies that the predetermined driving control is the first predetermined driving control in the aforementioned set period, the presentation control unit 109d performs the following. The presentation control unit 109d not only causes the passenger-side display device to display the control content, but also causes the passenger SP 9222 to provide audio information about the predetermined driving control. Examples of audio information presentation include the aforementioned control content guidance and interactive information presentation. With the above configuration, while the passenger is not yet accustomed to automated driving without a monitoring obligation, the passenger SP 9222 can also provide audio information about the predetermined driving control to reduce the passenger's anxiety. However, once the passenger has become accustomed to the automated driving without a monitoring obligation, this audio information presentation can be suppressed to reduce the passenger's annoyance.

[0097] In the fifth embodiment, the initial identification unit 112 may also be configured to identify whether or not this is the first predetermined driving control for the passenger during the set period. This makes it possible to more accurately reduce the passenger's anxiety by having the passenger SP 9222 provide audio information about the predetermined driving control while the passenger is not yet accustomed to the automated driving without a monitoring obligation, and to suppress the annoyance of the passenger once the passenger has become accustomed to the automated driving without a monitoring obligation.

[0098] Sixth Embodiment The configuration of the vehicle system 1 of the sixth embodiment is not limited to the configurations of the above-described embodiments, and may be the configuration of the following sixth embodiment. An example of the configuration of the sixth embodiment will be described below with reference to the drawings. The vehicle system 1 of the sixth embodiment is similar to the vehicle system 1 of the first embodiment, except that it includes an HCU 10e instead of the HCU 10.

[0099] <General Configuration of HCU 10e> Next, the general configuration of the HCU 10e will be described using FIG. 17 . The HCU 10e is similar to the HCU 10 of the first embodiment except for some differences in processing. The HCU 10e includes, as functional blocks, an AD information acquisition unit 101, a driving control identification unit 102, an obstacle identification unit 103, a monitoring identification unit 104, a passenger state identification unit 105b, a sensing result acquisition unit 106, a display control unit 107e, a driver state identification unit 113, and a driving control instruction unit 114. The HCU 10e includes a passenger state identification unit 105b instead of the passenger state identification unit 105. The passenger state identification unit 105b is the same as that described in the third embodiment. The HCU 10e includes a display control unit 107e instead of the display control unit 107. The HCU 10e includes a driver state identification unit 113 and a driving control instruction unit 114. Except for these points, the HCU 10e is similar to the HCU 10 of the first embodiment. This HCU 10e also corresponds to a vehicle display control device. Furthermore, the execution of processing of each functional block of the HCU 10e by a computer corresponds to the execution of a vehicle display control method. As described in the first embodiment, specific examples of the passenger-side display device include the CID 9212 and the passenger DP 9213.

[0100] The driver state identification unit 113 identifies the psychological state of the driver as the state of the driver. The driver state identification unit 113 may identify at least whether the driver is anxious or not as the psychological state of the driver. The driver state identification unit 113 may identify the psychological state of the driver in the same manner as the passenger state identification unit 105b described in the third embodiment.

[0101] The driving control instruction unit 114 performs processing to output a signal to the automatic driving ECU 80. Through this output processing, the driving control instruction unit 114 issues an instruction to control the driving of the subject vehicle.

[0102] When the driving control specification unit 102 specifies that predetermined driving control will be performed during automated driving without a monitoring obligation, and when the driver state specification unit 113 specifies that the driver is anxious, the driving control instruction unit 114 may perform the following: The driving control instruction unit 114 may perform a control adjustment such that the acceleration when accelerating under predetermined driving control is smaller than when the driver state specification unit 113 does not specify that the driver is anxious. By suppressing acceleration, it is possible to reduce the driver's anxiety regarding automated driving without a monitoring obligation, even if the driver is feeling anxious.

[0103] When the driving control identification unit 102 identifies that predetermined driving control will be performed during automated driving without a monitoring obligation, and when the driver state identification unit 113 identifies that the driver is anxious, the driving control instruction unit 114 may perform the following: The driving control instruction unit 114 may perform control adjustment to make the timing of the start of deceleration when deceleration is performed under predetermined driving control earlier than when the driver state identification unit 113 has not identified that the driver is anxious. By accelerating the timing of deceleration, it is possible to reduce the driver's anxiety about automated driving without a monitoring obligation, even if the driver is feeling anxious.

[0104] It is preferable that the driving control instruction unit 114 not adjust the control when the driver's state identification unit 113 has not identified the driver's anxiety and the passenger's state identification unit 105b has identified the passenger's anxiety. This is because when the driver does not feel anxious, the driver is able to handle driving in an emergency and there is little need to change the vehicle control to relieve the passenger's anxiety.

[0105] The display control unit 107e is similar to the display control unit 107 of the first embodiment, except for some differences in processing. These differences will be described below. The processing by the display control unit 107e also corresponds to a display control step. When the driver's state identification unit 113 has not identified the driver's anxiety and the passenger's state identification unit 105b has identified the passenger's anxiety based on the fact that the driving control identification unit 102 has identified that a predetermined driving control will be performed during autonomous driving without a monitoring obligation, the display control unit 107e preferably performs the following. It is preferable that the display control unit 107e also causes the passenger's side display device to display the control content.

[0106] As mentioned above, if the driver is not feeling anxious, the driver is able to handle emergency driving and there is little need to change vehicle control to alleviate the anxiety of the passengers. In contrast, with the above configuration, if the driver is not feeling anxious but the passengers are, it is possible to alleviate the anxiety of the passengers by displaying the control details without changing the vehicle control.

[0107] (Seventh embodiment) The configuration of the seventh embodiment may be adopted without being limited to the configurations of the above-described embodiments. An example of the configuration of the seventh embodiment will be described below with reference to the drawings. The vehicle system 1 of the seventh embodiment includes an HCU 10f instead of the HCU 10. The vehicle system 1 of the seventh embodiment includes an information presentation device 92b instead of the information presentation device 92. The vehicle system 1 of the seventh embodiment includes a voice input device 93. Except for these points, the vehicle system 1 of the seventh embodiment is similar to the vehicle system 1 of the first embodiment. The information presentation device 92b and the voice input device 93 are similar to those described in the third embodiment.

[0108] <General Configuration of HCU 10f> Next, the general configuration of the HCU 10f will be described using FIG. 18 . The HCU 10f is similar to the HCU 10 of the first embodiment except for some differences in processing. The HCU 10f includes, as functional blocks, an AD information acquisition unit 101, a driving control identification unit 102, an obstacle identification unit 103, a monitoring identification unit 104, a passenger state identification unit 105b, a sensing result acquisition unit 106, a presentation control unit 109f, a driver state identification unit 113, and a driving control instruction unit 114. The HCU 10f includes a passenger state identification unit 105b instead of the passenger state identification unit 105. The passenger state identification unit 105b is the same as that described in the third embodiment. The HCU 10f includes a presentation control unit 109f instead of the display control unit 107. The HCU 10f includes a driver state identification unit 113 and a driving control instruction unit 114. The driver state identification unit 113 and the driving control instruction unit 114 are the same as those described in the third embodiment. Except for these points, the HCU 10f is the same as the HCU 10 of the first embodiment. This HCU 10f also corresponds to a vehicle display control device. Furthermore, the execution of processing of each functional block of the HCU 10f by a computer corresponds to the execution of a vehicle display control method. As described in the first embodiment, specific examples of the passenger-side display device include the CID 9212 and the passenger DP 9213.

[0109] The presentation control unit 109f includes a display control unit 107, an audio output control unit 110, and an interaction control unit 111 as sub-functional blocks. The display control unit 107 is the same as that described in the first embodiment. The audio output control unit 110 and the interaction control unit 111 are the same as those described in the third embodiment. The presentation control unit 109f is the same as the presentation control unit 109 of the third embodiment, except for some differences in processing. These differences will be described below.

[0110] When the display control unit 109f causes the display control unit 107 to also display control details on the passenger-side display device based on the fact that the driving control identification unit 102 has identified that a predetermined driving control will be performed during automated driving without a monitoring obligation, when the driver state identification unit 113 has not identified the driver's anxiety and the passenger state identification unit 105b has identified the passenger's anxiety, the presentation control unit 109f performs the following operations. The presentation control unit 109f not only causes the passenger-side display device to display the control details, but also causes the passenger SP 9222 to present information about the predetermined driving control via voice. Examples of voice information presentation include the aforementioned control content guidance and interactive information presentation. According to the above configuration, when the driver is not feeling anxious but the passenger is, it is possible to alleviate the passenger's anxiety by presenting information via voice without changing the vehicle control.

[0111] (Embodiment 8) In the above-described embodiment, the HCUs 10, 10a, 10b, 10c, 10d, 10e, and 10f correspond to the vehicle display control device, but this is not necessarily limited to this. For example, an ECU other than the HCUs 10, 10a, 10b, 10c, 10d, 10e, and 10f may correspond to the vehicle display control device. As an example, the autonomous driving ECU 80 may perform the functions of the vehicle display control device. In this case, the autonomous driving ECU 80 may indirectly control the display devices 921, 921b and the audio output device 922 by issuing instructions to ECUs that control the display devices 921, 921b and the audio output device 922. Furthermore, in the above-described embodiment, the autonomous driving ECU 80 includes a driving environment recognition unit, but this is not necessarily limited to this. For example, an ECU other than the autonomous driving ECU 80 may perform the functions of the driving environment recognition unit.

[0112] (Disclosed Technical Ideas) This specification discloses multiple technical ideas described in the following multiple clauses. Some clauses may be described in a multiple dependent form, with the subsequent clause alternatively referring to the preceding clause. Furthermore, some clauses may be described in a multiple dependent form, referring to another multiple dependent clause. These multiple dependent clauses define multiple technical ideas.

[0113] (Technical Idea 1) A vehicle display control device that can be used in a vehicle that performs automatic driving, comprising: a driving control identification unit (102) that identifies that predetermined driving control, which is a predetermined driving control, will be performed during the automatic driving, and a display control unit (107, 107a, 107c, 107d, 107e) that controls display on a driver's side display device that is a display device provided in the vehicle exclusively for the driver, and display on a passenger's side display device that is a display device provided in the vehicle that can be used by passengers other than the driver of the vehicle, wherein the display control unit, based on the identification by the driving control identification unit that the predetermined driving control will be performed during automatic driving without a monitoring obligation, which is the automatic driving without a monitoring obligation for the surroundings, causes not only the driver's side display device but also the passenger's side display device to display a control content display that shows the implementation content of the predetermined driving control.

[0114] (Technical Idea 2) The vehicle display control device according to Technical Idea 1, wherein the driving control specification unit specifies, as the predetermined driving control, a driving control that is different from a driving control in the autonomous driving up to that point.

[0115] (Technical Idea 3) A vehicle display control device according to Technical Idea 1 or 2, wherein the display control unit changes whether or not to cause the passenger side display device to display the control content, depending on the type of the predetermined driving control identified by the driving control identification unit.

[0116] (Technical Idea 4) A vehicle display control device according to Technical Idea 3, wherein the display control unit causes the passenger-side display device to display the control content based on whether the type of predetermined driving control identified by the driving control identification unit is offset control, which is driving control that changes the position of the vehicle within the vehicle's lane to create a gap between the vehicle and surrounding vehicles, and does not cause the passenger-side display device to display the control content if the type of predetermined driving control identified by the driving control identification unit is lane change control, which is driving control that changes lanes.

[0117] (Technical Idea 5) A vehicle display control device according to any one of Technical Ideas 1 to 4, wherein the driving control identification unit identifies at least offset control, which is driving control that changes the position of the vehicle within the vehicle's lane to create a gap between the vehicle and surrounding vehicles, as the predetermined driving control, and the display control unit causes the passenger-side display device to display the control content when the type of predetermined driving control identified by the driving control identification unit is offset control and the offset control causes the vehicle to move toward the side where the passenger is located, but does not cause the passenger-side display device to display the control content even if the offset control does not cause the vehicle to move toward the side where the passenger is located.

[0118] (Technical Idea 6) A display control device for a vehicle according to any one of Technical Ideas 1 to 5, comprising an obstacle identification unit (103) that identifies the presence or absence of an obstacle around the vehicle, and a monitoring identification unit (104) that identifies the presence or absence of a surrounding area being monitored by the driver of the vehicle, wherein the display control unit, when the obstacle identification unit identifies the presence of the obstacle, causes the driver's side display device to display information indicating that the obstacle has been detected, and when the monitoring identification unit determines that the driver is not monitoring the surrounding area, also causes the passenger's side display device to display information indicating that the obstacle has been detected.

[0119] (Technical Idea 7) A vehicle display control device according to any one of Technical Ideas 1 to 6, wherein the driving control identification unit identifies at least pass-through control, which is a driving control that allows the vehicle to pass an object when the distance between the object and the vehicle is equal to or less than a specified value, and driving control other than the pass-through control, as the predetermined driving control, and the vehicle is equipped with a sensing result acquisition unit (106) that acquires sensing results from a periphery monitoring sensor that monitors the periphery of the vehicle, and the display control unit, when the driving control identification unit identifies that the pass-through control will be performed during the autonomous driving without monitoring obligation, causes the passenger-side display device to display, instead of the control content display, the sensing result acquired by the sensing result acquisition unit or a recognition result of the periphery of the vehicle using the sensing result.

[0120] (Technical Idea 8) A vehicle display control device according to any one of Technical Ideas 1 to 7, wherein the driving control identification unit identifies at least automatic parking control, which is driving control for automatically parking the vehicle, as the predetermined driving control, and the vehicle includes a sensing result acquisition unit (106) that acquires sensing results from a periphery monitoring sensor that monitors the periphery of the vehicle, and when the driving control identification unit identifies that the automatic parking control will be performed during the autonomous driving without monitoring obligation, the vehicle display control device displays, on the passenger side display device on the side of the vehicle where the passenger is located, the sensing result acquired by the sensing result acquisition unit or a recognition result of the periphery of the vehicle using the sensing result.

[0121] (Technical Idea 9) A vehicle display control device described in any one of Technical Ideas 1 to 8, wherein the driving control identification unit identifies at least driving control that moves the vehicle in a vehicle width direction as the predetermined driving control, and the display control unit causes the passenger-side display device to display the control content based on the driving control identification unit's identification that driving control that moves the vehicle in a vehicle width direction will be performed even in a situation where there is no passenger in the passenger seat of the vehicle.

[0122] (Technical Idea 10) A vehicle display control device as described in any one of Technical Ideas 1 to 9, comprising a usage determination unit (108) that determines whether the passenger is using the passenger-side display device, and the display control unit (107a) causes the control content to be displayed not only on the driver-side display device but also on the passenger-side display device when the usage determination unit determines that the passenger is not using the passenger-side display device based on the fact that the driving control identification unit has identified that the specified driving control will be performed during the autonomous driving without monitoring obligation.

[0123] (Technical Idea 11) A vehicle display control device as described in any one of Technical Ideas 1 to 10, comprising a presentation control unit (109) capable of presenting information by voice other than the display on the passenger side display device by the display control unit, wherein the presentation control unit is also capable of presenting dialogue information, which is the presentation of information that prompts a dialogue with an occupant of the vehicle by having the occupant speak, and wherein the presentation control unit, when having the display control unit also display the control content on the passenger side display device based on the driving control identification unit identifying that the specified driving control will be performed during the autonomous driving without monitoring obligation, includes the implementation content of the specified driving control in the speech in the dialogue information presentation.

[0124] (Technical Idea 12) A vehicle display control device according to Technical Idea 11, comprising a passenger state identification unit (105b) that identifies the state of the passenger, wherein the presentation control unit is capable of controlling the audio output of a passenger side audio output device (9222) that is an audio output device provided in the vehicle and available to the passenger, to provide control content guidance, which is audio output indicating the content of the specified driving control to be implemented, as the information presentation different from the dialogue information presentation, wherein the presentation control unit, based on the identification by the driving control identification unit that the specified driving control will be implemented during the autonomous driving without monitoring obligation, causes the display control unit to also display the control content on the passenger side display device, and when the passenger state identification unit identifies anxiety of the passenger, not only causes the passenger side display device to display the control content, but also causes the passenger side audio output device to provide the control content guidance.

[0125] (Technical Idea 13) A vehicle display control device as described in any one of Technical Ideas 1 to 12, comprising an initial identification unit (112) that, when the driving control identification unit identifies that the specified driving control will be performed, identifies whether the specified driving control is the first specified driving control in a set period, and the display control unit (107c) causes the passenger-side display device to also display the control content when the initial identification unit identifies that the specified driving control is the first specified driving control in a set period, based on the driving control identification unit identifying that the specified driving control will be performed during the autonomous driving without monitoring obligation.

[0126] (Technical Idea 14) A vehicle display control device according to any one of Technical Ideas 1 to 13, comprising: a presentation control unit (109d) capable of causing the display control unit to present information by voice other than the display on the passenger-side display device; and an initial identification unit (112) that, when the driving control identification unit identifies that the predetermined driving control will be performed, identifies whether the predetermined driving control is the first predetermined driving control within a set period. The vehicle display control device, when the display control unit identifies that the predetermined driving control will be performed by the driving control identification unit, causes the display control unit to also display the control content on the passenger-side display device based on the identification that the predetermined driving control will be performed by the driving control identification unit, and when the initial identification unit identifies that the predetermined driving control is the first predetermined driving control within a set period, not only causes the passenger-side display device to display the control content, but also causes a passenger-side audio output device (9222) that is an audio output device provided in the vehicle and available to the passenger to present information about the predetermined driving control by voice.

[0127] (Technical Idea 15) A display control device for a vehicle described in any one of Technical Ideas 1 to 14, comprising: a driver state identification unit (113) that identifies the state of the driver; and a driving control instruction unit (114) that issues instructions to perform driving control of the vehicle, wherein the driving control instruction unit, when it is identified by the driving control identification unit that the predetermined driving control will be performed during the automatic driving without monitoring obligation and when it is identified by the driver state identification unit that the driver is anxious, performs a control adjustment to reduce the acceleration when accelerating with the predetermined driving control compared to when the driver state identification unit has not identified the driver's anxiety.

[0128] (Technical Idea 16) A display control device for a vehicle described in any one of Technical Ideas 1 to 15, comprising: a driver state identification unit (113) that identifies the state of the driver; and a driving control instruction unit (114) that issues instructions to perform driving control of the vehicle, wherein the driving control instruction unit, when it is identified by the driving control identification unit that the predetermined driving control will be performed during the automatic driving without monitoring obligation and when it is identified by the driver state identification unit that the driver is anxious, performs a control adjustment to make the timing of the start of deceleration when deceleration is performed by the predetermined driving control earlier than when the driver state identification unit has not identified that the driver is anxious.

[0129] (Technical Idea 17) A display control device for a vehicle as described in Technical Idea 15 or 16, comprising a passenger state identification unit (105b) that identifies the state of the passenger, wherein the driving control instruction unit does not perform the control adjustment when the driver state identification unit has not identified the driver's anxiety and when the passenger state identification unit has identified the passenger's anxiety, and the display control unit (107e), based on the fact that the driving control identification unit has identified that the specified driving control will be performed during the autonomous driving without monitoring obligation, also causes the passenger side display device to display the control content when the driver state identification unit has not identified the driver's anxiety and when the passenger state identification unit has identified the passenger's anxiety.

[0130] (Technical Idea 18) The vehicle display control device according to Technical Idea 15 or 16, further comprising: a presentation control unit (109f) capable of presenting information by voice other than the display on the passenger-side display device by the display control unit; and a passenger state identification unit (105b) that identifies the state of the passenger, wherein the driving control instruction unit does not perform the control adjustment when the driver state identification unit has not identified the driver's anxiety and the passenger state identification unit has identified the passenger's anxiety, The presentation control unit, when the driving control identification unit has identified that the specified driving control will be performed during the automatic driving without monitoring obligation, causes the display control unit to also display the control content on the passenger's side display device, and when the driver's state identification unit has not identified the driver's anxiety and the passenger's state identification unit has identified the passenger's anxiety, not only causes the passenger's side display device to display the control content, but also presents audio information about the specified driving control from a passenger's side audio output device (9222), which is an audio output device provided in the vehicle and available to the passenger.

[0131] The present disclosure is not limited to the above-described embodiments, and various modifications are possible within the scope of the claims. Embodiments obtained by appropriately combining the technical means disclosed in different embodiments are also within the technical scope of the present disclosure. Furthermore, the control unit and method described in the present disclosure may be implemented by a special-purpose computer comprising a processor programmed to execute one or more functions embodied in a computer program. Alternatively, the apparatus and method described in the present disclosure may be implemented by a special-purpose hardware logic circuit. Alternatively, the apparatus and method described in the present disclosure may be implemented by one or more special-purpose computers configured by combining a processor executing a computer program with one or more hardware logic circuits. Furthermore, the computer program may be stored as instructions executed by a computer on a computer-readable non-transitory tangible recording medium.

Claims

1. A vehicle display control device that can be used in vehicles performing autonomous driving, A driving control identification unit (102) identifies that a predetermined driving control is performed in the aforementioned automated driving, The vehicle comprises a display control unit (107, 107a, 107c, 107d, 107e) that controls the display on a driver-side display device, which is a display device for the driver only, and the display on a passenger-side display device, which is a display device installed in the vehicle and can be used by passengers other than the driver of the vehicle. The display control unit, based on its determination by the driving control identification unit that the predetermined driving control will be performed during automatic driving without monitoring obligations, which is automatic driving without monitoring obligations, causes not only the driver-side display device but also the passenger-side display device to display the control content, which is a display indicating the details of the predetermined driving control. The display control unit changes whether or not to display the control content on the passenger-side display device according to the type of predetermined driving control identified by the driving control identification unit. The display control unit causes the passenger-side display device to display the control content based on the fact that the type of predetermined driving control identified by the driving control identification unit is offset control, which is driving control that changes the position of the vehicle within its own lane in order to create a gap between the vehicle and surrounding vehicles. However, if the type is lane change control, which is driving control that changes lanes, the passenger-side display device does not display the control content.

2. A vehicle display control device that can be used in vehicles performing autonomous driving, A driving control identification unit (102) identifies that a predetermined driving control is performed in the aforementioned automated driving, The vehicle comprises a display control unit (107, 107a, 107c, 107d, 107e) that controls the display on a driver-side display device, which is a display device for the driver only, and the display on a passenger-side display device, which is a display device installed in the vehicle and can be used by passengers other than the driver of the vehicle. The display control unit, based on its determination by the driving control identification unit that the predetermined driving control will be performed during automatic driving without monitoring obligations, which is automatic driving without monitoring obligations, causes not only the driver-side display device but also the passenger-side display device to display the control content, which is a display indicating the details of the predetermined driving control. The aforementioned driving control specification unit specifies, at a minimum, an offset control, which is a driving control that changes the position of the vehicle within its own lane in order to create a gap between the vehicle and surrounding vehicles, as the predetermined driving control. The display control unit causes the passenger-side display device to display the control content when the type of predetermined driving control specified by the driving control specification unit is the offset control and the vehicle is moved to the side where the passenger is located by the offset control, while even if it is the offset control, if the vehicle is not moved to the side where the passenger is located by the offset control, the display control device does not display the control content on the passenger-side display device.

3. A vehicle display control device that can be used in vehicles performing autonomous driving, A driving control identification unit (102) identifies that a predetermined driving control is performed in the aforementioned automated driving, The vehicle comprises a display control unit (107, 107a, 107c, 107d, 107e) that controls the display on a driver-side display device, which is a display device for the driver only, and the display on a passenger-side display device, which is a display device installed in the vehicle and can be used by passengers other than the driver of the vehicle. The display control unit, based on its determination by the driving control identification unit that the predetermined driving control will be performed during automatic driving without monitoring obligations, which is automatic driving without monitoring obligations, causes not only the driver-side display device but also the passenger-side display device to display the control content, which is a display indicating the details of the predetermined driving control. The aforementioned driving control identification unit identifies, at a minimum, a passing control which is a driving control that causes the vehicle to pass an object when the distance between the vehicle and the object it is passing is less than or equal to a specified value, and a driving control other than the passing control, as the predetermined driving control. The vehicle is equipped with a sensing result acquisition unit (106) that acquires sensing results from surrounding monitoring sensors that monitor the area around the vehicle, The display control unit, when it determines that the lane-passing control is to be performed by the driving control specification unit during automatic driving without monitoring obligations, causes the passenger-side display device to display the sensing results acquired by the sensing result acquisition unit or the recognition results of the vehicle's surroundings using those sensing results, instead of the control content display.

4. A vehicle display control device that can be used in vehicles performing autonomous driving, A driving control identification unit (102) identifies that a predetermined driving control is performed in the aforementioned automated driving, The vehicle comprises a display control unit (107, 107a, 107c, 107d, 107e) that controls the display on a driver-side display device, which is a display device for the driver only, and the display on a passenger-side display device, which is a display device installed in the vehicle and can be used by passengers other than the driver of the vehicle. The display control unit, based on its determination by the driving control identification unit that the predetermined driving control will be performed during automatic driving without monitoring obligations, which is automatic driving without monitoring obligations, causes not only the driver-side display device but also the passenger-side display device to display the control content, which is a display indicating the details of the predetermined driving control. The aforementioned driving control identification unit identifies, at a minimum, automatic parking control, which is a driving control that automatically parks the vehicle, as the predetermined driving control. The vehicle is equipped with a sensing result acquisition unit (106) that acquires sensing results from surrounding monitoring sensors that monitor the area around the vehicle, The display control unit, in the event of automatic driving without monitoring obligation, determines in the driving control specification unit that automatic parking control will be performed, and in such a case, displays the sensing result acquired by the sensing result acquisition unit, or the recognition result of the area around the vehicle using the sensing result, on the passenger side of the vehicle where the passenger is located, on the passenger side display device.

5. A vehicle display control device that can be used in vehicles performing autonomous driving, A driving control identification unit (102) identifies that a predetermined driving control is performed in the aforementioned automated driving, The vehicle comprises a display control unit (107, 107a, 107c, 107d, 107e) that controls the display on a driver-side display device, which is a display device for the driver only, and the display on a passenger-side display device, which is a display device installed in the vehicle and can be used by passengers other than the driver of the vehicle. The display control unit, based on its determination by the driving control identification unit that the predetermined driving control will be performed during automatic driving without monitoring obligations, which is automatic driving without monitoring obligations, causes not only the driver-side display device but also the passenger-side display device to display the control content, which is a display indicating the details of the predetermined driving control. The system includes a presentation control unit (109) capable of providing information via voice, in addition to the display on the passenger-side display device by the display control unit, The presentation control unit can also perform dialogue information presentation, which is information presentation that allows for dialogue with the occupant of the vehicle by having it speak to the occupant of the vehicle. The aforementioned display control unit, based on the fact that the driving control identification unit has identified that the predetermined driving control will be performed during the automated driving without monitoring obligation, causes the display control unit to also display the control content on the passenger-side display device, and in such cases, the utterance in the dialogue information presentation also includes the details of the predetermined driving control. The system includes a passenger status identification unit (105b) that identifies the status of the passenger, The presentation control unit can also control the audio output from the passenger-side audio output device (9222), which is an audio output device installed in the vehicle that can be used by the passenger, and thereby provide control content guidance, which is an audio output indicating the content of the predetermined driving control, as an information presentation different from the dialogue information presentation. The aforementioned display control unit, in the case where, during automatic driving without monitoring obligation, the driving control identification unit has identified that the predetermined driving control will be performed, causes the display control unit to also display the control content on the passenger-side display device, and when the passenger state identification unit has identified the passenger's anxiety, not only causes the passenger-side display device to display the control content, but also causes the passenger-side voice output device to provide guidance on the control content.

6. A vehicle display control device that can be used in vehicles performing autonomous driving, A driving control identification unit (102) identifies that a predetermined driving control is performed in the aforementioned automated driving, The vehicle comprises a display control unit (107, 107a, 107c, 107d, 107e) that controls the display on a driver-side display device, which is a display device for the driver only, and the display on a passenger-side display device, which is a display device installed in the vehicle and can be used by passengers other than the driver of the vehicle. The display control unit, based on its determination by the driving control identification unit that the predetermined driving control will be performed during automatic driving without monitoring obligations, which is automatic driving without monitoring obligations, causes not only the driver-side display device but also the passenger-side display device to display the control content, which is a display indicating the details of the predetermined driving control. When the driving control identification unit identifies that the predetermined driving control is to be performed, it is further equipped with an initial identification unit (112) that identifies whether or not the predetermined driving control is the first predetermined driving control within a set period. The display control unit (107c) is a vehicle display control device that, when the driving control identification unit identifies that the predetermined driving control is performed during automatic driving without monitoring obligation, and when the initial identification unit identifies that the predetermined driving control is the first predetermined driving control within a set period, causes the passenger-side display device to also display the control content.

7. A vehicle display control device that can be used in vehicles performing autonomous driving, A driving control identification unit (102) identifies that a predetermined driving control is performed in the aforementioned automated driving, The vehicle comprises a display control unit (107, 107a, 107c, 107d, 107e) that controls the display on a driver-side display device, which is a display device for the driver only, and the display on a passenger-side display device, which is a display device installed in the vehicle and can be used by passengers other than the driver of the vehicle. The display control unit, based on its determination by the driving control identification unit that the predetermined driving control will be performed during automatic driving without monitoring obligations, which is automatic driving without monitoring obligations, causes not only the driver-side display device but also the passenger-side display device to display the control content, which is a display indicating the details of the predetermined driving control. A presentation control unit (109d) is capable of providing information by voice, in addition to the display on the passenger-side display device by the display control unit, When the driving control identification unit identifies that the predetermined driving control is to be performed, the system includes an initial identification unit (112) that identifies whether the predetermined driving control is the first predetermined driving control within a set period. The display control unit, in the case where, during automatic driving without monitoring obligation, the driving control identification unit has identified that the predetermined driving control is performed, and the display control unit causes the passenger-side display device to display the control content, and the initial identification unit has identified that the predetermined driving control is the first predetermined driving control within a set period, not only causes the passenger-side display device to display the control content, but also causes the passenger-side display device to provide audio information about the predetermined driving control from a passenger-side audio output device (9222), which is an audio output device installed in the vehicle and is available to the passenger.

8. A vehicle display control device that can be used in vehicles performing autonomous driving, A driving control identification unit (102) identifies that a predetermined driving control is performed in the aforementioned automated driving, The vehicle comprises a display control unit (107, 107a, 107c, 107d, 107e) that controls the display on a driver-side display device, which is a display device for the driver only, and the display on a passenger-side display device, which is a display device installed in the vehicle and can be used by passengers other than the driver of the vehicle. The display control unit, based on its determination by the driving control identification unit that the predetermined driving control will be performed during automatic driving without monitoring obligations, which is automatic driving without monitoring obligations, causes not only the driver-side display device but also the passenger-side display device to display the control content, which is a display indicating the details of the predetermined driving control. The driver status identification unit (113) identifies the driver's status, The vehicle is equipped with a driving control instruction unit (114) that gives instructions to control the vehicle's movement, The aforementioned driving control instruction unit, in the case of automatic driving without monitoring obligation, when the driving control identification unit determines that the predetermined driving control should be performed, and when the driver state identification unit identifies the driver's anxiety, performs a control adjustment to reduce the acceleration when accelerating with the predetermined driving control compared to when the driver state identification unit does not identify the driver's anxiety. The system includes a passenger status identification unit (105b) that identifies the status of the passenger, If the driver status identification unit has not identified the driver's anxiety, and the passenger status identification unit has identified the passenger's anxiety, the driving control instruction unit will not perform the control adjustment. The display control unit (107e) is a vehicle display control device that, in the event of automatic driving without monitoring obligation, determines that the predetermined driving control is performed by the driving control determination unit, and when the driver status determination unit has not determined the driver's anxiety, and the passenger status determination unit has determined the passenger's anxiety, causes the passenger display device to also display the control content.

9. A vehicle display control device that can be used in vehicles performing autonomous driving, A driving control identification unit (102) identifies that a predetermined driving control is performed in the aforementioned automated driving, The vehicle comprises a display control unit (107, 107a, 107c, 107d, 107e) that controls the display on a driver-side display device, which is a display device for the driver only, and the display on a passenger-side display device, which is a display device installed in the vehicle and can be used by passengers other than the driver of the vehicle. The display control unit, based on its determination by the driving control identification unit that the predetermined driving control will be performed during automatic driving without monitoring obligations, which is automatic driving without monitoring obligations, causes not only the driver-side display device but also the passenger-side display device to display the control content, which is a display indicating the details of the predetermined driving control. The driver status identification unit (113) identifies the driver's status, The vehicle is equipped with a driving control instruction unit (114) that gives instructions to control the vehicle's movement, The aforementioned driving control instruction unit, in the case of automatic driving without monitoring obligation, when the driving control identification unit determines that the predetermined driving control should be performed, and when the driver state identification unit identifies the driver's anxiety, performs a control adjustment to reduce the acceleration when accelerating with the predetermined driving control compared to when the driver state identification unit does not identify the driver's anxiety. A presentation control unit (109f) is capable of providing information by voice, in addition to the display on the passenger-side display device by the display control unit, The system includes a passenger status identification unit (105b) that identifies the status of the passenger, If the driver status identification unit has not identified the driver's anxiety, and the passenger status identification unit has identified the passenger's anxiety, the driving control instruction unit will not perform the control adjustment. The aforementioned display control unit, in the case where, during automatic driving without monitoring obligation, the driving control identification unit has identified that the predetermined driving control is to be performed, and the display control unit causes the passenger-side display device to display the control content, and the driver state identification unit has not identified the driver's anxiety, and the passenger state identification unit has identified the passenger's anxiety, not only causes the passenger-side display device to display the control content, but also causes the passenger-side display device to provide audio information about the predetermined driving control from a passenger-side audio output device (9222), which is an audio output device installed in the vehicle and is available to the passenger.

10. A vehicle display control device that can be used in vehicles performing autonomous driving, A driving control identification unit (102) identifies that a predetermined driving control is performed in the aforementioned automated driving, The vehicle comprises a display control unit (107, 107a, 107c, 107d, 107e) that controls the display on a driver-side display device, which is a display device for the driver only, and the display on a passenger-side display device, which is a display device installed in the vehicle and can be used by passengers other than the driver of the vehicle. The display control unit, based on its determination by the driving control identification unit that the predetermined driving control will be performed during automatic driving without monitoring obligations, which is automatic driving without monitoring obligations, causes not only the driver-side display device but also the passenger-side display device to display the control content, which is a display indicating the details of the predetermined driving control. The driver status identification unit (113) identifies the driver's status, The vehicle is equipped with a driving control instruction unit (114) that gives instructions to control the vehicle's movement, The aforementioned driving control instruction unit, in the case of automatic driving without monitoring obligation, when the driving control identification unit determines that the predetermined driving control will be performed, and when the driver state identification unit identifies the driver's anxiety, will perform a control adjustment to make the timing of the start of deceleration when decelerating with the predetermined driving control earlier than when the driver state identification unit does not identify the driver's anxiety. The system includes a passenger status identification unit (105b) that identifies the status of the passenger, If the driver status identification unit has not identified the driver's anxiety, and the passenger status identification unit has identified the passenger's anxiety, the driving control instruction unit will not perform the control adjustment. The display control unit (107e) is a vehicle display control device that, in the event of automatic driving without monitoring obligation, determines that the predetermined driving control is performed by the driving control determination unit, and when the driver status determination unit has not determined the driver's anxiety, and the passenger status determination unit has determined the passenger's anxiety, causes the passenger display device to also display the control content.

11. A vehicle display control device that can be used in vehicles performing autonomous driving, A driving control identification unit (102) identifies that a predetermined driving control is performed in the aforementioned automated driving, The vehicle comprises a display control unit (107, 107a, 107c, 107d, 107e) that controls the display on a driver-side display device, which is a display device for the driver only, and the display on a passenger-side display device, which is a display device installed in the vehicle and can be used by passengers other than the driver of the vehicle. The display control unit, based on its determination by the driving control identification unit that the predetermined driving control will be performed during automatic driving without monitoring obligations, which is automatic driving without monitoring obligations, causes not only the driver-side display device but also the passenger-side display device to display the control content, which is a display indicating the details of the predetermined driving control. The driver status identification unit (113) identifies the driver's status, The vehicle is equipped with a driving control instruction unit (114) that gives instructions to control the vehicle's movement, The aforementioned driving control instruction unit, in the case of automatic driving without monitoring obligation, when the driving control identification unit determines that the predetermined driving control will be performed, and when the driver state identification unit identifies the driver's anxiety, will perform a control adjustment to make the timing of the start of deceleration when decelerating with the predetermined driving control earlier than when the driver state identification unit does not identify the driver's anxiety. A presentation control unit (109f) is capable of providing information by voice, in addition to the display on the passenger-side display device by the display control unit, The system includes a passenger status identification unit (105b) that identifies the status of the passenger, If the driver status identification unit has not identified the driver's anxiety, and the passenger status identification unit has identified the passenger's anxiety, the driving control instruction unit will not perform the control adjustment. The aforementioned display control unit, in the case where, during automatic driving without monitoring obligation, the driving control identification unit has identified that the predetermined driving control is to be performed, and the display control unit causes the passenger-side display device to display the control content, and the driver state identification unit has not identified the driver's anxiety, and the passenger state identification unit has identified the passenger's anxiety, not only causes the passenger-side display device to display the control content, but also causes the passenger-side display device to provide audio information about the predetermined driving control from a passenger-side audio output device (9222), which is an audio output device installed in the vehicle and is available to the passenger.

12. A vehicle display control device according to any one of claims 1 to 11, The aforementioned driving control identification unit is a vehicle display control device that identifies a driving control different from the driving control used in the aforementioned automated driving as the predetermined driving control.

13. A vehicle display control device according to any one of claims 1 to 11, An obstacle identification unit (103) that identifies the presence or absence of obstacles around the vehicle, The vehicle includes a monitoring identification unit (104) that identifies whether or not the driver of the vehicle is monitoring the surroundings, The display control unit, when it identifies the presence of an obstacle, causes the driver-side display device to display information indicating that an obstacle has been detected, and when it identifies that the driver is not monitoring the surroundings, it also causes the passenger-side display device to display information indicating that an obstacle has been detected.

14. A vehicle display control device according to any one of claims 1 to 11, The aforementioned driving control specification unit specifies, at a minimum, a driving control that moves the vehicle in the vehicle width direction as the predetermined driving control. The display control unit, based on the fact that the driving control specification unit has determined that driving control is performed to move the vehicle in the vehicle width direction, even when there is no passenger in the passenger seat of the vehicle, causes the passenger-side display device to display the control content.

15. A vehicle display control device according to any one of claims 1 to 11, The system includes a usage determination unit (108) that determines whether the passenger is using the passenger-side display device, The display control unit (107a) is a vehicle display control device that, when the driving control identification unit has identified that the predetermined driving control is performed during automatic driving without monitoring obligation, and when the usage determination unit determines that the passenger is not using the passenger-side display device, causes the control content to be displayed not only on the driver-side display device but also on the passenger-side display device.

16. A vehicle display control method that can be used in vehicles performing autonomous driving, Run by at least one processor, A driving control identification step in which a predetermined driving control is performed in the aforementioned automated driving, The process includes a display control step that controls the display on a driver-side display device, which is a display device provided in the vehicle exclusively for the driver, and the display on a passenger-side display device, which is a display device provided in the vehicle and can be used by passengers other than the driver of the vehicle. In the aforementioned display control step, when there is no obligation to monitor the surroundings during autonomous driving without monitoring, based on the determination in the aforementioned driving control identification step that the predetermined driving control will be performed, the control content display, which is a display indicating the details of the predetermined driving control, is made to be shown not only on the driver's side display device but also on the passenger's side display device. In the display control step, the method of displaying the control content on the passenger-side display device is changed according to the type of predetermined driving control identified in the driving control identification step. In the display control step, the method for controlling a vehicle display in which, based on the fact that the type of predetermined driving control identified in the driving control identification step is offset control, which is driving control that changes the position of the vehicle within its own lane in order to create a gap between the vehicle and surrounding vehicles, the method causes the passenger-side display device to display the control content, while in the case of lane change control, which is driving control that changes lanes, the method does not cause the passenger-side display device to display the control content.

17. A vehicle display control method that can be used in vehicles performing autonomous driving, Run by at least one processor, A driving control identification step in which a predetermined driving control is performed in the aforementioned automated driving, The process includes a display control step that controls the display on a driver-side display device, which is a display device provided in the vehicle exclusively for the driver, and the display on a passenger-side display device, which is a display device provided in the vehicle and can be used by passengers other than the driver of the vehicle. In the aforementioned display control step, when there is no obligation to monitor the surroundings during autonomous driving without monitoring, based on the determination in the aforementioned driving control identification step that the predetermined driving control will be performed, the control content display, which is a display indicating the details of the predetermined driving control, is made to be shown not only on the driver's side display device but also on the passenger's side display device. In the aforementioned driving control identification step, at least an offset control, which is a driving control that changes the position of the vehicle within its own lane in order to create a gap between the vehicle and surrounding vehicles, is identified as the predetermined driving control. A vehicle display control method in which, in the display control step, if the type of predetermined driving control identified in the driving control identification step is the offset control, and the vehicle is moved to the side where the passenger is located by the offset control, the control content is displayed on the passenger-side display device; on the other hand, even if it is the offset control, if the vehicle is not moved to the side where the passenger is located by the offset control, the control content is not displayed on the passenger-side display device.

18. A vehicle display control method that can be used in vehicles performing autonomous driving, Run by at least one processor, A driving control identification step in which a predetermined driving control is performed in the aforementioned automated driving, The process includes a display control step that controls the display on a driver-side display device, which is a display device provided in the vehicle exclusively for the driver, and the display on a passenger-side display device, which is a display device provided in the vehicle and can be used by passengers other than the driver of the vehicle. In the aforementioned display control step, when there is no obligation to monitor the surroundings during autonomous driving without monitoring, based on the determination in the aforementioned driving control identification step that the predetermined driving control will be performed, the control content display, which is a display indicating the details of the predetermined driving control, is made to be shown not only on the driver's side display device but also on the passenger's side display device. In the aforementioned driving control identification step, at least a passing control, which is a driving control that causes the vehicle to pass an object when the distance between the vehicle and the object it is passing is less than or equal to a specified value, and a driving control other than the passing control are identified as the predetermined driving control. This includes a sensing result acquisition step, which involves acquiring sensing results from surrounding monitoring sensors that monitor the area around the vehicle, A vehicle display control method in which, in the display control step, when the driving control identification step identifies that the lane-passing control will be performed during the automated driving without monitoring obligation, the passenger-side display device displays the sensing result acquired in the sensing result acquisition step or the recognition result of the vehicle's surroundings using the sensing result, instead of the control content display.

19. A vehicle display control method that can be used in vehicles performing autonomous driving, Run by at least one processor, A driving control identification step in which a predetermined driving control is performed in the aforementioned automated driving, The process includes a display control step that controls the display on a driver-side display device, which is a display device provided in the vehicle exclusively for the driver, and the display on a passenger-side display device, which is a display device provided in the vehicle and can be used by passengers other than the driver of the vehicle. In the aforementioned display control step, when there is no obligation to monitor the surroundings during autonomous driving without monitoring, based on the determination in the aforementioned driving control identification step that the predetermined driving control will be performed, the control content display, which is a display indicating the details of the predetermined driving control, is made to be shown not only on the driver's side display device but also on the passenger's side display device. In the aforementioned driving control identification step, at least an automatic parking control, which is a driving control that automatically parks the vehicle, is identified as the predetermined driving control. This includes a sensing result acquisition step, which involves acquiring sensing results from surrounding monitoring sensors that monitor the area around the vehicle, In the display control step, if the automatic parking control is determined in the driving control determination step during automatic driving without monitoring obligation, the vehicle display control method causes the vehicle to display the sensing result obtained in the sensing result acquisition step, or the recognition result of the area around the vehicle using the sensing result, on the passenger side of the vehicle where the passenger is located, on the passenger side display device.

20. A vehicle display control method that can be used in vehicles performing autonomous driving, Run by at least one processor, A driving control identification step in which a predetermined driving control is performed in the aforementioned automated driving, The process includes a display control step that controls the display on a driver-side display device, which is a display device provided in the vehicle exclusively for the driver, and the display on a passenger-side display device, which is a display device provided in the vehicle and can be used by passengers other than the driver of the vehicle. In the aforementioned display control step, when there is no obligation to monitor the surroundings during autonomous driving without monitoring, based on the determination in the aforementioned driving control identification step that the predetermined driving control will be performed, the control content display, which is a display indicating the details of the predetermined driving control, is made to be shown not only on the driver's side display device but also on the passenger's side display device. This includes a presentation control step that enables the presentation of information by voice, in addition to the display on the passenger-side display device as a result of the display control step, In the aforementioned presentation control process, it is also possible to perform dialogue information presentation, which is information presentation that allows for dialogue with the occupant of the vehicle by having the vehicle make a speech directed at the occupant. In the aforementioned presentation control step, when the predetermined driving control is determined to be performed in the driving control identification step during autonomous driving without monitoring obligations, and the control content is displayed on the passenger-side display device by the display control step, the utterance in the dialogue information presentation also includes the details of the predetermined driving control. This includes a passenger status identification step that identifies the status of the aforementioned passenger, In the presentation control step, by controlling the voice output of the passenger-side voice output device (9222), which is a voice output device installed in the vehicle and usable by the passenger, it is also possible to provide control content guidance, which is a voice output indicating the content of the predetermined driving control, as information presentation different from the dialogue information presentation. In the aforementioned presentation control step, when the vehicle is in automatic driving mode without monitoring obligation, and the vehicle has determined in the driving control identification step that the predetermined driving control will be performed, the vehicle is instructed by the display control step to also display the control content on the passenger-side display device, and in the passenger state identification step, the passenger's anxiety is identified, in addition to instructing the passenger-side display device to display the control content, the vehicle is also instructed by the passenger-side voice output device to provide guidance on the control content.

21. A vehicle display control method that can be used in vehicles performing autonomous driving, Run by at least one processor, A driving control identification step in which a predetermined driving control is performed in the aforementioned automated driving, The process includes a display control step that controls the display on a driver-side display device, which is a display device provided in the vehicle exclusively for the driver, and the display on a passenger-side display device, which is a display device provided in the vehicle and can be used by passengers other than the driver of the vehicle. In the aforementioned display control step, when there is no obligation to monitor the surroundings during autonomous driving without monitoring, based on the determination in the aforementioned driving control identification step that the predetermined driving control will be performed, the control content display, which is a display indicating the details of the predetermined driving control, is made to be shown not only on the driver's side display device but also on the passenger's side display device. If the driving control identification step identifies that the predetermined driving control will be performed, the process includes an initial identification step to determine whether or not that predetermined driving control is the first predetermined driving control within a set period. In the display control step, when the predetermined driving control is determined in the driving control determination step to be performed during automatic driving without monitoring obligation, if the predetermined driving control is determined in the initial determination step to be the first predetermined driving control within a set period, the display control method for a vehicle is also made to display the control content on the passenger-side display device.

22. A vehicle display control method that can be used in vehicles performing autonomous driving, Run by at least one processor, A driving control identification step in which a predetermined driving control is performed in the aforementioned automated driving, The process includes a display control step that controls the display on a driver-side display device, which is a display device provided in the vehicle exclusively for the driver, and the display on a passenger-side display device, which is a display device provided in the vehicle and can be used by passengers other than the driver of the vehicle. In the aforementioned display control step, when there is no obligation to monitor the surroundings during autonomous driving without monitoring, based on the determination in the aforementioned driving control identification step that the predetermined driving control will be performed, the control content display, which is a display indicating the details of the predetermined driving control, is made to be shown not only on the driver's side display device but also on the passenger's side display device. A presentation control step that enables the presentation of information by voice, in addition to the display on the passenger-side display device as a result of the display control step, If the driving control identification step identifies that the predetermined driving control will be performed, the process includes an initial identification step that identifies whether or not the predetermined driving control is the first predetermined driving control within a set period. In the presentation control step, when the vehicle is in automatic driving without monitoring duty, and the vehicle has determined in the driving control identification step that the predetermined driving control will be performed, the display control step causes the control content to be displayed on the passenger-side display device, and in the initial identification step, the vehicle has determined that the predetermined driving control is the first predetermined driving control within a set period, the vehicle not only causes the control content to be displayed on the passenger-side display device, but also causes the vehicle to provide audio information about the predetermined driving control from a passenger-side audio output device (9222), which is an audio output device installed in the vehicle and is available to the passenger.

23. A vehicle display control method that can be used in vehicles performing autonomous driving, Run by at least one processor, A driving control identification step in which a predetermined driving control is performed in the aforementioned automated driving, The process includes a display control step that controls the display on a driver-side display device, which is a display device provided in the vehicle exclusively for the driver, and the display on a passenger-side display device, which is a display device provided in the vehicle and can be used by passengers other than the driver of the vehicle. In the aforementioned display control step, when there is no obligation to monitor the surroundings during autonomous driving without monitoring, based on the determination in the aforementioned driving control identification step that the predetermined driving control will be performed, the control content display, which is a display indicating the details of the predetermined driving control, is made to be shown not only on the driver's side display device but also on the passenger's side display device. A driver status identification step to identify the driver's status, The process includes a driving control instruction step which gives instructions to perform driving control of the vehicle, In the aforementioned driving control instruction step, if, during the aforementioned automated driving without monitoring obligation, the driving control identification step identifies that the predetermined driving control will be performed, and the driver's anxiety is identified in the driver's state identification step, the system will perform a control adjustment to reduce the acceleration when accelerating in the predetermined driving control compared to when the driver's anxiety is not identified in the driver's state identification step. This includes a passenger status identification step that identifies the status of the aforementioned passenger, In the aforementioned driving control instruction step, if the driver's anxiety has not been identified in the driver's state identification step, and the passenger's anxiety has been identified in the passenger's state identification step, the control adjustment will not be performed. In the aforementioned display control step, based on the fact that the predetermined driving control is determined in the driving control determination step when the vehicle is in automatic driving without monitoring obligation, if the driver's anxiety is not determined in the driver's state determination step, and the passenger's anxiety is determined in the passenger's state determination step, the vehicle display control method causes the passenger's display device to also display the control content.

24. A vehicle display control method that can be used in vehicles performing autonomous driving, Run by at least one processor, A driving control identification step in which a predetermined driving control is performed in the aforementioned automated driving, The process includes a display control step that controls the display on a driver-side display device, which is a display device provided in the vehicle exclusively for the driver, and the display on a passenger-side display device, which is a display device provided in the vehicle and can be used by passengers other than the driver of the vehicle. In the aforementioned display control step, when there is no obligation to monitor the surroundings during autonomous driving without monitoring, based on the determination in the aforementioned driving control identification step that the predetermined driving control will be performed, the control content display, which is a display indicating the details of the predetermined driving control, is made to be shown not only on the driver's side display device but also on the passenger's side display device. A driver status identification step to identify the driver's status, The process includes a driving control instruction step which gives instructions to perform driving control of the vehicle, In the aforementioned driving control instruction step, if, during the aforementioned automated driving without monitoring obligation, the driving control identification step identifies that the predetermined driving control will be performed, and the driver's anxiety is identified in the driver's state identification step, the system will perform a control adjustment to reduce the acceleration when accelerating in the predetermined driving control compared to when the driver's anxiety is not identified in the driver's state identification step. A presentation control step that enables the presentation of information by voice, in addition to the display on the passenger-side display device as a result of the display control step, This includes a passenger status identification step that identifies the status of the aforementioned passenger, In the aforementioned driving control instruction step, if the driver's anxiety has not been identified in the driver's state identification step, and the passenger's anxiety has been identified in the passenger's state identification step, the control adjustment will not be performed. In the aforementioned presentation control step, when the vehicle is in automatic driving without monitoring obligation, and the vehicle has determined in the driving control identification step that the predetermined driving control will be performed, the vehicle is instructed by the display control step to also display the control content on the passenger-side display device, and the driver's anxiety has not been identified in the driver's state identification step, and the passenger's anxiety has been identified in the passenger's state identification step, the vehicle is instructed not only to display the control content on the passenger-side display device, but also to provide audio information about the predetermined driving control from a passenger-side audio output device (9222), which is an audio output device provided in the vehicle and is available to the passenger.

25. A vehicle display control method that can be used in vehicles performing autonomous driving, Run by at least one processor, A driving control identification step in which a predetermined driving control is performed in the aforementioned automated driving, The process includes a display control step that controls the display on a driver-side display device, which is a display device provided in the vehicle exclusively for the driver, and the display on a passenger-side display device, which is a display device provided in the vehicle and can be used by passengers other than the driver of the vehicle. In the aforementioned display control step, when there is no obligation to monitor the surroundings during autonomous driving without monitoring, based on the determination in the aforementioned driving control identification step that the predetermined driving control will be performed, the control content display, which is a display indicating the details of the predetermined driving control, is made to be shown not only on the driver's side display device but also on the passenger's side display device. A driver status identification step to identify the driver's status, The process includes a driving control instruction step which gives instructions to perform driving control of the vehicle, In the aforementioned driving control instruction step, if, during the aforementioned automated driving without monitoring obligation, the driving control identification step identifies that the predetermined driving control will be performed, and the driver's anxiety is identified in the driver's state identification step, the control adjustment is made to make the timing of the start of deceleration when decelerating in the predetermined driving control earlier than when the driver's anxiety is not identified in the driver's state identification step. This includes a passenger status identification step that identifies the status of the aforementioned passenger, In the aforementioned driving control instruction step, if the driver's anxiety has not been identified in the driver's state identification step, and the passenger's anxiety has been identified in the passenger's state identification step, the control adjustment will not be performed. In the aforementioned display control step, based on the fact that the predetermined driving control is determined in the driving control determination step when the vehicle is in automatic driving without monitoring obligation, if the driver's anxiety is not determined in the driver's state determination step, and the passenger's anxiety is determined in the passenger's state determination step, the vehicle display control method causes the passenger's display device to also display the control content.

26. A vehicle display control method that can be used in vehicles performing autonomous driving, Run by at least one processor, A driving control identification step in which a predetermined driving control is performed in the aforementioned automated driving, The process includes a display control step that controls the display on a driver-side display device, which is a display device provided in the vehicle exclusively for the driver, and the display on a passenger-side display device, which is a display device provided in the vehicle and can be used by passengers other than the driver of the vehicle. In the aforementioned display control step, when there is no obligation to monitor the surroundings during autonomous driving without monitoring, based on the determination in the aforementioned driving control identification step that the predetermined driving control will be performed, the control content display, which is a display indicating the details of the predetermined driving control, is made to be shown not only on the driver's side display device but also on the passenger's side display device. A driver status identification step to identify the driver's status, The process includes a driving control instruction step which gives instructions to perform driving control of the vehicle, In the aforementioned driving control instruction step, if, during the aforementioned automated driving without monitoring obligation, the driving control identification step identifies that the predetermined driving control will be performed, and the driver's anxiety is identified in the driver's state identification step, the control adjustment is made to make the timing of the start of deceleration when decelerating in the predetermined driving control earlier than when the driver's anxiety is not identified in the driver's state identification step. A presentation control step that enables the presentation of information by voice, in addition to the display on the passenger-side display device as a result of the display control step, This includes a passenger status identification step that identifies the status of the aforementioned passenger, In the aforementioned driving control instruction step, if the driver's anxiety has not been identified in the driver's state identification step, and the passenger's anxiety has been identified in the passenger's state identification step, the control adjustment will not be performed. In the aforementioned presentation control step, when the vehicle is in automatic driving without monitoring obligation, and the vehicle has determined in the driving control identification step that the predetermined driving control will be performed, the vehicle is instructed by the display control step to also display the control content on the passenger-side display device, and the driver's anxiety has not been identified in the driver's state identification step, and the passenger's anxiety has been identified in the passenger's state identification step, the vehicle is instructed not only to display the control content on the passenger-side display device, but also to provide audio information about the predetermined driving control from a passenger-side audio output device (9222), which is an audio output device provided in the vehicle and is available to the passenger.