Notification device, notification method, and program

Abstract

The present invention provides a notification device, notification method, and program that can prevent the occupant from losing awareness of the driving conditions when they become awake, even if there are changes in the driving conditions. [Solution] The notification device is a notification device that notifies an occupant riding in a vehicle capable of autonomous driving, and comprises a sleep information acquisition unit 322 that acquires sleep information indicating the occupant's sleep state, and a notification control unit 422 that outputs notification information to notify the occupant of the changes when the occupant wakes up if there are any changes in the vehicle's driving conditions while the occupant is sleeping.

Description

[Technical Field]

[0001] The present disclosure relates to a notification device, a notification method, and a program for notifying a vehicle occupant. [Background Art]

[0002] Patent Document 1 discloses an automatic driving apparatus that performs automatic driving, comprising: a vehicle control unit that performs automatic driving along an approved route that is a route approved by a driver's seat occupant; a delay factor detection unit that detects a predetermined delay factor existing on the approved route; and an occupant state acquisition unit that acquires whether the driver's seat occupant is asleep, wherein the vehicle control unit is configured to, when a delay factor is detected, search for an alternative route and change a planned travel route to the alternative route without obtaining approval from the driver's seat occupant. [Prior Art Document] [Patent Document]

[0003] [Patent Document 1] Japanese Unexamined Patent Application Publication No. 2023-108495 [Summary of the Invention] [Problem to be Solved by the Invention]

[0004] However, in the above-mentioned Patent Document 1, when there is a change related to the traveling situation, the driver's seat occupant may not be able to grasp the traveling situation when waking up. In this case, for example, if the vehicle is traveling in an unexpected location when the driver's seat occupant wakes up, the driver's seat occupant may feel anxious.

[0005] The present disclosure provides a notification device, a notification method, and a program capable of suppressing a situation where an occupant cannot grasp a traveling situation when waking up even when there is a change related to the traveling situation. [Means for Solving the Problem]

[0006] A notification device according to one aspect of the present disclosure is a notification device for notifying an occupant riding in a vehicle capable of autonomous driving, comprising: a sleep information acquisition unit that acquires sleep information indicating the occupant's sleep state; and a notification information output unit that outputs notification information to notify the occupant of the content of any changes in the vehicle's driving conditions when the occupant wakes up while the occupant is sleeping.

[0007] A notification method relating to one aspect of the present disclosure is a notification method for notifying an occupant riding in a vehicle capable of autonomous driving, comprising the steps of: acquiring sleep information indicating the occupant's sleep state; and, if there is a change in the vehicle's driving conditions while the occupant is sleeping, outputting notification information to notify the occupant of the details of the change when the occupant wakes up.

[0008] A program relating to one aspect of this disclosure causes a computer to execute the notification method described above. [Effects of the Invention]

[0009] According to this disclosure, it is possible to provide a notification device, notification method, and program that can prevent the occupant from losing awareness of the driving conditions when they become awake, even if there are changes in the driving conditions. [Brief explanation of the drawing]

[0010] [Figure 1] Figure 1 shows an example of the configuration of an automated driving system equipped with a notification device according to this embodiment. [Figure 2] Figure 2 shows an example of the interior of a vehicle equipped with an autonomous driving system. [Figure 3] Figure 3 is a block diagram showing the configuration of the autonomous driving ECU and in-vehicle equipment according to the embodiment. [Figure 4] Figure 4 is a flowchart showing an example of the operation of the autonomous driving system in this embodiment. [Figure 5] Figure 5 shows an example of the configuration of an automated driving system equipped with a notification device according to the first modified example. [Figure 6] Figure 6 is a block diagram showing the configuration of the autonomous driving ECU and in-vehicle equipment in the first modified example. [Figure 7] Figure 7 is a flowchart showing an example of the operation of the first modified autonomous driving system. [Figure 8] Figure 8 is a flowchart showing an example of the operation of the second modified autonomous driving system. [Figure 9] Figure 9 is a block diagram showing the configuration of the autonomous driving ECU and in-vehicle equipment in the third modified example. [Modes for carrying out the invention]

[0011] A notification device according to a first aspect of this disclosure is a notification device for notifying an occupant riding in a vehicle capable of autonomous driving, comprising: a sleep information acquisition unit that acquires sleep information indicating the occupant's sleep state; and a notification information output unit that outputs notification information to notify the occupant of the content of any changes in the vehicle's driving conditions when the occupant wakes up while the occupant is sleeping.

[0012] According to the notification device of the first embodiment described above, if there is a change in the driving conditions while the occupant is sleeping, notification information can be output to inform the occupant of the change when the occupant wakes up. This makes it possible to prevent the occupant from being unable to understand the driving conditions when they wake up, even if there is a change in the driving conditions.

[0013] A notification device according to a second aspect of this disclosure is a notification device according to the first aspect described above, further comprising a route change unit for changing the route to the destination, wherein the change in driving conditions includes the change in the route.

[0014] According to the notification device according to the second aspect described above, if the route to the destination is changed while the occupant is asleep, the content of the route change can be notified to the occupant when the occupant wakes up. This can, for example, prevent the occupant from feeling uneasy. It should be noted that when the route to the destination is changed while the occupant is asleep, for example, if the vehicle is traveling in an unexpected location when the occupant wakes up, there is a concern that the occupant may feel uneasy.

[0015] A notification device according to a third aspect of the present disclosure is the notification device according to the second aspect described above, wherein the occupant includes a first occupant and a second occupant, and the route changing unit changes the route without obtaining permission from the second occupant while the first occupant is asleep.

[0016] According to the notification device according to the third aspect described above, the route can be automatically changed without obtaining permission from the second occupant. Therefore, for example, when changing the route, it is possible to prevent the second occupant from feeling bothered. Furthermore, for example, when the second occupant is a child, it is unnecessary to have the child make a judgment on the route change.

[0017] A notification device according to a fourth aspect of the present disclosure is the notification device according to any one of the first to third aspects described above, wherein the change related to the traveling condition includes a change in tolls required to arrive at the destination.

[0018] According to the notification device according to the fourth aspect described above, for example, even when the toll is changed along with the route change, the occupant can be notified that the toll has been changed when the occupant wakes up.

[0019] A notification device according to a fifth aspect of the present disclosure is the notification device according to any one of the first to fourth aspects described above, wherein the notification information includes information indicating a reason for the change.

[0020] According to the notification device according to the fifth aspect described above, the reason for the change can be notified to the occupant when the occupant wakes up, and therefore, for example, it is possible to prevent the occupant from feeling doubt and / or anxiety.

[0021] The notification device according to the sixth aspect of this disclosure is a notification device according to any one of the first to fifth aspects described above, wherein the occupants include the driver's seat occupant, and the notification information output unit outputs the notification information when the driver's seat occupant wakes up if there is a change in the driving conditions while the driver's seat occupant is sleeping.

[0022] According to the notification device of the sixth embodiment described above, it is possible to prevent the driver from losing awareness of the driving situation when they become awake.

[0023] A notification device according to a seventh aspect of this disclosure includes a route changing unit in the notification device according to the sixth aspect, wherein the occupants include a passenger in the front seat, and the route changing unit changes the route when it obtains permission from the passenger in the front seat while the driver in the front seat is asleep.

[0024] According to the notification device of the seventh aspect described above, the route can be changed while the driver is asleep, with the permission of the passenger in the front seat.

[0025] The notification device according to the eighth aspect of this disclosure is a notification device according to any one of the first to seventh aspects, wherein the occupants include the driver's seat occupant and the passenger seat occupant, and the notification information output unit outputs the notification information when the passenger seat occupant wakes up if there is a change in the driving conditions while the passenger seat occupant is sleeping.

[0026] According to the notification device of the eighth aspect described above, it is possible to prevent the passenger in the front seat from losing awareness of the driving situation when they become awake.

[0027] A notification device according to the ninth aspect of this disclosure includes a mode switching unit that switches between a notification mode for providing notifications to the occupant and a non-notification mode for providing notifications, in a notification device according to any one of the first to eighth aspects described above.

[0028] According to the notification device of the ninth aspect described above, for example, if the occupant is not interested in changes related to the driving conditions, setting it to a non-notification mode can prevent the occupant from feeling annoyed.

[0029] A notification method relating to the tenth aspect of this disclosure is a notification method for notifying an occupant riding in a vehicle capable of autonomous driving, and includes the steps of: acquiring sleep information indicating the sleep state of the occupant; and, if there is a change in the driving conditions of the vehicle while the occupant is sleeping, outputting notification information to notify the occupant of the details of the change when the occupant wakes up.

[0030] According to the notification method of the 10th embodiment described above, if there is a change in the driving conditions while the occupants are sleeping, notification information can be output to inform the occupants of the change when they wake up. This makes it possible to prevent the occupants from being unable to understand the driving conditions when they wake up, even if there is a change in the driving conditions.

[0031] The program relating to the 11th aspect of this disclosure causes a computer to execute the notification method relating to the 10th aspect described above.

[0032] According to the program of the 11th embodiment described above, even if there is a change in the driving conditions, it is possible to suppress the situation in which the occupants become awake and lose their ability to understand the driving conditions.

[0033] Further advantages and effects of one aspect of this disclosure will be made apparent from the specification and drawings. Such advantages and / or effects are provided by some embodiments and configurations described in the specification and drawings, but not all configurations are necessarily required.

[0034] The embodiments will be described in detail below with reference to the drawings. The embodiments described below are all general or specific examples. The numerical values, shapes, materials, components, arrangement and connection forms of components, steps, and the order of steps shown in the embodiments below are examples and are not intended to limit the disclosure. Among the components in the embodiments below, components that are not described in the independent claim indicating the highest-level concept will be described as optional components. Each figure is a schematic diagram and is not necessarily a strict illustration. In each figure, the same components are denoted by the same reference numerals.

[0035] (Embodiment) Figure 1 shows an example of the configuration of an automated driving system 100 equipped with a notification device according to this embodiment. Figure 2 shows an example of the interior of a vehicle equipped with the automated driving system 100.

[0036] The autonomous driving system 100 is a system that enables an autonomous vehicle to be driven. The vehicle is not particularly limited and may be an electric vehicle, a hybrid vehicle, or a gasoline-powered vehicle, for example. In this embodiment, autonomous driving refers to, for example, Level 4 or Level 5 as defined by the Society of Automotive Engineers (SAE International).

[0037] As shown in Figure 1, the autonomous driving system 100 includes a surrounding monitoring sensor 11, a vehicle status sensor 12, a GPS (Global Positioning System) unit 13, a map information storage unit 14, a wireless communication device 15, an occupant status sensor 16, a body ECU (Electronic Control Unit) 17, and a driving actuator 18. The autonomous driving system 100 also includes an HMI (Human Machine Interface) device 20, an autonomous driving ECU 30, and an in-vehicle unit 40. The in-vehicle unit 40 is an IVI (In-Vehicle Infotainment), a CDC (Cockpit Domain Controller), etc. Note that the autonomous driving ECU 30 and the in-vehicle unit 40 are examples of the "notification devices" described herein.

[0038] The autonomous driving ECU 30 is interconnected with the surrounding monitoring sensor 11, vehicle status sensor 12, GPS unit 13, map information storage unit 14, wireless communication device 15, occupant status sensor 16, body ECU 17, driving actuator 18, HMI device 20, and in-vehicle unit 40, for example, via an in-vehicle network 50, enabling mutual communication. The in-vehicle network 50 is a communication network established within the vehicle. The communication standards of the in-vehicle network 50 are not particularly limited. The autonomous driving ECU 30 may also be connected to other devices via signal lines other than the in-vehicle network 50.

[0039] The surrounding monitoring sensor 11 is a sensor that monitors the environment around the vehicle. The surrounding monitoring sensor 11 detects moving and stationary objects within the detection range around the vehicle. The surrounding monitoring sensor 11 includes, for example, a camera 11a, sonar 11b, radar 11c and / or Lidar (Light Detection And Ranging) 11d. The camera 11a has, for example, an image sensor. The sonar 11b obtains information about the surrounding environment using sound waves such as ultrasound. The radar 11c obtains information about the surrounding environment using radio waves. The Lidar 11d obtains information about the surrounding environment using laser light.

[0040] The surrounding monitoring sensor 11 detects, for example, moving objects such as pedestrians and other vehicles, road markings (lane markings, etc.), and structures installed along the road (road signs, traffic lights, etc.). The surrounding monitoring sensor 11 also detects, for example, the color of traffic lights and the illumination status of brake lights and turn signals of vehicles ahead.

[0041] For example, the detection results from the surrounding monitoring sensor 11 are transmitted to the autonomous driving ECU 30, which then analyzes the detection results from the surrounding monitoring sensor 11 to detect the vehicle's surrounding environment.

[0042] The vehicle condition sensor 12 detects information related to the vehicle's state. The vehicle condition sensor 12 includes, for example, a vehicle speed sensor, a steering angle sensor, and an acceleration sensor. The vehicle speed sensor detects the vehicle's speed. The steering angle sensor detects the steering angle. The acceleration sensor detects, for example, the acceleration of the vehicle in the longitudinal direction and the acceleration in the lateral direction (width direction). The detection results from the vehicle condition sensor 12 are transmitted, for example, to the autonomous driving ECU 30.

[0043] The GPS unit 13 calculates the vehicle's position using signals transmitted from positioning satellites that constitute the GNSS (Global Navigation Satellite System). The GPS unit 13 includes a GNSS receiver and inertial sensors, etc. The GPS unit 13 calculates the vehicle's position and direction of travel, and transmits the calculation results to the autonomous driving ECU 30.

[0044] The map information storage unit 14 is a memory device that stores map information. The map information includes the three-dimensional shape of roads, the locations of road markings and traffic signs, etc. The map information stored in the map information storage unit 14 may be updated, for example, based on update information received by the wireless communication device 15.

[0045] The wireless communication device 15 is a device having a communication circuit that allows the vehicle to communicate wirelessly with other devices. The communication standard for wireless communication is not particularly limited.

[0046] The wireless communication device 15 acquires traffic information such as congestion information, accident information, and traffic regulation information from external devices such as a map server, traffic information center, roadside unit, and other vehicles. Congestion information includes, for example, the location of the congested section, the length of the congestion, and the time required to pass through the congested section. Accident information includes, for example, the location of the accident and the time of the accident. Traffic regulation information includes, for example, the location of the regulated section and the regulation time. Traffic regulation information may also include the reason for the regulation (construction or accident, etc.), the lane number to be regulated, and the maximum speed limit to be regulated.

[0047] The occupant state sensor 16 includes, for example, a driver's seat occupant sensor 16a that detects the state of the driver's seat occupant. The driver's seat occupant sensor 16a is, for example, capable of detecting at least the state of the driver's seat occupant's face. The driver's seat occupant sensor 16a is, for example, positioned diagonally above the front of the driver's seat (see Figure 2). The driver's seat occupant sensor 16a is, for example, a camera having an image sensor such as an image sensor. Note that the driver's seat occupant sensor 16a does not have to be a camera, and may be, for example, a biosensor that detects heart rate, pulse and / or body temperature.

[0048] The driver's seat occupant sensor 16a sequentially detects the state of the driver's seat occupant based on the driver's seat occupant's face image included in the captured image. For example, the driver's seat occupant sensor 16a sequentially detects the driver's seat occupant's face orientation, gaze direction, and / or the degree of eyelid opening as part of the driver's seat occupant's state. The driver's seat occupant sensor 16a transmits driver's seat occupant information indicating the driver's seat occupant's state to, for example, the automatic driving ECU 30. In this embodiment, the driver's seat occupant sensor 16a transmits at least sleep information indicating the driver's seat occupant's sleep state to the automatic driving ECU 30.

[0049] The body ECU 17 is an ECU that comprehensively controls the body-related on-board equipment installed in the vehicle. These body-related on-board equipment include, for example, electric windows, electric doors, turn signals, and headlights.

[0050] The travel actuator 18 includes, for example, a drive motor or an engine. The travel actuator 18 may also include, for example, a brake actuator and a steering actuator.

[0051] The HMI device 20 is an interface device for information exchange between the occupant and the automated driving system 100. The HMI device 20 has, for example, a display 21 and a speaker 22 as devices for notifying the occupant of information. The HMI device 20 also has an input device 23 as an input interface for receiving operations from the occupant.

[0052] As shown in Figure 2, in this embodiment, the display 21 includes, for example, a head-up display (HUD) (not shown) and / or a center display. The HUD is a device that projects a virtual image onto a predetermined area, such as the windshield, by projecting image light onto it. The center display is a display provided in the center of the instrument panel in the vehicle width direction. The center display is composed of, for example, a liquid crystal display or an organic EL display. The display 21 displays an image corresponding to the input signal based on the control signal and video signal input from the autonomous driving ECU 30.

[0053] Speaker 22 outputs sound to the occupants. Speaker 22 is a device that outputs sound corresponding to the signal input from the autonomous driving ECU 30.

[0054] The input device 23 is a device that receives input operations from the occupant to the automated driving system 100. The input device 23 has, for example, a touch panel that receives touch operations from the occupant, and / or a microphone that receives voice operations from the occupant.

[0055] As shown in Figure 1, the autonomous driving ECU 30 controls the driving actuator 18 and the body ECU 17 based on the detection results of the surrounding monitoring sensor 11, the detection results of the vehicle state sensor 12, the calculation results of the GPS unit 13, map information, traffic information, the detection results of the occupant state sensor 16, etc., thereby executing some or all of the driving operations.

[0056] The autonomous driving ECU 30 is a computer device. The autonomous driving ECU 30 has a communication unit 31, a control unit 32, and a storage unit 33.

[0057] The communication unit 31 is a communication module (communication circuit) for communicating with the surrounding monitoring sensor 11 and the in-vehicle device 40, etc., via the in-vehicle network 50. The communication unit 31 is, for example, a wired communication circuit for wired communication, but it may also be a wireless communication circuit for wireless communication.

[0058] The control unit 32 performs, for example, information processing in the autonomous driving ECU 30 and control of the operations performed by the autonomous driving ECU 30. The control unit 32 is composed of, for example, a processor. The processor is composed of, for example, a CPU or a GPU.

[0059] The storage unit 33 is a storage device that stores control programs and the like executed by the control unit 32. The storage unit 33 may have, for example, a semiconductor memory. The storage unit 33 may also have an HDD or the like.

[0060] Furthermore, the memory unit 33 stores, for example, information about the surrounding environment, map information, and route information to the destination.

[0061] The autonomous driving ECU 30 is capable of executing multiple driving modes with different levels of autonomous driving. For the sake of clarity, here we will assume that the autonomous driving ECU 30 is capable of executing both manual driving mode and autonomous driving mode.

[0062] Manual driving mode is a mode in which the driver in the driver's seat performs all driving tasks. Manual driving mode corresponds to automation level 0.

[0063] Autonomous driving mode is a mode in which the system is capable of performing all driving tasks. Autonomous driving mode corresponds to automation level 4 or automation level 5. In autonomous driving mode, sleep is permitted for the driver's seat occupant.

[0064] In autonomous driving mode, the autonomous driving ECU30 automatically performs steering, acceleration, and deceleration of the vehicle so that it follows the road to the destination set by the driver.

[0065] The in-vehicle unit 40 controls the HMI device 20. Specifically, the in-vehicle unit 40 controls the display 21 and speaker 22 to notify the occupant of information.

[0066] The in-vehicle unit 40 is a computer device. The in-vehicle unit 40 has a communication unit 41, a control unit 42, and a storage unit 43.

[0067] The communication unit 41 is a communication module (communication circuit) for communicating with the automatic driving ECU 30 and the HMI device 20, etc., via the in-vehicle network 50. The communication unit 41 is, for example, a wired communication circuit for wired communication, but it may also be a wireless communication circuit for wireless communication.

[0068] The control unit 42 performs, for example, information processing in the in-vehicle device 40 and controls the operations performed by the in-vehicle device 40. The control unit 42 is composed of, for example, a processor. The processor is composed of, for example, a CPU or a GPU.

[0069] The storage unit 43 is a storage device that stores control programs and the like executed by the control unit 42. The storage unit 43 may have, for example, a semiconductor memory. The storage unit 43 may also have an HDD or the like.

[0070] [Functional configuration of the autonomous driving ECU 30 and HMI device 20] Next, the functional configuration of the autonomous driving ECU 30 and the in-vehicle unit 40 will be described with reference to Figure 3. Figure 3 is a block diagram showing the configuration of the autonomous driving ECU 30 and the in-vehicle unit 40 according to this embodiment.

[0071] As shown in Figure 3, the control unit 32 of the autonomous driving ECU 30 includes, as functional components, a related information acquisition unit 321, a sleep information acquisition unit 322, an initial route determination unit 323, an alternative route determination unit 324, a route setting unit 325, and a driving control unit 326. The route setting unit 325 is an example of the "route change unit" in this disclosure.

[0072] The related information acquisition unit 321 acquires, for example, route-related information concerning a pre-set planned route. In this embodiment, the route-related information is, for example, information indicating whether or not delay factors are occurring on the planned route to the destination. Specifically, the related information acquisition unit 321 acquires traffic information from the wireless communication device 15 and the vehicle's location information from the GPS unit 13. The related information acquisition unit 321 transmits the acquired traffic information and location information to the alternative route determination unit 324.

[0073] In this embodiment, the related information acquisition unit 321 determines whether or not there will be a delay in the arrival time at the destination based on traffic information, location information, and route information indicating the currently set planned route. If it determines that there will be a delay, it transmits the traffic information and location information to the alternative route determination unit 324. The determination of whether or not there will be a delay in the arrival time at the destination is made, for example, by whether or not there is a delay compared to the estimated arrival time at the time the route was set. Furthermore, if the delay time is less than or equal to a predetermined value, it is not necessary to transmit the traffic information and location information to the alternative route determination unit 324. In other words, it is not necessary to perform the route change described later.

[0074] The sleep information acquisition unit 322 acquires sleep information indicating the sleep state of the occupant. The sleep information may include sleep status information indicating that the occupant is asleep. The sleep information may also include information indicating the direction of the occupant's face, gaze direction, or degree of eyelid opening. Specifically, the sleep information acquisition unit 322 determines whether or not the occupant is asleep based on the acquired sleep information. If the occupant is asleep, the sleep information acquisition unit 322 transmits sleep status information indicating that the occupant is asleep to the notification control unit 422, which will be described later. If the occupant wakes up from sleep, the sleep information acquisition unit 322 transmits wakefulness information indicating that the occupant has woken up to the notification control unit 422, which will be described later. The sleep information acquisition unit 322 can transmit sleep status information and wakefulness information to various parts of the automatic driving ECU 30 and various parts of the HMI device 20 as needed.

[0075] The initial route determination unit 323 determines the initial route. Specifically, the initial route determination unit 323 acquires, for example, destination information, location information, map information, and traffic information. Destination information is information indicating the destination entered into the input device 23 by the driver. Based on the destination information, location information, map information, and traffic information, the initial route determination unit 323 proposes one or more routes to the destination to the driver. When the driver selects a route using the input device 23, the initial route determination unit 323 determines the route selected by the driver as the initial route. The initial route determination unit 323 may determine the initial route without proposing a route to the driver. The initial route determination unit 323 transmits the initial route information indicating the determined initial route to the route setting unit 325 and the difference extraction unit 421, which will be described later.

[0076] The alternative route determination unit 324 determines an alternative route different from the initial route. Specifically, the alternative route determination unit 324 acquires, for example, destination information, location information, map information, and traffic information. Based on the destination information, location information, map information, and traffic information, the alternative route determination unit 324 searches for one or more alternative routes to the destination.

[0077] In this embodiment, the alternative route determination unit 324 does not propose the searched alternative routes to the occupants. Instead, the alternative route determination unit 324 selects (determines) one alternative route from one or more alternative routes. At this time, the alternative route determination unit 324 may, for example, select the route with the earliest estimated arrival time at the destination, the route with the lowest toll fees, or the route with the shortest distance. The criteria used by the alternative route determination unit 324 for selection are predetermined, for example, by the occupant in the driver's seat.

[0078] The alternative route determination unit 324 then transmits alternative route information indicating the selected (determined) alternative route to the route setting unit 325 and the difference extraction unit 421, which will be described later.

[0079] The route setting unit 325 sets the planned route to the destination. Specifically, first, the route setting unit 325 receives initial route information from the initial route determination unit 323 and sets the planned route that the vehicle will travel based on the initial route information. Then, the route setting unit 325 transmits the planned route information, which indicates the set planned route, to the driving control unit 326.

[0080] Furthermore, when the route setting unit 325 receives alternative route information from the alternative route determination unit 324, it changes the planned route from the initial route to the alternative route. The route setting unit 325 also transmits the planned route information, which indicates the changed planned route, to the driving control unit 326.

[0081] The driving control unit 326 performs automatic driving by controlling the driving actuator 18 so that the vehicle moves along the planned route.

[0082] The control unit 42 of the in-vehicle device 40 includes, as functional components, a difference extraction unit 421 and a notification control unit 422. The notification control unit 422 is an example of the "notification information output unit" in this disclosure.

[0083] The difference extraction unit 421 extracts the differences caused by the change. Specifically, in this embodiment, the difference extraction unit 421 extracts the differences caused by the route change based on the initial route information from the initial route determination unit 323 and the alternative route information from the alternative route determination unit 324. The difference extraction unit 421 transmits difference information indicating the differences caused by the route change to the notification control unit 422. The difference information includes, for example, information indicating the section of the route that has been changed, the estimated arrival time before and after the route change, and the difference in tolls.

[0084] The notification control unit 422 outputs notification information to inform the occupant of any changes in the vehicle's driving conditions while the occupant is asleep, when the occupant wakes up. Specifically, the notification control unit 422 receives sleep information and wakefulness information from the sleep information acquisition unit 322, and difference information from the difference extraction unit 421. Based on the difference information, the notification control unit 422 can determine whether or not there have been any changes in the driving conditions. In addition, based on the sleep information and wakefulness information, the notification control unit 422 can determine whether or not the occupant is asleep, and whether or not the occupant has woken up from sleep. Therefore, the notification control unit 422 can determine whether or not there have been any changes in the driving conditions while the occupant was asleep.

[0085] Furthermore, the notification control unit 422 outputs notification information to the display 21 and / or speaker 22, for example, to inform the occupant of the changes when the occupant becomes awake. As a result, the display 21 and / or speaker 22 notify the occupant who has woken from sleep of the changes. For example, the display 21 displays an image indicating the changes. Also, for example, the speaker 22 outputs audio indicating the changes.

[0086] Furthermore, in this embodiment, the notification information includes the reason for the change. That is, the notification control unit 422 outputs notification information that informs the occupant of the content of the change and the reason for the change when the occupant becomes awake. Thus, in this embodiment, the display 21 and / or speaker 22 notify the occupant who has woken from sleep not only of the content of the change but also of the reason for the change. The reason for the change is, for example, a delay factor included in the route-related information, and is transmitted from the related information acquisition unit 321 to the notification control unit 422.

[0087] Next, with reference to Figure 4, the operation of the autonomous driving system 100 of this embodiment will be described. Here, we will describe the case in which the driver's seat occupant is notified of the changes when the driver's seat occupant becomes awake. Figure 4 is a flowchart showing an example of the operation of the autonomous driving system 100 of this embodiment.

[0088] As shown in Figure 4, in step S11, the initial route is determined. Specifically, the initial route determination unit 323 determines the initial route based on the input operation to the input device 23 by the driver's seat occupant.

[0089] Next, in step S12, the initial route is set. Specifically, the route setting unit 325 sets the planned route to the destination to the initial route determined by the initial route determination unit 323, based on the initial route information from the initial route determination unit 323.

[0090] Next, in step S13, autonomous driving is initiated. Specifically, the driver performs a predetermined operation on the input device 23 to initiate autonomous driving, and the driving control unit 326 controls the driving actuator 18. As a result, autonomous driving begins, and the vehicle travels along the initial route.

[0091] Next, in step S14, the sleep information acquisition unit 322 acquires sleep information indicating the sleep state of the occupants and determines whether or not it has detected sleep in the driver's seat occupant. Specifically, for example, if the driver's seat occupant changes from an awake state to a sleep state, the sleep information acquisition unit 322 determines that it has detected sleep in the driver's seat occupant. On the other hand, if the driver's seat occupant is awake, the sleep information acquisition unit 322 determines that it has not detected sleep in the driver's seat occupant. Note that step S14 is an example of the "acquisition step" in this disclosure.

[0092] If the sleep information acquisition unit 322 determines in step S14 that it has not detected sleep in the driver's seat occupant, the process repeats step S14.

[0093] On the other hand, if the sleep information acquisition unit 322 determines in step S14 that it has detected sleep in the driver's seat occupant, the process proceeds to step S15.

[0094] Next, in step S15, the related information acquisition unit 321 determines whether or not a delay has been predicted. Specifically, based on the acquired route-related information, the related information acquisition unit 321 predicts that the vehicle will be delayed if there are delay factors such as accidents and / or traffic congestion on the initial route (planned route).

[0095] If the related information acquisition unit 321 did not predict that the vehicle would be delayed in step S15, the process proceeds to step S19.

[0096] On the other hand, if the related information acquisition unit 321 predicts in step S15 that the vehicle will be delayed, the process proceeds to step S16.

[0097] Next, in step S16, the alternative route determination unit 324 searches for an alternative route. Specifically, the alternative route determination unit 324 searches for multiple alternative routes, for example.

[0098] Next, in step S17, the alternative route determination unit 324 determines an alternative route. Specifically, from among the multiple routes that have been searched, the alternative route is determined to be the route with the earliest estimated arrival time at the destination.

[0099] Next, in step S18, the route setting unit 325 changes the route. Specifically, the route setting unit 325 changes the planned route from the initial route to an alternative route. As a result, the vehicle travels along the alternative route.

[0100] Next, in step S19, the sleep information acquisition unit 322 determines whether or not it has detected the driver's seat occupant becoming awake. Specifically, for example, if the driver's seat occupant changes from a sleep state to an awake state (wakes up), the sleep information acquisition unit 322 determines that it has detected the driver's seat occupant becoming awake. On the other hand, if the driver's seat occupant is in a sleep state, the sleep information acquisition unit 322 determines that it has not detected the driver's seat occupant becoming awake.

[0101] If the sleep information acquisition unit 322 determines in step S19 that it has not detected the driver's seat occupant being awake, the process returns to step S15.

[0102] On the other hand, if the sleep information acquisition unit 322 determines in step S19 that it has detected the driver's seat occupant being awake, the process proceeds to step S20.

[0103] Next, in step S20, the difference extraction unit 421 extracts the differences due to the changes. Specifically, the difference extraction unit 421 extracts, for example, the section where the route has been changed, and the difference in toll fees.

[0104] Next, in step S21, the notification control unit 422 determines whether or not there is a difference due to the change.

[0105] If the notification control unit 422 determines in step S21 that there are no differences due to the changes, the process proceeds to step S23.

[0106] On the other hand, if the notification control unit 422 determines in step S21 that there is a difference due to the change, the process proceeds to step S22.

[0107] Next, in step S22, the notification control unit 422 outputs notification information to inform the occupant of the changes. Specifically, the notification control unit 422 outputs the notification information to the display 21 and / or speaker 22. As a result, the driver's seat occupant is notified of the changes via the display 21 and / or speaker 22. In this embodiment, the driver's seat occupant is notified of the changes and the reasons for the changes via the display 21 and / or speaker 22. Note that step S22 is an example of an "output step" in this disclosure.

[0108] Next, in step S23, for example, the related information acquisition unit 321 determines whether or not to terminate the automated driving. Specifically, for example, the related information acquisition unit 321 determines to terminate the automated driving if the vehicle arrives at its destination or if the driver performs a predetermined operation to terminate the automated driving.

[0109] If the related information acquisition unit 321 determines in step S23 that the automatic driving should not be terminated, the process returns to step S14.

[0110] On the other hand, if the related information acquisition unit 321 determines in step S23 that the automated driving operation has ended, the process terminates.

[0111] In this manner, the driver's seat occupant will be notified of the changes.

[0112] In this embodiment, an example is shown where only the driver's seat occupants are present in the vehicle, with no passengers in the front passenger seat or rear seats. However, this disclosure is not limited to this example. For example, in addition to the driver's seat occupants, there may also be passengers in the front passenger seat and / or rear seats. In this case, the passengers in the front passenger seat and / or rear seats may be asleep or awake.

[0113] Furthermore, while this embodiment shows an example where no notification information is output when there are no differences due to changes, this disclosure is not limited to this. For example, notification information may be output even if there are no differences due to changes. In other words, the driver may be notified that there were no route changes.

[0114] The technical features of the notification device (autonomous driving ECU 30 and in-vehicle unit 40) according to this embodiment, configured as described above, can be explained as follows, for example.

[0115] The notification device of this embodiment (autonomous driving ECU 30 and in-vehicle unit 40) includes, as described above, a sleep information acquisition unit 322 that acquires sleep information indicating the sleep state of the occupant, and a notification control unit 422 that outputs notification information to notify the occupant of the changes when the occupant wakes up if there are any changes in the vehicle's driving conditions while the occupant is sleeping.

[0116] This allows for the output of notification information to inform the occupants of any changes in the driving conditions while they are sleeping, upon their awakening. Therefore, even if there are changes in the driving conditions, it is possible to prevent the occupants from becoming unaware of the changes upon their awakening.

[0117] Furthermore, in this embodiment, as described above, a route setting unit 325 is provided for changing the route to the destination, and changes related to the driving conditions include changing the route.

[0118] This allows the system to notify the occupants of any changes to the route to their destination when they wake up, provided the route is altered while they are sleeping. This helps to reduce anxiety among the occupants. However, if the route is altered while the occupants are sleeping, there is a concern that they may feel anxious if, for example, they wake up to find the vehicle traveling in an unexpected location.

[0119] Furthermore, in this embodiment, as described above, changes related to the driving conditions include changes in the tolls incurred until arrival at the destination.

[0120] This allows the driver to notify the occupants of the change in toll fees when they are awake, even if, for example, the route changes from a regular road to a highway and the toll fee changes as a result.

[0121] Furthermore, in this embodiment, as described above, the notification information includes information indicating the reason for the change.

[0122] This allows the crew to be informed of the reason for the change when they become awake, thus preventing them from feeling confused and / or anxious.

[0123] Furthermore, in this embodiment, as described above, the occupants include the driver's seat occupant, and the notification control unit 422 outputs notification information when the driver's seat occupant wakes up if there is a change in the driving conditions while the driver's seat occupant is sleeping.

[0124] This helps to prevent the driver from losing awareness of the driving situation when they become awake.

[0125] The notification device according to this embodiment has been described above, but the configuration of the notification device is not limited to the configuration described in the above embodiment. Therefore, a modified version of the notification device configuration will be described, focusing on the differences from the above embodiment.

[0126] [First variation] Next, with reference to Figures 5 to 7, an automated driving system 100 equipped with a notification device according to the first modified example will be described. In the first modified example, unlike the above embodiment, a driver and a passenger are in the vehicle, and an example is described in which an alternative route is permitted by the passenger. Figure 5 is a diagram showing an example of the configuration of the automated driving system 100 equipped with a notification device according to the first modified example.

[0127] As shown in Figure 5, in the first modified example, the occupant state sensor 16 includes a driver's seat occupant sensor 16a and a passenger seat occupant sensor 16b. The passenger seat occupant sensor 16b can, for example, detect the facial state of at least the passenger seat occupant. The passenger seat occupant sensor 16b is positioned, for example, diagonally above the front of the passenger seat. The other configurations of the passenger seat occupant sensor 16b are the same as those of the driver's seat occupant sensor 16a. Alternatively, instead of providing the driver's seat occupant sensor 16a and the passenger seat occupant sensor 16b separately, a single sensor capable of detecting the states of both the driver's seat occupant and the passenger seat occupant may be provided.

[0128] The passenger-seat occupant sensor 16b sequentially detects the state of the passenger-seat occupant based on the passenger-seat occupant's face image included in the captured image. For example, the passenger-seat occupant sensor 16b sequentially detects the passenger-seat occupant's state, such as the orientation of the passenger-seat occupant's face, the direction of their gaze, and / or the degree to which their eyelids are open. The passenger-seat occupant sensor 16b transmits passenger-seat occupant information indicating the passenger-seat occupant's state to, for example, the autonomous driving ECU 30. In the first modified example, the passenger-seat occupant sensor 16b transmits at least sleep information indicating the passenger-seat occupant's sleep state to the autonomous driving ECU 30.

[0129] [Functional configuration of the notification device (autonomous driving ECU 30 and HMI device 20)] Next, with reference to Figure 6, the functional configuration of the first modified autonomous driving ECU 30 and in-vehicle unit 40 will be described. Figure 6 is a block diagram showing the configuration of the first modified autonomous driving ECU 30 and in-vehicle unit 40.

[0130] As shown in Figure 6, in the first modified example, the sleep information acquisition unit 322 acquires sleep information indicating the sleep state of the driver's seat occupant and sleep information indicating the sleep state of the passenger seat occupant. Based on the acquired sleep information, the sleep information acquisition unit 322 determines whether the driver's seat occupant and the passenger seat occupant are asleep. If the driver's seat occupant is asleep, the sleep information acquisition unit 322 transmits sleep information indicating that the driver's seat occupant is asleep to the notification control unit 422. If the driver's seat occupant wakes up from sleep, the sleep information acquisition unit 322 transmits wakefulness information indicating that the driver's seat occupant has woken up to the notification control unit 422. Similarly, if the passenger seat occupant is asleep, the sleep information acquisition unit 322 transmits sleep information indicating that the passenger seat occupant is asleep to the notification control unit 422. If the passenger seat occupant wakes up from sleep, the sleep information acquisition unit 322 transmits wakefulness information indicating that the passenger seat occupant has woken up to the notification control unit 422.

[0131] In the first modified version, the alternative route determination unit 324 proposes the searched alternative routes to the occupants. Specifically, in the first modified version, if, for example, the driver's seat occupant is asleep and the passenger seat occupant is awake, the alternative route determination unit 324 proposes the searched alternative routes to the passenger seat occupant. The method of proposing to the passenger seat occupant is not particularly limited, but can be done, for example, via the display 21 and / or speaker 22. If the passenger seat occupant selects (allows) one alternative route from one or more alternative routes, the alternative route determination unit 324 selects (determines) the one allowed alternative route. The method of allowing the passenger seat occupant to choose an alternative route is not particularly limited, but can be done, for example, via the input device 23.

[0132] Furthermore, if the driver and passenger are asleep, the alternative route determination unit 324 may not propose an alternative route to the passenger and may select (determine) one alternative route in the same manner as in the above embodiment. Alternatively, if the driver and passenger are asleep, the alternative route determination unit 324 may propose an alternative route to the passenger, regardless of whether the passenger is asleep or awake. In this case, if the alternative route is proposed to the passenger and not selected (allowed) for a predetermined time, the alternative route determination unit 324 may select (determine) one alternative route in the same manner as in the above embodiment.

[0133] The other configurations of the first modified example are the same as those of the embodiment described above.

[0134] Next, with reference to Figure 7, the operation of the first modified autonomous driving system 100 will be described. In the first modified example, an alternative route is permitted by the passenger in the front seat while the driver is asleep. Figure 7 is a flowchart showing an example of the operation of the first modified autonomous driving system 100.

[0135] As shown in Figure 7, steps S11 to S16 are the same as in the above embodiment.

[0136] Next, in step S101, an alternative route is authorized by the passenger. Specifically, if the passenger is awake, the alternative route determination unit 324 proposes the searched alternative routes to the passenger. The passenger then authorizes one alternative route via the input device 23, etc. If, for example, the passenger is asleep and no alternative route is proposed to the passenger, the alternative route determination unit 324 selects (determines) one alternative route. In this case, the operation of the automated driving system 100 is the same as in the above embodiment.

[0137] Next, in step S17, the alternative route determination unit 324 determines an alternative route. Specifically, the alternative route determination unit 324 selects the route authorized by the passenger in the front seat from among the multiple routes that have been searched as the alternative route.

[0138] Next, steps S18 to S21 are performed in the same manner as in the above embodiment.

[0139] Next, in step S22, the notification control unit 422 outputs notification information to inform the occupants of the changes. In this first modified example, the notification information may include information indicating the content of the changes, but may not include information indicating the reason for the changes. In other words, in the first modified example, the driver's seat occupant is notified of the content of the changes, but not of the reason for the changes. The driver's seat occupant does not want to know the reason for a route change that has been authorized by the passenger seat occupant, so the inconvenience caused by being notified of the reason for the changes can be suppressed.

[0140] Next, step S23 is performed in the same manner as in the above embodiment.

[0141] Other operations of the first modified example are the same as those of the embodiment described above.

[0142] In the first modified example, an example was described in which a passenger-seat occupant sensor 16b for detecting the state of the passenger-seat occupant is provided, but this disclosure is not limited to this. For example, as described above, if the driver-seat occupant is asleep, and the alternative route determination unit 324 proposes an alternative route to the passenger-seat occupant regardless of whether the passenger-seat occupant is asleep or awake, the passenger-seat occupant sensor 16b does not need to be provided. However, in this case, if the passenger-seat occupant is asleep, the time required to determine an alternative route will be longer, which may result in a longer route or the need to turn back. Also, if voice is used when proposing an alternative route, there is a possibility of waking both the driver-seat occupant and the passenger-seat occupant. Therefore, it is preferable to provide the passenger-seat occupant sensor 16b and not propose an alternative route to the passenger-seat occupant if the passenger-seat occupant is also asleep.

[0143] Furthermore, while the first modification described an example where the passenger in the front seat authorizes an alternative route, if the passenger in the front seat is a child, for example, the passenger in the front seat does not need to authorize an alternative route. In this case, for example, if the passenger in the front seat sensor 16b estimates the age of the passenger in the front seat, and the estimated age of the passenger in the front seat is below a predetermined age, the alternative route determination unit 324 may select (determine) an alternative route without proposing an alternative route to the passenger in the front seat. In addition, the notification device may be configured to allow the selection of a permission-free mode in which the passenger in the front seat does not authorize an alternative route. In other words, for example, the route to the destination may be changed without obtaining permission from the passenger in the front seat while the driver is asleep.

[0144] Furthermore, while the first modification described a case where the driver is asleep and the passenger is awake, this disclosure is not limited to this. For example, the driver may be awake and the passenger may be asleep. In this case, the driver may authorize an alternative route and notify the passenger of the change when the passenger becomes awake. However, since the passenger is less interested in which route to the destination is taken than the driver, it is not necessary to notify the passenger of the change when the passenger becomes awake.

[0145] In the first modified version of the notification device, as described above, the occupants include a first occupant (here, the driver's seat occupant) and a second occupant (here, the passenger seat occupant), and the route setting unit 325 may change the route without obtaining permission from the second occupant while the first occupant is asleep.

[0146] This allows the vehicle to automatically change its route without the permission of the second crew member. Therefore, it reduces the inconvenience the second crew member might experience when the route is changed. Furthermore, if the second crew member is a child, they are not required to make decisions about route changes.

[0147] The notification device of the first modified version includes a route setting unit 325 that changes the route to the destination, and the occupants include a passenger in the front seat, and the route setting unit 325 changes the route when it obtains permission from the passenger in the front seat while the driver in the front seat is asleep.

[0148] This allows the route to be changed while the driver is asleep, with the permission of the passenger in the front seat.

[0149] Furthermore, if the driver is asleep and permission from the passenger in the front seat cannot be obtained, the route setting unit 325 does not need to change the route. With this configuration, for example, it is possible to prevent the route from being changed without the permission of the passenger in the front seat while the driver is asleep.

[0150] In the first modified example of the notification device, as described above, the notification control unit 422 may output notification information when the passenger in the passenger seat wakes up if there is a change in the driving conditions while the passenger in the passenger seat is sleeping.

[0151] This helps to prevent the passenger in the front seat from losing awareness of the driving situation when they become awake.

[0152] The other configurations, operations, and effects of the first modified example are the same as those of the embodiment described above.

[0153] [Second variation] Next, an automated driving system 100 equipped with a notification device according to a second modified example will be described. In the second modified example, unlike the embodiments described above, an example will be described in which a driver and a passenger are in the vehicle, and both the driver and the passenger are asleep.

[0154] In the second modified example, similar to the first modified example, the occupant status sensor 16 includes a driver's seat occupant sensor 16a and a passenger seat occupant sensor 16b.

[0155] Furthermore, in the second modified configuration, if there is a change in the driving conditions while the driver and passenger are sleeping, the notification control unit 422 outputs notification information to inform at least the passenger who wakes up first of the details of the change.

[0156] Next, with reference to Figure 8, the operation of the second modified autonomous driving system 100 will be described. In the second modified example, the case where both the driver and passenger are asleep will be described. Figure 8 is a flowchart showing an example of the operation of the second modified autonomous driving system 100.

[0157] As shown in Figure 8, steps S11 to S14 are the same as in the above embodiment.

[0158] Next, in step S14a, the sleep information acquisition unit 322 acquires sleep information indicating the sleep state of the passenger in the front seat and determines whether or not it has detected sleep for the passenger in the front seat. Specifically, for example, if the passenger in the front seat changes from an awake state to a sleep state, the sleep information acquisition unit 322 determines that it has detected sleep for the passenger in the front seat. On the other hand, if the passenger in the front seat is awake, the sleep information acquisition unit 322 determines that it has not detected sleep for the passenger in the front seat.

[0159] For the sake of simplicity, this explanation describes an example where the passenger in the front seat falls asleep after the driver. However, the passenger in the front seat may fall asleep before the driver. In this case, the passenger may fall asleep, for example, before the initial route is set (before step S11).

[0160] If the sleep information acquisition unit 322 determines in step S14a that sleep has not been detected in the passenger seat occupant, the process returns to step S14.

[0161] On the other hand, if the sleep information acquisition unit 322 determines in step S14a that it has detected sleep in the passenger seat, the process proceeds to step S15.

[0162] Next, steps S15 to S18 are performed in the same manner as in the above embodiment.

[0163] Next, in step S19, the sleep information acquisition unit 322 determines whether or not it has detected that the driver or passenger is awake.

[0164] If the sleep information acquisition unit 322 determines in step S19 that it has not detected the driver's seat occupant or the passenger seat occupant being awake, the process returns to step S15.

[0165] On the other hand, if the sleep information acquisition unit 322 determines in step S19 that it has detected the driver's seat occupant or the passenger seat occupant being awake, the process proceeds to step S20.

[0166] Next, steps S20 and S21 are performed in the same manner as in the above embodiment.

[0167] Next, in step S22, the notification control unit 422 outputs notification information to inform the occupants of the changes. Thus, in the second modified example, the notification control unit 422 will notify the occupant who wakes up first, either the driver or the passenger, of the changes. In the second modified example, as in the above embodiment, the notification control unit 422 will notify the occupant who wakes up first of the changes and the reason for the changes.

[0168] Other operations of the second modified example are the same as those of the embodiment described above.

[0169] Furthermore, although a detailed explanation will be omitted, the changes may be notified to the occupant in the driver's seat or the passenger seat who becomes awake first, and the changes may also be notified to the occupant who becomes awake later.

[0170] Furthermore, if the occupant who awakens first is the passenger in the front seat, it is preferable to notify the passenger in the front seat who awakened first of the changes, and also to notify the driver in the front seat who awakened later of the changes. Also, if the occupant who awakens first is the driver in the front seat, it is acceptable to notify the driver in the front seat who awakened first of the changes, and not to notify the passenger in the front seat who awakened later of the changes.

[0171] In the second modified notification device, as described above, if there is a change in the driving conditions while the first and second occupants (in this case, the driver's seat occupant and the passenger seat occupant) are asleep, the device will notify at least the occupant who wakes up first of the changes. For example, if the vehicle is driving in an unexpected location, the occupant who wakes up first is particularly likely to feel anxious. Therefore, notifying at least the occupant who wakes up first of the changes is especially effective.

[0172] The other configurations, operations, and effects of the second modified example are the same as those of the embodiment described above.

[0173] [Third variation] Next, with reference to Figure 9, an automated driving system 100 equipped with a notification device according to the third modified example will be described. Figure 9 is a block diagram showing the configuration of the automated driving ECU 30 and the in-vehicle device 40 of the third modified example. In the third modified example, unlike the above embodiments, an example will be described in which a notification mode that notifies the occupant of the changes when they become awake and a non-notification mode in which no notification is made can be executed. In the third modified example, a part of the above embodiment will be modified for explanation, but for example, a part of the first or second modified example may also be modified.

[0174] As shown in Figure 9, in the third modified example, unlike the embodiments described above, the control unit 32 and / or control unit 42 can perform two modes: a notification mode in which, if there is a change in the driving conditions while the occupant is sleeping, the occupant is notified of the change when they wake up, and a non-notification mode in which no notification is given.

[0175] In the third modified configuration, the control unit 32 or control unit 42 (in this case, control unit 42) has a mode switching unit 425 that switches between notification mode and non-notification mode. Specifically, the mode switching unit 425 switches between notification mode and non-notification mode based on the input operation of the occupant to the input device 23. The mode switching unit 425 transmits a notification mode signal indicating notification mode and a non-notification mode signal indicating non-notification mode to the notification control unit 422.

[0176] When the notification control unit 422 receives a notification mode signal, it outputs notification information when the occupant becomes awake, as described above. However, when it receives a non-notification mode signal, it does not output notification information when the occupant becomes awake. Therefore, no notification is sent to the occupant.

[0177] Switching between notification mode and non-notification mode is performed by the occupant, for example, before step S14 in the above embodiment. This allows the system to set whether or not to send notifications to the occupant when they become awake.

[0178] The other configurations and operations of the third modified example are the same as those of the embodiments described above.

[0179] The notification device of the third modified example includes a mode switching unit 425 that switches between a notification mode in which notifications are sent to the occupants and a non-notification mode in which no notifications are sent, as described above.

[0180] This allows, for example, if the occupants are not interested in changes related to the driving situation, setting the system to silent mode can prevent them from feeling bothered.

[0181] The other configurations, operations, and effects of the third modified example are the same as those of the embodiments described above.

[0182] (Other embodiments) The display device relating to this disclosure has been described above based on the embodiments and their modifications; however, this disclosure is not limited to the embodiments and their modifications.

[0183] For example, the above embodiments show an example where a driver is seated in the vehicle, but the driver does not necessarily have to be seated. In other words, the vehicle may only have a passenger in the front passenger seat and / or a passenger in the rear seats. Such a configuration is envisioned, for example, in an unmanned taxi.

[0184] Furthermore, while the above embodiments illustrate an example of changing the route when there is a delay in the estimated time of arrival at the destination, this disclosure is not limited to this. For example, if a detour route has been set due to an accident or traffic congestion, the route may be changed if it is determined that the estimated time of arrival will be earlier or the toll will decrease as the accident or traffic congestion is resolved.

[0185] Furthermore, while the above embodiments illustrate examples where changes in driving conditions include, for example, changes in the route to the destination and / or changes in tolls, this disclosure is not limited to these examples. For example, it could also be a change in the estimated time of arrival. In other words, for example, if the estimated time of arrival changes even though the route has not been changed, notification information may be output when the occupant becomes awake.

[0186] Furthermore, while the above embodiments describe an example in which the notification device is configured by the automatic driving ECU 30 and the in-vehicle unit 40, this disclosure is not limited thereto. The notification device may be configured by only one of the automatic driving ECU 30 and the in-vehicle unit 40. Alternatively, the notification device may be configured by one or more devices other than the automatic driving ECU 30 and the in-vehicle unit 40. Needless to say, the automatic driving ECU 30 and the in-vehicle unit 40 may be implemented by a single device.

[0187] Furthermore, while the above embodiments describe an example of notifying an awakened occupant of changes in content after they have become awake, this disclosure is not limited to this. For example, if there is a change in the driving conditions, notification may be given by display regardless of whether the occupant is asleep or awake. The display may then continue until the occupant becomes awake.

[0188] Each of the various supplementary details concerning the notification device according to the above embodiment may be appropriately applied to modifications of the embodiment. In addition, forms obtained by applying various modifications to each embodiment and modification as conceivable by a person skilled in the art, as well as forms realized by arbitrarily combining the components and functions of each embodiment and modification without departing from the spirit of this disclosure, are also included in this disclosure. Furthermore, any combination of two or more claims from the claims described in the claims at the time of filing this application, within the scope that is not technically contradictory, is also included in this disclosure. [Industrial applicability]

[0189] The notification device, notification method, and program described herein can be applied to notification devices, notification methods, and programs used in vehicles capable of autonomous driving. [Explanation of symbols]

[0190] 30. Autonomous driving ECU (notification device) 40 Onboard device (notification device) 322 Sleep information acquisition unit 325 Route setting section (route change section) 422 Notification Control Unit (Notification Information Output Unit) 425 Mode switching section S14 Step (Step to obtain) S22 Step (Step to output)

Claims

1. A notification device that notifies occupants of a vehicle capable of autonomous driving, A sleep information acquisition unit that acquires sleep information indicating the sleep state of the crew member, If there is a change in the vehicle's driving conditions while the occupant is asleep, a notification information output unit outputs notification information to inform the occupant of the details of the change when the occupant wakes up. Equipped with, Notification device.

2. It is equipped with a route change section that changes the route to the destination, The aforementioned changes to the driving conditions include, The notification device according to claim 1.

3. The crew includes the first crew and the second crew, The aforementioned route changing unit changes the route while the first crew member is asleep and without obtaining permission from the second crew member. The notification device according to claim 2.

4. The aforementioned changes to the driving conditions include changes to the tolls incurred until arrival at the destination. The notification device according to any one of claims 1 to 3.

5. The aforementioned notification information includes information indicating the reason for the aforementioned change. The notification device according to any one of claims 1 to 3.

6. The aforementioned occupants include the driver's seat occupant, The notification information output unit outputs the notification information when the driver wakes up if there is a change in the driving conditions while the driver is asleep. The notification device according to any one of claims 1 to 3.

7. It is equipped with a route change section that changes the route to the destination, The aforementioned occupants include the passenger in the front seat, The route change unit changes the route when permission is obtained from the passenger in the front seat while the passenger in the driver's seat is asleep. The notification device according to claim 6.

8. The aforementioned occupants include the driver's seat occupant and the passenger seat occupant, The notification information output unit outputs the notification information when the passenger in the passenger seat wakes up if there is a change in the driving conditions while the passenger in the passenger seat is sleeping. The notification device according to any one of claims 1 to 3.

9. The system includes a mode switching unit that switches between a notification mode in which the occupant is notified and a non-notification mode in which the occupant is not notified. The notification device according to any one of claims 1 to 3.

10. A notification method for informing occupants of a vehicle capable of autonomous driving, The steps include: acquiring sleep information indicating the sleep state of the crew member; If there is a change in the vehicle's driving conditions while the occupant is asleep, the occupant will be notified of the change when he or she wakes up. including, Notification method.

11. A program that causes a computer to execute the notification method described in claim 10.

Images