Notification device and program

Abstract

To provide a notification device and program, capable detecting a driver looking at a passenger in a rear seat via a rear-view mirror and talking with the passenger, and generating a warning notification.SOLUTION: A notification device according to an aspect of an embodiment comprises a controller. The controller generates a warning notification when a driver of a vehicle is watching a rear-view mirror and engaged in conversation while the vehicle is on the move with a passenger(s) in a rear seat of the vehicle.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a notification device and a program. [Background technology]

[0002] Conventionally, there is known a technology that detects the line of sight or the direction of the face of a vehicle driver to determine whether the driver is looking away from the road, and if it is determined that the driver is looking away from the road, issues a warning to warn the driver (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-77282 Summary of the Invention [Problem to be solved by the invention]

[0004] However, there are various types of inattentive driving by drivers, and the prior art has not been able to address these types. For example, when there are passengers in the backseat, the driver may become engrossed in a conversation while looking at the passengers in the backseat through the rearview mirror. In this case, the driver may become distracted while driving, so it is preferable to issue a warning to alert the driver.

[0005] However, drivers may check the status of the following vehicle by looking at the rearview mirror for safety reasons. In the prior art, it was not possible to distinguish whether the driver was looking at the rearview mirror for safety reasons or to talk to a passenger in the back seat.

[0006] The present invention has been made in consideration of the above, and aims to provide a notification device and program that can detect when a driver is talking to a passenger in the rear seat while looking at them in the rearview mirror, and can notify them of a warning. [Means for solving the problem]

[0007] In order to solve the above problems and achieve the object, the notification device of the present invention includes a controller that issues a warning when the driver is gazing at the rearview mirror and is engaged in a conversation while the vehicle is moving and has passengers seated in the rear seats. [Effects of the Invention]

[0008] In the present invention, when a passenger is seated in the rear seat of a vehicle and the driver is gazing at the rearview mirror and is also in a conversation state, it is estimated that the driver is looking at the passenger in the rear seat through the rearview mirror while talking, and a warning is issued. As a result, the present invention can detect that the driver is looking at the passenger in the rear seat through the rearview mirror while talking, and issue a warning. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram for explaining an outline of a notification method performed by a notification device according to the first embodiment. [Figure 2] FIG. 2 is a block diagram showing an example of the configuration of a notification system including a notification device according to the first embodiment. [Figure 3] FIG. 3 is a flowchart illustrating an example of processing executed by the controller according to the first embodiment. [Figure 4] FIG. 4 is a diagram showing an output unit that issues a warning notice. [Figure 5] FIG. 5 is a block diagram showing an example of the configuration of a notification system including a notification device according to the second embodiment. [Figure 6] FIG. 6 is a flowchart showing an example of processing executed by the controller according to the second embodiment. [Figure 7] FIG. 7 is a flowchart showing an example of processing executed by a controller according to the third embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, embodiments of a notification device and a program disclosed in the present application will be described in detail with reference to the accompanying drawings. However, the present invention is not limited to the following embodiments.

[0011] (First embodiment) <Notification method overview> First, an overview of the notification method performed by the notification device according to the first embodiment will be described below with reference to Fig. 1. Fig. 1 is a diagram for explaining the overview of the notification method performed by the notification device according to the first embodiment.

[0012] As shown in FIG. 1, the notification method according to the first embodiment is executed by a notification device 10 mounted on a vehicle A. The vehicle A is provided with a rearview mirror B for rearward confirmation. The vehicle A is also provided with a front seat C1 and a rear seat C2. While FIG. 1 shows an example in which the rear seats C2 are arranged in a single row, the present invention is not limited to this and two or more rows may be used. In the example of FIG. 1, a driver D sits in the front seat C1 of the vehicle A, and a passenger E sits in the rear seat C2.

[0013] The notification device 10 according to this embodiment is capable of detecting that the driver D is talking to the passenger E in the rear seat C2 while looking at the rearview mirror B, and issuing a warning.

[0014] Specifically, the notification device 10 first determines whether or not the vehicle A is moving (step S1). For example, the notification device 10 determines that the vehicle A is moving when the shift is in the D (Drive) range, which causes the vehicle A to move forward, and the vehicle speed is equal to or greater than a threshold vehicle speed. The threshold vehicle speed is set to a value (e.g., 30 km / h) at which it can be determined that the vehicle A is moving, but is not limited to this and can be set to any value.

[0015] When the notification device 10 determines that the vehicle A is moving, it determines whether or not a passenger E is seated in the rear seat C2 (step S2). For example, the notification device 10 detects the presence or absence of the passenger E by analyzing an in-vehicle image captured by an in-vehicle camera 13 (see FIG. 2), which will be described later. The notification device 10 may also detect the presence or absence of the passenger E using a seat sensor provided in the rear seat C2. That is, the notification device 10 may determine that the passenger E is seated in the rear seat C2 when a signal indicating that the passenger E is seated is output from the seat sensor.

[0016] When the notification device 10 determines that the passenger E is seated in the rear seat C2, it determines whether the driver D is in a gazing state, gazing at the rearview mirror B, and whether the driver D is in a conversation state, gazing at the rearview mirror B (step S3). The determination of whether the driver D is in a gazing state and whether the driver D is in a conversation state is performed using, for example, an in-vehicle image captured by the in-vehicle camera 13, which will be described later.

[0017] When it is determined that the driver D is in a gazing state and in a conversation state, the notification device 10 issues a warning to the driver D (step S4). That is, when the driver D is in a gazing state and in a conversation state with the passenger E seated in the rear seat C2, the notification device 10 presumes that the driver D is talking to the passenger E in the rear seat C2 while looking at the passenger E in the rear seat C2 through the rearview mirror B, and issues a warning to the driver D. Note that such a warning to the driver D may be, for example, a display of a message encouraging the driver to concentrate on driving, or an audio notification, but is not limited to these.

[0018] As a result, the notification device 10 according to this embodiment can detect that the driver D is talking to the passenger E in the rear seat C2 while looking at the rearview mirror B, and can issue a warning.

[0019] <Overall configuration of the notification system> Next, the configuration of a notification system 1 including the notification device 10 according to the first embodiment will be described with reference to Fig. 2. Fig. 2 is a block diagram showing an example of the configuration of a notification system 1 including the notification device 10 according to the first embodiment. Note that the block diagram of Fig. 2 shows only the components necessary to explain the features of the embodiment, and general components are omitted.

[0020] As shown in FIG. 2, the notification system 1 includes a notification device 10, a shift sensor 11, a vehicle speed sensor 12, an in-vehicle camera 13, a microphone 14, an output unit 15, and a terminal device 100.

[0021] The shift sensor 11 detects the position of the shift lever. The shift sensor 11 outputs a signal indicating the detected position of the shift lever to the notification device 10. The vehicle speed sensor 12 detects the speed of the vehicle A. The vehicle speed sensor 12 outputs a signal indicating the detected speed of the vehicle A to the notification device 10.

[0022] In-vehicle camera 13 is installed at an appropriate position in vehicle A and captures images of the interior of vehicle A. The in-vehicle images include, for example, an image of the face of driver D and, if passenger E is seated in rear seat C2, an image of passenger E. In-vehicle camera 13 outputs the captured in-vehicle images to notification device 10. In-vehicle camera 13 is, for example, a camera equipped with a lens and an imaging element such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor), but is not limited to this.

[0023] The microphone 14 is installed inside the vehicle A and collects sounds from inside the vehicle (for example, the speech of the driver D and passenger E). The microphone 14 outputs a signal indicating the collected sounds from inside the vehicle to the notification device 10.

[0024] The output unit 15 is communicably connected to the notification device 10. The output unit 15 outputs various information such as a warning notification. For example, the output unit 15 includes at least one of a display unit such as a display and an audio output unit such as a speaker, and outputs various information such as a warning notification to the driver D of the vehicle A.

[0025] 2 shows an example in which the shift sensor 11, vehicle speed sensor 12, in-vehicle camera 13, microphone 14, and output unit 15 are configured to be external to the notification device 10, but this is not limiting. In other words, some or all of the components from the shift sensor 11 to the output unit 15 may be configured to be included in the notification device 10.

[0026] The terminal device 100 is a device carried and used by a passenger (co-passenger) of the vehicle A other than the driver D. Here, the passenger of the vehicle A is a passenger E in the rear seat C2, but is not limited to this and may be another passenger such as a passenger in the front passenger seat (not shown). The terminal device 100 may be, for example, a smartphone, a mobile phone, a tablet terminal, or the like, but is not limited to these. The terminal device 100 may issue a warning notification, which will be described later.

[0027] The notification device 10 includes a controller (control unit) 20, a storage unit 30, and a communication unit 40. The storage unit 30 is realized by a storage device such as a ROM (Read Only Memory), a RAM (Random Access Memory), or a flash memory. The storage unit 30 stores various data, various programs, and the like.

[0028] The communication unit 40 is a communication interface for transmitting and receiving information to and from the terminal device 100, etc. For example, the communication unit 40 has a function for connecting to the terminal device 100 so as to be able to communicate via short-range wireless communication. As a short-range communication method, for example, Wi-Fi (registered trademark), Bluetooth (registered trademark), etc. can be used, but is not limited to these.

[0029] The controller 20 corresponds to a so-called processor. The controller 20 is realized by a CPU (Central Processing Unit), an MPU (Micro Processing Unit), a GPU (Graphical Processing Unit), or the like. The controller 20 executes a program according to an embodiment (not shown) stored in the storage unit 30, using RAM as a work area. Note that the controller 20 may be partially or entirely configured by hardware such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).

[0030] When the controller 20 detects that the driver D is talking to the passenger E in the rear seat C2 while looking at the rearview mirror B, the controller 20 executes a notification process to issue a warning.

[0031] <Notification processing> Next, the notification process executed by the controller 20 will be described with reference to Fig. 3. Fig. 3 is a flowchart showing an example of the process executed by the controller 20 according to the first embodiment. Note that the process shown in Fig. 3 is repeatedly executed every time a predetermined time elapses, but is not limited to this.

[0032] 3, the controller 20 determines whether the vehicle A is traveling (step S101). Specifically, the controller 20 determines whether the vehicle A is traveling based on signals output from the shift sensor 11 and the vehicle speed sensor 12. For example, the controller 20 determines that the vehicle A is traveling when the position of the shift lever detected by the shift sensor 11 is in the D range for forward traveling and the vehicle speed detected by the vehicle speed sensor 12 is equal to or greater than a threshold vehicle speed (e.g., 30 km / h).

[0033] If the controller 20 determines that the vehicle A is not moving (step S101, No), it skips the subsequent processing. On the other hand, if the controller 20 determines that the vehicle A is moving (step S101, Yes), it determines whether or not a passenger E is seated in the rear seat C2 (step S102). Specifically, the controller 20 acquires an in-vehicle image from the in-vehicle camera 13. The controller 20 analyzes the acquired in-vehicle image using an arbitrary image analysis method, and detects the presence or absence of a passenger E in the rear seat C2 from the analysis result.

[0034] If the controller 20 determines that the passenger E is not seated in the rear seat C2 (step S102, No), the controller 20 skips the subsequent processing. On the other hand, if the controller 20 determines that the passenger E is seated in the rear seat C2 (step S102, Yes), the controller 20 determines whether the driver D is in a gazing state gazing at the rearview mirror B (step S103).

[0035] Here, a specific example will be described for determining whether the driver D is in a gazing state, gazing at the rearview mirror B. The controller 20 determines whether the driver D is in a gazing state based on at least one of the time the driver D continuously looks at the rearview mirror B and the frequency with which the driver D looks at the rearview mirror B.

[0036] Specifically, the controller 20 detects the line of sight of the driver D. More specifically, the controller 20 analyzes the in-vehicle video captured by the in-vehicle camera 13 using any video analysis method to acquire information on the eye feature points (iris, inner corner of the eye, outer corner of the eye, etc.) of the driver D. The controller 20 detects the line of sight (direction of gaze) of the driver D from the acquired information on the eye feature points. The controller 20 stores the position of the rearview mirror B in advance in the storage unit 30, and determines that the driver D is looking at the rearview mirror B when a line along the direction in which the driver D's line of sight is facing intersects with the position of the rearview mirror B.

[0037] In the above, an example has been shown in which it is determined that the driver D is looking at the rearview mirror B using the line of sight of the driver D, but this is not limiting, and it may be determined, for example, using the direction of the face of the driver D. That is, the controller 20 may detect the direction of the face of the driver D from the in-vehicle image, and if the detected direction of the face of the driver D is facing the position of the rearview mirror B, it may be determined that the driver D is looking at the rearview mirror B.

[0038] The controller 20 measures the time that the driver D continuously looks at the rearview mirror B. If the measured time is equal to or longer than a threshold time, the controller 20 determines that the driver D is in a gazing state, gazing at the rearview mirror B. The threshold time is set to a value (e.g., 3 seconds) that allows determination that the driver D is gazing at the rearview mirror B, but is not limited to this and can be set to any value. In this way, the controller 20 can accurately determine that the driver D is in a gazing state by using the time that the driver D continuously looks at the rearview mirror B.

[0039] Furthermore, the controller 20 measures the frequency (number of times) that the driver D looks at the rearview mirror B per reference period. The reference period can be set to any value (for example, one minute). If the measured frequency (number of times) is equal to or greater than a threshold number of times, the controller 20 determines that the driver D is in a gazing state, gazing at the rearview mirror B. The threshold number of times is set to a value (for example, five times) that allows determination that the driver D is gazing at the rearview mirror B, but is not limited to this and can be set to any value. In this way, the controller 20 can accurately determine that the driver D is in a gazing state by using the frequency that the driver D looks at the rearview mirror B.

[0040] The threshold time and threshold number of times that it can be determined that the driver D is gazing at the rearview mirror B are generally set to values ​​that are greater than the time and number of times that the driver D checks the rearview mirror B to confirm safety. That is, the driver D checks the rearview mirror B to confirm safety, but the time spent looking at the rearview mirror B in each check is short and the frequency is not high. Therefore, it is sufficient to measure in advance the time and frequency that various drivers check the rearview mirror B to confirm safety, and set the threshold time and threshold number of times to values ​​that are greater than the average value. This makes it possible to reliably distinguish whether the check of the rearview mirror B is for safety confirmation or a state of gazing.

[0041] The controller 20 determines whether the driver D is in a gazing state by using both or either the time that the driver D continuously looks at the rearview mirror B and the frequency with which the driver D looks at the rearview mirror B.

[0042] If the controller 20 determines that the driver D is not in the gazing state (step S103, No), it skips the subsequent processing. On the other hand, if the controller 20 determines that the driver D is in the gazing state (step S103, Yes), it determines whether the driver D is in a conversation state (step S104).

[0043] Here, a specific example of determining whether the driver D is in a conversation state will be described. The controller 20 determines whether the driver D is in a conversation state based on at least one of the driver's mouth movement and the driver's voice.

[0044] Specifically, the controller 20 analyzes the in-vehicle video captured by the in-vehicle camera 13 using an arbitrary video analysis method to acquire information on the feature points of the driver D's mouth (corners of the mouth, lips, etc.). Based on the acquired information on the feature points of the mouth, the controller 20 measures the duration over which the feature points of the driver D's mouth continue to change. If the measured duration is equal to or greater than a threshold duration, the controller 20 determines that the driver D is in a conversation state. Note that the threshold duration is set to a value (e.g., 5 seconds) that allows determination that the driver D is talking, but is not limited to this and can be set to any value. In this way, the controller 20 can accurately determine that the driver D is in a conversation state by using the movement of the driver D's mouth.

[0045] The controller 20 also acquires the voice inside the vehicle from the microphone 14. The controller 20 analyzes the acquired voice inside the vehicle using any voice analysis method to acquire information on the volume (loudness) of the voice. If the volume of the acquired voice is equal to or greater than a threshold volume, the controller 20 determines that the driver D is in a conversation state. The threshold volume is set to a value (e.g., 60 dB) at which it can be determined that the driver D is in a conversation state, but is not limited to this and can be set to any value. In this way, the controller 20 can accurately determine that the driver D is in a conversation state by using the voice of the driver D.

[0046] The controller 20 determines whether the driver D is in a conversation state by using both or either of the mouth movement and voice of the driver D described above.

[0047] When the controller 20 determines that the driver D is not in a conversation state (step S104, No), it skips the subsequent processing. On the other hand, when the controller 20 determines that the driver D is in a conversation state (step S104, Yes), it issues a warning (step S105). To be precise, the controller 20 issues a warning when the driver D is in a gazing state gazing at the rearview mirror B and when the driver D is in a conversation state. In other words, when the passenger E is seated in the rear seat C2 and the driver D is in a gazing state and when the driver D is in a conversation state, the controller 20 estimates that the driver D is talking while looking at the passenger E in the rear seat C2 through the rearview mirror B, and issues a warning.

[0048] Here, the notification of the alert will be described with reference to Fig. 4. Fig. 4 is a diagram showing the output unit (display unit) 15 where the alert notification is made.

[0049] As shown in Fig. 4, the controller 20, because the driver D may be engrossed in a conversation with passenger E in the rear seat C2 and may be distracted from driving, displays a notification in the display field 15a of the output unit (display unit) 15 urging the driver D to concentrate on driving. The display field 15a displays a message encouraging the driver to concentrate on driving, such as "Are you having a conversation while looking at the rear seat? Please concentrate on driving." In addition to or instead of displaying such a message, the controller 20 may output an audio message encouraging the driver to concentrate on driving from the output unit (audio output unit) 15.

[0050] As a result, in this embodiment, driver D can be made aware that his or her attention to driving may be distracted by conversation with passenger E in rear seat C2, and this can encourage him or her to concentrate on driving.

[0051] Continuing with the explanation of FIG. 3, in step S105, the controller 20 may notify a passenger E of the vehicle A, which is different from the driver D, of a warning. Specifically, the controller 20 notifies the terminal device 100 of the above-mentioned warning via the communication unit 40. As a result, although not shown in the drawings, the terminal device 100 displays or outputs a message urging the driver D to concentrate on driving. When the warning is notified, the passenger E using the terminal device 100 can, for example, verbally warn the driver D to concentrate on driving. In this way, being directly warned by the passenger E makes it possible for the driver D to be more aware that he or she should concentrate on driving.

[0052] The controller 20 may determine that the driver D is in a conversational state when the driver D and passenger E are having an active conversation. Specifically, the controller 20 may determine that the driver D is in a conversational state when the volume of the voice inside the vehicle is equal to or greater than a second threshold volume, which is greater than a threshold volume (first threshold volume) that indicates a normal conversation state by the driver D. The second threshold volume is set to a value (e.g., 70 dB) that allows determination that the conversation between the driver D and passenger E is active, but is not limited to this and can be set to any value. This allows the controller 20 to issue a warning to encourage the driver D to concentrate on driving when there is a possibility that the driver D's attention to driving is becoming more distracted due to the active conversation with passenger E.

[0053] As described above, the notification device 10 according to the first embodiment includes the controller 20. The controller 20 issues a warning when the driver D is in a gazing state, gazing at the rearview mirror B, and is also in a conversation state while the vehicle A is traveling with the passenger E seated in the rear seat C2 of the vehicle A. In this manner, in this embodiment, when the driver D is in a gazing state and is also in a conversation state while the passenger E is seated in the rear seat C2 of the vehicle A, it is estimated that the driver D is having a conversation while looking at the passenger E in the rear seat C2 through the rearview mirror B, and a warning is issued. In this manner, in this embodiment, it is possible to detect that the driver D is having a conversation while looking at the passenger E in the rear seat C2 through the rearview mirror B, and to issue a warning.

[0054] (Second embodiment) Next, the configuration of a notification system 1 including a notification device 10 according to the second embodiment will be described with reference to Fig. 5. Fig. 5 is a block diagram showing an example of the configuration of a notification system 1 including a notification device 10 according to the second embodiment. Note that, in the following, components common to the first embodiment will be assigned the same reference numerals and descriptions thereof will be omitted.

[0055] In the second embodiment, at least one of the conditions for issuing a warning and the content of the warning is changed depending on whether or not there are other vehicles around vehicle A. Specifically, the notification system 1 according to the second embodiment includes an outside vehicle camera 16, as shown in FIG.

[0056] Exterior camera 16 is installed at an appropriate position on vehicle A and captures images of the outside of vehicle A. In other words, exterior camera 16 captures images of the surroundings of vehicle A, such as the areas in front of and behind vehicle A. Exterior camera 16 outputs the captured images of the outside of vehicle A to notification device 10. Note that exterior camera 16 may include multiple cameras, such as a front camera that captures images in front of vehicle A and a rear camera that captures images behind vehicle A. Exterior camera 16 is, for example, a camera equipped with a lens and an imaging element such as a CCD or CMOS, but is not limited to this.

[0057] 5 shows an example in which the vehicle exterior camera 16 is located outside the notification device 10, but the present invention is not limited to this. That is, the vehicle exterior camera 16 may be configured to be included in the notification device 10.

[0058] The controller 20 detects whether or not there are other vehicles in the vicinity of the vehicle A. Specifically, the controller 20 acquires an outside-vehicle image from the exterior camera 16. The controller 20 analyzes the acquired outside-vehicle image using any video analysis method, and detects whether or not there are other vehicles in the vicinity from the analysis results. Note that the other vehicles in this case include a leading vehicle traveling in front of the vehicle A and a trailing vehicle traveling behind the vehicle A, but are not limited thereto and may include only one of the leading vehicle and the trailing vehicle.

[0059] The controller 20 according to the second embodiment executes a notification process for issuing a warning when another vehicle is present around the vehicle A. The notification process executed by the controller 20 according to the second embodiment will now be described with reference to Fig. 6. Fig. 6 is a flowchart showing an example of the process executed by the controller 20 according to the second embodiment.

[0060] 6, the controller 20 executes the processes of steps S101 to S104. When the controller 20 determines in step S104 that the driver D is in a conversation state (step S104, Yes), the controller 20 determines whether or not another vehicle is present around the vehicle A (step S104a). To be precise, the controller 20 determines whether or not another vehicle is present around the vehicle A when the driver D is in a gazing state gazing at the rearview mirror B and the driver D is in a conversation state.

[0061] When the controller 20 determines that no other vehicle is present (step S104a, No), it skips the notification process of step S105. In other words, when the controller 20 determines that no other vehicle is present, it does not perform the notification process of step S105. On the other hand, when the controller 20 determines that another vehicle is present (step S104a, Yes), it proceeds to step S105 and performs notification process to issue a warning. In this way, in the controller 20 according to the second embodiment, the conditions for issuing a warning are changed depending on whether or not another vehicle is present.

[0062] As a result, in the second embodiment, a warning can be issued when the surrounding environment is one in which there are other vehicles around vehicle A and the driving situation requires more concentration on driving than in a surrounding environment in which there are no other vehicles.

[0063] In the above example, the controller 20 executes the notification process when another vehicle is present around the vehicle A, but the present invention is not limited to this. For example, the controller 20 may execute the notification process only when a preceding vehicle is present in front of the vehicle A. This makes it possible to issue a warning when the surrounding environment is one in which the preceding vehicle is present and the driving state requires more concentration on driving than in a surrounding environment in which no preceding vehicle is present. Furthermore, the controller 20 may execute the notification process only when a following vehicle is present behind the vehicle A. This makes it possible to issue a warning when the surrounding environment is one in which the following vehicle is present and the driving state requires more concentration on driving than in a surrounding environment in which no following vehicle is present.

[0064] Furthermore, in the above example, the condition for issuing a warning message is changed depending on whether or not there is another vehicle in the vicinity of vehicle A. However, in addition to or instead of this, controller 20 may change the content of the warning message depending on whether or not there is another vehicle. That is, for example, controller 20 may change the content of the warning message when there is another vehicle to a message encouraging the driver to concentrate more on driving compared to the content of the warning message when there is no other vehicle. As a result, in the second embodiment, when the surrounding environment is such that there are other vehicles around vehicle A and the driving state requires the driver to concentrate more on driving compared to the surrounding environment where there are no other vehicles, it is possible to issue a warning message with content appropriate to such driving state.

[0065] (Third embodiment) Next, a configuration of a notification system 1 including a notification device 10 according to a third embodiment will be described. In the third embodiment, at least one of the conditions for issuing a warning and the content of the warning is changed depending on the type of road on which the vehicle A is traveling.

[0066] More specifically, the notification system 1 according to the third embodiment includes a GPS (Global Positioning System) sensor 17, as indicated by the two-dot chain line in Fig. 5. The GPS sensor 17 receives radio waves transmitted from GPS satellites and acquires location information of the vehicle A based on the received radio waves. The GPS sensor 17 outputs the acquired location information to the notification device 10.

[0067] 5 shows an example in which the GPS sensor 17 is located outside the notification device 10, but the present invention is not limited to this. That is, the GPS sensor 17 may be configured to be included in the notification device 10.

[0068] Map information (not shown) is stored in the storage unit 30. The map information is information about a map including the route (road) on which the vehicle A travels. The map information also includes information about the type of road (for example, an ordinary road, an expressway, etc.).

[0069] The controller 20 detects the type of road on which the vehicle A is traveling based on the position information of the vehicle A acquired from the GPS sensor 17 and map information. The controller 20 according to the third embodiment executes a notification process to issue a warning when the detected type of road is an expressway and there is another vehicle in the vicinity of the vehicle A. Here, the notification process executed by the controller 20 according to the third embodiment will be described with reference to FIG. 7. FIG. 7 is a flowchart showing an example of the process executed by the controller 20 according to the third embodiment.

[0070] 7, the controller 20 executes the processes of steps S101 to S104. When the controller 20 determines in step S104 that the driver D is in a conversation state (step S104, Yes), the controller 20 determines whether or not the road on which the vehicle A is traveling is an expressway (step S104b). More precisely, the controller 20 determines whether or not the road on which the vehicle A is traveling is an expressway when the driver D is in a gazing state gazing at the rearview mirror B and the driver D is in a conversation state.

[0071] When the controller 20 determines that the road on which the vehicle A is traveling is an expressway (step S104b, Yes), it determines whether or not another vehicle is present around the vehicle A (step S104c). When the controller 20 determines that no other vehicle is present around the vehicle A (step S104c, No), it skips the notification process of step S105. In other words, when the controller 20 determines that the road on which the vehicle A is traveling is an expressway and no other vehicle is present, it does not perform the notification process of step S105. On the other hand, when the controller 20 determines that another vehicle is present (step S104c, Yes) or when it determines that the road on which the vehicle A is traveling is a type other than an expressway (for example, an ordinary road) (step S104b, No), it proceeds to step S105 and executes notification process to issue a warning. As described above, in the controller 20 according to the third embodiment, the condition for issuing a warning is changed depending on the type of road on which the vehicle A is traveling.

[0072] As a result, in the third embodiment, a warning can be issued when vehicle A is traveling on a highway in a driving environment where other vehicles are present around vehicle A, and the driving condition requires more concentration on driving than when vehicle A is traveling on a highway in a driving environment where there are no other vehicles present.

[0073] In the above, an example has been described in which the controller 20 according to the third embodiment executes the notification process when another vehicle is present around the vehicle A, but the present invention is not limited to this. For example, the controller 20 according to the third embodiment may execute the notification process only when the vehicle A is traveling on a highway and there is a preceding vehicle in front of the vehicle A. This makes it possible to issue a warning notice when the vehicle A is traveling on a highway and there is a preceding vehicle in a driving environment where the driver needs to concentrate more on driving than when the vehicle A is traveling on a highway and there is no preceding vehicle. Furthermore, the controller 20 according to the third embodiment may execute the notification process only when the vehicle A is traveling on a highway and there is a following vehicle behind the vehicle A. This makes it possible to issue a warning notice when the vehicle A is traveling on a highway and there is a following vehicle in a driving environment where the driver needs to concentrate more on driving than when the vehicle A is traveling on a highway and there is no following vehicle.

[0074] Furthermore, in the above example, the condition for issuing a warning message is changed depending on the type of road on which vehicle A is traveling. However, in addition to or instead of this, controller 20 may change the content of the warning message depending on the type of road on which vehicle A is traveling. That is, for example, controller 20 may change the content of the warning message when vehicle A is traveling on an expressway to a message that encourages the driver to concentrate more on driving compared to the content of the warning message when vehicle A is not traveling on an expressway. As a result, in the third embodiment, when the driving environment is such that vehicle A is traveling on an expressway and the driver needs to concentrate more on driving compared to a driving environment in which vehicle A is not traveling on an expressway, it is possible to issue a warning message with content appropriate to the driving state.

[0075] Further advantages and modifications will readily occur to those skilled in the art. Therefore, the invention in its broader aspects is not limited to the specific details and representative embodiments shown and described above. Accordingly, various modifications may be made without departing from the spirit or scope of the general inventive concept as defined by the appended claims and their equivalents. [Explanation of symbols]

[0076] 10 Notification device 20 Controller 100 Terminal Device

Claims

1. a controller that issues a warning when a driver is in a gaze state of gazing at a rearview mirror and in a conversation state of engaging in conversation while the vehicle is traveling with a passenger seated in a rear seat of the vehicle; A notification device comprising:

2. The controller If the time that the driver continuously looks at the rearview mirror is equal to or longer than a threshold time, it is determined that the driver is in the gazing state. The notification device of claim 1 .

3. The controller If the frequency at which the driver looks at the rearview mirror per reference period is equal to or greater than a threshold number of times, it is determined that the driver is in the gazing state. The notification device of claim 1 .

4. The controller determining whether the driver is in the conversation state according to the movement of the driver's mouth; The notification device of claim 1 .

5. The controller determining whether the driver is in the conversation state according to the voice of the driver; The notification device of claim 1 .

6. The controller changing at least one of the conditions for issuing the warning and the content of the warning depending on whether or not there is another vehicle around the vehicle; The notification device of claim 1 .

7. The controller changing at least one of the conditions for issuing the warning and the content of the warning according to the type of road on which the vehicle is traveling; The notification device of claim 1 .

8. The controller notifying a passenger of the vehicle other than the driver of the vehicle of the warning; The notification device of claim 1 .

9. When a driver is in a gazing state of gazing at a rearview mirror and is in a conversation state of engaging in a conversation while the vehicle is running with a passenger seated in the rear seat of the vehicle, a warning is issued to the driver; A program that causes a computer to execute the following.

Images