Inattentive driving determination device and inattentive driving determination method

Abstract

To restrict a driver from being unnecessarily determined to be in an inattentive driving state even when a vehicle is towing a towed vehicle.SOLUTION: An inattentive driving determination device determines whether a driver of a vehicle 100 is inattentively driving. The device includes: a visual line direction detection section 331 for detecting a visual line direction of a driver; a towing determination section 332 for determining whether a towed vehicle 101 is connected to the vehicle; an inattentive driving determination section 334 for determining whether the driver is in an inattentive driving state based on whether the visual line direction of the driver satisfies an inattentive driving determination condition; and a condition setting section 333 for setting the inattentive driving determination condition so as to mitigate the inattentive driving determination condition in comparison with a case where the towed vehicle is not connected to the vehicle when the towed vehicle is connected to the vehicle.SELECTED DRAWING: Figure 5

Description

Technical Field

[0001] The present disclosure relates to a glance determination device and a glance determination method.

Background Art

[0002] Conventionally, a glance determination device that detects the line-of-sight direction of a driver and determines whether the driver is in a glance state based on the detected line-of-sight direction has been known (such as Patent Document 1). In particular, in the glance determination device described in Patent Document 1, when the vehicle is going straight, if the line-of-sight direction of the driver is in the direction of both side mirrors, a rearview mirror, a multimedia display, and a meter panel, it is determined that the driver is glancing.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] By the way, when a vehicle is towing a towed vehicle, the driver will check the state of the towed vehicle at a certain frequency through a side mirror or a rearview mirror in order to check the state of the towed vehicle. As a result, when the vehicle is towing a towed vehicle, the frequency of determining that the driver is in a glance state may become unnecessarily high.

[0005] In view of the above problems, an object of the present disclosure is to suppress the unnecessary determination that the driver is in a glance state even when the vehicle is towing a towed vehicle.

Means for Solving the Problems

[0006] The gist of the present disclosure is as follows.

[0007] (1) A glance determination device that determines whether a driver of a vehicle is glancing, comprising: a line-of-sight direction detection unit that detects the line-of-sight direction of the driver; a towing determination unit that determines whether a towed vehicle is connected to the vehicle; a glance determination unit that determines whether the driver is in a glancing state based on whether the line-of-sight direction of the driver satisfies a glance determination condition; a condition setting unit that sets the glance determination condition such that the glance determination condition is relaxed when a towed vehicle is connected to the vehicle compared to when no towed vehicle is connected to the vehicle. (2) The glance determination condition includes a condition regarding an area of the line-of-sight direction of the driver, and the condition setting unit sets the glance determination condition such that when a towed vehicle is connected to the vehicle and the line-of-sight direction of the driver is within a towed vehicle visual recognition area for visually recognizing an image of the towed vehicle, the glance determination condition is not satisfied. The glance determination device according to (1) above. (3) The glance determination condition includes a condition regarding an area of the line-of-sight direction of the driver and a duration of viewing each area, and the condition setting unit sets the glance determination condition such that when the line-of-sight direction of the driver is within a towed vehicle visual recognition area for visually recognizing an image of the towed vehicle, the glance determination condition is satisfied for a longer duration when a towed vehicle is connected to the vehicle compared to when no towed vehicle is connected to the vehicle. The glance determination device according to (1) above. (4) Further comprising a notification unit that notifies the driver when it is determined that the driver is in a glancing state, and when a towed vehicle is connected to the vehicle and the line-of-sight direction of the driver is within a towed vehicle visual recognition area for visually recognizing an image of the towed vehicle, the notification unit notifies the driver in a manner different from when no towed vehicle is connected to the vehicle. The glance determination device according to (3) above. (5) A glance determination method for determining whether a driver of a vehicle is glancing, comprising: Detecting the line-of-sight direction of the driver; Determining whether a towed vehicle is connected to the vehicle; Determining whether the driver is in a side-glancing state based on whether the line-of-sight direction of the driver satisfies a side-glancing determination condition; When a towed vehicle is connected to the vehicle, setting the side-glancing determination condition such that the side-glancing determination condition is relaxed compared to when no towed vehicle is connected to the vehicle; A side-glancing determination method including the above.

Advantages of the Invention

[0008] According to the present disclosure, it is possible to suppress the unnecessary determination that the driver is in a side-glancing state when the vehicle is towing a towed vehicle.

Brief Description of the Drawings

[0009]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Embodiments for Carrying Out the Invention

[0010] Hereinafter, embodiments will be described in detail with reference to the drawings. In the following description, the same reference numerals are assigned to similar components.

[0011] <Configuration of the device> With reference to FIGS. 1 to 3, the configuration of a driver monitoring system 1 equipped with a sidelong glance determination device according to one embodiment will be described. FIG. 1 is a schematic diagram showing a vehicle 100 and a towed vehicle 101 equipped with the driver monitoring system 1.

[0012] As shown in FIG. 1, the vehicle 100 is configured to be able to tow the towed vehicle 101. The vehicle 100 has a fitting for attaching the towed vehicle 101, and the fitting of the towed vehicle 101 is attached to this fitting.

[0013] In the present embodiment, the vehicle 100 is not a vehicle mainly for towing such as a trailer head, but a vehicle not mainly for towing, for example, a passenger car. Further, the towed vehicle 101 may be any towed vehicle as long as it can be towed by a passenger car or the like, such as not only a boat trailer for mounting a watercraft such as a boat 102 as shown in FIG. 1, but also a camping trailer providing a living space, a bike trailer for mounting a bike, or a multi-trailer capable of loading various items.

[0014] FIG. 2 is a block diagram schematically showing the configuration of the driver monitoring system 1. The driver monitoring system 1 is mounted on the vehicle 100 and determines whether the driver of the vehicle 100 is making a sidelong glance. As shown in FIG. 2, the driver monitoring system 1 includes a driver monitoring camera 11, a connection connector 12, a human machine interface (HMI) 13, and an electronic control unit (hereinafter referred to as "ECU") 30. The driver monitoring camera 11, the connection connector 12, the HMI 13, and the ECU 30 are communicably connected via, for example, an in-vehicle network 21. The in-vehicle network 21 is a network compliant with a standard such as CAN (Controller Area Network), for example.

[0015] The driver monitoring camera 11 is an example of an imaging device that images the driver. In the present embodiment, the driver monitoring camera 11 is provided at the upper part of the steering column and is arranged facing the driver so as to be able to image the driver, specifically, the face and a part of the upper body of the driver. Note that the driver monitoring camera 11 may be provided at a position different from the upper part of the steering column as long as it can image the driver of the vehicle 100. For example, the driver monitoring camera 11 may be provided on the steering wheel, rearview mirror, meter panel, meter hood, etc. of the vehicle 100.

[0016] The driver monitoring camera 11 includes a camera and a projector. For example, the camera is a CMOS (Complementary Metal Oxide Semiconductor) camera or a CCD (Charge Coupled Device) camera, and the projector is an LED (Light Emitting Diode). Also, in order to be able to image the driver's face without giving discomfort to the driver even in low illuminance situations such as at night, the projector is preferably a near-infrared LED, and it is also preferable that the camera can detect near-infrared rays. For example, the projector is two near-infrared LEDs arranged on both sides of the camera. Also, a filter such as a visible light cut filter may be provided in the camera. The driver monitoring camera 11 outputs the images captured at predetermined intervals to the ECU 30 via the in-vehicle network 21.

[0017] The connection connector 12 is a connector that is connected to the connection connector of the towed vehicle 101 when the towed vehicle 101 is connected to the vehicle 100. Various signals are transmitted from the ECU 30 of the vehicle 100 to the towed vehicle 101 via the connection connector 12, and power is also supplied. Thereby, for example, according to the operation of the driver of the vehicle 100, the turn indicator of the towed vehicle 101 blinks or the brake lamp lights up. The connection connector 12 is connected to the ECU 30 via the in-vehicle network 21 and is used to transmit the signals transmitted from the ECU 30 to the towed vehicle 101.

[0018] The HMI 13 is an interface for inputting and outputting information between the driver or passenger and the driver monitoring system 1. The HMI 13 includes an information providing device for providing various information to the driver or passenger, and an input device for the driver or passenger to perform input operations.

[0019] Specifically, as an information providing device, the HMI 13 includes a display 14 for displaying character information and image information. The display 14 is an example of a display device for displaying images. The display 14 is a display device of any type, such as a liquid crystal display or an organic EL display. The display 14 is arranged so that at least the driver can view its screen. Therefore, the display 14 is arranged, for example, on the instrument panel, meter panel, etc. of the vehicle 100. The display 14 receives an image signal from the ECU 30 via the in-vehicle network 21 and displays an image according to this image signal. Note that the vehicle 100 may include other types of display devices, such as a head-up display, instead of or in addition to the display 14 as an information providing device.

[0020] Also, the HMI 13 has a speaker 15 as an information providing device. The speaker 15 is an example of a device for outputting sound. The speaker 15 receives an audio signal from the ECU 30 via the in-vehicle network 21 and outputs sound according to this audio signal. Note that the HMI 13 may include devices other than the display 14 and the speaker 15 (for example, a vibration device, etc.) that provide various information to the driver or passenger as an information providing device.

[0021] In addition, the HMI 13 has a touch panel 16 as an input device. The touch panel 16 is an example of a device that receives input when touched by a driver or a passenger. The touch panel 16 is disposed on the surface of the display 14 and outputs an operation signal to the ECU 30 via the in-vehicle network 21 when an operation by contact is performed by the driver or the passenger. Note that the HMI 13 may include devices other than the touch panel 16 (e.g., buttons, switches, etc.) for the driver or the passenger to perform input operations as input devices.

[0022] The ECU 30 functions as a glance determination device that determines whether or not the driver of the vehicle 100 is glancing away. Also, the ECU 30 controls the information provided by the information providing device of the HMI 13. Therefore, the ECU 30 controls the image displayed on the display 14 and the sound output from the speaker 15. As shown in FIG. 2, the ECU 30 includes a communication interface 31, a storage unit 32, and a processor 33.

[0023] The communication interface 31 is a circuit for connecting the ECU 30 to the in-vehicle network 21.

[0024] The storage unit 32 stores data. The storage unit 32 includes, for example, at least one of a volatile semiconductor memory, a non-volatile semiconductor memory, a hard disk drive (HDD), and a solid state drive (SSD). The storage unit 32 stores a computer program executed by the processor 33 of the ECU 30. Also, the storage unit 32 stores data used in the computer program executed by the processor 33, such as data transmitted from the driver monitor camera 11 and the like.

[0025] The processor 33 includes one or more CPUs (Central Processing Units) and peripheral circuits thereof. The processor 33 may further include other arithmetic circuits such as a logical arithmetic unit or a numerical arithmetic unit. The processor 33 executes the computer program stored in the storage unit 32.

[0026] Figure 3 is a functional block diagram of the processor 33 of the ECU 30. As shown in Figure 3, the processor 33 includes a line-of-sight direction detection unit 331, a towing determination unit 332, a condition setting unit 333, a side glance determination unit 334, and a notification unit 335. Each of these units included in the processor 33 is a functional module realized by, for example, a computer program operating on the processor 33. Alternatively, each unit included in the processor 33 may be implemented in the ECU 30 as an independent integrated circuit, microprocessor, or firmware.

[0027] The line-of-sight direction detection unit 331 detects the driver's line-of-sight direction based on the image captured by the driver monitor camera 11. The line-of-sight direction is represented by the horizontal or vertical angle between the longitudinal direction of the vehicle 100 and the driver's line of sight.

[0028] Specifically, the line-of-sight direction detection unit 331 detects the driver's line-of-sight direction by a known image processing method based on the image acquired from the driver monitor camera 11. As specific image processing methods, for example, calculating the line-of-sight direction directly based on the input image, or calculating the face orientation and the orientation of the eyes relative to the face based on the input image and calculating the line-of-sight direction based on the calculated face orientation and the orientation of the eyes relative to the face, etc. are conceivable.

[0029] The towing determination unit 332 determines whether or not a towed vehicle 101 is connected to the vehicle 100. In the present embodiment, the towing determination unit 332 determines whether or not the connection connector of the towed vehicle 101 is connected to the connection connector 12 of the vehicle 100. And when it is determined that the connection connector of the towed vehicle 101 is connected to the connection connector 12 of the vehicle 100, the towing determination unit 332 determines that the towed vehicle 101 is connected to the vehicle 100. On the other hand, when it is determined that the connection connector of the towed vehicle is not connected to the connection connector 12 of the vehicle 100, the towing determination unit 332 determines that the towed vehicle 101 is not connected to the vehicle 100.

[0030] Note that as long as the towing determination unit 332 can determine whether the towed vehicle 101 is connected to the vehicle 100, the determination may be made based on devices other than the connection connector 12. For example, when the vehicle 100 has a rear camera that images the rear of the vehicle 100, the towing determination unit 332 may determine whether the towed vehicle 101 is connected to the vehicle 100 based on the image obtained from this rear camera. In this case, the image obtained from the rear camera is input to an identifier that identifies the presence or absence of the towed vehicle 101. Alternatively, the towing determination unit 332 may determine whether the towed vehicle 101 is connected to the vehicle 100 based on the input information input to the driver by the touch panel 16 of the HMI 13. In this case, when the driver inputs via the touch panel 16 that the towed vehicle 101 is connected to the vehicle 100, the towing determination unit 332 determines that the towed vehicle 101 is connected to the vehicle 100.

[0031] The condition setting unit 333 sets a distraction determination condition for determining that the driver is in a distracted state. In the present embodiment, the distraction determination condition includes conditions related to the area in the driver's line of sight direction and the duration for which the line of sight direction is located in each area. Specifically, in the present embodiment, the condition setting unit 333 sets, for each area in the driver's line of sight direction, the duration for which the driver is determined to be in a distracted state when the driver's line of sight direction is located in that area as a threshold value.

[0032] FIG. 4 is a diagram for explaining the area in which the driver is determined to be in a distracted state during driving. During driving of the vehicle 100, it is necessary for the driver to visually recognize the front of the vehicle 100. Therefore, in the present embodiment, when the driver's line of sight direction is in the front area A shown by the solid line in the figure, the distraction determination condition is set so that the driver is not determined to be in a distracted state regardless of the duration.

[0033] On the other hand, during the operation of the vehicle 100, the driver may temporarily need to visually recognize the area B where the side mirror is located, the area C where the rearview mirror is located, the area D where the display 14 (central display 14a) in the center of the instrument panel is located, and the area E where the display 14 (meter display 14b) on the meter panel is located. Therefore, when the driver's line of sight is temporarily in these areas B to E, it is necessary to determine that the driver is not in a side-glancing state. On the other hand, these drivers should not visually recognize these areas B to E for a long period during driving. Therefore, in the present embodiment, when the driver's line of sight is in the areas B to E for a predetermined first time X or more, the driver is determined to be in a side-glancing state, and when the driver's line of sight is in the areas B to E for less than the first time X, the driver is determined not to be in a side-glancing state, and the side-glancing determination condition is set.

[0034] In addition, in the present embodiment, a retrofit monitor 17 is provided inside the vehicle 100. This retrofit monitor 17 is attached by the user after the sale of the vehicle 100 and is not connected to the ECU 30, for example. The retrofit monitor 17 is, for example, a smartphone and is used for the driver to use a navigation application. The position of this retrofit monitor 17 is registered in advance by the driver or the user via the touch panel 16 of the HMI 13 at its installation position. In such a case, the driver may temporarily need to visually recognize the area F where the retrofit monitor 17 is located during the operation of the vehicle 100. Therefore, in the present embodiment, similar to the areas B to E, when the driver's line of sight is in the area F where the retrofit monitor 17 is located for the first time X or more, the driver is determined to be in a side-glancing state, and when the driver's line of sight is in the area F for less than the first time X, the driver is determined not to be in a side-glancing state, and the side-glancing determination condition is set.

[0035] In addition, for regions other than regions A to F, the driver basically does not need to visually recognize these regions even temporarily during driving. Therefore, in the present embodiment, when the driver's line of sight direction is in a region other than regions A to F for a predetermined second time Y that is shorter than the first time X, the driver is determined to be in a side-glancing state, and when the driver's line of sight direction is in a region other than regions A to F for less than the second time Y, the driver is determined not to be in a side-glancing state. Thus, side-glancing determination conditions are set.

[0036] In addition, in the present embodiment, the side-glancing determination conditions change based on the presence or absence of the connection of the towed vehicle 101 determined by the towing determination unit 332. Details regarding such changes in the side-glancing determination conditions will be described later.

[0037] Note that in the present embodiment, in regions B to F, it is determined whether the driver is in a side-glancing state at the same first time X. However, it may be determined whether the driver is in a side-glancing state at different times for each of regions B to F.

[0038] The side-glancing determination unit 334 determines whether the driver is in a side-glancing state based on whether the driver's line of sight direction satisfies the side-glancing determination conditions set by the condition setting unit 333. In particular, in the present embodiment, based on whether the driver's line of sight direction detected by the line of sight direction detection unit 331 continuously positions in a specific region over a threshold value corresponding to that region, it is determined whether the driver is in a side-glancing state. For example, when the state where the driver's line of sight direction is in the direction within region B continues for the first time X or more, the side-glancing determination unit 334 determines that the driver is in a side-glancing state. On the other hand, for example, when the driver's line of sight direction is in the direction within region A, or when the state where the driver's line of sight direction is in the direction within region B continues for less than the first time X, the side-glancing determination unit 334 determines that the driver is not in a side-glancing state.

[0039] When the peeking determination unit 334 determines that the driver is in a peeking state, the notification unit 335 notifies the driver. For example, the notification unit 335 causes the display 14 to display that the driver is in a peeking state. Alternatively, for example, the notification unit 335 causes the speaker 15 to output a voice indicating that the driver is in a peeking state.

[0040] <Peeking determination during towing> Next, with reference to FIGS. 5 and 6, the peeking determination when the towed vehicle 101 is connected to the vehicle 100 will be described. When the vehicle 100 is towing the towed vehicle 101, the driver will check the condition of the towed vehicle 101 at a certain frequency in order to check the condition of the towed vehicle. Such checking of the condition of the towed vehicle 101 by the driver is performed by the side mirror and the rear mirror. Also, when a video of the rear of the vehicle 100 is projected on the center display 14a, the meter display 14b, or the aftermarket monitor 17, the checking of the condition of the towed vehicle 101 by the driver is also performed by these center display 14a, meter display 14b, or aftermarket monitor 17. Therefore, the regions B to F where these side mirrors and the like are located can be said to be regions where the driver needs to visually recognize the towed vehicle image when the towed vehicle 101 is connected to the vehicle 100 (hereinafter referred to as "towed vehicle visual recognition regions").

[0041] Therefore, in the present embodiment, when the towed vehicle 101 is connected to the vehicle 100, the condition setting unit 333 sets the peeking determination condition so that the peeking determination condition is relaxed compared to when the towed vehicle is not connected to the vehicle 100. In particular, in the present embodiment, when the towed vehicle 101 is connected to the vehicle 100, the peeking determination condition is relaxed so that the peeking determination condition in the towed vehicle visual recognition region is relaxed compared to when the towed vehicle is not connected to the vehicle 100.

[0042] Specifically, in the present embodiment, when the towed vehicle 101 is not connected to the vehicle 100, the condition setting unit 333 sets the towed vehicle visual recognition area as a side glance determination area in which the driver is determined to be in a side glance state when the driver's line of sight is within that area for a predetermined time. On the other hand, when the towed vehicle 101 is connected to the vehicle 100, the condition setting unit 333 does not set the towed vehicle visual recognition area as the side glance determination area. That is, when the towed vehicle 101 is connected to the vehicle 100, the condition setting unit 333 sets the side glance determination conditions so that the side glance determination conditions are not satisfied when the driver's line of sight is within the towed vehicle visual recognition area. Therefore, when the towed vehicle 101 is not connected to the vehicle 100, the areas B to F in FIG. 4 are set as the side glance determination areas, whereas when the towed vehicle 101 is connected to the vehicle 100, the areas B to F in FIG. 4 are not set as the side glance determination areas.

[0043] According to the present embodiment, the side glance determination conditions are relaxed when the towed vehicle 101 is connected to the vehicle 100. Thereby, when the driver looks at the side mirror or the like to confirm the towed vehicle 101, it is suppressed that the driver is unnecessarily determined to be in a side glance state.

[0044] FIG. 5 is a flowchart showing the flow of the condition setting process for setting the side glance determination conditions. The illustrated condition setting process is executed by the processor 33, for example, at regular time intervals.

[0045] As shown in FIG. 5, in the condition setting process, first, the towing determination unit 332 determines whether the towed vehicle 101 is connected to the vehicle 100 (step S11). As described above, the towing determination unit 332 determines based on whether the connection connector of the towed vehicle 101 is connected to the connection connector 12 of the vehicle 100.

[0046] If it is determined in step S11 that the towed vehicle 101 is not connected to the vehicle 100, the condition setting unit 333 sets the side vision determination condition to the normal condition (step S12). Accordingly, the condition setting unit 333 sets the towed vehicle visual recognition area (for example, areas B to F) as the side vision determination area.

[0047] On the other hand, if it is determined in step S11 that the towed vehicle 101 is connected to the vehicle 100, the condition setting unit 333 sets the side vision determination condition to the towing condition (step S13). Accordingly, the condition setting unit 333 does not set the towing visual recognition area (for example, areas B to F) as the side vision determination area.

[0048] FIG. 6 is a flowchart showing the flow of the side vision determination process for performing the side vision determination. The illustrated side vision determination process is executed by the processor 33, for example, at regular time intervals.

[0049] As shown in FIG. 6, in the side vision determination process, first, the line-of-sight direction detection unit 331 detects the driver's line-of-sight direction (step S21). As described above, the line-of-sight direction detection unit 331 detects the driver's line-of-sight direction based on the image captured by the driver monitor camera 11.

[0050] Next, the side vision determination unit 334 determines whether or not the driver's line-of-sight direction detected by the line-of-sight direction detection unit 331 satisfies the side vision determination condition (step S22). The side vision determination condition used here is the condition currently set in step S12 or S13 of the condition setting process shown in FIG. 5.

[0051] If it is determined in step S22 that the driver's line-of-sight direction does not satisfy the side vision determination condition, the side vision determination process ends without notifying the driver. On the other hand, if it is determined in step S22 that the driver's line-of-sight direction satisfies the side vision determination condition, the notification unit 335 notifies the driver that the driver is in a side vision state via the display 14 or the speaker 15.

[0052] <Modification Example> Next, with reference to FIG. 7, one modification example will be described. In the above-described embodiment, when the towed vehicle 101 is connected to the vehicle 100, the towed vehicle visual recognition area is not set as the side glance determination area. In contrast, in this modification example, even when the towed vehicle 101 is connected to the vehicle 100, the towed vehicle visual recognition area remains set as the side glance determination area. However, in this modification example, when the towed vehicle 101 is connected to the vehicle 100, the side glance determination conditions in the towed vehicle visual recognition area are relaxed compared to when the towed vehicle 101 is not connected to the vehicle 100. On the other hand, for areas other than the towed vehicle visual recognition area, the side glance determination conditions are not changed according to whether the towed vehicle 101 is connected to the vehicle 100 or not.

[0053] Specifically, in this modification example, the condition setting unit 333 increases the threshold value regarding the duration in the towed vehicle visual recognition area when the towed vehicle 101 is connected to the vehicle 100 compared to when the towed vehicle 101 is not connected to the vehicle 100. That is, when the driver's line of sight direction is within the towed vehicle visual recognition area, the condition setting unit 333 sets the side glance determination conditions so that the side glance determination conditions are satisfied for a longer duration when the towed vehicle 101 is connected to the vehicle 100 compared to when the towed vehicle 101 is not connected to the vehicle 100.

[0054] Therefore, in this modification example, when the towed vehicle 101 is not connected to the vehicle 100, it is determined that the driver is in a side glance state when the state where the driver's line of sight direction is in areas B to F in FIG. 4 continues for a first time X or more. On the other hand, when the towed vehicle 101 is connected to the vehicle 100, it is determined that the driver is in a side glance state when the state where the driver's line of sight direction is in areas B to F in FIG. 4 continues for a third time Z longer than the first time X (Z > X).

[0055] Further, in this modification, when the towed vehicle 101 is connected to the vehicle 100, if the driver's line of sight is within the towed vehicle visibility area, a notification to the driver is made in a mode (second mode) different from the mode (first mode) when the towed vehicle 101 is not connected to the vehicle 100. On the other hand, when the driver's line of sight is outside the towed vehicle visibility area, even if the towed vehicle 101 is connected to the vehicle 100, a notification to the driver is made in the same mode as when the towed vehicle 101 is not connected to the vehicle 100.

[0056] Specifically, in the present embodiment, when the driver's line of sight is within the towed vehicle visibility area, if the towed vehicle 101 is connected to the vehicle 100, the notification unit 335 causes the speaker 15 to output sound such that the notification sound from the speaker 15 becomes smaller compared to when the towed vehicle 101 is not connected to the vehicle 100.

[0057] Further, when the driver's line of sight is within the towed vehicle visibility area, if the towed vehicle 101 is connected to the vehicle 100, the notification unit 335 may cause the speaker 15 to output sound so as to emit a notification sound different from that when the towed vehicle 101 is not connected to the vehicle 100. In addition, in the present embodiment, when the towed vehicle 101 is connected to the vehicle 100, the notification unit 335 may cause the display 14 to perform screen display in a mode different from that when the towed vehicle 101 is not connected to the vehicle 100. In this case, when the towed vehicle 101 is connected to the vehicle 100, the sound output and the screen display are performed in a mode that does not interfere with the driver's driving or in a mode that makes it difficult for the driver to be distracted compared to when the towed vehicle 101 is not connected to the vehicle 100.

[0058] FIG. 7 is a flowchart similar to FIG. 6 showing the flow of the side glance determination process for performing side glance determination. Steps S31 and S32 in FIG. 7 are the same as steps S21 and S22 in FIG. 6, and thus the description thereof is omitted.

[0059] When it is determined in step S32 that the driver's line of sight direction satisfies the side glance determination condition, the notification unit 335 determines whether the driver's line of sight direction is outside the towed vehicle visibility area (step S33). The notification unit 335 makes the determination based on the driver's line of sight direction detected in step S31.

[0060] When it is determined in step S33 that the driver's line of sight direction is outside the towed vehicle visibility area, the notification unit 335 notifies the driver that they are in a side glance state in the first mode (step S34). Therefore, for example, the notification is made with a relatively loud notification sound. On the other hand, when it is determined in step S33 that the driver's line of sight direction is within the towed vehicle visibility area, the notification unit 335 notifies the driver that they are in a side glance state in the second mode (step S35). Therefore, for example, the notification is made with a relatively quiet notification sound.

[0061] In this modification, when the towed vehicle 101 is connected to the vehicle 100, while the side glance determination area does not change, the side glance determination condition in the towed vehicle visibility area is relaxed. As a result, when the towed vehicle 101 is connected to the vehicle 100, it is suppressed that the driver is not determined to be in a side glance state when the driver looks at the towed vehicle visibility area more than necessary. Also, in this modification, the notification mode to the driver changes according to whether the driver's line of sight direction is within the towed vehicle visibility area. In particular, when the line of sight direction is within the towed vehicle visibility area, the notification is made in a mode that has little impact on the driver's driving. For this reason, it is suppressed that a side glance notification to the driver is made in a mode that has a large impact on driving when the driver is visually recognizing the towed vehicle 101.

[0062] In addition, in the above-described embodiments and modified examples, the relaxation of the side vision determination conditions for the area where the display 14 and the retrofitted monitor 17 are located is performed regardless of whether the display 14 and the retrofitted monitor 17 display an image of the rear of the vehicle 100 (an image around the towed vehicle 101). However, the relaxation of the side vision determination conditions for the area where the display 14 and the retrofitted monitor 17 are located may be performed only when the display 14 and the retrofitted monitor 17 display an image of the rear of the vehicle 100.

[0063] As described above, the preferred embodiments according to the present disclosure have been described. However, the present disclosure is not limited to these embodiments, and various modifications and changes can be made within the scope of the claims.

Description of Reference Numerals

[0064] 1 Driver Monitoring System 11 Driver Monitoring Camera 30 ECU 33 Processor

Claims

1. A glance-check determination device that determines whether a driver of a vehicle is engaged in glance-checking, comprising: a line-of-sight direction detection unit that detects the line-of-sight direction of the driver; a towing determination unit that determines whether a towed vehicle is connected to the vehicle; a glance-check determination unit that determines whether the driver is in a glance-check state based on whether the line-of-sight direction of the driver satisfies a glance-check determination condition; a condition setting unit that sets the glance-check determination condition such that the glance-check determination condition is relaxed when a towed vehicle is connected to the vehicle compared to when no towed vehicle is connected to the vehicle; A glance-check determination device comprising the above components.

2. The glance-check determination condition includes a condition regarding an area of the line-of-sight direction of the driver, and when a towed vehicle is connected to the vehicle, the condition setting unit sets the glance-check determination condition such that the glance-check determination condition is not satisfied when the line-of-sight direction of the driver is within a towed-vehicle visual recognition area for visually recognizing an image of the towed vehicle. The glance-check determination device according to claim 1.

3. The glance-check determination condition includes a condition regarding an area of the line-of-sight direction of the driver and a duration of viewing each area, and when the line-of-sight direction of the driver is within a towed-vehicle visual recognition area for visually recognizing an image of the towed vehicle, the condition setting unit sets the glance-check determination condition such that the glance-check determination condition is satisfied for a longer duration when a towed vehicle is connected to the vehicle compared to when no towed vehicle is connected. The glance-check determination device according to claim 1.

4. The device further comprises a notification unit that notifies the driver when it is determined that the driver is in a glance-check state, and when a towed vehicle is connected to the vehicle, the notification unit notifies the driver in a manner different from when no towed vehicle is connected when the line-of-sight direction of the driver is within a towed-vehicle visual recognition area for visually recognizing an image of the towed vehicle. The glance-check determination device according to claim 3.

5. A glance-check determination method for determining whether a driver of a vehicle is engaged in glance-checking, comprising: detecting the line-of-sight direction of the driver; determining whether a towed vehicle is connected to the vehicle; determining whether the driver is in a glance-check state based on whether the line-of-sight direction of the driver satisfies a glance-check determination condition; When a towed vehicle is connected to the vehicle, set the side view determination condition so that the side view determination condition is relaxed compared to when the towed vehicle is not connected to the vehicle. A side view determination method including this.

Images