Distraction determination device, distraction determination method, and non-transitory computer recording medium

By detecting the vehicle's periphery and driver's status, and adjusting the judgment range and angle, the problem of misjudgment of the driver's monitoring device when the object mark is approached in front of the vehicle is solved, and the accuracy and safety of visual vision of the driver are improved.

CN118928424APending Publication Date: 2024-11-12TOYOTA JIDOSHA KK +1
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410501652.7
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2023-05-09
Filing Date
2024-04-25
Publication Date
2024-11-12

AI Technical Summary

Technical Problem

It is difficult for existing driver monitoring devices to accurately determine whether the driver is visualizing the front mark or equipment in the vehicle outside the vehicle. Especially when the front mark in the vehicle becomes closer from a distance, it is easy to misjudge it as visual equipment in the vehicle.

Method used

By detecting vehicle peripheral data and driver status data, adjusting the visual judgment range and distracted judgment angle, and determining the driver's line of sight direction based on the position relationship and distance of the object to avoid misjudgment. Specific measures include increasing the judgment range and angle when the object mark is approached, and ensuring that the driver's line of sight is within the appropriate range before it is determined to be distracted.

Benefits of technology

It effectively suppresses misjudgment, improves the accuracy of the driver's visual inspection of objects in front of the vehicle, and reduces the misguided alarm about equipment inside the vehicle.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118928424A_ABST
    Figure CN118928424A_ABST
Patent Text Reader

Abstract

The invention relates to a distraction determination apparatus, a distraction determination method, and a non-transitory computer recording medium. The purpose of the present invention is to suppress erroneous determination as being visible to an in-vehicle device despite being visible to a front object outside a vehicle. The distraction determination device (4) is configured to: detect a target object present in front of the vehicle on the basis of peripheral data indicating a situation in the periphery of the vehicle; detecting a viewpoint position and a gaze direction of the driver based on driver data indicating a state of the driver; a visual determination range for changing the vertical direction in accordance with the positional relationship with the object, the visual determination range being a range for making a determination of whether or not the driver is viewing an in-vehicle device disposed forward in the vehicle; if the line-of-sight direction of the driver falls within the visual determination range for a predetermined distraction determination time or longer, it is determined that the driver is distraction with respect to the in-vehicle device; and changing the visual determination range such that the upper end position of the visual determination range is located on the lower side when the target is located near compared to when the target is located farther than when the target is located farther.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a distraction determination device, a distraction determination method and a non-transitory computer recording medium. Background Art

[0002] Patent document 1 discloses a device which, as a conventional driver monitoring device, is configured such that the shorter the distance to a leading vehicle traveling in another lane (adjacent lane), the wider the left-right range permitted for the driver's line of sight is, and if the driver's line of sight deviates from the range, it is determined that the driver is distracted.

[0003] Prior art literature

[0004] Patent Literature

[0005] Patent Document 1: Japanese Patent Application Publication No. 2019-87143

[0006] A front window glass is arranged on the upper front side of the driver's seat and the front passenger seat of the vehicle, and an instrument panel is arranged on the lower front side. The instrument panel is equipped with devices that the driver sees (hereinafter referred to as "in-vehicle devices") such as a monitor, a car navigation system, and instruments. Therefore, when the driver is looking at in-vehicle devices (i.e., when the driver is distracted), the driver's line of sight is directed downward in the vertical direction (the height direction of the vehicle), compared to when the driver is looking at objects in front of the vehicle such as other vehicles through the front window glass (hereinafter referred to as "objects in front of the vehicle").

[0007] Similarly, when the driver is visually viewing a front object outside the vehicle through the windshield, the driver's line of sight tends to be downward in the vertical direction when the front object outside the vehicle is near the vehicle compared to when the front object outside the vehicle is far away.

[0008] Therefore, compared with when the external front object is far away, when the external front object is near the vehicle, it is difficult to determine whether the driver is in a state of visually viewing the external front object through the windshield or viewing the equipment inside the vehicle. Assuming that the left-right range permitted for the driver's line of sight is changed according to the positional relationship with the preceding vehicle traveling in the other lane (adjacent lane) as in the aforementioned Patent Document 1, when the driver is viewing the external front object through the windshield and the line of sight is directed toward the lower side in the up-down direction as the distance to the external front object gradually decreases, the driver may be mistakenly determined to be viewing the equipment inside the vehicle even though the driver is viewing the external front object. Summary of the invention

[0009] The present invention has been made with attention paid to such a problem, and an object of the present invention is to prevent a person from mistakenly determining that he is viewing a device inside the vehicle even though he is viewing a forward object outside the vehicle.

[0010] The gist of the present disclosure is as follows.

[0011] (1) A distraction determination device for determining whether a driver of a vehicle is distracted, wherein the distraction determination device is configured to: detect an object existing in front of the vehicle based on surrounding data indicating the condition of the surroundings of the vehicle; detect the viewpoint position and line of sight direction of the driver based on driver data indicating the state of the driver; change a visual determination range in the up and down directions according to a positional relationship with the object, wherein the visual determination range is a range for determining whether the driver is visually observing in-vehicle equipment arranged in front of the vehicle; determine that the driver is distracted from the in-vehicle equipment if the line of sight of the driver continues to fall within the visual determination range for more than a predetermined distraction determination time; and change the visual determination range in such a way that the upper end position of the visual determination range is on the lower side when the object is nearby compared to when the object is far away.

[0012] (2) The distraction determination device according to (1) above, wherein when the target object is far away, the upper end position of the visual determination range is set to any position between the upper end position of the in-vehicle device and the lower end position of the front window glass of the vehicle.

[0013] (3) A distraction determination device according to (1) or (2) above, wherein the distraction determination device is configured not to change the visual determination range when the positional relationship with the object changes from a distant state to a nearby state during the period from when the driver's line of sight falls within the visual determination range to when the distraction determination time elapses.

[0014] (4) A distraction determination device according to any one of (1) to (3) above, wherein the distraction determination device is configured to: grasp the positional relationship with the object by detecting the distance to the object; if the distance to the object is greater than or equal to a specified threshold, determine that the object is far away; and if the distance to the object is less than the specified threshold, determine that the object is nearby.

[0015] (5) A distraction determination device according to any one of (1) to (3) above, wherein the distraction determination device is configured to: grasp the positional relationship with the target object by detecting the driver's line of sight angle, wherein the line of sight angle is an angle formed by a horizontal line extending horizontally from the driver's viewpoint and a line of sight direction extending from the driver's viewpoint toward a line of sight below the horizontal line; if the line of sight angle is less than or equal to a specified angle, determine that the target object is far away; and if the line of sight angle is greater than the specified angle, determine that the target object is nearby.

[0016] (6) The distraction determination device according to any one of (1) to (5) above, wherein the distraction determination device is configured to increase the distraction determination time when the object is located nearby compared to when the object is located far away.

[0017] (7) The distraction determination device according to any one of (1) to (6) above, wherein the distraction determination device is configured to: provide a distraction-related warning to the driver when it is determined that the driver is distracted by the in-vehicle device.

[0018] (8) A distraction determination device for determining distraction of a driver of a vehicle, wherein the distraction determination device is configured to: detect an object existing in front of the vehicle based on surrounding data indicating the condition of the surroundings of the vehicle; detect the viewpoint position, sight direction, and sight angle of the driver based on driver data indicating the state of the driver; change the distraction determination angle according to the positional relationship with the object, wherein the distraction determination angle is an angle used to determine whether the driver is visually viewing an in-vehicle device arranged in front of the vehicle; if the driver's sight angle continues to be above the distraction determination angle for more than a predetermined distraction determination time, it is determined that the driver is distracted from the in-vehicle device; and increase the distraction determination angle when the object is located nearby compared to when the object is located far away, wherein the sight angle is an angle formed by a horizontal line extending horizontally from the driver's viewpoint position and a sight direction line extending from the driver's viewpoint position toward a sight direction below the horizontal line, and the distraction determination angle is an angle formed by a horizontal line and a distraction determination line extending from the driver's viewpoint position toward an upper end position of the in-vehicle device.

[0019] (9) A distraction determination method, implemented by a distraction determination device for determining the distraction of a vehicle driver, wherein the distraction determination method includes: detecting an object existing in front of the vehicle based on surrounding data indicating the surrounding conditions of the vehicle; detecting the viewpoint position and line of sight direction of the driver based on driver data indicating the state of the driver; changing a visual determination range in the up and down directions according to the positional relationship with the object, wherein the visual determination range is a range for determining whether the driver is visually observing in-vehicle equipment arranged in the front of the vehicle; if the driver's line of sight continues to fall within the visual determination range for more than a predetermined distraction determination time, it is determined that the driver is distracted from the in-vehicle equipment; and changing the visual determination range in a manner such that the upper end position of the visual determination range is on the lower side when the object is nearby compared to when the object is far away.

[0020] (10) A non-transitory computer recording medium, comprising a computer program for a distraction determination device for determining whether a driver of a vehicle is distracted, the computer program being used to cause the distraction determination device to execute: detecting an object existing in front of the vehicle based on surrounding data indicating the condition of the surroundings of the vehicle; detecting the viewpoint position and line of sight direction of the driver based on driver data indicating the state of the driver; changing a visual determination range in the up and down directions according to a positional relationship with the object, the visual determination range being a range for determining whether the driver is visually observing in-vehicle equipment arranged in front of the vehicle; determining that the driver is distracted from the in-vehicle equipment if the line of sight of the driver continues to fall within the visual determination range for more than a predetermined distraction determination time; and changing the visual determination range in such a way that the upper end position of the visual determination range is on the lower side when the object is nearby compared to when the object is far away.

[0021] Effects of the Invention

[0022] According to these schemes of the present invention, when the object in front of the vehicle is located nearby, the upper end position of the visual judgment range in the up and down directions for judging whether the equipment inside the vehicle is being visually viewed is changed to the lower side compared to when the object in front of the vehicle is located far away, thereby preventing the erroneous judgment that the equipment inside the vehicle is being visually viewed despite the object in front of the vehicle being visually viewed. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] Figure 1 It is a schematic system configuration diagram of a vehicle according to the first embodiment of the present invention.

[0024] Figure 2 This is a diagram showing the hardware configuration of the control device.

[0025] Figure 3 This is a flowchart for explaining details of the distraction determination process of the in-vehicle device according to the first embodiment of the present invention.

[0026] Figure 4 This figure explains the visual judgment range of in-vehicle equipment.

[0027] Figure 5 This diagram explains that when the front object outside the vehicle is near the host vehicle, the driver's line of sight tends to be oriented downward in the vertical direction, compared to when the front object outside the vehicle is far away.

[0028] Figure 6 This is a flowchart for explaining details of the distraction determination process of the in-vehicle device according to the second embodiment of the present invention.

[0029] Fig. 7A This is a diagram for explaining the sight line angle θ1 and the distraction determination angle θ2.

[0030] Figure 7B This is a diagram for explaining the sight line angle θ1 and the distraction determination angle θ2.

[0031] Figure 8 This is a flowchart for explaining details of distraction determination processing of the in-vehicle device according to the third embodiment of the present invention.

[0032] Description of Reference Numerals

[0033] 4: control device (distraction determination device), 100: vehicle. DETAILED DESCRIPTION

[0034] Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. It should be noted that in the following description, the same reference numerals are given to the same components.

[0035] (First Embodiment)

[0036] Figure 1 It is a system schematic diagram of a vehicle 100 according to the first embodiment of the present invention.

[0037] The vehicle 100 includes a peripheral sensor 1, a driver sensor 2, an output device 3, and a control device 4. The peripheral sensor 1, the driver sensor 2, the output device 3, and the control device 4 are communicatively connected via a standard in-vehicle network 5 such as a controller area network. The vehicle 100 may be a vehicle with an automatic driving function or a driving assistance function, or may be a manually driven vehicle.

[0038] The surrounding sensor 1 is a sensor for generating surrounding data indicating the state of the surroundings of the vehicle 100. In the present embodiment, one or more external cameras for photographing the surroundings of the vehicle 100 are provided as the surrounding sensor 1. The external camera photographs the surroundings of the vehicle 100 at a predetermined frame rate (e.g., 10 [Hz] to 40 [Hz]) and generates a surrounding image of the surroundings of the vehicle 100. Whenever a surrounding image is generated, the external camera transmits the generated surrounding image to the control device 4 as surrounding data.

[0039] It should be noted that, instead of or in addition to the external camera, a distance measuring sensor for measuring the distance to other vehicles, pedestrians, bicycles, and other objects existing around the vehicle 100 may be provided as the surrounding sensor 1. Examples of the distance measuring sensor include a laser radar (LiDAR) that irradiates radar light and measures the distance based on the reflected light, and a millimeter wave radar sensor that irradiates radio waves and measures the distance based on the reflected waves.

[0040] The driver sensor 2 is a sensor for generating driver data indicating the state of the driver. In the present embodiment, a driver monitoring camera for capturing the appearance of the driver including the driver's face is provided as the driver sensor 2. The driver monitoring camera captures the appearance of the driver at a predetermined frame rate (e.g., 10 [Hz] to 40 [Hz]) to generate an appearance image of the driver's appearance. Whenever the appearance image of the driver is generated, the driver monitoring camera sends the generated appearance image to the control device 4 as the driver data.

[0041] The output device 3 is a device for notifying the driver of the vehicle 100 through the driver's physical sense (e.g., visual, auditory, and tactile senses). In this embodiment, a display (e.g., an instrument display, a center display, a head-up display, etc.) and a speaker arranged at a position where the driver can visually recognize are provided as the output device 3. The display displays information (e.g., text information, image information) corresponding to the display signal output from the control device 4. The speaker outputs a voice corresponding to the voice signal output from the control device 4.

[0042] The control device 4 is an ECU (Electronic Control Unit) including a communication unit 41, a storage unit 42, and a processing unit 43 (see Figure 2 ), at least configured to determine whether the driver of the vehicle 100 is distracted by the in-vehicle equipment (devices such as a monitor mounted on the dashboard, car navigation, and instruments that are the driver's visual objects), and to warn the driver based on the determination result. In addition to the aforementioned surrounding data and driver data, various data such as vehicle position data obtained by a positioning sensor and vehicle speed data obtained by a vehicle speed sensor can also be input into the control device 4 as needed.

[0043] Figure 2 It is a diagram showing the hardware configuration of the control device 4 .

[0044] The control device 4 includes a communication unit 41 , a storage unit 42 , and a processing unit 43 .

[0045] The communication unit 41 includes an interface circuit for connecting the control device 4 to the in-vehicle network 5. The communication unit 4 supplies data (peripheral data, driver data, etc.) received from the outside to the processing unit 43. In addition, the communication unit 41 sends the display signal and the voice signal output from the processing unit 43 to the output device 3.

[0046] The storage unit 42 includes a storage medium such as a HDD (Hard Disk Drive), an SSD (Solid Disk Drive), or a semiconductor memory, and stores various computer programs and data used for processing in the processing unit 43 .

[0047] The processing unit 43 includes one or more CPUs (Central Processing Units) and their peripheral circuits, and executes various computer programs stored in the storage unit 42. The processing unit 43 is, for example, a processor. Figure 3 An example of distraction determination processing of an in-vehicle device, which is one of the processes executed by the processing unit 43 and further by the control device 4, will be described.

[0048] Figure 3 This is a flowchart for explaining the details of the distraction determination process of the in-vehicle device according to the present embodiment. The control device 4 repeatedly executes this routine in a predetermined calculation cycle.

[0049] In step S1 , the control device 4 detects an object (vehicle-external front object) existing in front of the vehicle 100 based on the surrounding data received from the surrounding sensor 1 , specifically, the surrounding image received from the external camera.

[0050] In the present embodiment, the control device 4 detects the area representing the front object outside the vehicle in the surrounding image and the type of the front object outside the vehicle represented in the area by sequentially inputting the surrounding image received from the external camera into the classifier. The classifier can be, for example, a convolutional neural network (CNN) having a plurality of convolutional layers connected in series from the input side to the output side. In addition, the control device 4 estimates the distance (vehicle-to-vehicle distance) from the vehicle 100 to the front object outside the vehicle using the standard size of the object stored in the storage unit 42 according to the type of each object and the size of the front object outside the vehicle detected in the surrounding image, and tracks the front object outside the vehicle detected in the surrounding image along the time series, thereby calculating the position and speed of the front object outside the vehicle. It should be noted that the detection method of the front object outside the vehicle is not limited to such a method, and detection can be performed using various known methods.

[0051] In step S2 , the control device 4 detects the driver's line of sight direction based on the driver data received from the driver sensor 2 , specifically, the driver's appearance image received from the driver monitoring camera.

[0052] In this embodiment, the control device 4 detects the position of the pupil center as a moving point (i.e., the driver's viewpoint position) and the position of the Purkinje image (corneal reflection image) as a reference point by sequentially performing image processing on the facial images received from the driver monitoring camera 21, and detects the driver's line of sight direction based on the positional relationship between the Purkinje image and the pupil center (the position of the moving point relative to the reference point).

[0053] In step S3, the control device 4 determines whether an external front object mark is detected. If an external front object mark is detected, the control device 4 proceeds to the process of step S4. On the other hand, if an external front object mark is not detected, the control device 4 proceeds to the process of step S5.

[0054] In step S4, the control device 4 determines whether the inter-vehicle distance to the front object outside the vehicle is greater than or equal to a predetermined threshold. If the inter-vehicle distance to the front object outside the vehicle is greater than or equal to the predetermined threshold, the control device 4 determines that the front object outside the vehicle is far away, and enters the process of step S5. On the other hand, if the inter-vehicle distance to the front object outside the vehicle is less than the predetermined threshold, the control device 4 determines that the front object outside the vehicle is nearby, and enters the process of step S6.

[0055] In step S5, the control device 4 sets the visual determination range of the in-vehicle equipment to the first range. Figure 4 As shown, the visual judgment range of the in-vehicle equipment is used to determine whether the driver is visually observing the in-vehicle equipment installed on the instrument panel (in Figure 4 In the example shown, the car navigation monitor is used to determine a certain range in the up and down directions. The upper end position of the first range is set at the upper end position of the in-vehicle device (at Figure 4 In the example shown, the upper end position of the car navigation monitor) to the lower end position of the front window glass (the upper end position of the instrument panel). The lower end position of the first range can be set to, for example, the lower end position of the in-vehicle equipment (at Figure 4 In the example shown, it is the lower end position of the monitor of the car navigation, but it can also be lower than this position, and can also be higher than this position to some extent.

[0056] In step S6, the control device 4 sets the visual determination range of the in-vehicle equipment to a second range different from the first range. The upper end position of the second range is set lower than the upper end position of the first range. The reason for this is described below.

[0057] like Figure 4As shown in the figure, if the driver's line of sight is directed to a range above the lower end position of the front window glass, it can be determined that the driver is visually observing the front objects outside the vehicle such as other vehicles through the front window glass. Therefore, in other words, if the driver's line of sight is directed to a range below the lower end position of the front window glass, it can be determined that the driver is not visually observing the front objects outside the vehicle through the front window glass, but may be visually observing the equipment inside the vehicle.

[0058] Here, as a method for detecting that the in-vehicle device is being viewed with good sensitivity, the upper limit position of the visual determination range of the in-vehicle device is set as high as possible, for example, at the lower end position of the front window glass. Thus, when the driver's line of sight is directed downward from the lower end position of the front window glass, it can be quickly detected that the in-vehicle device is being viewed.

[0059] However, if Figure 5 As shown, when the driver is visually observing an object outside the vehicle through the front windshield, the driver's line of sight tends to be toward the lower side in the up-down direction (height direction) when the object outside the vehicle is near the vehicle, compared to when the object outside the vehicle is far away.

[0060] Therefore, if the upper limit position of the visual judgment range of the in-vehicle equipment is set on the upper side in order to detect with good sensitivity that the in-vehicle equipment is being visually viewed, when the driver is visually viewing an object outside the vehicle in front through the front windshield and the line of sight is directed downward due to the gradually decreasing inter-vehicle distance to the object in front of the vehicle, the line of sight may temporarily fall within the visual judgment range of the in-vehicle equipment. As a result, although the driver is visually viewing the object in front of the vehicle through the front windshield, it may be determined that the driver is distracted from the in-vehicle equipment.

[0061] Therefore, in this embodiment, when the inter-vehicle distance to the front object outside the vehicle is less than a predetermined threshold, that is, when it can be determined that the front object outside the vehicle is nearby, the visual determination range of the in-vehicle equipment is set to the second range, and the upper end position of the second range is set to the lower side than the upper end position of the first range. Thus, even if the inter-vehicle distance to the front object outside the vehicle gradually decreases and the driver's line of sight is directed downward, the line of sight is unlikely to fall within the visual determination range of the in-vehicle equipment, so it can be suppressed to be determined that the driver is distracted from the in-vehicle equipment.

[0062] In step S7, the control device 4 determines whether the driver is distracted from the in-vehicle equipment, specifically, whether the driver's line of sight continues to fall within the visual determination range of the in-vehicle equipment for a predetermined distraction determination time (e.g., 2 seconds). If the driver's line of sight continues to fall within the visual determination range of the in-vehicle equipment for more than the distraction determination time, the control device 4 determines that the driver is distracted because he is not visually observing the object in front of the vehicle, and enters the processing of step S8. On the other hand, if the driver's line of sight does not continue to fall within the visual determination range of the in-vehicle equipment for more than the distraction determination time, the control device 4 ends this processing.

[0063] In step S8, the control device 4 warns the driver about distraction via the output device 3. The method and content of the distraction warning are not particularly limited, and for example, the driver may be warned of being unable to recognize the object in front of the vehicle by: implementing a voice-based broadcast, issuing a warning sound, displaying image information, text information on a display, or a combination of these methods.

[0064] According to the present embodiment described above, the control device 4 (distraction determination device) for determining the distraction of the driver of the vehicle 100 is configured to: detect an object existing in front of the vehicle 100 (an object outside the vehicle in front) based on surrounding data indicating the condition of the surroundings of the vehicle 100; detect the viewpoint position and line of sight direction of the driver based on driver data indicating the state of the driver; change the visual determination range in the up and down directions according to the positional relationship with the object outside the vehicle in front, the visual determination range being a range for determining whether the driver is visually observing the in-vehicle equipment arranged in front of the vehicle; if the driver's line of sight falls within the visual determination range for more than a prescribed distraction determination time, it is determined that the driver is distracted from the in-vehicle equipment; and change the visual determination range in such a way that the upper end position of the visual determination range is on the lower side when the object outside the vehicle in front is located nearby compared to when the object outside the vehicle in front is located far away.

[0065] Therefore, even if the distance between the vehicle and the object in front of the vehicle gradually becomes smaller and the driver's line of sight is directed downward, the line of sight is not likely to fall within the visual judgment range of the equipment inside the vehicle. Therefore, it can prevent the driver from mistakenly judging that the equipment inside the vehicle is being visually viewed despite the object in front of the vehicle being visually viewed.

[0066] It should be noted that, in the present embodiment, the control device 4 is configured to: grasp the positional relationship with the object outside the vehicle in front by detecting the vehicle-to-vehicle distance to the object outside the vehicle in front; if the vehicle-to-vehicle distance to the object outside the vehicle in front is greater than or equal to a specified threshold, determine that the object outside the vehicle in front is located far away; if the vehicle-to-vehicle distance to the object outside the vehicle in front is less than the specified threshold, determine that the object outside the vehicle in front is located nearby.

[0067] As a result, the upper end position of the visual judgment range can be appropriately changed according to the inter-vehicle distance to the front object outside the vehicle.

[0068] When the front object outside the vehicle is far away, the upper end position of the visual determination range may be set to any position between the upper end position of the in-vehicle equipment and the lower end position of the windshield of the vehicle 100 .

[0069] Thus, when the front object outside the vehicle is far away, it can be detected with good sensitivity that the driver is visually viewing the in-vehicle equipment when the line of sight of the driver is directed downward from the lower end position of the front window glass. In other words, when the front object outside the vehicle is near, the upper end position of the visual judgment range is changed to the lower side compared to when the front object outside the vehicle is far away, so the sensitivity of the visual judgment of the in-vehicle equipment can be suppressed.

[0070] (Second Embodiment)

[0071] Next, the second embodiment of the present invention is described. This embodiment is different from the first embodiment in the following aspects: when the visual inspection (distraction) of the in-vehicle equipment has been confirmed when the front object outside the vehicle is far away, even if the front object outside the vehicle approaches and the vehicle-to-vehicle distance is less than a predetermined threshold, the visual inspection range is not changed to the second range and the first range is maintained as it is. This difference is described below.

[0072] In the aforementioned first embodiment, when an object outside the vehicle is already visually viewed through the front windshield, when the object outside the vehicle approaches, the visual judgment range of the in-vehicle equipment is changed from the first range to the second range to suppress the sensitivity of the visual judgment of the in-vehicle equipment, thereby preventing the person from being distracted by the in-vehicle equipment despite visually viewing the object outside the vehicle.

[0073] However, in the first embodiment, when the driver is visually viewing the in-vehicle equipment without visually viewing the distant front object outside the vehicle through the front windshield, if the front object outside the vehicle approaches rapidly, the visual determination range of the in-vehicle equipment may be set to the second range before the predetermined time has passed since the in-vehicle equipment was visually viewed. As a result, when the driver's line of sight falls within an area included in the first range but not included in the second range, the driver cannot be warned about distraction.

[0074] Therefore, in this embodiment, during the period from the start of visual inspection of the in-vehicle equipment to the elapse of the prescribed distraction determination time, when the inter-vehicle distance to the front vehicle outside the vehicle is less than the prescribed distance, the visual inspection range of the in-vehicle equipment is not changed to the second range but the first range is maintained. Thus, when the in-vehicle equipment is being visually inspected without visually inspecting the in-vehicle front object that is far away, even if the in-vehicle front object approaches rapidly, the visual inspection range of the in-vehicle equipment is not changed from the first range, so that the driver can be warned about distraction.

[0075] Figure 6 This is a flowchart for explaining the details of the distraction determination process of the in-vehicle device of this embodiment. The control device 4 repeatedly executes this routine at a predetermined calculation cycle. Figure 6 In the embodiment, the contents of the processing from step S1 to step S8 are the same as those in the first embodiment, and thus the description thereof is omitted here.

[0076] In step S21, the control device 4 determines whether the driver is distracted by the in-vehicle device. If the driver's line of sight falls within the visual determination range of the in-vehicle device, the control device 4 determines that the driver is distracted by the in-vehicle device, and proceeds to step S22. On the other hand, if the driver's line of sight does not fall within the visual determination range of the in-vehicle device, the control device 4 determines that the driver is not distracted by the in-vehicle device, and proceeds to step S24.

[0077] In step S22, the control device 4 determines whether the time elapsed since the driver started to be distracted from the in-vehicle equipment is greater than or equal to the distraction determination time. If the time elapsed since the start of distraction is greater than or equal to the distraction determination time, the control device 4 proceeds to the process of step S23 to warn the driver of the distraction from the in-vehicle equipment. On the other hand, if the time elapsed since the start of distraction is less than the distraction determination time, the control device 4 determines that it is too early to issue a warning and proceeds to the process of step S25.

[0078] In step S23, the control device 4 and the aforementioned Figure 3 Similarly to the process of step S8, a warning related to distraction is given to the driver via the output device 3.

[0079] In step S24 , the control device 4 sets the flag F to 0. The flag F is a flag that is set to 1 during the period from when the driver starts to be distracted from the in-vehicle device until the distraction determination time has passed, and is a flag whose initial value is set to 0.

[0080] In step S25 , the control device 4 sets the flag F to 1.

[0081] In step S26, the control device 4 determines whether the flag F is set to 1. When the flag F is set to 1, that is, when the driver is distracted from the in-vehicle equipment without visually observing the in-vehicle equipment through the front window glass, and before the distraction determination time has passed since the in-vehicle equipment was distracted, the vehicle-to-vehicle distance to the in-vehicle equipment is less than a predetermined threshold, the control device 4 proceeds to the processing of step S5, and does not change the visual determination range of the in-vehicle equipment to the second range but maintains the first range as it is. On the other hand, when the flag F is set to 0, the control device 4 proceeds to the processing of step S6.

[0082] In this way, the control device 4 (distraction determination device) of the present embodiment is configured such that, during the period from when the driver's line of sight falls within the visual determination range to when the distraction determination time has passed, when the positional relationship with the object in front of the vehicle changes from a state of being located far away to a state of being located nearby, the visual determination range is not changed.

[0083] Thus, during the period from the start of visual inspection of the in-vehicle equipment to the time of distraction determination, when the inter-vehicle distance to the front vehicle outside the vehicle is less than the predetermined distance, the visual inspection range of the in-vehicle equipment is not changed to the second range but the first range is maintained. Therefore, when the driver is distracted from the in-vehicle equipment without visually inspecting a distant front object outside the vehicle, the visual inspection range of the in-vehicle equipment is not changed from the first range even if the front object outside the vehicle approaches rapidly, so that the in-vehicle equipment is visually inspected with good sensitivity and a warning related to distraction can be issued to the driver.

[0084] (Third Embodiment)

[0085] Next, a third embodiment of the present invention will be described. The method of determining whether the driver is distracted from the in-vehicle device in this embodiment is different from that in the first embodiment. This difference will be described below.

[0086] like Fig. 7A and Figure 7B As shown, if the line extending horizontally from the driver's viewpoint is set as the horizontal line A, the line extending from the driver's viewpoint toward the line of sight below the horizontal line is set as the line of sight direction line B, the line extending from the driver's viewpoint toward the upper end of the visual judgment range of the in-vehicle equipment (in this example, the upper end of the car navigation monitor) is set as the distraction judgment line C, the angle formed by the horizontal line A and the line of sight parallel to the line B is set as the line of sight angle θ1, and the angle formed by the horizontal line A and the distraction judgment line C is set as the distraction judgment angle θ2, then when the line of sight angle θ1 is greater than or equal to the distraction judgment angle θ2, it can be determined that the driver is distracted from the in-vehicle equipment. It should be noted that Fig. 7A This shows an example where an object outside the vehicle is far away. Figure 7BAn example is shown in which a front object outside the vehicle is present nearby.

[0087] Furthermore, when the driver is visually observing the object in front of the vehicle, Fig. 7A Compared with the case where the object in front of the vehicle is far away, Figure 7B As shown, when an object outside the vehicle is nearby, the sight line is directed downward, so the sight line angle θ1 tends to increase. Therefore, when an object outside the vehicle is nearby, even if the driver is visually observing the object outside the vehicle, the angle difference between the sight line angle θ1 and the distraction determination angle θ2 tends to decrease, and even if the driver is visually observing the object outside the vehicle, he may be mistakenly determined to be distracted from the in-vehicle equipment.

[0088] Therefore, in the present embodiment, the distraction determination angle θ2 is set to be larger when the front object outside the vehicle is nearby than when the front object outside the vehicle is far away. In this way, the same effects as those of the first embodiment can be obtained.

[0089] Figure 8 This is a flowchart for explaining the details of the distraction determination process of the in-vehicle device of this embodiment. The control device 4 repeatedly executes this routine at a predetermined calculation cycle. Figure 8 In the embodiment, the contents of the processing of step S1, step S3 to step S4, and step S8 are the same as those of the first embodiment, and thus the description thereof is omitted here.

[0090] In step S31, the control device 4 and the aforementioned Figure 3 The process of step S2 similarly detects the viewpoint position and line of sight direction of the driver, and detects the line of sight angle θ1.

[0091] In step S32, the control device 4 sets the distraction determination angle θ2 to a first angle. The first angle may be, for example, an angle formed by the distraction determination line C and the horizontal line A when the upper end position of the visual determination range of the in-vehicle equipment is set to the upper end position of the first range described in the first embodiment.

[0092] In step S33, the control device 4 sets the distraction determination angle θ2 to a second angle greater than the first angle. The second angle can be set, for example, to the angle between the distraction determination line C and the horizontal line A when the upper end position of the visual determination range of the in-vehicle equipment is set to the upper end position of the second range described in the first embodiment.

[0093] In step S34, the control device 4 determines whether the driver is distracted from the in-vehicle equipment, specifically, whether the sight line angle θ1 is greater than the distraction determination angle θ2 for a predetermined distraction determination time. If the sight line angle θ1 is greater than the distraction determination angle θ2 for a predetermined distraction determination time, the control device 4 determines that the driver is distracted from the in-vehicle equipment, and enters the process of step S8. On the other hand, if the sight line angle θ1 is not greater than the distraction determination angle θ2 for a predetermined distraction determination time, the control device 4 ends the process.

[0094] The control device 4 (distraction determination device) of the present embodiment described above is configured to: detect an object (external front object) existing in front of the vehicle 100 based on the surrounding data indicating the state of the surrounding of the vehicle 100; detect the viewpoint position, sight direction and sight angle of the driver based on the driver data indicating the state of the driver; change the distraction determination angle according to the positional relationship with the external front object, the distraction determination angle being an angle for determining whether the driver is visually viewing the in-vehicle equipment arranged in front of the vehicle; if the driver's sight angle continues to be above the distraction determination angle for more than a predetermined distraction determination time, it is determined that the driver is distracted from the in-vehicle equipment; and increase the distraction determination angle when the object is located nearby compared to when the object is located far away. The sight angle is the angle formed by a horizontal line extending horizontally from the driver's viewpoint position and a sight direction line extending from the driver's viewpoint position toward the sight direction below the horizontal line, and the distraction determination angle is the angle formed by the horizontal line and the distraction determination line extending from the driver's viewpoint position toward the upper end position of the in-vehicle equipment.

[0095] Therefore, when the vehicle-to-vehicle distance to the front object outside the vehicle gradually decreases and the driver's line of sight is directed downward, the line of sight angle is not likely to be greater than or equal to the distraction determination angle. Therefore, as in the first embodiment, it is possible to prevent the driver from mistakenly judging that he is looking at the equipment inside the vehicle despite looking at the front object outside the vehicle.

[0096] Although the embodiments of the present invention have been described above, the above embodiments merely illustrate a part of application examples of the present invention and are not intended to limit the technical scope of the present invention to the specific configurations of the above embodiments.

[0097] For example, in each of the above-mentioned embodiments, it is determined whether the front object outside the vehicle is far away or nearby according to the inter-vehicle distance to the front object outside the vehicle, thereby changing the visual determination range of the in-vehicle equipment. Specifically, if the inter-vehicle distance to the front object outside the vehicle is greater than or equal to a predetermined threshold, it is determined that the front object outside the vehicle is far away, and the visual determination range of the in-vehicle equipment is set to the first range. On the other hand, if the inter-vehicle distance to the front object outside the vehicle is less than the predetermined threshold, it is determined that the front object outside the vehicle is nearby, and the visual determination range of the in-vehicle equipment is set to the second range.

[0098] However, it is not limited to this, for example, as mentioned above Fig. 7A and Figure 7B As described above, when the driver is visually observing the object in front of the vehicle, the sight line is directed downward when the object in front of the vehicle is nearby, compared with when the object in front of the vehicle is far away, so the sight line angle θ1 tends to increase. Therefore, it can also be set as follows: whether the object in front of the vehicle is far away or nearby is judged based on the sight line angle θ1. Specifically, it can also be set as follows: if the sight line angle θ1 is less than or equal to a specified angle, it is judged that the object in front of the vehicle is far away, and if the sight line angle θ1 is greater than a specified angle, it is judged that the object in front of the vehicle is nearby.

[0099] That is, the control device 4 can also be configured to: grasp the positional relationship with the object outside the vehicle in front by detecting the driver's line of sight angle θ1; if the line of sight angle θ1 is less than or equal to a specified angle, it is determined that the object outside the vehicle in front is far away; if the line of sight angle θ1 is greater than the specified angle, it is determined that the object outside the vehicle in front is nearby.

[0100] In addition, for example, in each of the above-mentioned embodiments, the distraction determination time may be increased when the front object outside the vehicle is located nearby compared to when the front object outside the vehicle is located far away. Thus, when the front object outside the vehicle is located nearby, the sensitivity of visual determination of the in-vehicle device can be suppressed compared to when the front object outside the vehicle is located far away, thereby further suppressing the erroneous determination that the in-vehicle device is being viewed despite visually viewing the front object outside the vehicle.

[0101] For example, in the above-mentioned embodiment, the computer program (distraction determination processing of the in-vehicle device) executed in the control device 4 can be provided in the form of a computer-readable portable recording medium such as a semiconductor memory, a magnetic recording medium or an optical recording medium.

Claims

1. A distraction determination device for determining whether a driver of a vehicle is distracted. in, The distraction determination device is configured as follows: detecting an object existing in front of the vehicle based on surrounding data indicating a condition of the surrounding of the vehicle; detecting a viewpoint position and a sight direction of the driver based on driver data representing a state of the driver; changing a visual determination range in a vertical direction according to a positional relationship with the object mark, the visual determination range being a range for determining whether the driver is visually observing an in-vehicle device arranged at the front of the vehicle; If the driver's line of sight continues to fall within the visual determination range for more than a predetermined distraction determination time, it is determined that the driver is distracted from the in-vehicle device; as well as The visual judgment range is changed so that the upper end position of the visual judgment range is located at a lower side when the object mark is located nearby compared to when the object mark is located far away.

2. The distraction determination device according to claim 1, in, When the target object is located far away, the upper end position of the visual judgment range is set to an arbitrary position between the upper end position of the in-vehicle device and the lower end position of the windshield glass of the vehicle.

3. The distraction determination device according to claim 1 or 2, in, The distraction determination device is configured not to change the visual determination range when the positional relationship with the object changes from a distant state to a nearby state during the period from when the driver's line of sight falls within the visual determination range to when the distraction determination time elapses.

4. The distraction determination device according to any one of claims 1 to 3, in, The distraction determination device is configured as follows: By detecting the distance to the object, the positional relationship with the object is grasped; If the distance to the object is greater than or equal to a specified threshold, it is determined that the object is located far away; as well as If the distance to the object is smaller than a predetermined threshold, it is determined that the object is located nearby.

5. The distraction determination device according to any one of claims 1 to 3, in, The distraction determination device is configured as follows: The positional relationship with the object is grasped by detecting the sight angle of the driver, wherein the sight angle is an angle formed by a horizontal line extending horizontally from the viewpoint of the driver and a sight direction line extending from the viewpoint of the driver toward a sight direction below the horizontal line; If the sight angle is less than or equal to a specified angle, it is determined that the object is far away; and If the sight line angle is greater than a predetermined angle, it is determined that the object is located nearby.

6. The distraction determination device according to any one of claims 1 to 5, in, The distraction determination device is configured to increase the distraction determination time when the object is located nearby compared to when the object is located far away.

7. The distraction determination device according to any one of claims 1 to 6, in, The distraction determination device is configured to, when determining that the driver is distracted from the in-vehicle device, issue a distraction-related warning to the driver.

8. A distraction determination device for determining whether a driver of a vehicle is distracted. in, The distraction determination device is configured as follows: detecting an object existing in front of the vehicle based on surrounding data indicating a condition of the surrounding of the vehicle; detecting a viewpoint position, a sight direction, and a sight angle of the driver based on driver data representing a state of the driver; changing a distraction determination angle according to a positional relationship with the object, the distraction determination angle being an angle for determining whether the driver is visually viewing an in-vehicle device disposed in front of the vehicle; If the driver's line of sight angle continues to be greater than the distraction determination angle for more than a predetermined distraction determination time, it is determined that the driver is distracted from the in-vehicle device; as well as When the object is located nearby, the distraction determination angle is increased compared to when the object is located far away. The sight line angle is an angle formed by a horizontal line extending horizontally from the viewpoint of the driver and a sight line extending from the viewpoint of the driver toward a sight line direction below the horizontal line. The distraction determination angle is an angle formed by the horizontal line and a distraction determination line extending from the viewpoint position of the driver toward the upper end position of the in-vehicle device.

9. A distraction determination method, implemented by a distraction determination device for determining whether a driver of a vehicle is distracted. in, The distraction determination method comprises: detecting an object existing in front of the vehicle based on surrounding data indicating a condition of the surrounding of the vehicle; detecting a viewpoint position and a sight direction of the driver based on driver data representing a state of the driver; changing a visual determination range in a vertical direction according to a positional relationship with the object mark, the visual determination range being a range for determining whether the driver is visually observing an in-vehicle device arranged at the front of the vehicle; If the driver's line of sight continues to fall within the visual determination range for more than a predetermined distraction determination time, it is determined that the driver is distracted from the in-vehicle device; and The visual judgment range is changed so that the upper end position of the visual judgment range is located at a lower side when the object mark is located nearby compared to when the object mark is located far away.

10. A non-transitory computer recording medium comprising a computer program for a distraction determination device for determining whether a driver of a vehicle is distracted. in, The computer program is used to enable the distraction determination device to execute: detecting an object existing in front of the vehicle based on surrounding data indicating a condition of the surrounding of the vehicle; detecting a viewpoint position and a sight direction of the driver based on driver data representing a state of the driver; changing a visual determination range in a vertical direction according to a positional relationship with the object mark, the visual determination range being a range for determining whether the driver is visually observing an in-vehicle device arranged at the front of the vehicle; If the driver's line of sight continues to fall within the visual determination range for more than a predetermined distraction determination time, it is determined that the driver is distracted from the in-vehicle device; as well as The visual judgment range is changed so that the upper end position of the visual judgment range is located at a lower side when the object mark is located nearby compared to when the object mark is located far away.