Driving state detection method

The driving state detection method estimates driver load and behavior to distinguish between distracted, drowsy, and inattentive driving by comparing predicted load and performance with normal driving ability, effectively detecting decreased alertness and inattentiveness.

JP7578021B2Active Publication Date: 2024-11-06MAZDA MOTOR CORP

Patent Information

Application Number
JP2021026103
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-02-22
Publication Date
2024-11-06
Estimated Expiration
2041-02-22

AI Technical Summary

Technical Problem

Existing technologies struggle to detect a driver's decreased alertness, inattentiveness, and distraction accurately, as absent-minded or thinking states are visually indistinguishable from normal states in images taken by driver monitor cameras.

Method used

A driving state detection method that estimates the driver's load from surrounding vehicle information, evaluates driving operation and behavior performance, compares it with normal driving ability, and uses eyelid position, head orientation, and line of sight deviation to determine distracted, drowsy, or inattentive driving.

Benefits of technology

Accurately detects decreased driver alertness, inattentiveness, and distraction by evaluating driving ability based on predicted load and behavior, distinguishing between distracted, drowsy, and inattentive driving states.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007578021000002
    Figure 0007578021000002
  • Figure 0007578021000003
    Figure 0007578021000003
  • Figure 0007578021000004
    Figure 0007578021000004
Patent Text Reader

Abstract

To detect a driver's state of being less awakened or inattentive to driving and to enable the driver's state of being idle to be detected.SOLUTION: Driver's current driving ability is evaluated (C) on the basis of a predicted load predicted from a surrounding state of a vehicle (A) and performance of driver's handling a situation (B). By comparing the current driving ability with normal driving ability of the driver, a degree of demonstrating the driving ability is determined (E). Also, whether or not the driver is sleepy or inattentive is determined (X). When the degree of demonstrating the driving ability is equal to or less than a predetermined degree and the driver is not determined to be sleepy or inattentive, the driver is determined to be in a state of being idle (F).SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The technology disclosed herein belongs to the technical field of detecting the driving state of a driver who drives a vehicle. [Background technology]

[0002] In recent years, technologies have been developed that detect the driving state of a driver who drives a vehicle from, for example, an image of the driver captured by a driver monitor camera, output data of various sensors mounted on the vehicle, etc. For example, Patent Document 1 discloses a technology that evaluates the wakefulness of a driver of a vehicle by utilizing an error value of the control of the vehicle by the driver. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 6492096 Summary of the Invention [Problem to be solved by the invention]

[0004] Here, it is possible to detect the driver's decreased alertness or inattentiveness from the images of the driver monitor camera.However, when the driver is absent-minded or thinking about something and in a absent-minded state (inattentiveness), it is difficult to detect from the images of the driver monitor camera because it is indistinguishable from a normal state from the outside.

[0005] The technology disclosed herein aims to detect a driver's decreased alertness or inattentiveness, and to make it possible to detect when the driver is in a distracted state. [Means for solving the problem]

[0006] In order to solve the above-mentioned problems, the technology disclosed herein is a driving state detection method for detecting the state of a driver of a vehicle, comprising: a step (a) of estimating a predicted load of the driver using information indicating the surrounding conditions of the vehicle; a step (b) of evaluating the performance of the driver's corresponding action using the information indicating the surrounding conditions of the vehicle, information indicating the driving operation of the driver, and information indicating the behavior of the driver; a step (c) of evaluating the current driving ability of the driver based on the predicted load estimated in step (a) and the performance of the corresponding action evaluated in step (b); a step (d) of comparing the driving ability evaluated in step (c) with the normal driving ability of the driver to determine the degree of driving ability; a step (e) of determining whether the driver is driving while drowsy or looking away from the road using information indicating the behavior of the driver; and a step (f) of determining that the driver is in an absentminded state when the degree of driving ability determined in step (d) is equal to or lower than a predetermined level and it is determined in step (e) that the driver is not driving while drowsy or looking away from the road.

[0007] According to this configuration, the current driving ability of the driver is evaluated based on the predicted load estimated from the surrounding conditions of the vehicle and the performance of the driver's corresponding behavior. Here, the corresponding behavior refers to the driving behavior performed by the driver in response to the conditions outside the vehicle. Then, the degree of driving ability is determined by comparing the evaluated current driving ability with the normal driving ability of the driver. Meanwhile, using information indicating the driver's behavior, it is determined whether the driver is driving while drowsy or while looking away. Then, when it is determined that the degree of driving ability is equal to or lower than a predetermined level and the driver is not driving while drowsy or while looking away, the driver is determined to be in a distracted state. Therefore, it is possible to comprehensively determine the state in which the driver's inherent driving ability is not being exercised and the behavior observed when driving while drowsy or while looking away, and to determine whether the driver is in a distracted state where he or she is daydreaming or thinking, or whether he or she is driving while drowsy or while looking away.

[0008] In the driving state detection method, step (e) may include a step of determining that the driver is driving while drowsy or looking away when the distance between the driver's upper and lower eyelids becomes smaller than a predetermined threshold value compared to a reference value, when the driver's head position deviates from a reference position by more than a predetermined threshold value, or when the deviation between the driver's line of sight and the vehicle's traveling direction becomes larger than a predetermined threshold value.

[0009] According to this, when the eyelids are slightly closed, the head is not in the normal position, or the line of sight is not in the direction of travel, the driver is judged to be drowsy or inattentive. On the other hand, when the driver is absent-minded, the eyelids are open, the head is in the normal position, and the line of sight is in the direction of travel. Therefore, absent-minded driving can be distinguished from drowsy driving or inattentive driving. Effect of the Invention

[0010] As described above, the technique disclosed herein can detect the driver's decreased alertness and inattentiveness, and can also detect when the driver is in a distracted state. [Brief description of the drawings]

[0011] [Figure 1] Functional diagram of a system for implementing the driving state detection method according to this embodiment [Diagram 2] Method for assessing driving ability [Diagram 3] Flow of processing in the driving state detection method according to the present embodiment [Figure 4] Flow of processing in the driving state detection method according to the present embodiment [Diagram 5] An example of a system configuration for executing the driving state detection method according to the present embodiment DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] Exemplary embodiments will now be described in detail with reference to the drawings.

[0013] FIG. 1 is a functional image diagram of a system for implementing a driving state detection method according to this embodiment. The system in FIG. 1 receives external sensing information, information on driving operations for a vehicle, and information from a driver monitor camera that captures an image of a driver, etc., as inputs. The external sensing information is information obtained by an external detection means, such as a camera mounted on the vehicle or an on-board sensor of an Advanced Driver Assistance Systems (ADAS), and includes information on targets in the external environment. The driving operation information is obtained by on-board sensors, such as an accelerator opening sensor and a brake pressure sensor. The driver monitor camera provides information on the driver's behavior, such as eye movement, head behavior, and facial expression.

[0014] The system in Figure 1 outputs the following: determination of distracted driving, drowsy driving, or inattentive driving. Inattentive driving refers to a state in which the driver is absent-minded or thinking about something, resulting in "mental inattention" and driving in a distracted state. "Inattentiveness" refers to a state in which the amount of attention paid to driving is reduced due to thinking about something and falls below the required amount.

[0015] The processing of the system in FIG. 1 will now be described in detail.

[0016] In block A, the predicted load is calculated using external sensing information. Here, a person's cognitive load consists of three components: attention allocation load, perceptual load, and predictive load. Attention allocation load is the load when directing the eyes to a place that should be checked in order to obtain information. Perceptual load is the load when recognizing and interpreting the distance and movement of something seen. Predictive load is the load when predicting future situations from perceptual information. In block A, a predictive load model is constructed, and the predictive load model is used to estimate the current predicted load from external sensing information.

[0017] Here, the predictive load model will be explained. It is considered that people recall memories and predict the future from clue information. For example, it has been confirmed from public road driving data that clue information for the event of the deceleration of a preceding vehicle includes the deceleration of the preceding vehicle, an uphill road, a red light, a sharp curve, a blinker, surrounding congestion, and a speed adjustment error of the preceding vehicle. For example, when a preceding vehicle turns on its blinker in a driving environment, the driver is considered to search for a memory that "the vehicle often decelerates after turning on the blinker" and predict that "the preceding vehicle may decelerate."

[0018] Therefore, the inventors of the present application hypothesized that the prediction load is composed of margin time and encounter rate. The margin time is the time from the appearance of a clue (the blinker in the above example) to the occurrence of an event (the deceleration of the preceding vehicle in the above example), and the encounter rate is the ratio of the clue to the event (blinker 20%, red light 25%, deceleration of the preceding vehicle 25%, etc.). In other words, the idea is that the longer the time available for recalling and the more frequently the event is encountered and the more it remains in the memory, the lower the prediction load should be.

[0019] However, according to the experiments conducted by the inventors of the present application, the results were not necessarily as expected. Further investigation revealed that it is necessary to consider the uncertainty of events in the real world in the prediction load. For example, while a leading vehicle will almost certainly slow down when the light is red, the leading vehicle will not necessarily slow down when the preceding vehicle slows down. In other words, the possibility of an event occurring in response to a clue varies depending on the clue.

[0020] Therefore, the predicted load model is defined, for example, by the following equation.

[0021]

number

[0022] In the above formula, the uncertainty is reflected in the predictive load model. Through the study by the present inventors, it has been confirmed that this predictive load model reflecting the uncertainty can be applied to driving scenes.

[0023] In Block B, the performance of the driver's risk reduction behavior is evaluated. A risk reduction behavior is a behavior for reducing the risk of an accident occurring, such as taking one's foot off the accelerator to slow down the preceding vehicle. The performance of the risk reduction behavior is evaluated based on the time from the appearance of a clue, such as a blinker, to taking one's foot off the accelerator. Other examples of risk reduction behavior include stepping on the brakes, checking the mirrors, etc.

[0024] Blocks C, D, and E judge the degree to which the driver is demonstrating his or her driving ability. Block C combines the predicted load calculated in Block A with the performance of risk reduction actions evaluated in Block B and outputs it as the driver's current driving ability. Block D accumulates the data on the driver's driving ability output from Block C. Then, based on the accumulated data, it performs individual learning of the driver's normal driving ability, i.e., his or her original driving ability. Block E compares the driver's current driving ability output from Block C with the driver's normal driving ability output from Block D.

[0025] FIG. 2 is a diagram for explaining a method for determining the degree of driving ability. In FIG. 2, driving ability is represented on a two-dimensional coordinate system with the horizontal axis representing the predicted load and the vertical axis representing the performance of risk reduction behavior. FIG. 2(a) shows the driver's current driving ability obtained in block C. FIG. 2(b) shows the driver's normal driving ability obtained in block D. A line representing normal driving ability is obtained from the accumulated driving ability data. Then, as shown in FIG. 2(c), the current driving ability shown in FIG. 2(a) is compared with the normal driving ability shown in FIG. 2(b) to determine the degree of driving ability. In FIG. 2(c), the performance of risk reduction behavior is deteriorated under the same predicted load, so it is determined that the driving ability is reduced, that is, the degree of driving ability is low. The degree of the degree of the performance may be evaluated, for example, by the distance between the coordinate position of the current driving ability and the line representing the normal driving ability.

[0026] Returning to Fig. 1, on the other hand, in block X, it is judged whether the driver is drowsy or distracted from driving based on the image of the driver captured by the driver monitor camera. In block X, for example, the distance between the upper and lower eyelids of the driver, the head position, the line of sight, etc. are used to make the judgment.

[0027] In block F, if it is not determined in block X that the driver is not drowsy or inattentive driving, and the comparison result in block E indicates that the driver is not demonstrating driving ability to a predetermined level or less, it is determined that the driver is driving absent-mindedly.

[0028] It is preferable that the data accumulated in block D does not include data when the driver is driving absent-mindedly or while drowsy / looking away from the road. In addition, in the system of Fig. 1, noises affecting the processing performance include the driver's driving characteristics (safety sensitivity, acceptable risk, etc.), cognitive ability (young, elderly, etc.), and driving experience (beginner, veteran, etc.).

[0029] Fig. 3 and Fig. 4 are flowcharts showing an example of a process flow in the driving state detection method according to this embodiment. Fig. 5 is a block diagram showing an example of a system configuration for executing the driving state detection method of Fig. 3 and Fig. 4. The controller 1 is, for example, configured by an IC chip having a processor and a memory, or a plurality of IC chips having a processor and a memory. The controller 1 may also include a chip dedicated to AI (Artificial Intelligence), a GPU (Graphic Processing Unit), etc.

[0030] The system of FIG. 5 includes a camera and a sensor mounted on the vehicle as input means of the controller 1. The front camera 10 is, for example, installed in the front of the vehicle and is a camera that captures the situation in front of the vehicle. The in-vehicle camera 11 is, for example, installed in the cabin of the vehicle and is a camera that captures the situation inside the vehicle, and functions as a driver monitor camera. The vehicle speed sensor 12, the acceleration sensor 13, and the yaw rate sensor 14 are sensors that detect the speed, acceleration, and yaw rate of the vehicle, respectively. The steering angle sensor 15, the steering torque sensor 16, the accelerator opening sensor 17, and the brake pressure sensor 18 are sensors that detect the steering angle, steering torque, accelerator opening, and brake pressure of the vehicle, respectively. The GPS (Global Positioning Systems) unit 19 is a unit that detects the position of the vehicle. The front camera 10 and the GPS unit 19 are examples of means for detecting the external situation. The steering angle sensor 15, the steering torque sensor 16, the accelerator opening sensor 17, and the brake pressure sensor 18 are examples of means for detecting the driving operation.

[0031] The controller 1 sends image signals to a center display 21 and a HUD (Head-Up Display) 22, sends audio signals to an audio output device 23, and sends control signals to a steering control device 24, a brake control device 25, and an engine control device .

[0032] In the processing of Fig. 3 and Fig. 4, the controller 1 outputs a distracted driving determination flag and a drowsiness / inattentive driving determination flag. When the controller 1 determines that the driver is driving distractedly, it sets the distracted driving determination flag to "1". When the controller 1 determines that the driver is driving drowsy / inattentively, it sets the drowsiness / inattentive driving flag to "1". When the distracted driving determination flag or the drowsiness / inattentive driving flag is set to "1", the controller 1 sends, for example, a signal to output a warning image to the center display 21 or the HUD 22, and a signal to output a warning sound to the audio output device 23. Alternatively, it sends a control signal to the brake control device 25 and the engine control device 26 to reduce the speed of the vehicle.

[0033] In the process of Fig. 3, the controller 1 acquires vehicle surroundings information (S11a), driver's driving operation information (S11b), and driver's gaze and head behavior information (S11c). The vehicle surroundings information is acquired, for example, based on an image captured by the front camera 10 and position information acquired by the GPS unit 19. The driving operation information is acquired, for example, based on various data detected by the steering angle sensor 15, steering torque sensor 16, accelerator opening sensor 17, and brake pressure sensor 18. The driver's gaze and head behavior information is acquired, for example, based on an image captured by the in-vehicle camera 11.

[0034] The controller 1 calculates the driver's predicted load based on the vehicle's surrounding information (S12). Here, the predicted load is calculated using the predicted load model described above for clues obtained from the vehicle's surrounding information, such as the blinker of the preceding vehicle. The controller 1 then evaluates the driver's performance of risk reduction behavior (S13). For example, the controller 1 evaluates the time it takes to release the accelerator in response to the blinker of the preceding vehicle. The controller 1 then evaluates the predicted load calculated in S12 and the performance of risk reduction behavior evaluated in S13 together as the driver's current driving ability (S14).

[0035] The controller 1 judges whether the driver's current driving ability obtained in S14 is below the driver's normal driving ability (S15). As described above, the driver's normal driving ability is learned from the accumulated data of the driver's past driving ability under normal circumstances. If it is not below the normal driving ability, it is determined that there is no problem and the process ends. On the other hand, if it is below the normal driving ability, the process proceeds to the next step S16.

[0036] In S16, the controller 1 determines whether the drowsiness / inattentive driving determination flag is "0" (S16). The flow of setting the drowsiness / inattentive driving determination flag is shown in FIG. 4 and will be described later. When the drowsiness / inattentive driving determination flag is set to "1", the controller 1 outputs the drowsiness / inattentive driving determination flag (S19) and ends the process. On the other hand, when the drowsiness / inattentive driving determination flag is "0", the controller 1 sets the absentminded driving determination flag to "1" (S17). Then, the controller 1 outputs the absentminded driving determination flag (S18) and ends the process.

[0037] FIG. 4 shows a flow of setting the drowsiness / inattentive driving determination flag. The controller 1 acquires information on the driver's posture, facial expression, etc. from the image captured by the in-vehicle camera 11 (S21). From the information acquired in S21, the difference between the distance between the driver's upper and lower eyelids and a reference value, for example, the distance in the initial state, is calculated (S22). If the calculated difference is equal to or greater than a predetermined threshold (No in S23), the drowsiness / inattentive driving determination flag is set to "1" (S28). If the calculated difference is smaller than the predetermined threshold, the deviation of the driver's head position from the reference position is calculated from the information acquired in S21 (S24). If the calculated deviation is equal to or greater than a predetermined threshold (No in S25), the drowsiness / inattentive driving determination flag is set to "1" (S28). If the calculated deviation is smaller than the predetermined threshold, the deviation between the line of sight and the traveling direction of the vehicle is calculated from the information acquired in S21 (S26). When the calculated deviation is equal to or greater than a predetermined threshold (No in S27), the drowsiness / inattentive driving determination flag is set to "1" (S28). When the calculated deviation is smaller than the predetermined threshold, the drowsiness / inattentive driving determination flag is not set to "1".

[0038] As described above, according to the present embodiment, the driver's current driving ability is evaluated based on the predicted load estimated from the vehicle's surrounding conditions and the driver's performance of the risk reduction behavior. The evaluated current driving ability is compared with the driver's normal driving ability to determine the degree of driving ability. Meanwhile, using information indicating the driver's behavior, it is determined whether the driver is driving while drowsy or while looking away. When it is determined that the degree of driving ability is equal to or lower than a predetermined level and the driver is not driving while drowsy or while looking away, the driver is determined to be in a distracted state. Therefore, it is possible to comprehensively determine whether the driver is in a distracted state where he or she is daydreaming or thinking, or whether the driver is driving while drowsy or while looking away.

[0039] In addition, when the driver's eyelids are slightly closed, the head is not in the normal position, or the driver's gaze is not in the direction of travel, the driver is judged to be drowsy or inattentive. On the other hand, when the driver is absent-minded, the eyelids are open, the head is in the normal position, and the driver's gaze is in the direction of travel. Therefore, absent-minded driving can be distinguished from drowsy driving or inattentive driving.

[0040] In the above-described embodiment, the driving ability of the driver is determined using the performance of risk reduction behavior. However, the present disclosure is not limited to this, and for example, the driving ability of the driver may be evaluated using the performance of behavior to maintain ride comfort or behavior to comply with laws and regulations. That is, in the present disclosure, the driving ability is evaluated using the performance of the driver's response behavior. Here, the "response behavior" refers to the driving behavior that the driver performs in response to the situation outside the vehicle, and the risk reduction behavior, the behavior to maintain ride comfort, and the behavior to comply with laws and regulations are examples of the driver's response behavior.

[0041] With regard to ride comfort maintenance behavior and law compliance behavior, the predicted load and performance may be evaluated, for example, as follows:

[0042] (Comfortable ride maintenance actions) Regarding the load (pedal operation related) for maintaining ride comfort in the longitudinal direction of the vehicle, it can be said that the load is higher the more unstable the speed of the preceding vehicle, the more drastic the gradient change, and the lower the traveling speed. Specifically, when the preceding vehicle is traveling at a constant speed, the vehicle itself only needs to travel at a constant speed, so no control that causes acceleration / deceleration that affects the ride comfort is generated. In other words, the load for maintaining ride comfort is low. On the other hand, when the preceding vehicle is repeatedly accelerating and decelerating, it is necessary to anticipate the situation and operate the pedals early in order to maintain a smooth ride. In other words, the load for maintaining ride comfort is high.

[0043] In addition, on flat roads, it is sufficient to keep the speed constant, so there is no need for control that causes acceleration or deceleration that affects the ride comfort, and the load to maintain the ride comfort is low. On the other hand, in scenes with frequent uphill and downhill sections, if the driver does not operate the accelerator or brake in advance, the speed will increase or decrease too much, so additional operation of the accelerator or brake is required. In other words, the load to maintain the ride comfort is high. In addition, when the driving speed is high, the front and rear gravitational acceleration generated by accelerator operation and brake operation is small, making adjustments easy. Therefore, the load to maintain the ride comfort is low. On the other hand, when the driving speed is low, the front and rear gravitational acceleration generated by accelerator operation and brake operation is large, so careful operation is required to maintain the ride comfort. Therefore, the load to maintain the ride comfort is high.

[0044] Also, with regard to the load to maintain ride comfort in the lateral direction (related to steering operation), it can be said that the load is higher the faster the road shape changes (the sharper the curve, the higher the driving speed). Specifically, when driving on a straight road, there is no need to make large steering operations. In other words, the load to maintain ride comfort is low. On the other hand, the sharper the curve, the larger the steering operation is required, and careful operation is required to maintain ride comfort. Therefore, the load to maintain ride comfort is high. Furthermore, the faster you drive around a curve, the faster you need to operate the steering wheel, so careful operation is required to maintain ride comfort. Therefore, the load to maintain ride comfort is high.

[0045] Performance may be evaluated, for example, based on the smoothness of the gravitational acceleration acting on the vehicle. For example, when the jerk (the derivative of acceleration / deceleration) is small, the performance is evaluated as high. Alternatively, it may be evaluated based on the smoothness of the connection between the front, rear, left and right G forces when driving around a curve. For example, it may be evaluated based on whether the GG diagram is close to a circle. If the connection is smooth, the performance is evaluated as high.

[0046] (Legal Compliance Actions) In case of signal When considering the timing of when a traffic light turns red when passing through an intersection, the closer the vehicle is to the intersection when it turns red, the higher the load. Specifically, for example, if the traffic light turns red 30 seconds before the vehicle approaches the intersection, the vehicle only needs to see the red light and stop slowly. Therefore, the load of compliance with regulations is low. On the other hand, if the traffic light turns red 3 seconds before the vehicle approaches the intersection, the vehicle must see the red light and operate immediately. Therefore, the load of compliance with regulations is high. Also, for traffic lights that change from green to yellow to red, the load is low because there is a sufficient amount of time before the light turns red, but for traffic lights that suddenly change from flashing yellow to red, the load is high.

[0047] Performance can be evaluated, for example, by how many seconds after the light turned red (or yellow) did the driver pass through the intersection. For example, if the driver stops, the performance can be evaluated as high, and if the driver passes the intersection 10 seconds after the light turned red or yellow, the performance can be evaluated as low.

[0048] In case of signs If the sign's color, visibility, and location make it easy to recognize that it exists, the burden is low.Specifically, for example, if the sign is faded and the contents are difficult to understand even when looking closely, or if a tree branch is in front of the sign and it is difficult to see, the compliance burden is high.Furthermore, if the sign has fallen over and is in an unusual location, the compliance burden can be said to be high.

[0049] For example, in the case of speed signs, performance can be evaluated based on how much the driver exceeds the speed limit. For example, if the driver adheres to the speed limit, the performance is evaluated as high, and the greater the degree of exceedance, the lower the performance is evaluated.

[0050] - In case of driving lane In the case of driving lanes, if the lane is clearly visible, the load is low, and if it is blurred and difficult to see, the load is high.

[0051] Performance may be evaluated, for example, based on how far the vehicle is protruding from the lane it is traveling in. For example, if the vehicle is not protruding from the lane, the performance is evaluated as high, and the more the vehicle protrudes from the lane, the lower the performance is evaluated.

[0052] The application of the present invention is not limited to automobiles, but is also effective for detecting the driving state of other moving objects, such as trains, etc.

[0053] In addition, the technology according to the present disclosure may be realized in a form other than a single information processing device. For example, a part of the processing executed by the controller 1 may be realized by another information processing device. Also, for example, an information processing device not mounted on a moving object, such as a smartphone or tablet carried by a driver, may execute a part of the processing. Alternatively, a form in which a cloud executes a part or all of the processing may be used.

[0054] The above-described embodiments are merely illustrative and should not be construed as limiting the scope of the present disclosure. The scope of the present disclosure is defined by the claims, and all modifications and variations within the scope of the claims are within the scope of the present disclosure. [Industrial Applicability]

[0055] The technology disclosed herein is capable of detecting a driver's decreased alertness or inattentiveness, and is also capable of detecting when the driver is in a distracted state, and is therefore useful, for example, for improving the safety of automobile driving. [Explanation of symbols]

[0056] 1 Controller 10. Front Camera 11 In-car camera (driver monitor camera) 12 Vehicle speed sensor 13 Acceleration Sensor 14 Yaw rate sensor 15 Steering angle sensor 16 Steering torque sensor 17 Accelerator opening sensor 18 Brake pressure sensor 19 GPS Unit 21 Center display 22 HUD 23 Audio output device 24 Steering control device 25 Brake control device 26 Engine control device

Claims

1. A driving state detection method for detecting a state of a driver of a vehicle, comprising: (a) estimating a predicted load of the driver using information indicative of a surrounding situation of the vehicle; (b) evaluating the performance of the driver's response action using information indicating a surrounding situation of the vehicle, information indicating the driving operation of the driver, and information indicating the behavior of the driver; (c) evaluating the current driving ability of the driver based on the predicted load estimated in step (a) and the performance of the corresponding behavior evaluated in step (b); A step (d) of comparing the driving ability evaluated in the step (c) with the driver's normal driving ability to determine the degree of driving ability exercised; A step (e) of determining whether the driver is drowsy or distracted while driving using the information indicating the driver's behavior; and a step (f) of determining that the driver is in a distracted state when the degree of driving ability determined in step (d) is below a predetermined level and when it is determined in step (e) that the driver is not driving while drowsy or looking away from the road.

2. 2. The driving condition detection method according to claim 1, The step (e) The method includes a step of determining that the driver is driving while drowsy or while looking away when the distance between the upper and lower eyelids of the driver becomes smaller than a predetermined threshold value compared to a reference value, when the position of the driver's head deviates from the reference position by a predetermined threshold value or more, or when the deviation between the driver's line of sight and the traveling direction of the vehicle becomes larger than a predetermined threshold value or more. A driving condition detection method comprising:

Citation Information

Patent Citations

  • Method of adjusting contact pressure of cutter in slitter

    JP1989092096A

  • State determination device, driving support system, and state determination method and program

    JP2014071519A

  • Two-stage drowsy driving prevention device through recognition of movement, face, eye and mouth shape

    JP2016539446A

  • Driver state determination device and driver state determination program

    JP2018013811A

  • Space display device, space display system, movable body, and space display method

    JP2018169481A

Cited By

  • Driving status determination device, driving support system, and driving status determination program

    JP2026181812A