Driver condition monitoring method and driver condition monitoring device
The integrated driver state monitoring system addresses environmental reliability issues by adjusting sensor weights, ensuring accurate and timely carelessness detection and warnings.
Patent Information
- Application Number
- DE102017221253
- Authority / Receiving Office
- DE · DE
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2017-03-10
- Filing Date
- 2017-11-28
- Publication Date
- 2025-09-04
- Estimated Expiration
- 2037-11-28
AI Technical Summary
Existing methods for monitoring driver carelessness, such as pupil recognition and heart rate measurement, are unreliable due to environmental factors like illumination and costly due to separate equipment needs, leading to inaccurate and inefficient warnings.
A driver state monitoring apparatus and method that integrates in-camera, radar, exterior camera, and communication interface to detect driver and vehicle states, adjusting sensor weights based on environmental conditions to accurately determine carelessness levels and provide timely warnings.
Accurately and efficiently determines driver carelessness by merging sensor information, compensating for environmental sensitivity, and providing real-time warnings, even in varying conditions.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
BACKGROUND 1. Technical field
[0001] The present disclosure relates to a method and apparatus for monitoring a driver condition, and more particularly to a method and apparatus for monitoring a driver condition to assist in the safe driving of a driver. 2. Description of the state of the art
[0002] In general, many people are injured each year due to traffic accidents caused by fatigued or careless driving. In particular, if a driver of a large vehicle such as a bus or truck causes a traffic accident due to fatigued or careless driving, significant damage can result.
[0003] Traditionally, eye blinking by a camera or heart rate measurement by a heart rate detection unit is used to determine a driver's inattention and warn a driver of their inattention state.
[0004] In the case of detecting a pupil to determine a driver's inattention state, this is greatly influenced by the lighting inside a vehicle, the lighting condition, or the outside weather.
[0005] Furthermore, detecting a biological signal such as heart rate to determine a driver's state of inattention can be very costly due to the requirement for separate equipment.
[0006] Technological background relevant to the understanding of the present invention can be found in document DE 10 2005 027 010 A1, which specifies a vehicle control unit and a vehicle control system, document US 9 135 803 B1, which describes an advanced system for detecting vehicle operation, document WO 2016 / 028 228 A1, which deals with determining driving risks, and US 2015 / 0 367 858 A1, which concerns a transfer rate between driver and vehicle. SUMMARY
[0007] It is an object of the present disclosure to provide a method and device for monitoring a driver's state of inattention that are capable of accurately and effectively determining a driver's state of inattention and warning a driver of their state of inattention. This object is achieved by the driver's state monitoring device and the driver's state monitoring method according to the independent claims. Individual embodiments emerge from the dependent claims.
[0008] Additional aspects of the present disclosure are set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the disclosure.
[0009] According to one aspect of the present disclosure, there may be provided a device for monitoring a driver condition, which includes: a driver condition detection unit for detecting a driver condition, a vehicle condition detection unit for detecting a vehicle condition, an environmental condition detection unit for detecting an environmental condition of the vehicle, a warning unit for warning a driver of an inattentive condition, and a control device for assigning a weighted value to the driver condition detected by the driver condition detection unit.the vehicle state detected by the vehicle state detection unit based on the environmental state detected by the environmental state detection unit, calculating a driver inattention level by applying the respective assigned weight values, determining whether the driver is in an inattention state or a normal state based on the calculated driver inattention level, and warning the driver by the warning unit when the driver is in the inattention state.
[0010] Furthermore, the driver condition detection unit may include an interior camera for photographing an image of the driver and a radar for measuring a heart rate of the driver, the vehicle condition detection unit may include an exterior camera for photographing a forward image of the vehicle and a communication interface for receiving vehicle information by communicating with the vehicle, and the control device may include an inattention level calculation device for calculating a driver inattention level value that combines a driver inattention level value output from the interior camera, a driver inattention level value output from the radar, a driver inattention level value output from the exterior camera, and a driver inattention level value output from the communication interface, and a weighted sensor value setting device for setting weighted sensor values of the interior camera, the radar,the external camera or the communication interface based on the detected environmental condition when the inattention level calculation device calculates the driver inattention level value.
[0011] Furthermore, the driver condition monitoring device may include a lookup table in which the weighted sensor values of the inside camera, the radar, the outside camera and the communication interface are stored in advance according to the environmental condition.
[0012] According to another aspect of the present disclosure, a driver condition monitoring device may be provided, including: an interior camera for photographing an image of a driver, a radar for measuring a driver's heart rate, an exterior camera for photographing a forward image of a vehicle, a communication interface for receiving vehicle information by communicating with the vehicle, an environmental condition detection unit for detecting an environmental condition of the vehicle, a warning unit for warning of a driver's inattention state, and a control device for calculating a driver inattention level value that combines a driver inattention level value output from the interior camera, a driver inattention level value output from the radar, a driver inattention level value output from the exterior camera, and a driver inattention level value output from the communication interface.Determining whether the driver is in an inattention state or a normal state based on the calculated driver inattention level value, and warning the driver through the warning unit when the driver is in the inattention state, wherein the control device can set weighted sensor values of the interior camera, the radar, the exterior camera, or the communication interface based on the detected environmental state when calculating the driver inattention level value, and can calculate the driver inattention level value by applying the respective set weighted sensor values.
[0013] Furthermore, the control device may set the weighted sensor values respectively by using a lookup table in which the weighted sensor values of the indoor camera, the radar, the outdoor camera, and the communication interface have been previously stored according to the environmental condition.
[0014] According to yet another aspect of the present disclosure, there may be provided a driver condition monitoring method including: detecting a condition of a driver, detecting a condition of a vehicle, detecting an environmental condition of the vehicle, assigning a weighted value to the detected driver condition and the detected vehicle condition, respectively, based on the detected environmental condition, calculating a driver inattention level by applying the assigned respective weighted values, determining whether the driver is in an inattention state or a normal state based on the calculated driver inattention level, and warning the driver when the driver is in the inattention state.
[0015] The embodiment of the present disclosure can more accurately and effectively determine and warn of a driver condition by determining the driver condition by fusing sensor information monitoring the driver condition, sensor information monitoring a vehicle condition, and sensor information monitoring a vehicle environment.
[0016] The embodiment of the present disclosure can detect a more accurate driver inattention state because the deterioration of the sensitivity and reliability of each sensor with respect to the environment can be compensated for by adjusting the weighting factor of the sensor information according to the importance and priority of information from each sensor based on the environmental condition. The embodiment of the present disclosure can detect a driver's drowsiness and inattention state by using information such as heart rate measurement, lane departure detection, vehicle speed change, and the like, even when driver pupil detection is impossible.
[0017] The embodiment of the present disclosure can warn a driver of the driver inattention state more quickly, that is, in real time, because the calculation processing is simple by using a lookup table in which the driver inattention levels are previously defined. BRIEF DESCRIPTION OF THE DRAWINGS
[0018] These and / or other aspects of the disclosure will become apparent and more easily understood from the following description of the embodiments, given in conjunction with the accompanying drawings, in which: Fig. 1 is a control block diagram of a driver condition monitoring device according to an embodiment of the present disclosure; Fig. 2 is a view for explaining a control device in a driver condition monitoring apparatus according to an embodiment of the present disclosure; Fig. 3 is an example of a lookup table for setting weighted sensor values in a driver condition monitoring device according to an embodiment of the present disclosure; and Fig. 3 is a control flow diagram of a driver condition monitoring device according to an embodiment of the present disclosure. DETAILED DESCRIPTION
[0019] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. The following embodiments are provided to fully convey the spirit of the present disclosure to those skilled in the art to which the present disclosure pertains. The present disclosure is not limited to the embodiments shown herein and may be embodied in other forms. The drawings are not intended to limit the scope of the present disclosure in any way, and the size of components may be exaggerated for clarity of illustration.
[0020] An embodiment of the present disclosure provides a method of calculating a result value indicative of a driver inattention level by fusing the results detected by each sensor through a single calculation using integrated sensors available inside and outside a vehicle, and setting a threshold value of the calculated result to more accurately detect an overall driver condition.
[0021] Furthermore, an embodiment of the present disclosure provides a method for easily adjusting the importance and priority of each sensor according to changes in the environment such as brightness, temperature, and humidity by changing factors in the calculation.
[0022] Furthermore, an embodiment of the present disclosure may add or subtract types of applicable sensors according to the type of vehicle, the demand for system accuracy cost, and the like, and may use the environment sensing sensors (for example, an illumination sensor, a temperature sensor, and a humidity sensor) attached to the existing vehicle as they are.
[0023] Fig. 1 is a control block diagram of a driver condition monitoring device according to an embodiment of the present disclosure.
[0024] According to Fig. 1, a driver condition monitoring device may include a driver condition detecting unit 10, a vehicle condition detecting unit 20, an environmental condition detecting unit 30, a control device 40, and a warning unit 50.
[0025] The control device 40 is electrically connected to the driver condition detection unit 10, the vehicle condition detection unit 20, the environmental condition detection unit 30, and the warning unit 50.
[0026] The driver state detection unit 10 detects a driver's state. The driver state detection unit 10 may include an interior camera 11 and a radar 12.
[0027] The interior camera 11 photographs the driver in order to be able to detect the driver's state (blinking eyes, drooping head, etc.).
[0028] The interior camera 11 monitors the driver's status using an RGB image stream, an IR image sensor, or the like. The interior camera 11 is arranged at a position where it can receive the least influence from the driver's handlebar rotation, extension, and back-and-forth position.
[0029] The internal camera 11 sends the photographed image signal to the control device 40.
[0030] The radar 12 transmits a radar signal to the heart and lungs of a driver for biometric detection and receives biometric signals (e.g., heartbeat, respiration) reflected from the heart and lungs.
[0031] The radar 12 may be located on the driver's seat in a straight line closest to the heart and lungs.
[0032] The radar 12 sends the received biometric signals to the control unit 40.
[0033] The driver condition detection unit 10 may include various sensors that can detect the driver condition in addition to the interior camera 11 and the radar 12.
[0034] The vehicle state detection unit 20 detects a state of a vehicle. The vehicle state detection unit 20 may include an external camera 21 and a communication interface 22. The communication interface 22 may include a CAN interface (CAN I / F; control device area network interface), LIN (local area network), and FlexRay.
[0035] The external camera 21 photographs lanes and traffic signs to record the driving status of the vehicle.
[0036] The external camera 21 is mounted behind a rearview mirror and takes photographs in the forward direction in which the vehicle is traveling.
[0037] The external camera 21 sends the photographed image signal to the control device 40.
[0038] The communication interface 22 performs communication with an electric braking system mounted on the vehicle according to a control signal from the control device 40.
[0039] The communication interface 22 receives vehicle information such as vehicle speed and steering change from the electronic braking system.
[0040] The communication interface 22 sends the received vehicle information to the control device 40. For example, the electronic braking system may be an ESC (Electronic Stability Control) system or an ABS (Anti-lock Braking System), which have vehicle information.
[0041] The communication interface 22 can receive vehicle information by communicating with any other system that has vehicle information including the vehicle speed and the steering angle in addition to the electronic braking system.
[0042] The vehicle state detection unit 20 may include various sensors and interfaces for detecting a driving state of a vehicle and vehicle information in addition to the external camera 21 and the communication interface 22.
[0043] The environmental state detection unit 30 detects an environmental state of a vehicle.
[0044] The environmental condition detection unit 30 may include an illumination sensor 31, a temperature sensor 32, and a humidity sensor 33.
[0045] The illumination sensor 31 measures the amount of light coming from outside.
[0046] The illumination sensor 31 can be arranged on a bumper of a vehicle and can receive the light incident on the entire surrounding area and measure the amount of light. The illumination sensor 31 sends the measured amount of light to the control device 40.
[0047] The temperature sensor 32 measures the temperature outside a vehicle.
[0048] The temperature sensor 32 is arranged within a radiator grille of a vehicle and can measure the temperature outside the vehicle.
[0049] Humidity sensor 33 measures the external humidity of a vehicle. Environmental condition detection unit 30 may include various sensors capable of detecting the environmental condition of a vehicle in addition to illumination sensor 31, temperature sensor 32, and humidity sensor 33.
[0050] The ambient condition detection unit 30 is used to increase the reliability of driver condition detection by detecting the ambient condition. An illumination sensor and a temperature sensor installed on a conventional vehicle can be used.
[0051] The warning unit 50 warns of a driver's inattention state on a screen and / or by voice according to a control signal from the control device 40.
[0052] The control device 40 may be composed of a microprocessor.
[0053] The control device 40 detects a driver condition by the driver's eye blink, heart rate measurement, and the like by using the inside camera 11 and the radar 12. The output of the driver condition detection becomes a driver inattention level value defined in advance in the form of a look-up table (LUT).
[0054] The control device 40 acquires and detects a driving state of the vehicle and vehicle information using the external camera 21 and the communication interface 22. The control device 40 detects a driving lane through the external camera 21 and detects the lane deviation (the driving state) (the number of times and the duration). In addition, the control device 40 detects speed signs and traffic lights, and detects whether a speed limit is complied with and the response speed according to the traffic light signal change. The communication interface 22 comprehensively receives information such as a vehicle steering change, the vehicle's driving angle, the vehicle speed, and the like. The driving state and the vehicle information acquisition outputs become a driver inattention level value, which is previously defined in the LUT form.
[0055] The control device 40 acquires a vehicle environmental state through the environmental state detection unit 30. The control device 40 acquires basic information for variably adjusting the reliability of each sensor constituting a system according to the change in the environment.
[0056] The control device 40 can adjust the weighted sensor value of the respective sensors of the driver state detection unit 10 and the driver state detection unit 20 based on the environmental condition detected by the environmental detection unit 30. For example, the control device 40 can distinguish between day and night using the illumination sensor 31, and can distinguish between low temperature, medium temperature, and high temperature using the temperature sensor 32. The control device 40 can adjust the weighted sensor values of the interior camera 11, the radar 12, the exterior camera 21, and the communication interface 22 based on night, day, and temperature, respectively, according to the output signals of the illumination sensor 31 and the temperature sensor 32.
[0057] In this way, the control device 40 can more accurately and effectively determine a driver inattention state by fusing information monitoring a driver state using the inside camera 11 and the radar 12 and information monitoring a vehicle state using the outside camera 21 and the communication interface 22, and determining the driver inattention state based on the fused information.That is, the control device 40 fuses information monitoring a driver state and information monitoring a vehicle state, calculates a driver's inattention level based on the fused information, determines whether the driver is in an inattention state or a normal state based on the calculated inattention level, and warns the driver of the inattention state through the warning unit 50 when the driver is in an inattention state.
[0058] The control device 40 can monitor an environmental condition in the process of determining a driver's inattention state by the environmental condition detection unit 30 and change the priority and importance of each sensor, such as the interior camera 11, the radar 12, the exterior camera 21, and the communication interface 22, according to the monitored environmental condition. The control device 40 can compensate for the deterioration of the sensitivity and reliability of each sensor due to the environment by using the environmental condition to adjust the weighted sensor value factor.
[0059] Fig. 2 is a view for explaining a control device in a driver condition monitoring apparatus according to an embodiment of the present disclosure.
[0060] According to Fig. 2, the control device 40 may include an inattention level calculation device 41 and a weighted sensor value setting device 42.
[0061] The inattention level calculator 41 combines the driver inattention levels output by the sensors 11 and 12 for detecting a driver state and the sensors 21 and 22 for detecting a vehicle state through calculation, and generates and outputs an output value. For example, an output value is generated by combining and calculating the respective driver inattention levels output by the interior camera 11, the radar 12, the exterior camera 21, and the communication interface 22.
[0062] The inattention level calculating device 41 calculates an inattention level by the following equation [1] according to the number of sensors. Inattention level (N)=α×S1+β×S2+γ×S3+.... Ω+Sn
[0063] Here, α, β, γ, ω are weighted value adjustment factors, and S n is a carelessness level of each sensor.
[0064] The weighted value adjustment factors and the number of inattention level output signals of each sensor depend on the number of sensors.
[0065] The weighted sensor value setting device 42 sets the weighted values of the respective sensors 11, 12, 21 and 22 used in the calculation by the inattention level calculating device 41.
[0066] For example, the control device 40 can adjust the weighted value factors of the sensors according to the importance and priority of the respective sensors based on the temperature measured and the day and night conditions by the illumination sensor 31 and the temperature sensor 32, respectively. Accordingly, the weighted values of the respective sensors are calculated to calculate the driver inattention level. The ratio adjustment is performed by setting the sum of the weighted value adjustment factors of the respective sensors to one.
[0067] Fig. 3 is an example of a lookup table for setting weighted sensor values in the driver condition monitoring device according to an embodiment of the present disclosure.
[0068] According to Fig. 3 In the case of normal temperature and daytime, the radar, the indoor camera, the outdoor camera and the communication interface are set in the lookup table so that they all have the same weighted sensor value.
[0069] In the case of normal temperature and nighttime, the weighted sensor values for the radar and communication interface are set relatively high compared to the indoor and outdoor cameras. In the case of high temperature and daytime, the weighted sensor value for the communication interface is set as the highest, and the weighted sensor value for the radar is set as the lowest.
[0070] In the case of high temperature and night time, the weighted sensor value for the communication interface is set to the highest and the weighted sensor values for the indoor camera and the outdoor camera are set to the lowest.
[0071] In the case of low temperature and daytime, the weighted sensor values for the respective sensors are set equal to the case of high temperature and daytime.
[0072] In the case of low temperature and night time, the weighted sensor values for the respective sensors are set equal to the case of high temperature and night time.
[0073] In the case of night time, since the reliability of the camera detection result is low, the weighted values of the inside camera and the outside camera are set low, and the importance of the vehicle state information received from the radar and the communication interface is set high.
[0074] According to Fig. 2, the control device 40 checks whether the inattention level value output by the inattention level calculation device 41 is equal to or greater than a preset value (threshold). If the inattention level value is equal to or greater than a preset value, this can be detected and determined as an inattention state. An inattention state refers to all driver conditions that may be dangerous for driving, including driving while drowsy and careless forward vision.
[0075] When it is determined by the driver state detection process that the driver is in a state of inattention, the control device 40 may warn the driver by outputting a warning signal through the warning unit 50.
[0076] In addition, in the case where a vibration device for vibrating the steering wheel or the seat is installed, the control device 40 can attract the driver's attention by vibrating the steering wheel or the seat by operating the vibration device.
[0077] In addition, the control device 40 can open the window by operating the window device, thereby assisting the driver in getting out of the inattention state.
[0078] The driver condition monitoring device may include a driving pattern storage unit 60. The driving pattern storage unit 60 stores a driver inattention level calculated by the control device 40.
[0079] In the driving pattern storage unit 60, the driver inattention level values are stored in time units associated with the driver's driving patterns. Accordingly, it is possible to provide a log service capable of improving careless driving habits by allowing the user to confirm inappropriate driving patterns or the like for each time zone on a monitor connected to the driver condition monitoring device.
[0080] Fig. 4 is a control flowchart of a driver condition monitoring device according to an embodiment of the present disclosure.
[0081] According to Fig. 4, first, the control device 40 monitors a driver state using the inside camera 11 and the radar 12 (100).
[0082] The control device 40 monitors a vehicle state using the external camera 21 and the communication interface 22 (102).
[0083] The control device 40 monitors an environmental condition using the illumination sensor 31 and the temperature sensor 32 (104).
[0084] The controller 40 determines whether a sensor weight adjustment is required. For example, in the case where the ambient condition is normal temperature and daytime, an initial value is used, by checking the illumination and temperature, it may be determined that adjustment of the weighted sensor value is not required in the case of normal temperature and daytime. Otherwise, it may be determined that adjustment of the weighted sensor value is required.
[0085] When, as a result of the determination in operation mode 106, adjustment of the weighted sensor value is required, the controller 40 adjusts each weighted sensor value of the radar, the indoor camera, the outdoor camera, and the communication interface according to the lookup table based on the illumination and the temperature (108).
[0086] The control device 40 calculates driver inattention levels by using each adjusted weighted sensor value (110). That is, the control device 40 uses the adjusted weighted sensor values for the driver inattention levels output by the inside camera 11, the radar 12, the outside camera 21, and the communication interface 22, respectively, as shown in Equation [1], thereby calculating a driver inattention level.
[0087] When it is determined in the operation mode 106 that the adjustment of the weighted sensor value is not required, the control device 40 calculates the driver inattention level by using the initial weighted sensor value in the operation mode 110. That is, the control device 40 applies the initial weighted sensor values to the driver inattention levels output from the inside camera 11, the radar 12, the outside camera 21, and the communication interface 22, respectively, as shown in Equation [1], thereby calculating a driver inattention level.
[0088] The control device 40 stores the calculated driver inattention level in the driving pattern storage unit 60 as a driving pattern of the driver (112).
[0089] The control device 40 compares a calculated driver inattention level L with a preset value Lf to determine whether the calculated driver inattention level L is equal to or greater than the preset value Lf.
[0090] When, as a result of the determination in the operation mode 114, the calculated driver inattention level L is equal to or greater than the preset value Lf, the control device 40 determines that the driver is in an inattention state (116) and warns the driver of the inattention state through the warning unit 50 (118).
[0091] If, as a result of the determination in operation mode 114, the calculated driver inattention level L is less than the preset value Lf, the control device 40 determines that the driver is in a normal state (120). Next, a return to a preset routine occurs.
[0092] As described above, the embodiment of the present disclosure does not individually process the driver state detected using the interior camera and radar and the vehicle state detected by the exterior camera and the communication interface, and can compensate for the deterioration of the data reliability of the detected driver and vehicle state by calculating the fusion-type inattention level. In addition, the embodiment of the present disclosure can reduce the sensitivity and reliability deterioration of the environment of each sensor by adjusting the weighted sensor value of each sensor so that the interior camera, radar, exterior camera, and communication interface use the environment state detected by the illumination and temperature sensors.
Claims
[1] Driver condition monitoring device comprising: a driver condition detecting unit (10) for detecting a driver condition; a vehicle state detection unit (20) for detecting a vehicle state; an environmental condition detecting unit (30) for detecting an environmental condition of the vehicle; a warning unit (50) for warning a driver of a driver inattention condition; and a control device (40) for assigning a weighted value to the driver state detected by the driver state detection unit (10) or the vehicle state detected by the vehicle state detection unit (20) on the basis of the environmental state detected by the environmental state detection unit (30), calculating a driver inattention level by applying the assigned respective weighted values, determining whether the driver is in an inattention state or a normal state based on the calculated driver inattention level, and warning the driver through the warning unit (50) when the driver is in the inattention state. [2] Driver condition monitoring device according to claim 1, wherein the driver condition detection unit (10) comprises an internal camera (11) for photographing an image of the driver and a radar (12) for measuring a heart rate of the driver, the vehicle state detection unit (20) has an external camera (21) for photographing an image in front of the vehicle and a communication interface (22) for receiving vehicle information by communicating with the vehicle, and the control device (40) comprises an inattention level calculation device (41) for calculating a driver inattention level value by combining a driver inattention level value output by the inside camera (11), a driver inattention level value output by the radar (12), a driver inattention level value output by the outside camera (21), and a driver inattention level value output by the communication interface (22), and a weighted sensor value setting device (42) for setting the weighted sensor values of the inside camera (11), the radar (12), the outside camera (21) and the communication interface (22), respectively, on the basis of the detected environmental state when the inattention level calculation device calculates the driver inattention level value. [3] The driver condition monitoring device according to claim 2, further comprising a look-up table in which the weighted sensor values of the inside camera (11), the radar (12), the outside camera (21) and the communication interface (22) are previously stored according to the environmental condition. [4] Driver condition monitoring device according to claim 3, wherein the ambient condition detection unit (30) comprises a lighting sensor (31), a temperature sensor (32) and a humidity sensor (33), wherein the detected environmental condition includes: normal temperature and daytime, normal temperature and nighttime, high temperature and daytime, high temperature and nighttime, low temperature and daytime, low temperature and nighttime, wherein the control device (40) monitors the ambient condition using the illumination sensor (31) and the temperature sensor (32), wherein the indoor camera (11), the radar (12), the outdoor camera (21) and the communication interface (22) are all set to have the same sensor-weighted value when the detected ambient condition is normal temperature and time of day, wherein the sensor-weighted values of the radar (12) and the communication interface (22) are set relatively high compared to the indoor camera (11) and the outdoor camera (21) when the detected ambient condition is normal temperature and night time, wherein the sensor-weighted value of the communication interface (22) is set to the highest and the sensor-weighted value of the radar (12) is set to the lowest when the detected ambient condition is high temperature and daytime or low temperature and daytime, wherein the sensor weighted value of the communication interface (22) is set to the highest and the sensor weighted values of the indoor camera (11) and the outdoor camera (21) are set to the lowest when the detected ambient condition is high temperature and night time or low temperature and night time. [5] A driver condition monitoring device according to claim 2 or 3, wherein the control device (40) is arranged to check whether the driver inattention level value output by the inattention level calculation device (41) has a value greater than or equal to a predetermined value, and when the driver inattention level value is equal to or greater than the predetermined value, to detect an inattention state. [6] Driver condition monitoring device according to claim 5, wherein a vibration device for vibrating a steering wheel or a seat is mounted; wherein the control device (40) is arranged to attract the driver's attention by vibrating the steering wheel or the seat. [7] A driver condition monitoring device according to claim 6, wherein the control device (40) opens a window by operating a window device, thereby assisting the driver to get out of the careless state. [8] Driver condition monitoring method comprising: Detecting a driver’s condition; Detecting a condition of a vehicle; Detecting the environmental condition of the vehicle; Assigning a weighted value to the detected driver state or the detected vehicle state based on the detected environmental state; Calculating a driver inattention level by applying the assigned weighted values; Determining whether the driver is in a state of inattention or a normal state based on the calculated driver inattention level; and Warn the driver when the driver is in a state of inattention. [9] A driver condition monitoring method according to claim 8, further comprising: Determine whether a sensor weighting adjustment is necessary. [10] A driver condition monitoring method according to claim 9, further comprising: Adjusting each of the sensor-weighted values of the radar, the indoor camera, the outdoor camera and the communication interface according to a lookup table based on the illumination and the temperature, if, according to the result of the determination, the setting is necessary, further comprehensive: Calculating the driver inattention level based on an initial weighted sensor value by the control device (40) if, according to the result of the determination, the adjustment is not necessary.
Citation Information
Patent Citations
vehicle control unit and vehicle control system containing the vehicle control unit
DE102005027010A1
System and method for determining the information transfer rate between a driver and vehicle
US20150367858A1
Advanced vehicle operator intelligence system
US9135803B1
System, method and apparatus for determining driving risk
WO2016028228A1