Method, device and mobile device for detecting driver fatigue in a vehicle

Abstract

A method for detecting driver fatigue in a vehicle (10), wherein data influencing fatigue detection are automatically transmitted from a mobile device (20) to the vehicle (10) as soon as the mobile device (20) is communicatively paired with the vehicle (10), characterized in that the data includes at least one of the following: • warning settings of the vehicle (10), wherein the warning settings influence the way in which the driver is warned by the vehicle (10) when it is detected that the driver's fatigue level is above a predetermined threshold, • settings of a driver assistance system of the vehicle (10) depending on the detected fatigue level, • information influencing the fatigue level, and that the information influencing the fatigue level is automatically acquired by the mobile device (20).without a user of the mobile device (20) making any input regarding the mobile device (20) which serves only the purpose of influencing fatigue detection, - that the information influencing the fatigue level is automatically acquired by the mobile device (20) by at least one of the following processes: • Evaluating manually activated functions of the mobile device (20) depending on the respective time at which the respective function is activated, and • Determining a wake-up time based on an alarm programmed into the mobile device (20) to which a manual input has been made.

Description

The present invention relates to a method for detecting fatigue in a driver of a vehicle, as well as a correspondingly designed device and a correspondingly designed mobile device. WO 2011 / 000382 describes a system that suggests a break. Data from the system can be downloaded, for example, from a smartphone. Furthermore, it is possible to provide the system with a personal user profile via a PC. WO 2011 / 041036 A1 concerns a safety management platform designed to improve driver safety. It uses features of a smartphone to assess the driver's current driving ability. US Patent 2010 / 0137748 A1 describes a device for fatigue estimation, in which a fatigue level is estimated depending on an activity level, the activity level being determined by detecting body movement. A mobile phone is also used for fatigue estimation. US Patent 2004 / 0209594A1 discloses a vehicle safety control system comprising a communication system with at least one input element accessible from inside the vehicle and at least one output element that communicates within the vehicle; at least one sensor capable of detecting at least one condition related to vehicle operation; and a controller that communicates with the sensor and the communication system to selectively suppress at least one of the said inputs and outputs when a detected parameter of the said at least one condition is outside a threshold value. When an input is suppressed, the driver is prevented from accessing or entering information into the communication system.When an output is suppressed, communication between the device and the driver of the vehicle is suppressed in order to, among other things, avoid distracting the driver during certain driving situations or conditions relating to the driver, the vehicle and / or the environment. Systems for detecting driver fatigue are known according to the state of the art. These systems, for example, use eye movements and reactions to recognize the driver's current level of fatigue and warn the driver if the current level of fatigue exceeds a predetermined threshold. The present invention aims to improve fatigue detection methods known according to the prior art. According to the invention, this is achieved by a method for detecting the fatigue of a driver of a vehicle according to claim 1, by a mobile device for detecting the fatigue of a driver of a vehicle according to claim 6, by a device for detecting the fatigue of a driver of a vehicle according to claim 8, and by a vehicle according to claim 9. The dependent claims define preferred and advantageous embodiments of the present invention. The present invention provides a method for detecting driver fatigue in a vehicle. Data is automatically transmitted from a mobile device to the vehicle as soon as the mobile device is paired with the vehicle. The data transmitted to the vehicle then influences the driver fatigue detection. The present invention enables the driver to adapt the fatigue detection system to the current driver much more easily than in the prior art. This greatly simplifies, for example, the personalization of the fatigue detection system. Input via a mobile device also allows for a much wider range of settings compared to input via a multi-function display. The driver can be asked for this data via the mobile device in the form of a questionnaire. However, the fatigue detection system can also be personalized via an input device in the vehicle, such as a multi-function display or the vehicle's head unit. The data transmitted from the mobile device to the vehicle may include one or more of the following information or settings: • Vehicle warning settings that influence how the vehicle warns the driver of their fatigue. These warning settings include both the warning strategy (e.g., playing a specific sound (e.g., the sound of a gong); vibration of the steering wheel; a continuous fatigue indicator, e.g., in the head-up display) and the warning intensity (e.g., the number of times the warning is repeated; a predetermined threshold at which a warning is issued; a volume at which the warning is issued; a duration for which the warning is issued or repeated). It is assumed that the driver will be warned of their fatigue if their current fatigue level exceeds the predetermined threshold.• Settings of the vehicle's driver assistance systems depending on the currently detected level of fatigue. For example, an automatic brake assist system can be configured so that automatic braking is initiated sooner the higher the driver's current level of fatigue. Furthermore, the distance maintained by an adaptive cruise control system, which regulates the distance to a vehicle ahead, can be set based on the level of fatigue. Settings for warnings that do not warn the driver of their fatigue (but, for example, warn of leaving their lane or of an approaching obstacle) can also be adjusted based on the level of fatigue. The warnings will be issued earlier and more intensely or clearly (e.g., earlier in audible form) the higher the level of fatigue.• Information that influences the level of fatigue or the determination of the level of fatigue. This information may include, for example, the driver's age, gender, or driver type, as well as their average sleep duration or the time the driver got up on the current day. Since this information or these settings are transferred from the mobile device to the vehicle, the driver can advantageously configure these settings themselves via the mobile device. The transfer of information or settings from the mobile device to the vehicle also offers the advantage that non-changing data, such as age or gender, only needs to be entered once into the mobile device but can then be used for fatigue detection in multiple vehicles. According to one embodiment of the invention, certain information influencing the fatigue level is automatically acquired by the mobile device without the need for the driver to make any input to the mobile device solely for the purpose of influencing fatigue detection. In other words, the automatic acquisition of information influencing the fatigue level includes the evaluation of inputs to the mobile device relating to other functions of the mobile device that are not related to fatigue detection. The automatic collection of information influencing fatigue detection further simplifies the process for the driver compared to current technology. This eliminates, for example, the need to manually request this information before starting a journey. Information influencing fatigue levels can be collected using one or more of the following methods: • Analyzing the mobile device's movement profile over time. For example, the device's position and / or acceleration sensors can be used to detect movement. Provided the mobile device remains stationary while the driver sleeps, the movement profile can be used to determine the duration of the driver's last sleep and the time it ended with relative accuracy. • Analyzing manually activated functions of the mobile device along with the time each function was activated. This activity profile of the mobile device—that is, the information about when each function was manually activated—allows conclusions to be drawn about the driver's rest or sleep phases.For example, it can be ruled out that the driver is asleep if they make or receive a call on their mobile device. • Determining a wake-up time based on an alarm programmed into the mobile device, which was manually deactivated close to the alarm time. If an alarm is configured on the mobile device and this alarm is activated and then manually deactivated, it can be assumed that the owner (i.e., the driver) of the mobile device is awake at that time. By evaluating the procedures described above, the following information can at least be estimated: • Time at which the driver likely got up. • Time at which the driver likely went to sleep. • Driving after a break or first drive within a specific time interval (e.g., within the last 2 hours). • Duration of the last break. • Duration of the last drive. • History of the driver's fatigue levels. Furthermore, information such as the number, duration and mileage of the driver's last journeys can be transmitted from the vehicle to the mobile device, which can then be evaluated by a fatigue detection system of the other vehicle, for example when changing to another vehicle, according to the invention. This information, which is stored in the mobile device, is continuously updated by evaluating the current movement and activity profile of the mobile device as well as the corresponding actions of the mobile device, without the driver having to make any extra active inputs. Within the scope of the present invention, it is also possible for information regarding the driver's fatigue generated by the fatigue detection system in the vehicle to be transmitted from the vehicle to the mobile device. By transferring the information generated by the fatigue detection system (for example, the progression of fatigue during a journey and times when the driver was warned of their fatigue) to the mobile device, the driver can then use and evaluate this fatigue information in various ways with a corresponding program (application) on their mobile device. In addition to creating, maintaining and managing the driver profile for fatigue detection, the mobile device can also be used for safety training regarding fatigue and for conducting a safety quiz to playfully raise awareness of fatigue while driving. In particular, a portion of the personal data influencing the fatigue detection system is not stored in the vehicle outside of the mobile device. This means that this personal data is not stored in the vehicle's memory, but only in the mobile device's memory, where it is protected from unauthorized access. This personal data is transmitted to the vehicle, for example, in the form of abstract metrics, where it is then analyzed and, if necessary, used to adjust certain parameters of the fatigue detection system. Typically, fatigue detection is personalized via data transmitted from the mobile device to the vehicle's fatigue detection system. However, personalization can also occur via the vehicle key or a corresponding vehicle setting configured by the driver (e.g., seat memory). In this latter case, the mobile device transmits additional daily information, such as the last time the driver woke up and the last duration of sleep. If several mobile devices designed according to the invention are detected, the driver's mobile device can be manually selected (e.g. by the driver) via a selection menu of a vehicle interface (e.g. via the on-board computer in the center console). According to the invention, a driver classification can also be performed, allowing the fatigue detection to be adapted to the specific driving behavior of the respective driver. For this purpose, driver characteristics are determined or calculated by evaluating key performance indicators from multiple journeys in order to improve the predictive accuracy of the current fatigue level based on these characteristics. This extended behavioral observation of the driver allows the respective driver type to be determined, enabling, for example, the classification of the current driver as a frequent driver, an infrequent driver, or a novice driver. These recorded driver characteristics can, for example, be incorporated into an individualized (driver-adapted) fatigue scale.This driver classification, or these driver characteristics obtained in this way, can be transferred to the mobile device so that they can be used on every journey, even with a different vehicle, by transferring them from the mobile device to the fatigue detection system of the respective vehicle at the start of each journey. Within the scope of the present invention, a mobile device for detecting driver fatigue is also provided. This mobile device comprises a controller and a communication interface for coupling with the vehicle. The mobile device is designed such that it automatically transmits data to the vehicle at a specific time, which influences the fatigue detection. This specific time occurs whenever the mobile device is connected to the vehicle or to the corresponding communication interface of the vehicle via its communication interface. The advantages of the mobile device according to the invention essentially correspond to the advantages of the method according to the invention, which have been explained in detail above, so that a repetition is omitted here. The mobile device could be, for example, a mobile phone, such as a smartphone, but also an MP3 player or a mini-computer not suitable for making phone calls. Furthermore, the present invention also provides a device for detecting driver fatigue in a vehicle. This device comprises a controller, a communication interface, an output device, and a sensor. The communication interface serves to connect to a mobile device according to the invention. The output device, for example, a head-up display or the display of the vehicle's instrument cluster in the center console, is configured to output the driver's fatigue level or a warning to the driver in an optical, acoustic, or haptic manner when the fatigue level exceeds a predetermined threshold. The device's sensor acquires current driver data, which the device uses to determine the driver's current fatigue level.The device is capable of automatically collecting data from the mobile device at a specific time, which influences fatigue detection. This time always occurs when the device's communication interface is paired with the mobile device. This device is specifically designed for use in vehicles only, meaning it is not, for example, a mobile device. The device according to the invention is capable of using its sensor (e.g., a camera) to capture data from the driver (e.g., eye movements), from which the driver's current level of fatigue can then be derived. The information transmitted from the mobile device to the device can then be used to influence the determination of the fatigue level based on the captured driver data and to adjust the manner in which the driver is warned of fatigue. A system according to the invention, which is formed from the device according to the invention and the mobile device according to the invention, is also conceivable. Finally, within the scope of the present invention, a vehicle is provided which includes a device according to the invention. The present invention is particularly suitable for motor vehicles. Of course, the present invention is not limited to this preferred field of application, as it can also be used in ships, aircraft, and rail-bound or track-guided vehicles. Furthermore, it is also conceivable to use the present invention independently of vehicles, for example, for fatigue detection in security personnel or operating personnel who, for instance, guard a building. The present invention will now be described in detail with reference to a preferred embodiment according to the invention and the single figure. The single figure shows a vehicle according to the invention with a device according to the invention, which is coupled to a mobile device according to the invention. The single figure shows a vehicle 10 according to the invention, which comprises a device 30 according to the invention. A mobile phone 20 according to the invention, comprising a controller 2 and a communication interface 1, is also located inside the vehicle 10. The device according to the invention, in turn, comprises a controller 4, a communication interface 3, a camera 5, and a display 6. The device 30 uses camera 5 to detect movements (especially eye movements) of the driver and transmits this data to the control unit 4. Based on this data transmitted by camera 5, the control unit 4 calculates or determines the current fatigue level of the driver of the vehicle 10. As soon as the mobile phone 20 according to the invention is paired with the device 30, data from the mobile phone 20 is transmitted to the device 30 in anonymized form. This data includes, firstly, personal, time-stable information about the driver, such as their age, gender, driving style, and average sleep duration, which can be stored in the form of a risk profile. Furthermore, data such as the driver's estimated wake-up time and the duration of their last sleep are also transmitted.This data, transmitted from the mobile phone 20 to the device 30, influences the algorithm for driver fatigue detection running in the control unit 4.

Claims

A method for detecting driver fatigue in a vehicle (10), wherein data influencing fatigue detection are automatically transmitted from a mobile device (20) to the vehicle (10) as soon as the mobile device (20) is communicatively paired with the vehicle (10), characterized in that the data includes at least one of the following: • warning settings of the vehicle (10), wherein the warning settings influence the way in which the driver is warned by the vehicle (10) when it is detected that the driver's fatigue level is above a predetermined threshold, • settings of a driver assistance system of the vehicle (10) depending on the detected fatigue level, • information influencing the fatigue level, and that the information influencing the fatigue level is automatically acquired by the mobile device (20).without a user of the mobile device (20) making any input regarding the mobile device (20) that serves only the purpose of influencing fatigue detection, - that the information influencing the fatigue level is automatically acquired by the mobile device (20) through at least one of the following processes: • Evaluating manually activated functions of the mobile device (20) depending on the respective time at which the respective function is activated, and • Determining a wake-up time based on an alarm programmed into the mobile device (20) to which a manual input has been made. Method according to claim 1, characterized in that information generated by the fatigue detection system in the vehicle (10) is transmitted from the vehicle (10) to the mobile device (20). Method according to claim 2, characterized in that the information generated by the fatigue detection system includes a fatigue profile over time and / or warning times at which the driver was warned of his fatigue. Method according to one of the preceding claims, characterized in that a personal component of the data influencing fatigue detection is not stored in the vehicle (10) outside the mobile device (20), but is transmitted from the mobile device (20) to the vehicle (10) in the form of abstract identifiers and leads to a corresponding change in the fatigue detection parameters in the vehicle (10). Method according to one of the preceding claims, characterized in that a current fatigue level of the driver is determined depending on the data transmitted from the mobile device (20) to the vehicle. Mobile device for driver fatigue detection of a vehicle (10), wherein the mobile device (20) comprises a controller (2) and a communication interface (1) for coupling with the vehicle (10), wherein the mobile device (20) is configured to automatically transmit data influencing fatigue detection from the mobile device (20) to the vehicle (10) as soon as the mobile device (20) is coupled with the vehicle (10) via the communication interface (1), characterized in that the mobile device (20) is configured to carry out the method according to one of claims 1-5. Mobile device according to claim 6, characterized in that the mobile device is a mobile phone (20). Device for driver fatigue detection of a vehicle (10), wherein the device (30) comprises a controller (4), a communication interface (3), an output device (6) and a sensor (5), wherein the communication interface (3) is configured for coupling with a mobile device (20), wherein the output device (6) is configured to output a fatigue level of the driver and / or to warn the driver when the fatigue level exceeds a predetermined threshold, wherein the sensor (5) is configured to acquire current data of the driver so that the device (30) determines the fatigue level based on this data, wherein the device (30) is configured to automatically receive data influencing fatigue detection from the mobile device (20) as soon as the mobile device (20) is coupled to the device (30) via the communication interface (3), characterized in thatthe device (30) is designed to carry out the method according to one of claims 1-5. Vehicle with a device (30) according to claim 8.

Images