Methods for determining the fatigue and / or stress level of a driver of a motor vehicle
The method uses infrared and image analysis to detect driver fatigue and stress, implementing vehicle adjustments to reduce these conditions, addressing the limitations of existing systems in accurately distinguishing and mitigating driver fatigue and stress.
Patent Information
- Application Number
- DE102024133609
- Authority / Receiving Office
- DE · DE
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-11-18
- Publication Date
- 2025-01-16
AI Technical Summary
Existing systems for determining driver fatigue and stress levels in vehicles are limited in their ability to accurately distinguish between stress and fatigue, and they lack effective measures to mitigate these conditions effectively.
A method using an infrared measurement device on the steering wheel to determine oxygen content and heart rate, combined with image analysis from a vehicle camera, to identify fatigue and stress levels, and implement measures such as temperature adjustment, massage, sound, lighting, and scenting to reduce these conditions.
Provides real-time, non-invasive detection of driver fatigue and stress, enabling targeted interventions to enhance driving comfort and safety by distinguishing between stress and fatigue, and effectively reducing these states through various vehicle adjustments.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
[0001] The present invention relates to a method for determining a fatigue and / or stress level of a driver of a motor vehicle according to claim 1.
[0002] It is known in the art to determine a driver's fatigue and / or stress levels and to take measures to reduce the fatigue and / or stress.
[0003] WO 2019 / 027389 A2 discloses a system that sends a message about the driver's health status to a health unit. An oximeter device is mounted on the steering wheel, which calculates the percentage of oxygen saturation in the driver's bloodstream. A heart rate monitor is also mounted on the steering wheel to monitor the driver's heart rate. A body temperature sensor, also mounted on the steering wheel, measures the driver's body temperature. An electronic condition monitoring unit evaluates the data received from the heart rate monitor, the body temperature sensor, and the oximeter device. A central electronic vehicle monitoring unit decelerates the vehicle and brings it to a standstill by receiving the data from the electronic condition monitoring unit. A dashboard alerts the driver in emergencies. A warning buzzer provides an audible warning to the driver in emergencies.
[0004] In contrast, the present invention is based on the object of reducing the driver's fatigue and / or stress.
[0005] This object is achieved by a method according to claim 1 and by a motor vehicle according to claim 10. Embodiments of the invention are specified in the dependent claims.
[0006] The method determines the oxygen content in the driver's blood and the driver's heart rate. Both the oxygen content and the heart rate are determined using infrared radiation. The infrared radiation is emitted by an infrared measuring device arranged on a steering wheel of the motor vehicle and detected after radiating through part of a driver's hand. This is particularly advantageous because the driver usually holds the steering wheel at least predominantly with both hands. The infrared measuring device can advantageously be arranged in areas in which many drivers position their hands while driving the motor vehicle. For example, the infrared measuring device can comprise sensors arranged in an upper half of the steering wheel. It is possible for the infrared measuring device to comprise multiple components.For example, the infrared measuring device may comprise one or more infrared radiation sources that emit infrared radiation. Furthermore, the infrared measuring device may comprise one or more sensors that detect the infrared radiation after it has passed through at least part of a driver's hand. Using the data measured by the sensor, the infrared measuring device can then determine the heart rate and / or oxygen level.
[0007] Using the measured oxygen level and / or heart rate, the driver's fatigue and / or stress level is determined. This is particularly advantageous because heart rate is known to be an indicator of stress and fatigue. Oxygen levels can provide clues to the driver's general physical condition. The measurement using the infrared measuring device can be performed continuously and non-invasively. Real-time analysis of the oxygen level and heart rate over time can identify patterns that indicate fatigue or increased stress.
[0008] Depending on the determined fatigue and / or stress level, a measure can be triggered by the motor vehicle to reduce fatigue and / or stress. For example, such a measure can be triggered if the fatigue and / or stress level is above a threshold. The measure can, for example, have a calming effect if the aim is to reduce stress. In this case, the measure can include, for example, increasing the air temperature in the interior of the motor vehicle and / or activating a massage device in a seat of the motor vehicle. If the aim is to reduce fatigue, the measure can have an invigorating effect. In this case, the measure can, for example, include reducing the air temperature in the interior of the motor vehicle.
[0009] It is particularly advantageous to use methods according to an embodiment of the invention in trucks, since their drivers frequently travel long, continuous distances. The risk of fatigue is therefore particularly high. However, it is also possible to use embodiments of the method in passenger cars to increase driving comfort.
[0010] According to one embodiment of the invention, the fatigue and / or stress level can be determined by recognizing patterns in a temporal progression of the determined oxygen content and / or the determined heart rate. This can be performed using known algorithms. It is particularly possible for an artificial neural network or artificial intelligence to recognize such patterns.
[0011] According to one embodiment of the invention, images recorded by a camera arranged in an interior of the motor vehicle can be used to determine the fatigue and / or stress level. These can be, for example, single images and / or video images. Using the images can improve the determination of the fatigue and / or stress level. In particular, the images can be used to distinguish whether the driver is stressed or tired, as these two states are sometimes difficult to distinguish based on heart rate and oxygen levels. In particular, changes in the driver's facial expression, eye movements, or head positions can be analyzed using the images to determine the fatigue and / or stress level.In particular, it is possible that for this purpose, changes in facial expression, eye movements or head positions are correlated with oxygen levels and / or heart rate.
[0012] According to one embodiment of the invention, activation of a massage device of the motor vehicle can be part of the measure. The massage device can be arranged, for example, in the driver's seat. In particular, the massage device can be arranged in a backrest of the seat. In the context of this description, activation is understood in particular to mean that the massage device begins to massage the driver upon activation. The massage can be particularly beneficial for reducing the driver's stress. However, it can also be used to reduce fatigue.
[0013] According to one embodiment of the invention, a change in the air temperature in the interior of the motor vehicle can be part of the measure. This can contribute to creating a pleasant environment for the driver, in which they feel less stressed. It is also possible to reduce fatigue by lowering the air temperature. The air temperature can be influenced in particular by a ventilation system of the motor vehicle, which can include a heating function with which heated air can be blown into the interior. It is also possible for the ventilation system to include an air conditioning system with which cooled air can be blown into the interior. A reduction in the air temperature in the interior can be carried out more quickly and / or more drastically by opening a window of the motor vehicle. The opening width can also depend, for example, on the driving speed of the motor vehicle.Thus, opening the window of the vehicle can also be part of the measure.
[0014] According to one embodiment of the invention, the activation or deactivation of a motor vehicle seat heater can be part of the measure. In this context, activation is understood in particular to mean that the seat heater is triggered to start heating. In this context, deactivation is understood in particular to mean that the seat heater is triggered to stop heating. Similar to the air temperature, the seat temperature can also influence stress and / or fatigue.
[0015] According to one embodiment of the invention, a change in the volume of sounds reproduced by an infotainment system of the motor vehicle, for example, music, can be part of the measure. Reducing the volume, for example, can be used to reduce stress. Increasing the volume, on the other hand, can be used to reduce fatigue.
[0016] According to one embodiment of the invention, increasing the supply of fresh air from outside the motor vehicle can be part of the measure. This can be achieved, for example, using the aforementioned ventilation system of the motor vehicle. An increased supply of fresh air can, in particular, contribute to reducing fatigue. Increasing the supply of fresh air can be particularly beneficial when the oxygen content in the driver's blood is low.
[0017] According to one embodiment of the invention, scenting the interior of the motor vehicle can be part of the measure. In the context of this description, scenting is understood in particular to mean that aromatic substances are introduced into the interior of the motor vehicle via the vehicle's ventilation system. Scenting is particularly effective in reducing fatigue and / or stress.
[0018] It is also possible that lighting in the vehicle's interior may be switched on or changed as part of the measure. The change can particularly affect the color and intensity of the lighting. Changing the lighting can, in particular, counteract stress and / or fatigue.
[0019] The motor vehicle according to claim 10 comprises a steering wheel and an infrared measuring device arranged on the steering wheel. The motor vehicle is designed to carry out a method according to one embodiment of the invention.
[0020] Further features and advantages of the present invention will become clear from the following description of a preferred embodiment with reference to the accompanying drawing. Fig. 1 a schematic view of a method according to an embodiment of the invention.
[0021] A steering wheel 1 has several areas 2 in which an infrared measuring device is arranged. When in use, the infrared measuring device emits infrared radiation through a driver's hands 3. After the hands have been irradiated, the infrared radiation is detected by sensors in the infrared measuring device. From this detected infrared radiation, the driver's oxygen level and heart rate can be determined.
[0022] A temporal progression 4 of the oxygen content and heart rate is transmitted to an artificial neural network, which recognizes patterns over time 4 that indicate an increased fatigue level 8 and / or an increased stress level 9. Furthermore, images 7 from a camera 6 in the interior of the motor vehicle can be used to determine the fatigue level 8 and / or the stress level 9. For this purpose, the images 7 are transmitted from the camera 6 to the artificial neural network 5.
[0023] Images 7 can be used, in particular, to validate the fatigue level 8 and / or stress level 9 determined using oxygen levels and heart rate. Images 7 are particularly useful for distinguishing whether the driver is tired or stressed. This can sometimes be difficult or impossible to distinguish based on oxygen levels and heart rate alone.
[0024] If the determined fatigue level 8 is higher than a fatigue threshold, a measure 10 is taken to reduce fatigue. This can be, for example, the activation or deactivation of seat heating, the activation of a massage device in the seat, a change in the air temperature in the interior of the motor vehicle, a change in the volume of sounds reproduced by an infotainment system, an increase in the air supply from outside the motor vehicle and / or a scenting of the interior and / or a change in the lighting in the interior, in particular with regard to the color, intensity, and / or brightness of the lighting.
[0025] If the determined stress level 9 is higher than a stress threshold, a measure 11 is taken to reduce the stress. This can be, for example, the activation of a seat heater, the activation of a massage device in the seat, a change in the air temperature in the interior of the motor vehicle, a change in the volume of sounds reproduced by an infotainment system, an increase in the air supply from outside the motor vehicle and / or a scenting of the interior and / or a change in the lighting in the interior, in particular with regard to the color, intensity and / or brightness of the lighting. QUOTES CONTAINED IN THE DESCRIPTION
[0000] This list of documents submitted by the applicant was generated automatically and is included solely for the convenience of the reader. This list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions. Cited patent literature
[0000] WO 2019 / 027389 A2
[0003]
Claims
[1] Method for determining a fatigue (8) and / or stress level (9) of a driver of a motor vehicle, comprising the following steps: - Determining an oxygen content in the blood of the driver and a heart rate of the driver using infrared radiation, wherein the infrared radiation is emitted and detected by an infrared measuring device (2) arranged on a steering wheel (1) of the motor vehicle; - Determination of the driver's fatigue (8) and / or stress level (9) using the determined oxygen level and / or heart rate; and - triggering a measure (10; 11) of the motor vehicle to reduce fatigue and / or stress depending on the determined fatigue (8) and / or stress level (9). [2] Method according to claim 1, characterized bythat the fatigue (8) and / or stress level (9) is determined by recognizing patterns in a time course (4) of the determined oxygen content and / or the determined heart rate. [3] Method according to one of the preceding claims, characterized by that images taken by a camera (6) arranged in an interior of the motor vehicle are used to determine the fatigue (8) and / or stress level (9). [4] Method according to one of the preceding claims, characterized by that activation of a massage device of the motor vehicle is part of the measure (10; 11). [5] Method according to one of the preceding claims, characterized by that a change in the air temperature in the interior of the motor vehicle is part of the measure (10; 11). [6] Method according to one of the preceding claims, characterized bythat activation or deactivation of a seat heating system of the motor vehicle is part of the measure (10; 11). [7] Method according to one of the preceding claims, characterized by that a change in the volume of sounds reproduced by an infotainment system of the motor vehicle is part of the measure (10; 11). [8] Method according to one of the preceding claims, characterized by that an increase in the supply of fresh air from outside the motor vehicle is part of the measure (10; 11). [9] Method according to one of the preceding claims, characterized by that a scenting of the interior of the motor vehicle and / or a change in the lighting of the interior is part of the measure (10; 11). [10] Motor vehicle, comprising a steering wheel (1) and an infrared measuring device (2), wherein the infrared measuring device (2) is arranged on the steering wheel (1), wherein the motor vehicle is designed to carry out a method according to one of the preceding claims.
Citation Information
Patent Citations
System that stops vehicle and automatically reports it to the health unit when the driver fall ill while driving
WO2019027389A2
Cited By
Method for controlling actuators in a motor vehicle, control device, and motor vehicle
DE102025141918A1
