Methods for determining the attentiveness of a driver of a vehicle

Abstract

A method (40) for determining the attentiveness of a driver (24) of a vehicle (20) is proposed, comprising the steps, Determining the first time at which a preceding vehicle begins to brake, using data received from a front camera (30) of the vehicle (20), Determining a second time at which the driver (24) applies the brakes, using data received from a monitoring system of the vehicle (20), Determining the driver's reaction time (24) as a function of a time difference between the first time point and the second time point, Determining the driver's attention (24) depending on the driver's reaction time (24).

Description

State of the art

[0001] From DE 10 2014 214 352 A1 a method and an arrangement for operating an occupant monitoring system are known. Disclosure of the invention

[0002] A procedure is proposed for determining the attentiveness of a driver of a vehicle, comprising the following steps: Determining the first point in time at which a preceding vehicle begins to brake, using data received from a front camera of the vehicle, Determining a second point in time at which the driver applies the brakes, using data received from a vehicle monitoring system, Determining the driver's reaction time as a function of a time difference between the first and second time points,

[0003] Determining the driver's level of attention based on the driver's reaction time.

[0004] The advantage of this method lies in its ability to reliably and accurately determine a driver's level of attention. It allows for the assessment of whether the driver is still fit to drive and attentively monitoring the road ahead. This ensures that appropriate action is taken if attention is low or critically impaired. Furthermore, the detection of reduced driver attention, for example, due to fatigue, intoxication, or the effects of drugs, can indicate unfitness to drive. This can enhance road safety.

[0005] In one exemplary implementation, the driver's attention can be determined based on reaction time and the necessity of braking. Advantageously, the necessity of braking can be determined based on the vehicle's speed, the speed of the vehicle ahead, and the distance between the vehicle and the vehicle ahead. This allows the driver's attention to be determined and assessed reliably, thereby increasing road safety.

[0006] In an advantageous embodiment, attention can be classified as low if the reaction time exceeds a defined first threshold, and attention can be classified as critical if the reaction time exceeds a defined second threshold. Advantageously, a warning can be issued to the driver if low driver attention is detected. Furthermore, a suitable measure from a driver assistance system can be initiated if critical driver attention is detected. A suitable measure from a driver assistance system could be, for example, an emergency call, a reduction in speed, braking to a safe stop, and / or emergency braking. This allows for the initiation of a suitable measure depending on the driver's attention, thereby increasing road safety.

[0007] Furthermore, a computing unit is proposed that is set up to execute and / or control the steps of the procedure for determining the attention of a driver of a vehicle.

[0008] Furthermore, a vehicle with a computing unit and a monitoring system is proposed.

[0009] Furthermore, a computer program is proposed that is designed to execute and / or control the steps of the procedure for determining the attention of a driver of a vehicle.

[0010] Furthermore, a machine-readable storage medium is proposed on which the computer program is stored. Brief description of the drawings

[0011] Exemplary embodiments of the invention are shown in the drawings and explained in more detail in the following descriptions. The same reference numerals are used for the similarly acting elements shown in the various figures, thus omitting repeated descriptions of the elements. The figures show: Fig. 1 a schematic representation of a vehicle according to an exemplary embodiment; Fig. 2 a flowchart of a procedure according to an exemplary embodiment; Fig. 3 a flowchart of a procedure according to an exemplary embodiment. Embodiments of the invention:

[0012] Fig. Figure 1 shows a schematic representation of a vehicle 20, for example, a motor vehicle, such as a car, with an observation device 22 for observing a vehicle interior 26, in particular one or more vehicle occupants 24 or passengers 24, other living beings, and / or objects according to an exemplary embodiment. The vehicle 20 has, in particular, an interior 26, in which, in particular, one or more seats for one or more vehicle occupants 24 may be arranged. Furthermore, the vehicle 20 has an observation device 22 for observing all or part of the vehicle interior 26, one or more vehicle occupants 24, for example, a driver, a front-seat passenger, and / or other living beings, and / or objects. The observation device 22 can also be referred to as an observation system, driver monitoring system, and / or occupant monitoring system.The monitoring device 22 can, for example, be configured to record the direction of gaze, posture, and / or position of the head, face, or eyes of the vehicle occupant 24, or the state of fatigue and / or other vital signs of the vehicle occupant 24. Furthermore, it can, for example, record the identity and / or physical characteristics such as height, weight, age, and / or gender of the vehicle occupant 24.

[0013] The observation device 22 can be arranged in particular in a dashboard, in an instrument panel, in a steering wheel, on a vehicle roof, on a window, on a rearview mirror or on a pillar, for example on an A-pillar and / or a B-pillar of the vehicle 20, or at another location in the vehicle 20.

[0014] For observing the vehicle interior 26, the observation device 22 can include a recording unit. In a further development, the observation device 22 can include a lighting unit for emitting light beams, in particular infrared beams. Alternatively, the observation device 22 can have no separate lighting unit and the vehicle interior or the vehicle occupants and / or objects can be illuminated by light from the surrounding environment.

[0015] The lighting unit can be directed, in particular, towards the interior 26, for example towards the vehicle occupant 24, in order to illuminate the interior 26 or the vehicle occupant 24 with light beams, in particular infrared beams. In other words, light beams, in particular infrared beams, can be emitted towards the interior 24 by means of the lighting unit. The lighting unit can, for example, be designed as a light unit, light element, light-emitting diode, LED, OLED and / or laser diode and / or comprise a light unit, a light element, a light-emitting diode, an LED, OLED and / or a laser diode.

[0016] The recording unit can be designed, for example, as an image capture unit, such as a sensor or camera, for example as an infrared camera module, wherein the recording unit is directed towards the interior 26 and thus towards the vehicle occupant 24 in order to visually capture the interior 26 or the vehicle occupant 24. The design as an infrared camera module makes it possible to carry out the observation even at night without brightly illuminating the vehicle occupant 24 and thereby disturbing or blinding them.

[0017] In other words, observation device 22 is designed for observing the interior of a vehicle. The observation device 22 can include a lighting unit for emitting light beams, for example, infrared beams, towards the vehicle interior and a receiving unit for receiving light beams, for example, infrared beams. Preferably, the light beams emitted by the lighting unit can be reflected onto or within the vehicle interior, and the reflected light beams can be directed towards the receiving unit.

[0018] Furthermore, the observation device 22 has a control unit 28 or an evaluation unit 28 or a computing unit 28 for controlling the lighting unit and / or the recording unit and / or for processing the data recorded by means of the recording unit.

[0019] Furthermore, the vehicle 20 has a front camera 30, which allows the vehicle to observe the area in front of the vehicle 20, including the traffic ahead. The data from the front camera 30 can be evaluated, in particular, by the processing unit 28.

[0020] Fig. Figure 2 shows a flowchart of a method 40 for determining the attentiveness of a driver of a vehicle according to an exemplary embodiment. The method can, for example, be executed or controlled by means of a computing unit. The computing unit can, for example, be arranged in the vehicle. The vehicle can, for example, be arranged according to Fig. 1. Be trained.

[0021] In the first step 42 of the procedure 40, the initial point in time at which a preceding vehicle begins to brake is determined using data received from a front camera of the vehicle. For this purpose, the data from the vehicle's front camera can, for example, be evaluated using an algorithm that detects as soon as the brake lights of the preceding vehicle illuminate. In other words, it is possible to detect when the brake lights of the preceding vehicle begin to illuminate, and this point in time is defined as the initial point in time at which the preceding vehicle begins to brake. In other words, the moment at which the preceding vehicle begins to brake can be detected using the front camera.

[0022] In a second step 44 of the procedure 40, a second time at which the driver applies the brakes is determined using received data from a vehicle monitoring system. For this purpose, data from a vehicle monitoring system can be evaluated, for example, to detect as soon as the driver presses the brake pedal. The monitoring system can, for example, be located in a vehicle according to the vehicle according to Fig. 1. In other words, the monitoring system can detect the moment the driver begins to brake.

[0023] In a third step 46 of procedure 40, the driver's reaction time is determined as a function of the time difference between the first and second time points. In other words, the time between the two time points or timestamps can be recorded as the reaction time. The reaction time can be determined, for example, using an algorithm.

[0024] Advantageously, the maximum permissible speed and the driver's reaction time can be calculated based on the time between two trigger events. This can provide the driver with feedback on their driving skills, their current state, and their recommended driving speed.

[0025] In a fourth step (48) of the procedure (40), the driver's level of attention is determined based on their reaction time. For example, attention can be classified as low if the reaction time exceeds a defined first threshold and as critical if it exceeds a defined second threshold. Attention can be determined using an algorithm, such as one using AI.

[0026] In a further development, reaction time can be measured, stored, and analyzed throughout the journey to determine attention levels. An increase or lengthening of reaction time during the journey indicates impairment and / or fatigue, and thus low attention.

[0027] In a further development, the driver's attention can be determined as a function of reaction time and the need for braking. Advantageously, the need for braking can be determined in particular as a function of the vehicle's speed, the speed of the vehicle ahead, and the distance between the vehicle and the vehicle ahead.

[0028] Fig. Figure 3 shows a flowchart of a method 40 for determining the attentiveness of a driver of a vehicle according to an exemplary embodiment. The method can, for example, be executed or controlled by means of a computing unit. The computing unit can, for example, be arranged in the vehicle. The vehicle can, for example, be arranged according to Fig. 1. Be trained. Procedure 40 according to Fig. 3 can perform the steps of procedure 40 according to Fig. 2 exhibit, in particular the first step 42, the second step 44, the third step 46 and the fourth step 48.

[0029] Procedure 40 according to Fig.Procedure 3 includes a further, fifth step 50. This fifth step 50 can be executed, in particular, after the fourth step 48. In the fifth step 50 of procedure 40, a warning is issued to the driver if low driver attention is detected, and / or a suitable measure from a driver assistance system is initiated if critical driver attention is detected. Advantageously, attention can be classified as low if the reaction time exceeds a defined first threshold and as critical if the reaction time exceeds a defined second threshold. For example, a visual and / or audible warning can be issued to the driver. For example, a warning can be displayed on a screen or display system and / or emitted audibly via a loudspeaker.A suitable measure of a driver safety system could be, for example, an emergency call, a reduction in speed, braking to a safe stop and / or an emergency stop.

[0030] In a further development, the vehicle can intervene if the driver's chosen speed and the braking distance resulting from the reaction time exceed the safe driving level. Advantageously, the driver can be warned and / or the vehicle's speed reduced.

[0031] In a further development, the system can calculate a maximum permissible speed and the driver's reaction time based on the reaction time, and thus the time between two trigger events. This can provide the driver with feedback on their driving skills, their current state, and / or their recommended driving speed. This can significantly reduce the number of traffic accidents. QUOTES INCLUDED IN THE DESCRIPTION

[0000] This list of documents cited by the applicant was automatically generated and is included solely for the reader's convenience. The list is not part of the German patent or utility model application. The DPMA accepts no liability for any errors or omissions. Cited patent literature

[0000] DE 10 2014 214 352 A1

[0001]

Claims

[1] Method (40) for determining the attention of a driver (24) of a vehicle (20), comprising the steps, Determining the first time at which a preceding vehicle begins to brake, using data received from a front camera (30) of the vehicle (20), Determining a second time at which the driver (24) applies the brakes, using data received from a monitoring system of the vehicle (20), Determining the driver's reaction time (24) as a function of a time difference between the first time point and the second time point, Determining the driver's attention (24) depending on the driver's reaction time (24). [2] Method (40) according to claim 1, wherein the attention of the driver (24) is determined depending on the reaction time and depending on the need to brake the vehicle (20). [3] Method (40) according to claim 2, wherein the necessity of braking the vehicle (20) is determined depending on a speed of the vehicle (20), a speed of the preceding vehicle and the distance between the vehicle (20) and the preceding vehicle. [4] Method (40) according to any of the preceding claims, wherein attention is classified as low if the reaction time is greater than a defined first threshold and wherein attention is classified as critical if the reaction time is greater than a defined second threshold. [5] Method (40) according to claim 4, wherein a warning is issued to the driver (24) when a low level of attention of the driver (24) is detected. [6] Method (40) according to any one of the preceding claims 4 to 5, wherein a suitable measure of a driving safety system is initiated when a critical attention of the driver (24) is detected. [7] Computing unit (28) configured to perform and / or control the steps of the method (40) according to any of the preceding claims. [8] Vehicle (20) with a monitoring system and a computing unit (28) according to claim 7. [9] Computer program configured to execute and / or control the steps of the method (40) according to any one of claims 1 to 6. [10] Machine-readable storage medium on which the computer program according to claim 9 is stored.

Images