Warning driver of vehicle

Abstract

The invention relates to a method for warning a driver (204) of a vehicle (201). In the method, an image of a face of a driver (204) is captured using an interior camera (101) arranged in a vehicle (201). The pupil width of the pupil of the driver (204) is determined in each case in the images captured by the interior camera (101). An expected pupil light reflex of the driver (204) is assigned to a change in light condition, and an actual pupil light reflex that the driver (204) responds to that change is determined from the pupil width. A warning signal is output for the driver (204) when the actual pupil light reflex substantially deviates from the expected pupil light reflex.

Description

Technical Field

[0001] This invention relates to a method and a warning device for warning a driver of a vehicle. Background Technology

[0002] To participate safely in road traffic, drivers of vehicles must possess sufficient capacity in terms of reaction time, concentration, perception, and attention. These capabilities can be impaired, for example, due to driver illness, medication use, alcohol consumption, drug use, or excessive fatigue. Such impairment can, for instance, cause sleep apnea, in which the driver falls asleep briefly and consequently causes a traffic accident. A lack of reaction time, concentration, perception, or attention can also prevent the driver from avoiding obstacles or other road users in time or from braking too slowly. Summary of the Invention

[0003] The purpose of this invention is to reduce the harm to road traffic caused by impaired driving ability of vehicle drivers, such as due to illness, medication, alcohol consumption, drug use, or excessive fatigue.

[0004] According to the present invention, this objective is achieved by a method having the features of claim 1 and a warning device having the features of claim 9.

[0005] Advantageous embodiments of the present invention are the subject of the dependent claims.

[0006] According to the present invention, this objective is achieved by a method for warning a driver of a vehicle, wherein, - Use interior space cameras placed inside the vehicle to capture images of the driver's face; - Determine the pupil width of the driver's pupils in images captured by the interior space camera; - Assigning the driver's expected pupillary light reflex to changes in light conditions and determining the driver's actual pupillary light reflex in response to the changes based on the pupil width; and - When the actual pupil light reflection deviates significantly from the expected pupil light reflection, a warning signal is output to the driver.

[0007] The pupillary light reflex characterizes the change in pupil width in response to changes in light conditions, more precisely, the change in the amount of light incident on the eye. Here, the change in pupil width occurs with a delay after the change in light conditions, for example, 1 to 3 seconds later. Changes in light conditions can be assigned to normal ranges for the pupillary light reflex, which are characteristic of individuals whose pupillary light reflexes are not affected by disease or other factors, such as medication, alcohol consumption, drug use, or fatigue. Therefore, a pupillary light reflex response to a change in light conditions that exceeds the normal range assigned to that change can indicate illness or the influence of factors such as medication, alcohol consumption, drug use, or fatigue.

[0008] The method according to the invention aims to identify indications of impairment to a driver's ability to drive a vehicle and to warn the driver when such indications are identified. The method utilizes the aforementioned indicative properties of the driver's pupillary light reflex, tailored to specific driver conditions and the impact on the driver. Therefore, according to the invention, the driver's pupillary light reflex is determined under changing light conditions and compared to an expected pupillary light reflex. Here, the expected pupillary light reflex is, for example, related to a normal range assigned to the change in light conditions. For example, the expected pupillary light reflex is the average pupillary light reflex within the normal range.

[0009] To determine the driver's pupillary light reflex, images are captured using interior space cameras positioned within the vehicle, in which the driver's face is visible, and the driver's pupillary width is determined in these images. A warning signal is output to the driver when the actual pupillary light reflex deviates significantly from the expected pupillary light reflex. Here, "significant deviation" is defined, for example, in relation to a normal range. For instance, the actual pupillary light reflex is assessed as significantly deviating from the expected pupillary light reflex when it exceeds the normal range or when the average pupillary light reflex deviating from the normal range exceeds an appropriately defined relative or absolute maximum deviation. For example, a significant deviation of the actual pupillary light reflex from the expected pupillary light reflex can also be derived from the statistical distribution variance of pupillary light reflexes in different individuals, particularly from the statistical distribution variance from which the normal range is derived.

[0010] For example, a light signal, a sound signal, or a combination of light and sound signals may be output as a warning signal.

[0011] Optical signals are output, for example, on screens arranged in the vehicle. For instance, graphic warning signals and / or written requests to interrupt driving for the driver are output as optical signals.

[0012] Sound signals are output, for example, from speaker units located in the vehicle. For instance, alarm signals and / or verbal requests to the driver to stop driving are output as sound signals.

[0013] In one embodiment of the method according to the invention, a light source arranged in the vehicle is used to induce a change in light conditions. For example, the light source is used to output light pulses perceptible to the driver. Thus, in one embodiment of the method according to the invention, the change in light conditions is specifically generated by a light source in the vehicle. On the one hand, this has the advantage that the change in light conditions can be induced at a defined point in time, without having to wait for and detect “random” changes. On the other hand, a defined change in light conditions can be induced by a light source for which the expected pupillary light reflection is known and does not need to be determined separately.

[0014] In another embodiment of the method according to the invention, a front camera arranged in or on the vehicle is used to capture images of the surrounding environment in front of the vehicle, and the images captured by the front camera are evaluated to determine changes in light conditions. In this embodiment of the method according to the invention, changes in light conditions are identified based on the images captured by the front camera and used to evaluate the driver's pupillary light reflex. Such changes in light conditions are, for example, changes caused by light emitted from the headlights of oncoming vehicles when entering or exiting a tunnel, or during two-way traffic, especially at dawn or dusk or in darkness.

[0015] In another embodiment of the method according to the invention, the road direction of the road on which the vehicle travels is determined. The driver's expected steering behavior is assigned to the road direction. The expected steering behavior is compared with the driver's actual steering behavior, and a warning signal is output when the actual steering behavior deviates significantly from the expected steering behavior. Here, the driver's actual steering behavior is determined, for example, based on sensor signals from the vehicle's steering angle sensor. The road direction is also determined, for example, based on images captured by the vehicle's front camera or with the aid of a navigation device. This embodiment of the method according to the invention aims to identify impairment of a driver's driving ability based on the driver's steering behavior. To this end, the steering behavior is compared with the expected steering behavior, which is assigned to the road direction of the road on which the vehicle travels. Here, for example, the vehicle's directional stability is checked, i.e., whether and to what extent the driver controls the vehicle according to road markings, or whether the driver drives, for example, in a so-called "snake-like" manner, i.e., the steering behavior frequently changes without being prompted by the road direction.

[0016] In another embodiment of the method according to the invention, the actual color of the driver's sclera is determined from an image captured by an interior space camera. The actual color of the sclera is compared with a desired color, and a warning signal is output when the actual color deviates significantly from the desired color. This embodiment of the method according to the invention takes into account that the color of the driver's sclera may change, for example, due to the driver's illness, medication, alcohol consumption, or drug use.

[0017] This objective is also achieved by a warning device for alerting the driver of a vehicle, the warning device comprising the following functional units: - An interior space camera installed in the vehicle, configured to capture images of the driver's face; - An image evaluation unit configured to determine the pupil width of the driver's pupils in images captured by an interior space camera; - A control unit configured to assign the driver's expected pupillary light reflex to changes in light conditions, determine the driver's actual pupillary light reflex in response to the changes based on the pupil width determined by the image evaluation unit, and initiate the output of a warning signal for the driver when the actual pupillary light reflex deviates significantly from the expected pupillary light reflex; and - An output unit located in the vehicle, configured to output a warning signal.

[0018] One embodiment of the warning device according to the invention includes a light source arranged in a vehicle, the light source being configured to change light conditions. For example, the light source is configured to output light pulses perceptible to the driver.

[0019] Another embodiment of the warning device according to the invention includes a front camera disposed in or on a vehicle, the front camera being configured to capture images of the surrounding environment in front of the vehicle. Here, an image evaluation unit is configured to determine changes in light conditions in the images captured by the front camera.

[0020] In another embodiment of the warning device according to the invention, the image evaluation unit is configured to determine the actual color of the sclera of the driver's eye in an image captured by an interior space camera, and the control unit is configured to compare the actual color with the expected color of the sclera, and to activate the output of a warning signal when the actual color deviates significantly from the expected color of the sclera.

[0021] The features of the warning device according to the invention correspond to the features of the method according to the invention. Therefore, the advantages of the warning device according to the invention also correspond to the aforementioned advantages of the method according to the invention. Attached Figure Description

[0022] Embodiments of the present invention will now be described in more detail with reference to the accompanying drawings. In the drawings: Figure 1 A block diagram of one embodiment of a warning device for warning a driver of a vehicle according to the present invention is shown; Figure 2 A road scene with vehicles is shown; Figure 3A flowchart illustrating one embodiment of a method for warning a driver of a vehicle according to the present invention is shown; Figure 4 A flowchart of another embodiment of the method for warning a driver of a vehicle according to the present invention is shown. Detailed Implementation

[0023] Figure 1 A block diagram of one embodiment of a warning device 100 for warning a driver of a vehicle according to the present invention is shown. The warning device 100 includes an interior space camera 101, a front camera 102, an image evaluation unit 103, a control unit 104, a light source 105, and an output unit 106.

[0024] The following also refers to Figure 2 Description of warning device 100.

[0025] Figure 2 A road scene 200 with vehicle 201 is shown. Vehicle 201 travels on road 202 along a direction of travel 203. Vehicle 201 is driven by driver 204, wherein... Figure 2 The driver 204's head is shown only in a circle.

[0026] An interior space camera 101 is disposed in the vehicle 201 and configured to capture images of the interior space region 205 of the vehicle 201, in which the face of the driver 204 is visible. The edges of the interior space region 205 detected by the interior space camera 101 are... Figure 2 The interior space camera 101 is shown in dashed lines. For example, it is mounted on or inside the rearview mirror of the vehicle 201.

[0027] A front camera 102 is mounted on or inside the vehicle 201 and configured to capture images of the surrounding environment 206 in front of the vehicle 201. The edges of the surrounding environment 206 detected by the front camera 102 are... Figure 2 It is shown in dashed lines.

[0028] The image evaluation unit 103 is configured to determine the pupil width of the driver 204 in the images captured by the interior space camera 102.

[0029] In addition, the image evaluation unit 103 is configured to determine changes in light conditions in images captured by the front camera 102.

[0030] In addition, the image evaluation unit 103 is configured to determine the color of the sclera of the driver 204's eyes in the image captured by the interior space camera 101.

[0031] The control unit 104 is configured to assign the expected pupil light reflection of the driver 204 to the change in light conditions, determine the actual pupil light reflection of the driver 204 in response to the change based on the pupil width determined by the image evaluation unit 103, and initiate the output of a warning signal for the driver 204 through the output unit 106 when the actual pupil light reflection deviates significantly from the expected pupil light reflection.

[0032] Furthermore, the control unit 104 is configured to determine the road direction of the road 202 traveled by the vehicle 201, assign the driver 204's expected steering behavior to the road direction, compare the expected steering behavior with the driver 204's actual steering behavior, and, when the actual steering behavior deviates significantly from the expected steering behavior, activate the output unit 106 to output a warning signal to the driver 204. Here, the control unit 104 is configured, for example, to determine the driver 204's actual steering behavior based on sensor signals from the vehicle 201's steering angle sensor. Additionally, the control unit 104 is configured, for example, to determine the road direction of the road 202 based on images captured by the vehicle 201's front camera 102 or by means of a navigation device.

[0033] In addition, the control unit 104 is configured to compare the actual color of the sclera of the driver 204's eye, as determined by the image evaluation unit 103, with the expected color of the sclera, and to initiate the output of a warning signal for the driver 204 via the output unit 106 when the actual color deviates significantly from the expected color of the sclera.

[0034] In addition, the control unit 104 is configured to initiate a change in light conditions via the light source 105.

[0035] A light source 105 is arranged in the vehicle 201 and configured to alter light conditions. For example, the light source 105 is configured to output light pulses perceptible to the driver 204. The light source may be, for example, an LED. The light pulses are significantly shorter than one second to avoid glare to the driver.

[0036] The output unit 106 is arranged in the vehicle 201 and configured to output a warning signal. The warning signal may be, for example, a light signal or an audible signal, or may include both light and audible signals.

[0037] In one implementation, the output time of the warning signal can be stored in the vehicle.

[0038] In order to output light signals, the output unit 106 includes, for example, a screen arranged in the vehicle 201, on which light signals are output, for example as graphic and / or written requests to interrupt driving.

[0039] In order to output an audio signal, the output unit 106 includes, for example, a loudspeaker unit arranged in the vehicle 201, which outputs an audio signal, such as an audible alarm signal to interrupt driving and / or a verbal request.

[0040] Image evaluation unit 103 and control unit 104 are arranged, for example, inside vehicle 201. Alternatively, image evaluation unit 103 and / or control unit 104 are arranged outside vehicle 201. For example, image evaluation unit 103 is implemented in a data cloud, to which vehicle 201 transmits images captured by interior space camera 101 and front camera 102, for example, via a radio connection. Control unit 104 may also be implemented, for example, in the data cloud, wherein the output of a warning signal initiated by control unit 104 is transmitted from the data cloud to vehicle 201.

[0041] Furthermore, the image evaluation unit 103 and / or control unit 104 are not necessarily physically independent objects, but may be configured as modules of a device or as software executed, for example, on a device in vehicle 201 or in a data cloud.

[0042] Figure 3 A flowchart 300 is shown representing one embodiment of a method according to the present invention, which includes method steps 301 to 306 for warning a driver 204 of a vehicle 201. The method uses reference... Figure 1 and Figure 2 The warning device 100 is used to implement this.

[0043] In the first method step 301, an interior space camera 101 arranged in the vehicle 201 is used to capture images of the interior space region 205 of the interior space of the vehicle 201, in which the face of the driver 204 is visible.

[0044] In the optional second method step 302, a front camera 102 disposed in or on the vehicle 201 is used to capture images of the surrounding environment 206 in front of the vehicle 201.

[0045] In the third method step 303, the image evaluation unit 103 determines the pupil width of the driver 204's pupil and / or the color of the sclera of the driver 204's eye in the image captured by the interior space camera 102.

[0046] Furthermore, in the third method step 303, the image evaluation unit 103 determines the change in light conditions in the image captured by the front camera 102, or the control unit 104 initiates a change in light conditions via a light source 105 arranged in the vehicle 201. For example, the change in light conditions via the light source 105 is initiated by the control unit 104 at a predetermined time point after the start of driving of the vehicle 201, and outputs a light pulse that can be perceived by the driver 204.

[0047] In the fourth method step 304, the control unit 104 assigns the driver 204's expected pupillary light reflex to the change in light conditions. Furthermore, the control unit 104 determines the driver 204's actual pupillary light reflex in response to the change in light conditions based on the pupil width determined by the image evaluation unit 103. When the actual pupillary light reflex deviates significantly from the expected pupillary light reflex and / or scleral color, the control unit 104 initiates the output of a warning signal to the driver 204 via an output unit 106 disposed in or on the vehicle 201. The expected pupillary light reflex as the driver 204's response to the change in light conditions is determined by the control unit 104, for example, based on data or patterns stored in a memory unit or a data cloud.

[0048] Optionally, in the fourth method step 304, the road direction of the road 202 traveled by the vehicle 201 is determined. Furthermore, the control unit 104 assigns the driver 204's expected steering behavior to the road direction and compares the expected steering behavior with the driver 204's actual steering behavior. When the actual steering behavior deviates significantly from the expected steering behavior, the control unit 104 initiates the output of a warning signal to the driver 204 via the output unit 106. For example, the driver 204's actual steering behavior is determined by the control unit 104 based on sensor signals from the vehicle 201's steering angle sensor. The road direction of the road 202 is determined, for example, by the control unit 104 based on images captured by the vehicle 201's front camera 102 or with the aid of a navigation device. The driver 204's expected steering behavior for the corresponding road direction is determined by the control unit 104, for example, based on patterns stored in a memory unit or stored in a data cloud.

[0049] In the fifth method step 305, the output unit 106 outputs a warning signal according to the specification of the control unit 104. For example, a light signal, an audio signal, or a combination of light and audio signals is output as a warning signal.

[0050] Figure 4 A flowchart 400 of another embodiment of the method according to the invention is shown, the method having method steps 401 to 405 for warning the driver 204 of the vehicle 201. The method uses reference... Figure 1 and Figure 2The warning device 100 is used to implement this.

[0051] In the first method step 401, an interior space camera 101 arranged in the vehicle 201 is used to capture images of the interior space region 205 of the interior space of the vehicle 201, in which the face of the driver 204 is visible.

[0052] In the second method step 402, the image evaluation unit 103 determines the pupil width of the driver 204's pupil and / or the color of the driver 204's sclera in the image captured by the interior space camera 102.

[0053] In the third method step 403, the light source 105 determines and changes the light conditions according to the specification of the control unit 104. For example, the light source 105 outputs light pulses that can be perceived by the driver 204 to change the light conditions.

[0054] In the fourth method step 404, the control unit 104 determines the actual pupillary light reflection of the driver 204 in response to changes in light conditions based on the pupil width determined by the image evaluation unit 103.

[0055] In the fifth method step 405, when the actual pupillary light reflection deviates significantly from the expected pupillary light reflection and / or the actual color of the sclera of the driver 204's eye, as determined by the image evaluation unit 103, deviates significantly from the expected sclera color, the control unit 104 initiates the output of a warning signal for the driver 204, and the signal is output by the output unit 106. For example, a light signal, an acoustic signal, or a combination of light and acoustic signals is output as a warning signal.

[0056] The expected pupillary light reflection, which is the driver's 204's response to changes in light conditions, is determined by the control unit 104, for example, based on data or patterns stored in a memory unit or a data cloud.

[0057] Optical signals may be output, for example, on a screen arranged in the vehicle 201. For example, a graphic alarm signal and / or written request for the driver 204 to stop driving may be output as an optical signal.

[0058] The sound signal is output, for example, on a speaker unit arranged in the vehicle 201. For example, an alarm signal and / or verbal request to the driver 204 to stop driving is output as a sound signal.

[0059] List of reference numerals in the attached diagram: 100 Warning Device 101 Interior Space Camera 102 Front camera 103 Image Evaluation Unit 104 Control Unit 105 Light Source 106 Output Units 200 Road Scenes Vehicle 201 202 Road 203 Driving direction 204 Drivers 205 Internal Space Area 206 Surrounding Environment 300, 400 Flowchart Methods and steps 301 to 305 Methods and steps 401 to 405

Claims

1. A method for warning a driver (204) of a vehicle (201), wherein, - Use an interior space camera (101) arranged in the vehicle (201) to capture an image of the driver's (204) face; - Determine the pupil width of the driver's (204) pupil in the image captured by the interior space camera (101); - When light conditions change, determine the actual pupillary light reflection of the driver (204) in response to the change, and compare the actual pupillary light reflection with the expected pupillary light reflection; as well as - When the actual pupil light reflection deviates significantly from the expected pupil light reflection, a warning signal is output to the driver (204).

2. The method according to claim 1, wherein, The light conditions are changed by using a light source (105) arranged in the vehicle (201).

3. The method according to claim 2, wherein, The light source (105) outputs light pulses that are perceptible to the driver (204).

4. The method according to any one of claims 1 to 3, wherein, A front camera (102) arranged in or on the vehicle (201) is used to capture images of the surrounding environment (206) in front of the vehicle (201), and the images captured by the front camera (102) are evaluated to determine changes in light conditions.

5. The method according to any one of claims 1 to 3, wherein, - Determine the road direction of the road (202) traveled by the vehicle (201); - Assign the driver's (204) expected steering behavior to the road direction; - Compare the expected steering behavior with the actual steering behavior of the driver (204); as well as - When the actual steering behavior deviates significantly from the expected steering behavior, the warning signal is output.

6. The method according to claim 5, wherein, The actual steering behavior of the driver (204) is determined based on the sensor signal from the steering angle sensor of the vehicle (201).

7. The method according to claim 5, wherein, The road direction is determined based on images captured by the front camera (102) of the vehicle (201) or by means of a navigation device.

8. The method according to any one of claims 1 to 3, wherein, - Determine the actual color of the sclera of the driver's (204) eyes in the images captured by the interior space camera (101); - Compare the actual color with the expected color of the sclera; and - When the actual color deviates significantly from the expected color of the sclera, the warning signal is output.

9. A warning device (100) for warning a driver (204) of a vehicle (201), the warning device (100) comprising: - An interior space camera (101) is arranged in the vehicle (201), the interior space camera (101) being configured to capture images of the face of the driver (204); - Image evaluation unit (103), the image evaluation unit (103) is configured to determine the pupil width of the driver's (204) pupil in the image captured by the interior space camera (101); - Control unit (104), the control unit (104) is configured to assign the expected pupillary light reflection of the driver (204) to changes in light conditions, determine the actual pupillary light reflection of the driver (204) in response to the changes based on the pupil width determined by the image evaluation unit (103), and initiate the output of a warning signal for the driver (204) when the actual pupillary light reflection deviates significantly from the expected pupillary light reflection; as well as - An output unit (106) arranged in the vehicle (201) is configured to output the warning signal.

10. The warning device (100) according to claim 9, the warning device (100) having a light source (105) arranged in the vehicle (201), the light source (105) being configured to change light conditions.

11. The warning device (100) according to claim 10, wherein, The light source (105) is configured to output light pulses that are perceptible to the driver (204).

12. The warning device (100) according to any one of claims 9 to 11, the warning device (100) having a front camera (102) disposed in or on the vehicle (201), the front camera (102) being configured to capture images of the surrounding environment (206) in front of the vehicle (201), wherein, The image evaluation unit (103) is configured to determine changes in light conditions in images captured by the front camera (102).

13. The warning device (100) according to any one of claims 9 to 11, wherein, The image evaluation unit (103) is configured to determine the actual color of the sclera of the driver's (204) eye in an image captured by the interior space camera (101), and the control unit (104) is configured to compare the actual color with the expected color of the sclera, and to activate the output of the warning signal when the actual color deviates significantly from the expected color of the sclera.

Images