Procedure for warning a driver of a vehicle

The method and system analyze nearby drivers' eye movements to detect fatigue, issuing warnings and adjusting vehicle dynamics, effectively reducing accident risks by addressing the inadequacies of existing methods.

DE102024002104A1Pending Publication Date: 2025-12-31MERCEDES BENZ GROUP AG
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
DE102024002104
Authority / Receiving Office
DE · DE
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-06-27
Publication Date
2025-12-31

AI Technical Summary

Technical Problem

Existing methods for warning vehicle drivers about potential hazards from fatigued road users are inadequate in detecting and responding to driver fatigue effectively.

Method used

A method and system that utilizes a high-resolution camera and electronic computing device to analyze eye movements of nearby drivers, issuing warnings or adjusting vehicle dynamics based on detected fatigue levels, including visual and acoustic signals, and potentially integrating with automatic emergency braking systems.

Benefits of technology

Enhances road safety by detecting and mitigating the risks posed by fatigued drivers, reducing the likelihood of accidents through timely warnings and dynamic vehicle interventions.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000000_0001_ABST
    Figure 00000000_0001_ABST
  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

The invention relates to a method for warning the driver of a vehicle (10), in which at least one image (14) of a road user (18) located in the vicinity (16) of the vehicle (10) is captured by means of a camera (12) of the vehicle (10). The image (14) is analyzed by means of an electronic computing device (20). By analyzing the image (14), the fatigue of the road user (18) is determined. Depending on the determined fatigue, at least one warning signal is issued to alert the driver and / or, depending on the determined fatigue, an intervention in the driving dynamics of the vehicle (10) takes place.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] The invention relates to a method for warning a driver of a vehicle according to the preamble of claim 1.

[0002] Such a method for warning a vehicle driver is, for example, already known from DE 10 2015 215 676 A1. In this method, a camera on the vehicle captures at least one image of a road user located in the vicinity of the vehicle. The image is then analyzed by an electronic computing device.

[0003] The object of the present invention is to improve a method of the type mentioned at the outset.

[0004] This problem is solved by a method with the features of claim 1. Advantageous embodiments with expedient further developments of the invention are specified in the remaining claims.

[0005] To improve a method of the type specified in the preamble of claim 1, the invention provides that the fatigue of the road user is determined by analyzing the image. Depending on the detected fatigue, at least one warning signal is issued to alert the driver, in particular by means of an electrical or electronic display device of the vehicle, wherein the warning signal is specifically issued to the driver. Alternatively or additionally, depending on the detected fatigue, the method intervenes in the vehicle's driving dynamics, in particular automatically and / or by means of the electronic computing device. Preferably, the electronic computing device is an electronic computing device of the vehicle.

[0006] A warning system is also disclosed, by means of which the method according to the invention can be carried out. The warning system, or the method, can inform the driver if other road users are possibly tired and could therefore pose a potential danger. In particular, the warning system, or the method, uses advanced sensor technology to monitor, for example, the eye movements of the road user. Based on the eye movements, as determined, for example, by analyzing the image, the level of fatigue is assessed.

[0007] The vehicle, also referred to as the first vehicle or ego-vehicle, whose driver is also called the first driver, is, for example, a second driver of a second vehicle located nearby. This second vehicle is, for instance, on a road in the vicinity of the first vehicle. The method or warning system according to the invention operates, for example, on the basis of two main components: A first main component is, for example, an outward-facing camera, particularly one with high resolution, which is oriented towards the surroundings. A second main component is an algorithm, which is executed, for example, by the electronic computing device. The algorithm is preferably designed to analyze the image and, in particular, to detect and analyze eye movements.

[0008] For example, a camera is mounted on the vehicle and continuously records the driver's eye movements. The camera provides data that characterizes the image and thus, for example, the eye movements. The electronic processing unit receives and analyzes this data. Based on the data and / or image, the electronic processing unit identifies specific patterns that could indicate fatigue. These patterns might include slow and irregular eye movements, frequent blinking, or sudden head movements. If the system detects signs of driver fatigue, a warning signal is issued, particularly inside the vehicle.The warning signal is or includes, for example, at least one warning tone and / or at least one warning signal that is visually perceptible to the driver. In other words, the warning signal is or includes, for example, at least one acoustic signal and / or at least one visual signal that is visually perceptible to the driver. The visual signal is displayed, for example, on a display, particularly a visual and / or electronic display, of the vehicle. The display is located, for example, on or in the vehicle's dashboard. For example, the display is located inside the vehicle, in which case it is also referred to as a display or interior display.Alternatively or additionally, the warning system can be connected to, interact with, and / or communicate with at least one other vehicle safety system, such as an automatic emergency braking system. This safety system operates, for example, based on the detected level of fatigue, enabling a rapid and effective response to potential hazards. This fatigue-dependent operation of the safety system includes, for instance, the automatic emergency braking system initiating emergency braking, thereby intervening in the vehicle's driving dynamics as described above.

[0009] The inventive method and thus the inventive warning system make it possible to detect fatigue in other road users, thereby keeping the risk of accidents particularly low. By alerting the driver of the vehicle to potential hazardous situations, in particular by issuing a warning signal, the warning system can contribute to preventing accidents and achieving a high level of road safety.

[0010] Further advantages, features, and details of the invention will become apparent from the following description of a preferred embodiment and from the drawing. The features and combinations of features mentioned above in the description, as well as those mentioned below in the figure description and / or shown in the single figure alone, can be used not only in the combinations specified, but also in other combinations or individually, without departing from the scope of the invention.

[0011] The drawing shows in the only Fig. 1 each a schematic perspective view of a first vehicle and a second vehicle, wherein based on Fig. 1. A procedure for warning a driver of the first vehicle is illustrated.

[0012] The only Fig. Figure 1 shows a schematic perspective view of a first vehicle 10, also referred to as the ego vehicle, which is designed as a motor vehicle, specifically a passenger vehicle. Based on Fig. 1. The following describes a procedure for warning a driver, that is, a driver of vehicle 10. In this procedure, at least one of the following is used: Fig. A particularly schematically depicted camera 12 of the vehicle 10 captures at least one image 14 of a road user 18, i.e., a road user or road user, located in the vicinity 16 of the vehicle 10. For example, several images of the road user 18 are captured by the camera 12. The preceding and following statements regarding image 14 can readily be applied to the other images of the road user 18 and vice versa.

[0013] By means of a Fig. Figure 14 is analyzed in relation to the electronic computing device 20, which is shown in a particularly schematic way. Fig. In the embodiment shown in Figure 1, the electronic computing device 20 is a component of the vehicle 10.

[0014] To achieve a particularly high level of safety, the system analyzes image 14 to determine the level of fatigue in road user 18. Depending on the detected level of fatigue, at least one warning signal is issued to alert the driver of vehicle 10. Alternatively or additionally, depending on the detected level of fatigue, the system intervenes in the driving dynamics of vehicle 10. The warning signal is issued, for example, via an electronic or electrical display device in vehicle 10, particularly within the vehicle's interior. This warning signal informs the driver of vehicle 10 that road user 18 is fatigued, which may be associated with an increased risk of an accident. Consequently, the driver of vehicle 10 can drive the vehicle 10 with appropriate caution to avoid an accident.

[0015] At the in Fig. In the embodiment shown in Figure 1, the road user 18 is a second driver of a second vehicle 22 located in the vicinity 16, wherein the road user 18 is located inside the vehicle 22.

[0016] For example, the procedure involves continuously recording the eye movements of road user 18 based on the images. By analyzing the images using the electronic computing device 20, the level of fatigue of road user 18 is determined based on the recorded eye movements. For example, specific patterns are evaluated using the electronic computing device 20 to determine fatigue. Recording the eye movements includes, for example, tracking them.

[0017] For example, and specifically only when the detected fatigue level exceeds a predefined or predetermined threshold, a warning signal is issued and / or the vehicle dynamics are intervened, particularly automatically. This ensures a particularly high level of safety. QUOTES INCLUDED IN THE DESCRIPTION

[0000] This list of documents cited by the applicant was automatically generated and is included solely for the reader's convenience. The list is not part of the German patent or utility model application. The DPMA accepts no liability for any errors or omissions. Cited patent literature

[0000] DE 10 2015 215 676 A1

[0002]

Claims

[1] Method for warning a driver of a vehicle (10) in which: - at least one image (14) of a road user (18) located in the vicinity (16) of the vehicle (10) is captured by means of a camera (12) of the vehicle (10); and - the image (14) is analyzed using an electronic computing device (20); characterized by , that: - by analyzing the image (14) a fatigue of the road user (18) is determined; and - depending on the detected fatigue, at least one warning signal is issued to alert the driver and / or an intervention in the vehicle's driving dynamics (10) takes place. [2] Method according to claim 1, characterized by , that: - several images (14) of the road user (18) are captured by means of the camera (12); - using the images (14), the eye movement of the road user (18) is continuously recorded; and - the images (14) are analyzed using the electronic computing device (20), which determines fatigue based on eye movement. [3] Method according to claim 2, characterized by that specific patterns are evaluated to determine fatigue.