Method for assisting a driver in operating a motor vehicle, motor vehicle and computer program product

Abstract

The invention relates to a method for assisting a driver (10) in driving a motor vehicle (2), wherein sensor data are generated by means of a sensor device (4) of the motor vehicle (2) which depicts the behavior of the driver (10), wherein the behavior is evaluated by means of a data processing device (6) of the motor vehicle (2) in such a way that non-ergonomic behavior is detected, and wherein a notification is issued by means of an output unit (8) of the motor vehicle (2) when non-ergonomic behavior is detected.

Description

[0001] The invention relates to a method for assisting a driver in driving a motor vehicle. Furthermore, the invention relates to a motor vehicle and a computer program product.

[0002] Assistance systems that support a driver in operating a motor vehicle are widespread. There are various types of assistance systems that differ in the type of support they provide.

[0003] In one of these types, the driver is monitored using sensors to detect signs of driver fatigue and then warn them. Such an assistance system is intended, in particular, to prevent accidents caused by so-called microsleep. Common names for assistance systems of this type include fatigue warning and attention assist. Examples of such assistance systems are described in CN 208 498 370 U and CN 112 289 003 A, among others.

[0004] Another type of assistance system uses sensors to monitor the driver's emotional reactions to driving situations. Depending on the driver's emotional reaction, different actions may be performed. An example of such an assistance system is described in US 2022 / 0 032 919 A1.

[0005] The object of the present invention is to enable a further type of assistance and to provide an advantageous method for assisting a driver in driving a motor vehicle, an advantageously designed motor vehicle and an advantageous computer program product.

[0006] This object is achieved by a method having the features of patent claim 1, by a motor vehicle having the features of patent claim 9, and by a computer program product having the features of patent claim 10. The advantages and preferred embodiments cited with regard to the method are also transferable mutatis mutandis to the devices, i.e., the computer program product on the one hand and the motor vehicle on the other, and vice versa. Advantageous embodiments with expedient further developments of the invention are specified in the dependent patent claims.

[0007] The method according to the invention serves to assist a driver in driving a motor vehicle and is designed accordingly. It is also designed for implementation in or by a motor vehicle according to the invention.

[0008] Conversely, the motor vehicle according to the invention is configured to execute the method, i.e., the method according to the invention, in at least one operating mode. The motor vehicle, i.e., the motor vehicle according to the invention, comprises a sensor device, a data processing device, and an output unit.

[0009] During the execution of the method, the sensor device generates sensor data that depicts the driver's behavior. This sensor data is then fed to the data processing unit and processed by it. Through this processing, the driver's behavior is evaluated by the data processing unit in such a way that non-ergonomic behavior is detected. If such non-ergonomic behavior is then detected, the data processing unit controls the output unit, so that a message is issued to the driver via the output unit.

[0010] In this way, the driver is supported in avoiding non-ergonomic behavior. According to the invention, the driver is thus supported in driving the motor vehicle by receiving assistance that enables the driver to avoid non-ergonomic behavior. It is assumed that non-ergonomic behavior, at least if it is persisted over a longer period of time, may have a negative impact on the driver's driving of the motor vehicle.

[0011] The following considerations were made in this regard. For example, if the driver maintains an unfavorable posture for an extended period while driving a motor vehicle, this can lead to discomfort and even pain. In this context, this is also referred to as a "repetitive driving injury" (RDI). This, in turn, can distract the driver and thus negatively impact vehicle handling.

[0012] Some people also tend to contract facial muscles in certain situations. This can lead to a reduced field of vision for the driver, particularly when the eyes are squinted. This behavior can also cause headaches and / or lead to faster driver fatigue. It can also promote the formation of facial wrinkles.

[0013] It is also unfavorable if the driver grips the steering wheel of the vehicle unnecessarily tightly and / or makes unnecessarily hasty steering movements and / or excessive steering corrections. This can also lead to faster driver fatigue.

[0014] Furthermore, any behavior described above, i.e., any non-ergonomic behavior, is typically a sign that the driver is tense or stressed. Furthermore, any behavior described above typically increases stress.

[0015] For these reasons, among others, the invention now supports the driver in avoiding non-ergonomic behavior, particularly behaviors that lead to fatigue more quickly or promote stress. To this end, the output unit issues a warning to the driver when such non-ergonomic behavior is detected. The warning preferably includes a recommendation on how the driver can achieve ergonomic behavior.

[0016] A further preferred embodiment is one in which the driver's behavior is characterized by a posture of the driver, in which sensor data depicting the driver's posture is generated by the sensor device, in which the posture is evaluated by the data processing device in such a way that a non-ergonomic posture is detected, and in which the aforementioned indication is output by the output unit when a non-ergonomic posture and thus non-ergonomic behavior is detected. The indication preferably further includes a recommendation on how the driver can adopt an ergonomic posture.

[0017] This is particularly useful if the posture is characterized by a relative position and / or relative alignment of the head to the upper body. In this case, at least the relative position and / or relative alignment of the head to the upper body is monitored by sensors and compared with specifications. If the relative position and / or relative alignment deviates from the specifications, a warning is issued.

[0018] A further advantageous embodiment is one in which the driver's behavior is characterized by the driver's facial expressions. Sensor data depicting the facial expressions are generated by the sensor device. The facial expressions are evaluated by the data processing device in such a way that a non-ergonomic facial expression and thus non-ergonomic behavior are detected. The output unit outputs the aforementioned notification when a non-ergonomic facial expression is detected. The notification preferably further includes a recommendation as to how the driver can achieve an ergonomic facial expression.

[0019] Typically, in addition to or as an alternative to posture, the driver's facial expressions are monitored using sensors and compared with the specified values. If the facial expressions deviate from the specified values, a warning is issued.

[0020] A method variant is also advantageous in which the driver's behavior is characterized by an actuation of a steering wheel of the motor vehicle, in which sensor data is generated by the sensor device that depicts the actuation, in which the actuation is evaluated by the data processing device in such a way that a non-ergonomic actuation and thus a non-ergonomic behavior is detected, and in which the aforementioned indication is output by the output unit when a non-ergonomic actuation is detected. The indication further preferably includes a recommendation as to how the driver can achieve ergonomic actuation.

[0021] In addition to or as an alternative to body posture and / or facial expressions, steering wheel operation is then monitored by sensors and compared with specifications. If the operation deviates from the specifications, the aforementioned warning is issued.

[0022] Depending on the application, the operation of the steering wheel includes the steering movements made by the driver and / or the pressure that the driver exerts on the steering wheel by gripping it.

[0023] Regardless, the aforementioned notification is typically provided visually and / or acoustically. For this purpose, the output unit may have a display and / or a loudspeaker, for example.

[0024] Also useful are variants in which corresponding messages are only issued via the output unit after a start-up phase has elapsed. The value for the start-up phase duration is usually greater than or equal to 10 minutes, for example, 20 or 30 minutes. Calibration, for example, takes place during such a start-up phase.

[0025] Other typical variants include those in which the aforementioned warning is only issued when the non-ergonomic behavior is detected for a minimum period of time, i.e., when the driver maintains the corresponding behavior for the minimum period of time. The value for the minimum period is typically greater than or equal to 10 seconds, for example, 20 seconds.

[0026] Depending on the application, the warning is also only issued for a limited period of time, even if the driver continues to maintain the non-ergonomic behavior. The value for this period is usually less than or equal to 1 minute, for example, 10 seconds. Preferably, the warning is issued again after a specified time interval if the driver continues to maintain the non-ergonomic behavior. The value for this time interval is usually greater than or equal to 1 minute, for example, 2 minutes or 5 minutes. Depending on the application, one or more corresponding repetitions are provided.

[0027] According to an alternative embodiment, such a warning is issued continuously until the driver changes his behavior or makes an input via an input unit of the motor vehicle.

[0028] If the sensory detection of the aforementioned body posture and / or the aforementioned facial expressions is further provided, the sensor device of the motor vehicle usually has at least one camera, which is integrated, for example, in an interior mirror / rearview mirror of the motor vehicle or in a roof lining of the motor vehicle.

[0029] If sensory detection of the previously described actuation of the steering wheel is provided, at least one pressure sensor is integrated, for example, into a steering wheel rim of the steering wheel and / or the steering wheel has at least one sensor with which changes in the rotational position of the steering wheel can be detected, i.e. steering movements.

[0030] It is also useful if the driver's behavior is evaluated using the data processing device by comparing at least one characteristic of the behavior with a comparison characteristic assigned to the driver. For example, the relative position and / or relative orientation of the head to the upper body is monitored by sensors and compared with a specification assigned to the driver, in particular an advantageous relative position and / or orientation. The comparison characteristic or specification is assigned to the driver in that it is based on the driver's individual data.

[0031] Alternatively, statistical data is used to create a standard or a comparison characteristic. In such a case, the behavior is then evaluated using the data processing device by comparing at least one characteristic of the behavior with a comparison characteristic from a statistical survey.

[0032] Depending on the application, corresponding comparison features or specifications are stored in a memory of the data processing device or in an external memory, such as an online database. If these are stored in an external memory, the motor vehicle conveniently has a transmitting and receiving unit through which the data processing device can query the corresponding comparison features or specifications.

[0033] A preferred embodiment also includes an evaluation of the driver's behavior with regard to posture, facial expressions, and steering wheel operation. Posture, facial expressions, and steering wheel operation are typically evaluated independently of one another and compared with corresponding specifications. Further preferred is the output of specific instructions in the event of deviations from the specifications, providing information on how the driver should adjust their posture, facial expressions, and / or steering wheel operation.

[0034] As already explained above, the method according to the invention is designed for execution in the motor vehicle according to the invention or by the motor vehicle according to the invention and, conversely, the motor vehicle according to the invention is set up to execute the method according to the invention in at least one operating mode.

[0035] For this purpose, the motor vehicle according to the invention has the aforementioned data processing device, by means of which the individual method steps of the method or at least a number of method steps of the method are then executed. For this purpose, an executable program is preferably stored or installed in the data processing device, which, after startup, automatically executes the method or at least a number of method steps of the method.

[0036] A corresponding program can also be subsequently installed or stored using a computer program product according to the invention, provided that at least one suitable data processing device is present in a motor vehicle. This computer program product is typically a file or a data storage device containing a file, with the file containing the executable program, i.e., in particular, a suitable program code.

[0037] It should therefore be pointed out again that the advantages and preferred embodiments mentioned with regard to the method are also to be transferred mutatis mutandis to the devices, i.e. the computer program product on the one hand and the motor vehicle on the other hand, and vice versa.

[0038] Further advantages, features, and details of the invention will become apparent from the claims, the following description of preferred embodiments, and the schematic drawings. These show: Fig. 1 shows a block diagram of a motor vehicle with an interior; and Fig. 2 shows a partial sectional view of part of the interior.

[0039] Corresponding parts are provided with the same reference numerals in all figures.

[0040] A motor vehicle 2 described below as an example is in Fig.1 is represented by a block diagram. It comprises a sensor device 4, a data processing device 6, and an output unit 8. The sensor device 4, the data processing device 6, and the output unit 8 form an assistance system that supports a driver 10 during operation in avoiding non-ergonomic behavior.

[0041] For this purpose, sensor data is generated by the sensor device 4, which represents the behavior of the driver 10. This sensor data is then fed to the data processing device 6 and processed by it. The processing then evaluates the behavior of the driver 10 in such a way that non-ergonomic behavior is detected. If such non-ergonomic behavior is detected, the output unit 8 is controlled by the data processing unit 6, so that a notification is output to the driver 10 via the output unit 6.

[0042] In the exemplary embodiment, the sensor device 4 comprises a camera 12 integrated into a rearview mirror 14 in the interior of the motor vehicle 2. In alternative embodiments, the camera 12 is integrated into a roof lining, an A-pillar, or a speedometer unit.

[0043] To depict the behavior of driver 10, camera 12 in the exemplary embodiment captures the face of driver 10. The image data from camera 12 are then evaluated by data processing device 6, with the facial expressions of driver 10 being assessed, for example, using a facial recognition software module. If tension in the facial muscles is then detected, non-ergonomic behavior is determined.

[0044] As a result, a warning is then output via the output unit 8, indicating the non-ergonomic behavior. In the exemplary embodiment, the warning is output visually, for example, via a display in a center console of the motor vehicle 2 (not shown) or a head-up display (not shown).

[0045] Depending on the design variant, the warning might be displayed in the form of a simple pictogram, for example. However, a concrete suggestion for how to achieve ergonomic behavior is preferred. For example, the suggestion: "Try to relax your face."

[0046] Furthermore, the relative orientation of the head 16 to the upper body 18 of the driver 10 is also recorded by the camera 12. The image data from the camera 12 are then evaluated by the data processing device 6 to assess the posture of the driver 10, in particular the relative orientation of the head 16 to the upper body 18.

[0047] If the posture deviates from a specified value, non-ergonomic behavior is detected, and a corresponding message is issued via output unit 8. Preferably, a specific suggestion is provided here as well, indicating how ergonomic behavior can be achieved. For example, the suggestion: "Tilt your neck further back for a more relaxed posture."

[0048] In addition, the sensor device 4 in the exemplary embodiment comprises two sensors 20, 22, which are integrated into a steering wheel 24 of the motor vehicle 2, namely a rotation sensor 20 and a pressure sensor 22. Steering movements are detected by means of the rotation sensor 20 and the pressure sensor 22 detects the pressure which the driver 10 exerts on the steering wheel 24 by gripping it.

[0049] These sensors 20, 22 map the operation of the steering wheel 24 by the driver 10, and this operation is also evaluated by the data processing device 6. If the driver 10 then exerts too much pressure or performs too hasty steering movements, the data processing device 6 again detects non-ergonomic behavior.

[0050] As a result, a message is then output via output unit 8, pointing out the non-ergonomic behavior. Preferably, a concrete suggestion is also provided here as to how ergonomic behavior can be achieved. For example, the suggestion: "Release the tension in your hands a little" or "Steer a little more smoothly." LIST OF REFERENCE SYMBOLS: 2 motor vehicles 4 Sensor device 6 Data processing facility 8 Output unit 10 drivers 12 Camera 14 rearview mirrors 16 heads 18 Upper body 20 rotation sensor 22 Pressure sensor 24 steering wheel QUOTES CONTAINED IN THE DESCRIPTION

[0000] This list of documents submitted by the applicant was generated automatically and is included solely for the convenience of the reader. This list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions. Cited patent literature

[0000] CN 208 498 370 U

[0003] CN 112 289 003 A

[0003] US 2022 / 0 032 919 A1

[0004]

Claims

[1] Method for assisting a driver (10) in driving a motor vehicle (2), wherein - sensor data are generated by means of a sensor device (4) of the motor vehicle (2), which represent a behavior of the driver (10), - the behavior is evaluated by means of a data processing device (6) of the motor vehicle (2) in such a way that non-ergonomic behavior is detected, and - an indication is output by means of an output unit (8) of the motor vehicle (2) when non-ergonomic behaviour is detected. [2] The method according to claim 1, wherein - the behaviour is characterised by a posture of the driver (10), - sensor data are generated by means of the sensor device (4) which depict the body posture, - the posture is evaluated by means of the data processing device (6) in such a way that a non-ergonomic posture is detected, and - the output unit (8) issues the message when a non-ergonomic posture is detected. [3] Method according to claim 2, wherein the posture is characterized by a relative position of the head (16) to the upper body (18). [4] Method according to one of claims 1 to 3, wherein - the behavior of the driver (10) is characterized by a facial expression of the driver (10), - sensor data are generated by means of the sensor device (4) which depict the facial expressions, - the facial expressions are evaluated by means of the data processing device (6) in such a way that a non-ergonomic facial expression is recognized, and - the message is output by means of the output unit (8) when a non-ergonomic facial expression is detected. [5] Method according to one of claims 1 to 4, wherein - the behavior of the driver (10) is characterized by an operation of a steering wheel (24) of the motor vehicle (2), - sensor data are generated by means of the sensor device (4) which represent the actuation, - the actuation is evaluated by means of the data processing device (6) in such a way that a non-ergonomic actuation is detected, and - the message is output by means of the output unit (8) when a non-ergonomic operation is detected. [6] Method according to one of claims 1 to 5, wherein the indication comprises a recommendation as to how the driver (10) can achieve ergonomic behavior. [7] Method according to one of claims 1 to 6, wherein the behavior is evaluated by means of the data processing device (6) by comparing at least one feature of the behavior with a comparison feature assigned to the driver (10). [8] Method according to one of claims 1 to 7, wherein the behavior is evaluated by means of the data processing device (6) by comparing at least one feature of the behavior with a comparison feature from a statistical survey. [9] Motor vehicle (2) arranged to carry out a method according to one of the preceding claims in at least one operating mode. [10] Computer program product containing a program executable on a data processing device (6) which, after starting, automatically executes a method according to one of the preceding claims.

Images