Assistance system and method for warning a distracted driver in an assisted or partially automated driving mode, and correspondingly configured motor vehicle

Abstract

The invention relates to an assistance system (9) and to a corresponding method (15) for warning a driver (2) in an assisted or partially automated driving mode of a motor vehicle (1). Accordingly, when the driver (2) is first distracted, a distraction warning (14) is output after the expiry of a first warning period during which the driver (2) was distracted. If the driver (2) is distracted again within a predefined repetition period, then a distraction warning (14) is output to the driver (2) after a shorter second warning time. The invention also relates to a correspondingly configured motor vehicle (1).

Description

[0001] Assistance system and method for warning a distracted driver in an assisted or partially automated ferry operation and correspondingly equipped motor vehicle

[0002] The present invention lies in the field of automotive technology and relates to an assistance system and a corresponding method for warning a distracted driver in an assisted or partially automated driving mode of a motor vehicle. The invention further relates to a correspondingly configured motor vehicle.

[0003] A multitude of different systems and devices already exist for today's motor vehicles to assist the driver in operating the respective vehicle, with the aim of increasing automation of the driving task. At present, however, the driver must still take over or perform at least some of the driving task themselves or at least monitor the automated systems or the surrounding traffic. Therefore, as things stand, the driver is not allowed to divert their attention from the driving task, i.e. from controlling or steering the vehicle or from monitoring ferry operations, or only for a very limited period of time. After a corresponding period of distraction, a warning can therefore be issued to the driver. However, this can disadvantageously result in a warning that is not always appropriate to the situation, which in turn can irritate the driver or reduce the acceptance of corresponding systems.Therefore, there is a need for further improvements here.

[0004] As one approach, EP 3 945 002 A1 describes a system and method for improving driver warnings for automated driving. This involves monitoring driver feedback during automated driving. Depending on whether such driver feedback is present, a point value is then adapted at a defined rate. If this point value meets a threshold before the driver feedback is present, a warning is generated for the driver. Thus, the appropriate point value can achieve a certain degree of adaptation to different situations. However, even this does not guarantee that all issued warnings are appropriate, take the respective situation into account, and are understandable and acceptable to the driver.

[0005] A warning system for a motor vehicle is also described in DE 102008 056 343 A1. This warning system comprises sensors for detecting a driving situation, a warning device, and a device for detecting the driver's attention level, which includes control elements of existing vehicle components. This device concludes that the driver's attention level is reduced if the total duration of a sequence of several control actions related to the control elements exceeds a minimum duration. This is intended to create a simple warning system that better addresses common causes of a reduction in the driver's attention level.

[0006] As a further approach, DE 10 2020204 964 A1 describes a method for monitoring a driver's attention level during vehicle operation. This method uses environmental information about a route to determine an attention level. If it is then determined that the driver's current attention level is lower than the determined attention level, a countermeasure is initiated.

[0007] The object of the present invention is to achieve improved driver acceptance for automatic distraction warning in an assisted or partially automated operation of a motor vehicle.

[0008] This problem is solved by the subject matter of the main claim and the subsidiary claims or the independent patent claims. Further possible embodiments of the invention are disclosed in the subclaims, the description, and the figures. Features, advantages, and possible embodiments presented in the description for one of the subject matter of the independent claims are to be regarded at least analogously as features, advantages, and possible embodiments of the respective subject matter of the other independent claims, as well as any possible combination of the subject matter of the independent claims, optionally in conjunction with one or more of the subclaims.

[0009] The assistance system according to the invention is configured for use in a motor vehicle to warn a driver of the respective motor vehicle during assisted or partially automated ferry operation of the motor vehicle. Assisted ferry operation can correspond to operation according to SAE J3016 Level 1, and partially automated ferry operation can correspond to operation according to SAE J3016 Level 2. The assistance system has an input interface for, in particular, continuously or regularly, recording sensor data that characterizes driver behavior. The sensor data can characterize the behavior, in particular with regard to the control of the motor vehicle, i.e., with regard to the perception or performance of the driving task or the control or monitoring of the motor vehicle. This sensor data can therefore depend on or be influenced by the driver's behavior.The sensor data can, for example, characterize the driver's level of attention or distraction, or depend on it, or indicate it. The assistance system further comprises a data processing device for processing the acquired sensor data and an output interface for outputting a warning signal. The data processing device can, for example, comprise a processing device, such as a microprocessor, microchip, or microcontroller, and a computer-readable data memory coupled thereto. The input interface and the output interface can be separate from one another, combined, or integrated into a common interface. Likewise, the input interface and the output interface can each be implemented entirely or partially in hardware and / or software.The assistance system as a whole can therefore be designed, for example, as a control unit for a motor vehicle or comprise such a control unit or the like.

[0010] The warning signal can, for example, be or comprise an acoustic and / or optical and / or haptic warning signal that can be output to the driver during normal operation. Likewise, the warning signal in the present sense can, for example, be a control signal by which a corresponding output device can be controlled or initiated to output a corresponding acoustic and / or optical and / or haptic warning. Such an output device can, for example, be or comprise a loudspeaker and / or a display device, for example a screen or a head-up display (HUD) or the like, and / or an actuator, for example for generating a mechanical vibration. The assistance system according to the invention can comprise the output device or be configured for direct or indirect coupling to such an output device, for example via an on-board electrical system of the respective motor vehicle.

[0011] According to the invention, the assistance system is designed to carry out, in particular automatically, a number of different method steps or measures during a current journey or operating time of the motor vehicle. For example, the assistance system is designed to evaluate the recorded sensor data to determine whether the driver is distracted from driving the motor vehicle, i.e. whether the driver's attention is directed towards something other than driving, i.e. manual control or monitoring of, for example, partially automated ferry operation in the respective traffic situation. In this case, the assistance system can therefore automatically determine whether the driver is not performing the driving task, is not performing it completely, or is not paying enough attention. The recording of the sensor data and the evaluation of the respective current sensor data can take place during the respective journey or operating time of the motor vehicle.During operation of the assistance system, the data can be continuously or regularly repeated, for example, with a corresponding operating or data processing frequency. Accordingly, it is possible to react dynamically to various situations or circumstances during the journey, as described below.

[0012] Furthermore, the assistance system is designed according to the invention to issue a warning signal upon detection of the driver being distracted for the first time from driving the motor vehicle, provided that the driver is distracted for the first time and this distraction continues or has continued for at least the first warning period. In other words, the assistance system can therefore issue the warning signal automatically if the driver is distracted or was distracted from driving the motor vehicle for at least the first warning period. If, on the other hand, the driver is only distracted from driving the motor vehicle for a shorter period and then fully or attentively resumes driving or monitoring the motor vehicle within the first warning period from the start or detection of the first distraction, the warning signal is not issued. In addition, a corresponding time counter or timer for the first warning period can then be reset, for example.Driver distraction can be detected, for example, in the absence of a feedback signal, based on the driver's hand position, the driver's gaze direction or head position, and / or similar factors. A driver feedback signal in this sense can be, for example, touching the steering wheel of the motor vehicle or manually intervening in the vehicle's control, such as moving the steering wheel, changing gear, or operating the accelerator or brake pedal, and / or similar factors.

[0013] Furthermore, according to the invention, the assistance system is configured to issue a warning signal upon detection of renewed, i.e., repeated, distraction of the driver from driving the motor vehicle, i.e., from perceiving or monitoring the driving task, during the same journey or operating time of the motor vehicle and within a predetermined repetition period since the last distraction, in particular since the end of the last distraction. This warning signal is issued if the renewed or repeated distraction of the driver continues or has continued for at least a second warning period, i.e., if the driver is or was distracted from driving the motor vehicle for at least the second warning period.

[0014] For example, the first time a driver is distracted can be detected and the corresponding warning signal can be issued, thereby encouraging the driver to return their attention to driving the vehicle, thus ending the initial distraction. When the first distraction is detected or when it ends, i.e. when the driver takes over driving again, the repetition period can then begin to run, for example a corresponding time counter or timer can be started. Monitoring or checking for driver distraction continues within this repetition period. If a driver distraction is detected during this repetition period, this is classified as repeated driver distraction. In the event of such repeated driver distraction, the driver is given a second warning period before the first distraction is stopped.another warning signal is issued.

[0015] According to the invention, the second warning period is shorter than the first warning period. Thus, in the event of a repeated distraction, the driver must return their attention to driving the vehicle more quickly than during the initial distraction in order to avoid the warning signal. In other words, the driver may be distracted for a longer period during the initial distraction than during a repeated, subsequent, or renewed distraction within the repetition period, before the warning signal is automatically issued to prompt the driver to return their attention to driving the vehicle.

[0016] In previous warning systems, a warning or notification is often always issued to the driver after the same, fixed distraction period. However, since drivers in assisted or partially automated ferry operations typically occasionally perform brief secondary activities outside of their actual driving task or the actual operation of the vehicle, such as adjusting an air conditioning system, changing a radio station, entering a navigation destination, and / or the like, such a strictly predetermined, fixed time period can lead to inappropriate warnings or warnings that are implausible or unexpected for the driver. This problem can be addressed by the present invention by implementing various warning time periods, i.e., warning thresholds, that are acceptable, understandable, and not, or less, irritating for the driver.can be, whereby at the same time a particularly high level of safety in traffic can be achieved. For example, a one-off distraction for the longer first warning period may not be a problem for safety if the driver pays sufficient attention before and after to fully grasp and understand the surrounding traffic situation. Frequent distractions of this length in quick succession, i.e. at or with shorter time intervals than the specified repetition period, can, on the other hand, lead to or contribute to a significant reduction in safety. This can be the case because the driver may not have enough time between two distractions or may not pay enough attention to fully grasp and understand the current traffic situation in order to ensure that there is no acute danger during the next distraction.

[0017] This problem can be reduced by shortening the duration of the second warning period. At the same time, however, the driver is still given the opportunity, for example, to briefly readjust a setting made during the initial distraction, or something similar, without immediately being confronted with another warning signal. Thus, the present invention takes into account not only the current situation but also its context, i.e., the history or development preceding the current situation. This makes it possible to issue warning signals that are more appropriate to the situation. Overall, the present invention enables the implementation of an effective yet tolerant warning concept that offers customer value, particularly for motor vehicles designed for Level 1 or Level 2 driving.

[0018] In one possible embodiment of the present invention, the assistance system is configured to detect or recognize the first-time distraction and / or repeated distraction of the driver whenever the driver's hands are not on the steering wheel of the motor vehicle and / or the driver's gaze is averted from the surrounding traffic for the respective warning period. The latter can be the case, for example, when the driver is looking at a screen inside the motor vehicle, such as an infotainment display or the like, or at a mobile electronic device carried on board, or at a passenger, or the like. This can be observed or recorded, for example, by means of a driver observation device, such as a camera or the like arranged in the interior of the motor vehicle and aimed at the driver.Whether the driver's hands are on the steering wheel of the motor vehicle can be detected, for example, using appropriate steering wheel sensors, such as capacitive touch sensors integrated into the steering wheel or the like. The assistance system can therefore comprise such devices or sensors and / or be configured to capture and process corresponding sensor data from such devices or sensors via the input interface in order to detect, i.e., recognize, the corresponding distraction. The criteria proposed here for detecting distractions can be particularly useful with regard to road safety and provide a basis for issuing warning signals that is easily understandable and acceptable to typical drivers.

[0019] In a further possible embodiment of the present invention, the first warning period and the second warning period are fixed. The first warning period can in particular be in the range from 4 s to 6 s, for example 5 s. The second warning period can in particular be in the range from 2.5 s to 4 s, for example 3 s. These values ​​can therefore, for example, be stored or implemented in the assistance system. Because the warning periods are fixed, the assistance system can be implemented particularly simply and with little effort and, moreover, can operate particularly consistently, i.e., offer the respective driver a particularly consistent and thus easily understandable and predictable behavior or experience. This can likewise lead to improved acceptance of the corresponding warning signals by the driver and thus to the avoidance of prolonged distractions and / or irritations for the driver.This can effectively encourage or train the driver to limit potential distractions to the corresponding warning periods. Furthermore, at the end of the respective warning period, the driver can be prevented from being surprised or startled, as could occur, for example, if the warning period were dynamically changed in a way that is not immediately apparent to the driver. This can also contribute to improving acceptance and safety in traffic situations. The specific values ​​or lengths of the warning period proposed here can offer or enable a good compromise between the complete avoidance of all distractions, which is unrealistic in practice, and safety and acceptance.

[0020] In a possible development of the present invention, the predefined repetition period lies in the range of 3 minutes to 10 minutes. Here, the repetition period can therefore be, for example, approximately 5 minutes. Such a value can offer the driver sufficient time to fully assess the surrounding traffic situation again after a distraction and to be able to correctly classify or extrapolate it. This makes it possible to achieve a correspondingly good compromise between minimizing distractions, road safety, and the acceptance of the warning signals. In particular, the repetition period can be fixed in order to achieve the simplest possible implementation of the assistance system and particularly consistent, comprehensible behavior of the assistance system.

[0021] In a further possible embodiment of the present invention, the assistance system is designed to detect or classify the next distraction of the driver as a first-time distraction whenever at least the predetermined repetition period has elapsed since the last detected distraction of the driver, in particular since its end, without a detected repeated distraction of the driver. The last or most recently detected distraction of the driver can be the first-time distraction or a previous repeated distraction. If, therefore, the driver has turned his full attention back to driving the motor vehicle after a distraction and was not distracted for at least the predetermined repetition period and has fully performed the driving task and / or was attentive with regard to driving the motor vehicle orof performing the driving task, the driver is then granted the longer initial warning period the next time he or she is distracted, before another warning signal is issued. This can occur, in particular, during the same trip. Thus, several initial driver distractions are possible during the same trip. If no repeated driver distraction is detected during the repetition period, a corresponding status or program flag, or the like, can be reset. Accordingly, the repetition period can also be referred to as a reset period.A corresponding reset, i.e. a corresponding reset of the distraction or detection classification to the first distraction, can also be carried out for each new journey or for each new operating time of the motor vehicle and / or the function or system for assisted or partially automated vehicle guidance, i.e. for example when the motor vehicle and / or the corresponding function or system is switched off or on or when the motor vehicle and / or the corresponding function or system is started up. In this way, the first detected distraction can always be detected as the first distraction after a corresponding start-up or after a corresponding reset. This can also contribute to improved acceptance of the warning signals by the driver. In a further possible embodiment of the present invention, the assistance system is designed to wait for the expiry of the second warning period after the detection of the distraction orIn the event of repeated driver distraction, if the driver is still distracted, a different warning signal may be issued to provide the driver with an escalated or more intensive warning than the one issued upon expiry of the first warning period after detection of the driver distraction or the first distraction for the first warning period. In this way, in the event of repeated distraction, the driver can be persuaded to return their attention to driving the vehicle more quickly and effectively, not only by the shorter second warning period, but also by the correspondingly escalated or more intensive warning. This can therefore contribute to correspondingly improved safety. At the same time, a corresponding escalation, i.e. a corresponding increase in intensity, i.e. clarity, perceptibility or penetrance of the warning or warning signal in the event of repeated distraction, can be easily understood and intuitively comprehended for the driver.In this way, for example, improved acceptance can be achieved than if a correspondingly intensive warning signal or warning were issued, generated or caused upon the first distraction.

[0022] In a possible further development of the present invention, the assistance system is configured to use the warning signal issued after the second warning period to issue a warning with greater volume and / or greater brightness and / or a different color and / or an increased frequency, for example, an increased flashing, vibration, or sound frequency, and / or using a different, in particular additional, output modality compared to the warning caused by the warning signal possibly issued after the first warning period. These adjustments therefore make it possible to realize the greater intensity mentioned elsewhere. Different output modalities in the present sense can be or include, for example, an acoustic output, a visual output, a haptic output, different actuators, different display devices, and / or the like.For example, after the first warning period, a visual warning can be issued in a vehicle's instrument cluster and / or an acoustic warning with a first volume and a first frequency or a first sound or tone pattern. After the second warning period has expired, however, the visual warning can be issued, for example - additionally or alternatively - via a head-up display and / or the acoustic warning can be issued with a higher second volume and / or a higher second frequency or a different second sound or tone pattern and / or a haptic warning, for example through vibration of an actuator in a driver's seat of the vehicle or the like.This ensures particularly reliably that the driver clearly perceives the corresponding more intensive warning and reacts to it by turning his attention back to driving the vehicle.

[0023] In a further possible embodiment of the present invention, the assistance system is configured to automatically detect an operating mode or ferry operation of the motor vehicle. Furthermore, the assistance system is configured to automatically interrupt its operation to output the warning signal upon detecting at least partially automated ferry operation or operating mode of the motor vehicle. Such at least partially automated ferry operation can, for example, be operation according to SAE J3016 Level 3 or higher. Furthermore, the assistance system is configured to automatically start its operation to output the warning signal upon detecting assisted or partially automated ferry operation or operating mode.In other words, the assistance system can issue the warning signals in the manner described if the driver is distracted to a certain extent, provided the vehicle is in assisted or partially automated ferry mode. However, if the vehicle is in at least partially automated ferry mode, the assistance system can automatically avoid or suppress the described warning signals.

[0024] Likewise, in at least partially automated ferry operations, the assistance system can, for example, automatically stop or refrain from detecting driver distractions in order to save the corresponding effort and energy consumption.

[0025] Thanks to the functionality of the assistance system proposed here, the driver does not have to manually switch the assistance system on and off depending on the ferry operation of the motor vehicle, for example. Furthermore, in the at least partially automated ferry operation, unnecessary or inappropriate warning signals and thus also the corresponding irritation of the driver can ultimately be avoided. This can further improve the acceptance of the warning signals. The present invention also relates to a method for warning a driver of a motor vehicle in the event of driver distraction during an assisted or partially automated journey of the motor vehicle. Sensor data is automatically recorded therein, which characterizes the driver's behavior, in particular with regard to distraction or a degree of distraction. The recorded sensor data is then automatically evaluated in order to identify any distractions of the driver from the driving task orfrom driving the motor vehicle. Upon detection of the driver's initial distraction, a warning signal is only issued if the driver has not returned his attention to driving the motor vehicle within a predetermined first warning period. This first warning period can begin to run when the distraction begins or is detected. In other words, the warning signal is issued if the driver has not returned to driving the motor vehicle within the first warning period or if the driver is still distracted from driving the motor vehicle after the first warning period has expired.

[0026] A repeated distraction is detected when the driver is again distracted from driving the motor vehicle within a predetermined repetition period after or since a detected distraction, in particular after or since its end. The warning signal or a warning signal is then issued if the driver is distracted for a second warning period that is shorter than the first warning period. The method according to the invention can be carried out, in particular automatically, by means of the assistance system according to the invention. In other words, the assistance system according to the invention can be configured to carry out, in particular automatically, the method according to the invention. Further method steps, measures, sequences or control processes mentioned in connection with the assistance system according to the invention can form further, possibly optional, method steps of the method according to the invention.

[0027] The present invention also relates to a motor vehicle comprising a system for assisted and / or partially automated vehicle guidance and a sensor system for recording sensor data that characterizes the behavior of the driver of the motor vehicle, in particular with regard to distraction or a degree of distraction of the driver from the guidance of the motor vehicle. The motor vehicle according to the invention is equipped with the assistance system according to the invention and / or is configured to carry out the method according to the invention, in particular automatically. The motor vehicle according to the invention can therefore in particular be the motor vehicle mentioned in connection with the assistance system according to the invention and / or in connection with the method according to the invention or correspond thereto.

[0028] Further features of the invention may emerge from the claims, the figures, and the description of the figures. The features and combinations of features mentioned above in the description, as well as the features and combinations of features shown below in the description of the figures and / or in the figures alone, can be used not only in the respective combinations specified, but also in other combinations or on their own, without departing from the scope of the invention.

[0029] The drawing shows:

[0030] Fig. 1 is a schematic representation of a motor vehicle configured for assisted or partially automated operation and automatic warning of a driver in case of excessive distraction; and

[0031] Fig. 2 is an exemplary schematic flow chart illustrating a corresponding method for monitoring driver distraction and issuing a warning.

[0032] Fig. 1 shows a partial schematic representation of a motor vehicle 1 with a driver 2. The motor vehicle 1 has, schematically indicated here, a driving system 3 for enabling at least assisted or partially automated ferry operation of the motor vehicle 1. In such ferry operation, the driver 2 must at least partially assume the driving task themselves or monitor it with at most relatively short interruptions. Accordingly, the driver 2 can be automatically warned if they are distracted from driving the motor vehicle 1 for a longer period of time. However, a conventional fixed warning time or a single fixed warning period does not always fully or appropriately take into account typical behavior of the driver 2. For example, if the driver 2 only very briefly turns to another task, for example one related to driving, a warning should not be issued immediately.If, however, Driver 2 is distracted from the driving task for an extended period of time, a warning or appropriately effective moderation should be issued. Therefore, an appropriate adjustment of the corresponding warning thresholds or warning periods to the driver's behavior is proposed here.

[0033] For this purpose, a steering wheel 4 of the motor vehicle 1 is shown here as an example, wherein several steering wheel sensors 5 are integrated into the steering wheel 4. These steering wheel sensors 5 are touch-sensitive. Thus, based on corresponding sensor signals from the steering wheel sensors 5, it can be detected whether the driver 2 has his hands 6 on the steering wheel 4 or not. The motor vehicle 1 further has a driver observation device 7. This allows the driver 2 to be observed in order to determine, for example, his direction of gaze or head position. In this case, based on corresponding sensor data from the driver observation device 7, it can be detected, for example, that the driver 2 is looking at a mobile device 8. Since the sensor data from the steering wheel sensors 5 also indicate that the driver 2's hands 6 are not on the steering wheel 4, it can be detected in such a situation that the driver 2 is distracted from driving the motor vehicle 1 and the surrounding traffic situation.

[0034] To detect and respond to this, the motor vehicle 1 is equipped with a corresponding assistance system 9. This assistance system 9 can, for example, record the sensor data from the steering wheel sensors 5 and the driver monitoring device 7 via an interface 10. To process the recorded sensor data, the assistance system 9 has a processor 11 (shown schematically here) and a computer-readable data storage device 12 coupled thereto. A computer or operating program can be stored in this data storage device 12, which is executable by the processor 11 and codes or implements a method for processing the sensor signals and for warning the driver 2 of a corresponding distraction, or corresponding control signals.

[0035] In order to be able to warn the driver 2 effectively, the motor vehicle 1 also has a corresponding output device 13 for outputting a corresponding warning 14, indicated schematically here, to the driver 2. Although the output device 13 and the warning 14 illustrate an acoustic warning of the driver 2, a visual and / or haptic warning of the driver 2 can also be represented. Fig. 2 shows an exemplary schematic flow chart 15 for such a method. In a method step S1, for example, the motor vehicle 1 is put into operation with the driving system 3, i.e., an assisted or partially automated ferry operation is started. Likewise, the assistance system 9 can be started here, for example. In this case, a driver status for the driver 2 can initially be set to "not pre-distracted."

[0036] In a method step S2, the acquisition of the sensor data from the steering wheel sensor 5 and the driver monitoring device 7 can be initiated by the assistance system 9. As indicated here by a loop-shaped arrow or path, the corresponding acquisition of the respective current sensor data can be continued continuously or even across the subsequent method steps.

[0037] In a method step S3, the current sensor data can be evaluated to determine whether driver 2 is distracted or not. If no distraction of driver 2 is detected, the method can follow a program path 16 and continue checking for distraction of driver 2 based on the next sensor data.

[0038] In this case, however, driver 2's hands 6 are not on the steering wheel 4, and driver 2's gaze is directed at the mobile device 8. Thus, a distraction of driver 2 is detected. The method then continues in a method step S4. Since the driver status is currently still "not pre-distracted," the detected distraction represents a first-time distraction of driver 2.

[0039] In method step S4, it can be checked whether a first warning period specified for initial distractions has elapsed since the onset of the detected distraction. Such a first warning period can be, for example, approximately 5 s. The first warning period can therefore be relatively long, since it can be assumed that driver 2 has a good understanding of the surrounding traffic situation without any prior distractions. With such a relatively tolerant first warning period, irritation of driver 2 can be avoided or reduced and thus acceptance of a warning signal that may be issued later, i.e., warning 14, can be promoted. If the first warning period has not yet elapsed, the method can continue to check whether driver 2 is still distracted. This is indicated here by a loop-like program path 17 that loops back to method step S3.However, if it is determined in method step S4 that the first warning period has expired, i.e. that driver 2 was distracted for the entire first warning period, the method can be continued with method steps S5 and S6.

[0040] Since driver 2 was distracted for at least the entire first warning period, the driver status can be set to "pre-distracted" in method step S5. For example, in parallel, a first warning signal can be generated in method step S6, thus issuing warning 14. This can warn driver 2 of the distraction and prompt them to refocus their attention on driving motor vehicle 1.

[0041] In a method step S7, it can then be checked, for example based on the current sensor data, whether the driver 2 is still distracted. This can be the case here, for example, if the driver 2 continues to look at the mobile device 8 and not, for example, through a windshield of the motor vehicle 1 at the surrounding traffic and / or still has his hands 6 not on the steering wheel 4. If this is the case, then, for example, the output of the first warning signal, i.e., method step S6, can be continued. For example, depending on the situation or other equipment of the motor vehicle 1, this can be continued, for example, until a predetermined termination condition is met, for example, for a predetermined warning duration or for a predetermined number of outputs of the first warning signal or the like.Thereafter, for example, the issuing of the first warning signal can be stopped or the warning signal can be intensified or escalated or the motor vehicle 1 can be automatically braked or stopped or the like.

[0042] If it is determined in method step S7 that driver 2 is no longer distracted, i.e. has turned his attention back to driving the motor vehicle 1, the output of the first warning signal can be stopped in a method step S8. For example, in parallel with this, a timer or time counter, i.e. a timer for a predetermined repetition period, can be started in a method step S9. In a method step S10, a check can then be made as to whether driver 2 is distracted again or is still paying attention to driving the motor vehicle 1. If it is determined here that driver 2 is not distracted, a check can be made in a method step S11 as to whether the repetition period has elapsed. If this is not the case, the method can run through a corresponding loop, as is schematically indicated here by a program path 18. If the program path 18 is then repeated at a later point in time until or after the end of the program path 16.If it is determined in a later run of method step S10 that driver 2 remains attentive, i.e., not distracted, and if it is then also determined in method step S11 that the repetition period has expired, the method can continue in method step S12. With a predetermined repetition period of, for example, at least 3 minutes or approximately 5 minutes or the like, driver 2 was then dedicated to the driving task for at least this time, i.e., not distracted.

[0043] Accordingly, in method step S12, the driver status can then be reset to "not pre-distracted," for example. The method can then return to an earlier point, for example, following a program path 19. Accordingly, the next distraction of driver 2 would then be detected in the next run of method step S3 and, if applicable, classified as a first-time distraction.

[0044] If, however, it is detected in method step S10 that driver 2 is distracted before the repetition period has elapsed, a timer or time counter can be started for a predetermined second warning period. This second warning period is shorter than the first warning period and can therefore be approximately 3 seconds, for example. In method step S13, a check is then made to determine whether this second warning period has already elapsed. If this is not the case, a further check can be made to determine whether driver 2 is still distracted, and then a further check can be made to determine whether the second warning period has elapsed, etc. This is schematically indicated here by a corresponding loop-shaped program path 20.

[0045] In the situation depicted here, for example, driver 2 has directed his gaze back to mobile device 8 within the second warning period. Driver 2 is thus distracted again, i.e. repeatedly, after having already been distracted before, without driver 2 being attentive to driving motor vehicle 1, i.e., not distracted, for at least the predetermined repetition period between these two consecutive distractions. Accordingly, the distraction detected in method step S10 is classified as repeated distraction of driver 2. The fact that the distraction detected here is to be classified as such repeated distraction is also evident, for example, from the fact that the driver status is still set to "pre-distracted." This can, for example, also trigger the starting of the time counter or timer for the second warning period instead of the first warning period.

[0046] If it is determined in method step S13 that driver 2 is still distracted and the second warning period has expired, a second warning signal can be generated or issued accordingly in a subsequent method step S14. This allows, for example, a more intensive and / or comprehensive warning 14 to be issued to driver 2 than upon the initial distraction.

[0047] In a method step S15, it can then be queried whether driver 2 is still distracted. Analogously to the previously described, if driver 2 continues to be repeatedly distracted, the output of the second warning signal, i.e., the corresponding warning 14, can then be continued in method step S14, for example, until the specified termination condition or another predetermined termination condition is met. This is indicated here by a corresponding program path 21.

[0048] If it is determined in method step S15 that driver 2 is no longer distracted, i.e., has returned his attention to driving the motor vehicle 1, the output of the second warning signal, i.e., the corresponding warning 14, can be terminated in a method step S16. For example, in parallel, the time counter or timer for the repetition period can be restarted in a method step S17. This allows the method to then return to method step S10, as indicated here by a corresponding loop-shaped program path 22. Thus, a further distraction detected within the repetition period then started in method step S17 would then again be detected as a repeated distraction of driver 2, since the driver status would then still be set to "pre-distracted."

[0049] In this way, the method can also be extended to more than two successively shorter warning periods. Overall, the examples described demonstrate how different or adaptive warning thresholds can be usefully and practically applied to driver attention monitoring.

[0050] List of reference symbols

[0051] 1 motor vehicle

[0052] 2 drivers

[0053] 3 Driving system

[0054] 4 steering wheel

[0055] 5 Steering wheel sensor

[0056] 6 hands

[0057] 7 Driver observation device

[0058] 8 Mobile device

[0059] 9 Assistance system

[0060] 10 Interface

[0061] 11 processor

[0062] 12 data storage

[0063] 13 Output device

[0064] 14 Warning

[0065] 15 Schedule

[0066] 16 - 22 program paths

[0067] S1 - S16 Process steps

Claims

Patent claims 1. Assistance system (9) for a motor vehicle (1) for warning a driver (2) in an assisted or partially automated ferry operation, comprising an input interface (10) for detecting sensor data that characterize a behavior of the driver (2), a data processing device (11, 12) for processing the detected sensor data and an output interface (10) for outputting a warning signal (14), wherein the assistance system (9) is designed to - to evaluate the recorded sensor data to determine whether the driver (2) is distracted from driving the motor vehicle (1), - upon detection of a first-time distraction of the driver (2), to issue a warning signal (14) if the first-time distraction of the driver (2) continues for at least a first warning period, - upon detection of repeated distraction of the driver (2) during the same journey and within a predetermined repetition period since the last detected distraction, to issue a warning signal (14) if the repeated distraction of the driver (2) continues for at least a second warning period, wherein the second warning period is shorter than the first warning period.

2. Assistance system (9) according to claim 1, characterized in that the assistance system (9) is designed to detect the first-time distraction and / or the repeated distraction of the driver (2) when, for the respective warning period, the hands of the driver (2) are not on the steering wheel (4) of the motor vehicle (1) and / or the driver's (2) gaze is averted from the surrounding traffic.

3. Assistance system (9) according to one of the preceding claims, characterized in that the first warning period and the second warning period are fixed, in particular in the range from 4 s to 6 s, preferably 5 s, for the first warning period and in the range of 2.5 s to 4 s, in particular 3 s, for the second warning period.

4. Assistance system (9) according to one of the preceding claims, characterized in that the repetition time period is predetermined in the range from 3 min to 10 min, in particular 5 min.

5. Assistance system (9) according to one of the preceding claims, characterized in that the assistance system (9) is configured to detect the next distraction of the driver (2) as a first-time distraction whenever at least the predetermined repetition time period has elapsed since the last detected distraction of the driver (2) without a detected repeated distraction of the driver (2).

6. Assistance system (9) according to one of the preceding claims, characterized in that the assistance system (9) is set up to issue a different warning signal (14) for more intensive warning of the driver (2) upon expiry of the second warning period after the detection of the repeated distraction of the driver (2) than upon expiry of the first warning period after the detection of the first distraction of the driver (2).

7. Assistance system (9) according to claim 6, characterized in that the assistance system (9) is set up to cause, by means of the warning signal (14) emitted after the second warning period, a warning (14) with a higher volume and / or with a higher brightness and / or with a different color and / or with an increased frequency and / or by means of a different, in particular additional, output modality compared to the warning (14) caused by the warning signal (14) emitted after the first warning period.

8. Assistance system (9) according to one of the preceding claims, characterized in that the assistance system (9) is designed to automatically detect a ferry operation of the motor vehicle (1) and - upon detection of at least partially automated ferry operation, to automatically interrupt its operation to issue the warning signal (14), - to automatically start its operation to issue the warning signal (14) upon detection of assisted or partially automated ferry operation.

9. Method (15) for warning a driver (2) of a motor vehicle (1) during an assisted or partially automated journey of the motor vehicle (1), wherein automatically - sensor data are recorded that characterise the behaviour of the driver (2), - the sensor data are evaluated to detect distractions of the driver (2) from driving the motor vehicle (1), - upon detection of a first distraction of the driver (2), a warning signal (14) is only issued if the driver (2) has not returned his attention to driving the motor vehicle (1) within a first warning period, - a repeated distraction is detected if the driver (2) is again distracted from driving the motor vehicle (1) within a predetermined repetition time period after a detected distraction, and then a warning signal (14) is issued after a second warning time period which is shorter than the first warning time period.

10. Motor vehicle (1), comprising a system (3) for assisted and / or partially automated vehicle guidance and a sensor system (5, 7) for recording sensor data that characterizes a behavior of the driver (2), wherein the motor vehicle (1) is equipped with an assistance system (9) according to one of claims 1 to 8 and / or is configured to carry out a method (15) according to claim 9.

Images