CONTROL DEVICE AND METHOD FOR CONTROLLING THE OPERATION OF A MOTOR VEHICLE
Patent Information
- Authority / Receiving Office
- DE · DE
- Patent Type
- Patents
- Current Assignee / Owner
- BAYERISCHE MOTOREN WERKE AG
- Filing Date
- 2024-12-04
- Publication Date
- 2026-04-23
AI Technical Summary
Existing driver assistance systems do not adequately account for a driver's state of attention, leading to reduced driving comfort and increased risk of unintentional braking due to lack of dynamic adjustment of speed control based on driver distraction.
A control device that determines a driver's gaze behavior and degree of distraction using sensor data to adjust compensation values and limits of automatic cruise control and speed limiter systems, dynamically adjusting speed control based on the driver's attention level.
Enhances driving comfort and safety by accurately adjusting speed control to the driver's attention level, reducing unintentional braking and improving traffic flow.
Description
[0001] The present disclosure relates to a control device for controlling the operation of a motor vehicle, a motor vehicle with the control device, and / or a method for controlling the operation of a motor vehicle. Additionally, or alternatively, a computer program is provided which includes instructions that, when executed by a computer, cause the computer to execute the method, at least partially. Additionally, or alternatively, a computer-readable medium is provided which includes instructions that, when executed by a computer, cause the computer to execute the method, at least partially.
[0002] Modern motor vehicles, especially automobiles, are increasingly being equipped with driver assistance systems.
[0003] Advanced Driver Assistance Systems (ADAS) are electronic, especially mechatronic, devices in motor vehicles designed to support the driver in certain driving situations. Safety aspects are often a primary focus, but increasing driving comfort is also a key consideration.
[0004] There are driver assistance systems designed to automatically control the longitudinal and / or lateral guidance of a motor vehicle.
[0005] For example, an automatic speed control system can automate the longitudinal control of the vehicle by automatically maintaining a predefined target speed. This can occur, for instance, as part of an automated driving function with or without an additional distance control function. For example, a combined distance and speed control function can be implemented within the framework of adaptive cruise control (ACC). Alternatively, a speed control function without distance control can be implemented, which is often referred to as cruise control (in BMW vehicles as Dynamic Cruise Control - DCC).
[0006] An automatic cruise control system (e.g., ACC or DCC) can, for example, include a function for automatically adjusting the vehicle's speed to changing speed limits. For instance, an automatic cruise control system might limit the vehicle's speed to 100 km / h if the speed limit is 100 km / h. When the speed limit is lifted, the automatic cruise control system can automatically accelerate the vehicle until it reaches a preset target speed, such as 130 km / h.
[0007] Furthermore, the automatic cruise control can incorporate a speed compensation value into its speed control. For example, if the speed compensation value is set to 7 km / h, the automatic cruise control can accelerate the vehicle to 137 km / h if there is no speed limit and the preset target speed is 130 km / h.
[0008] Driver assistance systems can also incorporate information about the driver's condition, such as the driver's level of attention, for the automated control of the vehicle.
[0009] Driver assistance systems that incorporate a driver's attentional state for automated vehicle control are known from the prior art. US Patent 2023 / 0192097 A1 describes a vehicle control device that performs acceleration suppression control to prevent a vehicle from accelerating if a distracted state, detected based on an image of the driver's seat, persists for a predetermined initial period. The distracted state is a condition in which the driver's attention to driving is impaired. The vehicle control device performs deceleration control to slow the vehicle down and bring it to a stop if the distracted state persists for a predetermined second period, which is longer than the first.US 2022135079 A1 describes a travel control system that recognizes driver actions based on image data, checks whether autonomous driving is permissible, and, if uncertain, requests a decision from the driver. The driver signals their intention by looking at marked objects; the system then initiates autonomous or slow driving, with safety ensured by HUD prompts and speed limits.
[0010] However, such well-known driver assistance systems do not define the driver's state of attention. Furthermore, these systems only describe a braking procedure that slows the vehicle if the driver is distracted. This can lead to reduced driving comfort and an increased risk of unintentional braking.
[0011] Against the background of this prior art, the purpose of the present disclosure is to specify a device and / or a method, each of which is suitable to enrich the prior art.
[0012] The problem is solved by the features of the independent claims. The dependent and subordinate claims each contain optional further developments of the disclosure.
[0013] The task is then solved by a control device for controlling the operation of a motor vehicle. The control device is designed to receive sensor data concerning the driver of the motor vehicle, to determine the driver's gaze behavior based on this sensor data, and to determine the driver's degree of distraction based on this determined gaze behavior. The control device is designed to adjust a compensation value and / or a compensation limit value of an automatic cruise control system and / or a speed limiter of the motor vehicle depending on the determined degree of distraction.
[0014] The control device can be part of the driver assistance system or represent the system itself. The control device can, for example, be an electronic control unit (ECU). The electronic control unit can be an intelligent, processor-controlled unit that can communicate with other modules via a central gateway (CGW) and may form the vehicle's electrical network via fieldbuses such as CAN bus, LIN bus, MOST bus, FlexRay, and / or Automotive Ethernet, for example, together with telematics control units and / or environmental sensors.
[0015] It is conceivable that the control unit manages functions relevant to the vehicle's driving behavior, such as steering, engine control, power transmission, and / or the braking system. Furthermore, driver assistance systems, such as a parking assistant, adaptive cruise control (ACC), a speed limiter, lane keeping assist, lane change assist, traffic sign recognition, light signal recognition, hill start assist, night vision assist, and / or intersection assist, can be controlled by the control unit.
[0016] The control device can be designed to determine the driver's level of distraction based on sensor data. The sensor data can represent a state of the driver.
[0017] The driver's state of mind may include a state of attentiveness. In this state of attentiveness, the driver may be looking in the direction of travel of the vehicle and / or through or at the windshield of the vehicle.
[0018] The driver's condition may include a state of distraction. In this state of distraction, the driver may be looking in a direction other than the direction of travel. For example, the driver may be looking in a rearview mirror and / or towards the vehicle's infotainment system. For example, the driver may not be looking through or at the windshield in this state of distraction.
[0019] The sensor data can include the duration of the driver's distraction state. The sensor data can include the duration of more than one driver distraction state.
[0020] The sensor data can include a number of driver distraction states, for example, a number of driver distraction states within a previously determined time interval.
[0021] The control device can be designed to determine the driver's gaze behavior based on sensor data, whereby the driver's gaze behavior can include the duration of a driver distraction state and / or durations of more than one driver distraction state and / or the number of driver distraction states within the previously determined time interval.
[0022] The control device can be data-connected to a detection unit for detecting the driver's state. The detection unit can be designed to acquire sensor data. For example, the detection unit can be designed to detect the driver's state based on the sensor data and optionally store it in the sensor data. For example, the detection unit can determine the detected durations and the number of detected driver distraction states. For example, the control device can communicate with the detection unit and receive the sensor data from it. It is conceivable that the control device receives the sensor data via a signal originating from the detection unit. The detection unit can be at least partially part of the control device, i.e.,...An external part of the detection unit, separate from the control device, can be designed to acquire the sensor data, and another part of the detection unit, which is also part of the control device, can be designed to determine the degree of deflection based on the sensor data.
[0023] The control device can be connected to the detection unit, optionally to the external part thereof, via a cable.
[0024] The detection unit can be, or include, a vehicle interior camera. The vehicle interior camera can be designed to capture sensor data relating to the driver and, optionally, to determine the driver's state and, optionally, their level of distraction. For example, the vehicle interior camera can be designed to detect whether the driver is looking in the direction of travel or not. In other words, the vehicle interior camera can be designed to detect a state of distraction and / or a state of attention of the driver.
[0025] The vehicle interior camera can be part of a driver monitoring system (DMS) or represent it.
[0026] The control device can be designed to control the operation of the automatic speed control.
[0027] Adaptive cruise control (e.g., as part of ACC, DCC, or a speed limiter) can automatically adjust a vehicle's speed to changing speed limits. For example, ACC or DCC can limit the vehicle's speed to a permitted maximum speed, regardless of a preset target speed. When the speed limit is lifted, the adaptive cruise control can automatically accelerate the vehicle back up to the preset target speed. For example, the preset target speed might be 130 km / h. The adaptive cruise control can also limit the vehicle's speed to a current permitted maximum speed, such as 100 km / h.When there is no longer a speed limit, the automatic cruise control can automatically accelerate the vehicle again until the preset target speed of 130 km / h is reached.
[0028] Automatic speed control can be part of a more comprehensive automated driving function, which not only performs longitudinal control, but also, for example, lateral control.
[0029] Alternatively or in addition to setting a compensation value and / or a compensation limit value of an automatic speed control system depending on the determined degree of distraction, it may be provided that a (possibly different) compensation value and / or a (possibly different) compensation limit value of a speed limiter is set depending on the determined degree of distraction.
[0030] A speed limiter (often also referred to simply as a limiter) automatically restricts a vehicle's speed to a pre-set maximum value, even if pressing the accelerator pedal would otherwise (i.e., with the limiter inactive) request a higher speed. Such a speed limiting system with a so-called "limiter" function is known, for example, as "SLD" (Speed Limit Device) in BMW vehicles.
[0031] Analogous to what was described above with regard to automatic speed control, the maximum speed value of a speed limiter can also be automatically set to a given permissible maximum speed (e.g., based on map data and / or camera-based traffic sign recognition). Here, too, an adjustable compensation value and, according to some embodiments, a compensation limit value that restricts the adjustability of the compensation value can be provided.
[0032] The control device can be data-linked to a vehicle's speed detection device for recording the permissible maximum speed. For example, the control device can communicate with the detection device and receive the permissible maximum speed.
[0033] The control device can be designed to use the permissible maximum speed when controlling the operation of the automatic cruise control and / or the speed limiter.
[0034] It is conceivable that the control device receives the permitted maximum speed via a signal from the detection device. The detection device can include an external camera or be designed as an external camera. Optical traffic sign recognition can be implemented using the external camera to detect the permitted maximum speed. Alternatively or additionally, the permitted maximum speed can be provided based on a digital map, depending on the vehicle's current position, which can be determined, for example, by a global satellite navigation system.
[0035] The automatic cruise control can incorporate a compensation value into the vehicle's speed control. For example, the automatic cruise control can increase the vehicle's preset target speed by the compensation value. The automatic cruise control can adjust the vehicle's speed so that the permissible maximum speed is exceeded by the compensation value. For example, if the compensation value is set to 7 km / h, the automatic cruise control can accelerate the vehicle to 137 km / h if there is no speed limit and the preset target speed is 130 km / h.
[0036] In general, the compensation value can be understood as an offset – especially a positive one – to a target speed of an automatic speed control, which would be automatically set by a function for adapting to speed limits in the absence of the compensation value.
[0037] Alternatively or additionally, the compensation value can be an offset – especially a positive one – to a maximum speed value of a speed limiter, which would be automatically set by a function for adapting to speed limits in the absence of the compensation value.
[0038] For example, the offset can be added to a specific maximum speed limit detected via a recognized traffic sign to obtain an adjusted target speed for use in automatic cruise control or an adjusted maximum speed value for use in the speed limiter. It is also possible that, in the absence of detected explicit speed limits, the speed limit adjustment function assumes a preset target speed, such as 130 km / h on a German Autobahn, and that the adjustment value is added to this preset target speed in such a case.
[0039] The compensation value can be a speed value. The compensation value can be adjustable. For example, the compensation value can be set by the driver before, after, and / or during a journey.
[0040] The compensation limit can be a speed limit. For example, the compensation limit can be the upper limit of the compensation value. It's conceivable that the compensation value cannot exceed the compensation limit. In other words, it's conceivable that the compensation value can only be adjusted up to the compensation limit. For example, if the compensation limit is 5 km / h, then the compensation value can only be adjusted up to a value of 5 km / h.
[0041] The compensation limit can be adjustable, for example by the control device. The compensation limit can be set to a previously determined value, for example to a value greater than or equal to 3 km / h, or greater than or equal to 5 km / h, or greater than or equal to 7 km / h, or greater than or equal to 10 km / h, or greater than or equal to 12 km / h.
[0042] It may be stipulated that the compensation limit value is not adjustable or changeable by the driver.
[0043] The control device can be designed to adjust the compensation limit depending on the degree of deflection, so that the compensation limit is reduced from a current compensation limit, and / or increased, and / or set to a previously determined value.
[0044] The control device can be designed to adjust the compensation value depending on the compensation limit value, so that the compensation value is less than or equal to the compensation limit value.
[0045] For example, if the compensation limit is reduced from a current compensation limit of 7 km / h to a value of 5 km / h by the control device, but the compensation value set by the driver is 7 km / h, then the compensation value will be limited to a value of 5 km / h by the control device.
[0046] In accordance with the above, a change in the compensation threshold can therefore automatically result in a change in the compensation value. For example, if a driver is identified as acutely distracted during a journey with a compensation value corresponding to a currently applicable compensation threshold, the compensation threshold and thus also the compensation value can be reduced.
[0047] Alternatively or additionally, it can be provided that the compensation threshold is recognized based on detected driver distraction behavior over a longer period during a trip or even over several trips and stored accordingly (e.g., as part of a driver profile). For example, it can be provided that a driver who has repeatedly shown inattentiveness over a number of trips can only set lower compensation thresholds for subsequent trips (or later in one of the trips) and / or that one or more already set compensation thresholds are automatically reduced to the compensation threshold.
[0048] The device described above offers a number of advantages. Among other things, the compensation threshold can be dynamically adjusted to the driver's condition. For example, the permissible compensation threshold can be reduced if the driver is highly distracted.
[0049] Furthermore, for example, if the driver's level of distraction is low, the permissible compensation limit can be increased. This can have a positive effect on driving comfort and traffic flow.
[0050] The control device may include a detection unit for determining the driver's level of distraction. For example, the control device and / or the detection unit may determine the driver's level of distraction from sensor data. Specifically, the control device and / or the detection unit may communicate with the detection unit and receive the sensor data, determine the driver's gaze pattern based on the sensor data, and then determine the driver's level of distraction based on this gaze pattern. It is conceivable that the control device and / or the detection unit receives the sensor data via a signal emanating from the detection unit.
[0051] The control device may include a memory unit for storing one or more limit values for the degree of distraction. The limit value(s) can be written to the memory unit during the manufacture of the motor vehicle.
[0052] The control device may include a readout unit for reading the limit value(s) of the degree of distraction. For example, the control device and / or the readout unit may be configured to read the limit value(s) of the degree of distraction from the storage unit.
[0053] The control device may include a comparison unit for comparing the driver's level of distraction with the limit value of the level of distraction and / or with the limits of the level of distraction.
[0054] The control device and / or the comparison unit may be configured to compare the distraction level limit(s) with the driver's distraction level, for example, with the driver's distraction level determined by the control device and / or the detection unit. The control device and / or the comparison unit may be configured to store a comparison result, for example, in the control device's storage unit.
[0055] The control device can be designed to adjust the compensation value and / or the compensation limit value depending on the comparison result.
[0056] Possible further developments of the device described above are explained in detail below.
[0057] The control device can be designed to determine the degree of driver distraction as a function of a short-term value, wherein the short-term value represents a sum of the durations of short-term distraction states within a previously determined first time interval, the respective durations of which are less than a previously determined short-term distraction limit.
[0058] A control device designed in this way offers the advantage that even brief lapses in attention by the driver are taken into account when determining the degree of distraction, so that the control device can determine the degree of distraction more accurately.
[0059] The driver's short-term state of distraction can be a state of distraction for the driver.
[0060] The short-term distraction limit can be less than or equal to 3 seconds, or less than or equal to 2 seconds, or less than or equal to 1 second, or less than or equal to 0.5 seconds, or less than or equal to 0.1 seconds.
[0061] The short-term distraction limit can be stored in the memory unit. The short-term distraction limit can be written to the memory unit during the vehicle's manufacturing process. The short-term distraction limit can be fixed. For example, a driver cannot change the short-term distraction limit.
[0062] The total duration can include the sum of the durations of the driver's short-term distraction states, for example during the first time interval.
[0063] The first time interval can be 30 seconds. The first time interval can be less than or equal to 60 seconds, or less than or equal to 45 seconds, or less than or equal to 25 seconds, or less than or equal to 20 seconds, or less than or equal to 15 seconds.
[0064] The control device and / or the detection unit can be designed to determine the short-term value, for example based on the sensor data.
[0065] For example, if the first time interval is 30 seconds and the detection unit has detected two short-term distraction states of the driver of 2 seconds each and three short-term distraction states of the driver of 0.5 seconds each within this first time interval, the short-term value determined by the control device and / or the detection unit is 5.5 seconds.
[0066] The control device may be designed to issue an acoustic and / or visual warning signal to the driver, for example by means of a loudspeaker and / or a vehicle display, when the short-term value exceeds a first short-term limit value.
[0067] The first short-term limit is a previously determined short-term value. The first short-term limit can be greater than or equal to 5 seconds, or greater than or equal to 10 seconds, or greater than or equal to 15 seconds.
[0068] The control device can be designed to determine the degree of driver distraction as a function of a long-term value, wherein the long-term value indicates a duration of a long-term distraction state of the driver, the duration of which is greater than a previously determined long-term distraction limit.
[0069] The long-term distraction state of the driver can be a distraction state of the driver.
[0070] The long-term distraction limit can be greater than or equal to 3 seconds, or greater than or equal to 4 seconds, or greater than or equal to 5 seconds.
[0071] The long-term distraction limit can be stored in the memory unit. The long-term distraction limit can be written into the memory unit during the vehicle's manufacturing process. The long-term distraction limit can be fixed. For example, it may be stipulated that a driver cannot change the long-term distraction limit.
[0072] The control device and / or the detection unit can be designed to determine the long-term value, for example based on the sensor data.
[0073] For example, if the detection unit has detected a long-term distraction state of the driver of 4 seconds, the long-term value determined by the control device and / or the detection unit is 4 seconds.
[0074] The control device can be designed to determine the degree of driver distraction as a function of a long-term maximum value, wherein the long-term maximum value indicates the duration of the driver's long-term distraction state with the highest duration within a previously determined third time interval, wherein the duration of the long-term maximum value is greater than the previously determined long-term distraction limit value.
[0075] The third time interval can be 60 minutes. The third time interval can be less than 60 minutes, or less than or equal to 45 minutes, or less than or equal to 30 minutes, or less than or equal to 15 minutes, or less than or equal to 5 minutes.
[0076] The third time interval can be the same as the first time interval.
[0077] For example, if the detection unit has detected a long-term distraction state of the driver of 4 seconds and a long-term distraction state of 6 seconds within the third time interval, the maximum long-term value determined by the control device and / or the detection unit is 6 seconds.
[0078] The control device may be designed to issue an acoustic and / or visual warning signal to the driver, for example by means of a loudspeaker and / or a vehicle display, when the long-term value and / or the long-term maximum value exceeds a first long-term limit value.
[0079] The first long-term limit is a previously determined value of the long-term value and / or the long-term maximum value. The first long-term limit can be greater than or equal to 3 seconds, or greater than or equal to 4 seconds, or greater than or equal to 5 seconds.
[0080] The control device can be designed to determine the degree of driver distraction depending on a distraction frequency, where the distraction frequency specifies a number of short-term and / or long-term values within a previously determined second time interval.
[0081] In other words, the distraction frequency can indicate the number of short-term and / or long-term values determined within the second time interval.
[0082] A control device designed in this way offers the advantage that, in addition to the duration of distractions, the frequency of driver inattention is also taken into account to determine the degree of distraction, so that the control device can determine the degree of distraction even more accurately.
[0083] The distraction frequency can include the number of short-term values within the second time interval, including only those short-term values greater than or equal to the first short-term limit.
[0084] The distraction frequency can include the number of long-term values within the second time interval, including only those long-term values greater than or equal to the first long-term limit.
[0085] The second time interval can be 60 minutes. The second time interval can be less than 60 minutes, or less than or equal to 45 minutes, or less than or equal to 30 minutes, or less than or equal to 15 minutes, or less than or equal to 5 minutes.
[0086] The second time interval can be the same as the first time interval and / or the third time interval.
[0087] The control device and / or the detection unit can be designed to determine the frequency of distractions, for example based on sensor data.
[0088] For example, if the second time interval is 60 minutes and the control device and / or the detection unit has / have detected two short-term values above the first short-term limit and three long-term values above the first long-term limit within this second time interval, the distraction frequency detected by the control device and / or the detection unit has a value of 5.
[0089] The control device may be designed to issue an acoustic and / or visual warning signal to the driver, for example by means of a loudspeaker and / or a vehicle display, when the frequency of distraction exceeds a first frequency threshold.
[0090] The first frequency threshold is a previously determined value for the distraction frequency. The first frequency threshold can be greater than or equal to 4, or greater than or equal to 6, or greater than or equal to 8.
[0091] The driver's level of distraction can be a single value. The driver's level of distraction can be a pair of values and / or a triple of values. The driver's level of distraction can be a vector with one dimension of two or more, or three or more.
[0092] The driver's level of distraction can include the short-term value and / or the long-term value and / or the frequency of distraction.
[0093] The control device can be designed to adjust the compensation limit value depending on the determined degree of distraction such that the compensation value and / or the compensation limit value is reduced from a current compensation (limit) value when the degree of distraction exceeds a previously determined first (second) upper limit value, or to adjust the compensation value and / or the compensation limit value depending on the determined degree of distraction such that the compensation (limit) value is set to a previously determined first value when the degree of distraction exceeds the previously determined first (second) upper limit value.
[0094] The terms "first" and "second" upper limit are introduced here solely to denote two potentially different upper limits (one for the compensation value and another for the compensation limit). The first and second upper limits can also be identical. Furthermore, it is not necessary to define both limits. For example, in an embodiment that does not require a compensation limit and where the adjustment, depending on the determined degree of deflection, is directly related to the compensation value, a second upper limit need not be defined at all.
[0095] The respective (first and / or second) upper limit value can be stored in the memory unit. The upper limit value can be written to the memory unit during the vehicle's manufacturing process. The upper limit value can be fixed. For example, it may be stipulated that a driver cannot change the upper limit value.
[0096] The respective (first and / or second) upper limit can be a single value. The upper limit can be a pair of values and / or a triple of values. The upper limit can be a vector with one dimension of two or more, or three or more.
[0097] The respective (first and / or second) upper limit may include the first short-term limit and / or the first long-term limit and / or the first frequency limit.
[0098] For example, the compensation limit can be reduced from a current compensation limit of 12 km / h to 10 km / h and / or to 7 km / h and / or to 5 km / h and / or to 2 km / h and / or to 0 km / h if the degree of distraction exceeds the previously determined second upper limit.
[0099] For example, the compensation limit can be set from a current compensation limit of 0 km / h to the previously determined first value if the degree of distraction exceeds the previously determined second upper limit.
[0100] The first value can be stored in the memory unit. The first value of the compensation limit can be written to the memory unit during the vehicle's manufacture. The first value can be fixed. For example, it may be stipulated that a driver cannot change the first value of the compensation limit. The first value can be 0 km / h.
[0101] The control device can be designed to adjust the compensation limit depending on the degree of distraction such that the compensation limit is reduced when the degree of distraction exceeds the first short-term limit and / or the first long-term limit and / or the first frequency limit, or to adjust the compensation limit depending on the degree of distraction such that the compensation limit is set to the previously determined first value when the degree of distraction exceeds the first short-term limit and / or the first long-term limit and / or the first frequency limit.
[0102] The control device can be designed to adjust the compensation limit value depending on the determined degree of distraction, such that the compensation limit value is increased from a current compensation limit value when the degree of distraction falls below a previously determined lower limit value, or to adjust the compensation limit value depending on the determined degree of distraction, such that the compensation limit value is set to a previously determined second value when the degree of distraction falls below the previously determined lower limit value.
[0103] Such a control device offers the advantage that driving comfort can be increased by raising the compensation threshold. At the same time, raising the compensation threshold can have a positive effect on traffic flow.
[0104] The lower limit value can be stored in the memory unit. The lower limit value can be written to the memory unit during the vehicle's manufacturing process. The lower limit value can be fixed. For example, a driver cannot change the lower limit value.
[0105] The lower limit can be a single value. The lower limit can be a pair of values and / or a triple of values. The lower limit can be a vector with one dimension of two or more, or three or more.
[0106] The lower limit may include a second short-term limit and / or a second long-term limit and / or a second frequency limit.
[0107] The second short-term limit is a previously determined value of the short-term limit. The second short-term limit can be less than or equal to 10 seconds, or less than or equal to 8 seconds, or less than or equal to 5 seconds.
[0108] The second long-term limit is a previously determined long-term value. The second long-term limit can be less than or equal to 3 seconds, less than or equal to 2 seconds, or less than or equal to 1 second.
[0109] The second frequency threshold is a previously determined value for the distraction frequency. The second frequency threshold can be less than or equal to 6, or less than or equal to 4, or less than or equal to 2.
[0110] The first short-term limit value can be the same as the second short-term limit value. The first long-term limit value can be the same as the second long-term limit value. The first frequency limit value can be the same as the second frequency limit value. The upper limit value can be the same as the lower limit value.
[0111] For example, the compensation threshold can be increased from a current compensation threshold of 0 km / h to 2 km / h and / or to 5 km / h and / or to 7 km / h and / or to 10 km / h and / or to 12 km / h if the degree of distraction falls below the previously determined lower threshold.
[0112] For example, the compensation limit can be set from a current compensation limit of 7 km / h to the previously determined second value if the degree of distraction falls below the previously determined lower limit.
[0113] The second value can be stored in the memory unit. The second value can be written to the memory unit during the vehicle's manufacturing process. The second value can be fixed. For example, a driver cannot change the second value. The second value can be 7 km / h.
[0114] The control device can be configured to adjust the compensation limit depending on the degree of distraction such that the compensation limit is increased when the degree of distraction falls below the second short-term limit and / or the second long-term limit and / or the second frequency limit. The control device can also be configured to adjust the compensation limit depending on the degree of distraction such that the compensation limit is set to the previously determined second value when the degree of distraction falls below the second short-term limit and / or the second long-term limit and / or the second frequency limit.
[0115] The above can be summarized in other words and in a possible more concrete form as described below, whereby the following description is not to be interpreted restrictively.
[0116] The compensation limit can also be referred to as the offset.
[0117] It is conceivable that an interior camera and an algorithm could be used to detect driver distraction. New vehicles in the future could be equipped with driver monitoring systems (DMS). These DMS can use an interior camera to detect the driver's gaze patterns and calculate their level of attention or distraction. If the driver is distracted from driving (for example, by performing a secondary task on the infotainment system (IVIS)), a visual and audible warning can be displayed, indicating the driver's distraction. Consumer protection organizations (Euro NCAP) have already proposed a specific algorithm for triggering these warnings. According to this proposal, the algorithm can be triggered after three seconds of distraction, as well as after a cumulative 10 seconds of distraction within the last 30 seconds. This latter type of distraction is also known as visual attention time sharing (VATS).Furthermore, consumer protection regulations have defined which elements count as distractions. These can include not only displays installed in the vehicle but also the rearview mirrors, meaning that any glances not directed through the windshield can be considered distractions.
[0118] Therefore, if the VATS total is currently high, for example 8 seconds, and there have been a comparatively large number of visual-acoustic warnings within a certain past time unit, for example five warnings in the last hour, then only an offset of 2 km / h can be allowed, whereas with a consistently low VATS total, for example on average not exceeding 4 seconds, and few visual-acoustic warnings in the past time unit, for example only one warning in the last hour, the entire possible offset can be allowed.
[0119] Furthermore, a motor vehicle equipped with the control unit or control device described above will be provided.
[0120] The motor vehicle can be a passenger car, in particular an automobile, or a commercial vehicle, such as a truck.
[0121] The motor vehicle may be automated. The motor vehicle may be designed to take over longitudinal and / or lateral control, at least partially and / or at least temporarily, by means of the control device during automated driving.
[0122] Automated driving can be implemented in such a way that the vehicle's movement is (largely) autonomous. Automated driving can also be controlled at least partially and / or temporarily by the control device.
[0123] It is conceivable that the vehicle actively intervenes in the lateral guidance of the vehicle through a driver assistance system, e.g. by adjusting the actual steering wheel position, and optionally passively, e.g. by displaying a turning instruction.
[0124] The motor vehicle may be a Level 1 autonomous vehicle, i.e., it may have certain driver assistance systems that support the driver in operating the vehicle, such as adaptive cruise control (ACC).
[0125] The motor vehicle can be a Level 2 autonomous vehicle, i.e., so semi-automated that functions such as automatic parking, lane keeping or lateral guidance, general longitudinal guidance, acceleration and / or braking are taken over by driver assistance systems.
[0126] The vehicle can be a Level 3 autonomous vehicle, meaning it is so conditionally automated that the driver does not need to continuously monitor the vehicle system. The vehicle independently performs functions such as activating the turn signals, changing lanes, and / or maintaining lane position. The driver can attend to other tasks but will be prompted by the system to take over driving duties within a reasonable warning period if necessary.
[0127] The vehicle can be a Level 4 autonomous vehicle, meaning it can be so highly automated that the vehicle's control system is permanently responsible for driving. If the system can no longer handle the driving tasks, the driver may be prompted to take over.
[0128] The vehicle can be a Level 5 autonomous vehicle, meaning it is so fully automated that a driver is not required to perform the driving task. No human intervention is necessary except for setting the destination and starting the system. The vehicle can operate without a steering wheel and pedals.
[0129] The above description with reference to the control device also applies analogously to the motor vehicle and vice versa.
[0130] Furthermore, a method for controlling the operation of a motor vehicle is provided, comprising: acquiring sensor data concerning a driver of the motor vehicle, determining the driver's gaze behavior based on the sensor data, and determining the driver's degree of distraction based on the determined gaze behavior. The method further comprises: setting a compensation value and / or a compensation limit value of an automatic cruise control system and / or a speed limiter of the motor vehicle depending on the determined degree of distraction.
[0131] The control procedure can be a computer-implemented procedure, i.e., one, several or all steps of the procedure can be performed at least partially by a computer or a data processing device, optionally the control device.
[0132] What has been described above with reference to the control device and the motor vehicle also applies analogously to the procedure and vice versa.
[0133] The procedure may also include: detecting the driver's condition and / or conditions.
[0134] The procedure may further include: storing the detected state of the driver and / or the detected states of the driver in the sensor data, for example storing the detected durations of the driver's distraction states and the detected number of driver distraction states in the sensor data.
[0135] The procedure may also include: reading the limit value of the degree of distraction or the limit values of the degree of distraction, for example from the storage unit.
[0136] The procedure may also include: comparing the driver's level of distraction with the limit value of the level of distraction and / or with the limit values of the level of distraction.
[0137] The procedure may further include: storing the comparison result from comparing the driver's level of distraction with the limit value of the level of distraction and / or with the limit values of the level of distraction, for example in the storage unit of the control device.
[0138] Furthermore, a computer program comprising commands that, when executed by a computer, cause it to at least partially execute the procedure described above is provided.
[0139] The program code of a computer program can be in any type of code, especially code suitable for controlling motor vehicles.
[0140] What has been described above with reference to the control device, the motor vehicle and the procedure also applies analogously to the computer program and vice versa.
[0141] Furthermore, a computer-readable medium, in particular a computer-readable storage medium, is provided. The computer-readable medium comprises instructions which, when executed by a computer, cause it to at least partially execute the procedure described above.
[0142] This means that a computer-readable medium can be provided that contains a computer program as defined above. The computer-readable medium can be any digital data storage device, such as a USB flash drive, a hard drive, a CD-ROM, an SD card, or an SSD card (or SSD drive / SSD hard drive).
[0143] The computer program does not necessarily have to be stored on such a computer-readable storage medium in order to be made available to the motor vehicle, but can also be obtained via the Internet or other external sources.
[0144] The above description relating to the procedure, the control device, the computer program and the motor vehicle also applies analogously to the computer-readable medium and vice versa.
[0145] The following is an optional embodiment with reference to Figures 1 and 2 described. Fig. 1 schematically shows a motor vehicle with a control device for controlling the operation of a motor vehicle according to the optional embodiment, and Fig. 2 schematically shows a flowchart of a method for controlling the operation of a motor vehicle according to the optional embodiment.
[0146] The in Figure 1The motor vehicle 10, shown only schematically, has a control device 20, a detection unit 30 arranged in a motor vehicle interior 11 of the motor vehicle 10, and a recording device 40 arranged on the motor vehicle 10. The control device 20 is data-connected to the detection unit 30 and the recording device 40.
[0147] The control device 20 has a detection unit 21 for determining the degree of distraction of the driver, a storage unit 22 for storing one or more limit values of the degree of distraction, a readout unit 23 for reading the limit value of the degree of distraction or the limit values of the degree of distraction and a comparison unit 24 for comparing the degree of distraction of the driver with the limit value of the degree of distraction and / or with the limit values of the degree of distraction.
[0148] The control device 20 is designed to perform the following, also with reference to Figure 2to execute the procedures described in detail.
[0149] The in Figure 2 The process, depicted as a flowchart, comprises seven process steps. In a first process step S1, the detection unit 30, located in the interior of the vehicle 11, detects the states of the driver of the vehicle 10 and stores the detected states of the driver in the sensor data relating to the driver of the vehicle 10.
[0150] In a second process step S2, the control device 20 receives the sensor data concerning the driver of the motor vehicle by means of a signal emanating from the detection unit 30 to the investigation unit 21 of the control device 20.
[0151] In a third process step S3, the control device 20 uses the detection unit 21 to determine the driver's gaze behavior based on the received sensor data.
[0152] In a fourth process step S4, the control device 20, together with the detection unit 21, determines the driver's degree of distraction based on the driver's measured gaze behavior. The degree of distraction comprises a short-term value, a long-term value, and a distraction frequency. To this end, the detection unit 21 determines the short-term value from the sum of the durations of short-term distractions of the driver within a first time interval, as contained in the sensor data. Furthermore, the detection unit 21 determines the long-term value from the long-term distractions within a third time interval, as contained in the sensor data.Finally, the investigation unit 21 determines the distraction frequency from the number of short-term and long-term values contained in the sensor data within a second time interval, taking into account only short-term values greater than or equal to a first short-term limit value and only long-term values greater than or equal to a first long-term limit value.
[0153] In a fifth process step S5, the control device 20 reads the deflection degree limit values stored in the storage unit 22 using the readout unit 23. In this case, an upper limit and a lower limit are stored in the storage unit 22. The upper limit comprises the first short-term limit, the first long-term limit, and a first frequency limit. The lower limit comprises a second short-term limit, a second long-term limit, and a second frequency limit.
[0154] In a sixth process step S6, the control device 20, using the comparison unit 24, compares the driver's distraction level, determined from the driver's gaze behavior, with the upper and lower limits of the distraction level. To do this, the control device 20, using the comparison unit 24, compares the determined short-term distraction level with the first short-term limit, the determined long-term distraction level with the first long-term limit, and the determined distraction frequency with the first frequency limit. The determined distraction level exceeds the upper limit if the long-term value exceeds the first long-term limit, the short-term value exceeds the first short-term limit, or the distraction frequency exceeds the first frequency limit.Furthermore, the control device 20 compares the determined short-term value of the distraction level with the second short-term limit value, the determined long-term value of the distraction level with the second long-term limit value, and the determined distraction frequency with the second frequency limit value using the comparison unit 24. The determined distraction level falls below the lower limit value if the long-term value falls below the second long-term limit value, the short-term value falls below the second short-term limit value, and the distraction frequency falls below the second frequency limit value.
[0155] In a seventh process step S7, the control device adjusts the compensation limit value depending on the determined degree of distraction. If the degree of distraction exceeds the upper limit value, the control device adjusts the compensation limit value, starting from the current compensation limit value, either by reducing it or by setting it to a previously determined first value. If the degree of distraction falls below the lower limit value, the control device adjusts the compensation limit value, starting from the current compensation limit value, either by increasing it or by setting it to a previously determined second value. Reference symbol list
[0156] 10 Motor vehicle 11 Motor vehicle interior 20 Control device 21 Detection unit 22 Storage unit 23 Readout unit 24 Comparison unit 30 Detection unit 40 Acquisition device S1 - S7 Procedure steps of the process
Claims
1. Control device (20) for controlling an operation of a motor vehicle (10), wherein the control device (20) is configured to: • receive sensor data concerning a driver of the motor vehicle (10), • determine a gaze behavior of the driver based on the sensor data, and • determine a distraction degree of the driver based on the determined gaze behavior, characterized in that the control device (20) is configured to: • set a compensation value and / or a compensation limit value of an automatic speed control and / or of a speed limiter of the motor vehicle (10) in dependence on the determined distraction degree.
2. Control device (20) according to claim 1, characterized in that the control device (20) is configured to determine the distraction degree of the driver in dependence on a short-term value, wherein the short-term value indicates a time duration sum of short-term distraction states within a previously determined first time interval, whose respective time duration is smaller than a previously determined short-term distraction limit value.
3. Control device (20) according to claim 1 or claim 2, characterized in that the control device is configured to determine the distraction degree of the driver in dependence on a long-term value, wherein the long-term value indicates a time duration of a long-term distraction state of the driver, whose time duration is greater than a previously determined long-term distraction limit value.
4. Control device (20) according to claim 2 or 3, characterized in that the control device (20) is configured to determine the distraction degree of the driver in dependence on a distraction frequency, wherein the distraction frequency indicates a number of short-term values and / or long-term values within a previously determined second time interval.
5. Control device (20) according to one of the preceding claims, characterized in that the control device (20) is configured to: • set the compensation value in dependence on the determined distraction degree such that the compensation value is reduced starting from a current compensation value, when the distraction degree exceeds a previously determined first upper limit value, or • set the compensation value in dependence on the determined distraction degree such that the compensation value is set to a previously determined first value, when the distraction degree exceeds the previously determined first upper limit value.
6. Control device (20) according to one of the preceding claims, characterized in that the control device (20) is configured to: • set the compensation value in dependence on the determined distraction degree such that the compensation value is increased starting from a current compensation value, when the distraction degree falls below a previously determined first lower limit value, or • set the compensation value in dependence on the determined distraction degree such that the compensation value is set to a previously determined second value, when the distraction degree falls below the previously determined first lower limit value.
7. Control device (20) according to one of the preceding claims, characterized in that the control device (20) is configured to: • set the compensation limit value in dependence on the determined distraction degree such that the compensation limit value is reduced starting from a current compensation limit value, when the distraction degree exceeds a previously determined second upper limit value, or • set the compensation limit value in dependence on the determined distraction degree such that the compensation limit value is set to a previously determined first value, when the distraction degree exceeds the previously determined second upper limit value.
8. Control device (20) according to one of the preceding claims, characterized in that the control device (20) is configured to: • set the compensation limit value in dependence on the determined distraction degree such that the compensation limit value is increased starting from a current compensation limit value, when the distraction degree falls below a previously determined second lower limit value, or • set the compensation limit value in dependence on the determined distraction degree such that the compensation limit value is set to a previously determined second value, when the distraction degree falls below the previously determined second lower limit value.
9. Motor vehicle (10), characterized in that the motor vehicle (10) comprises the control device (20) according to one of claims 1 to 8.
10. Method for controlling an operation of a motor vehicle (10), wherein the method comprises: • receiving (S2) sensor data concerning a driver of the motor vehicle (10), • determining (S3) a gaze behavior of the driver based on the sensor data, and • determining (S4) a distraction degree of the driver based on the determined gaze behavior, characterized in that the method comprises: • setting (S7) a compensation value and / or a compensation limit value of an automatic speed control and / or of a speed limiter of the motor vehicle (10) in dependence on the determined distraction degree.
11. Computer program, characterized in that the computer program comprises instructions which, when the program is executed by a computer, cause the computer to execute the method according to claim 10.
12. Computer-readable medium, characterized in that the computer-readable medium comprises instructions which, when the instructions are executed by a computer, cause the computer to execute the method according to claim 10.