Systems and methods for improving driver alerting during automated driving

Abstract

To provide a system, a method and other embodiments, relating to improvement in a driver alarm for automatic drive by a vehicle.SOLUTION: In one embodiment, the present method includes monitoring a vehicle control system for driver feedback during automatic drive. The present method further includes adapting a point value at a specified ratio according to whether the driver feedback is present or not. The present method further includes generating an alarm for a driver in response to determination that the point value satisfies a threshold value before the driver feedback is present.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The subject matter described herein relates generally to improving automated vehicle operation, and more specifically, to adapting driver alerts to improve automated driving. [Background technology]

[0002] A vehicle may be equipped with an automated driving module for automated driving as part of an automated driving system (ADS). The vehicle's ADS may be adapted to driving behavior, driving complexity, or driver feedback. Adaptation of the ADS may improve operation in a particular ADS mode using driver feedback or interaction. In various approaches, the vehicle's ADS may be adapted to a driver alert system depending on the driving behavior or driving complexity by testing in special driving facilities, virtual training systems using special vehicle equipment, etc. An ADS adapted via such methods may be very time-consuming, inconvenient, or ineffective for different driving behaviors, driving complexity, or driver feedback.

[0003] Some automated driving modes may also operate to request driving feedback within a period of time before alerting the driver. A vehicle system may request steering wheel feedback, braking feedback, etc., for a certain time interval. For example, a lane keeping assist (LKA) system may use steering wheel feedback to maintain safe operation. In one approach, the LKA system may reset a timer when the driver provides expected feedback on the steering wheel. In other cases, the LKA system may generate a warning or notification if the timer expires before receiving driver feedback.

[0004] Furthermore, frequent driver feedback may not be necessary when the ADS performs simple vehicle operations. In this approach, the vehicle system may generate warnings or prompts after a certain time interval, regardless of the complexity of the automated driving operation or driving conditions. For example, an ADS that operates the vehicle in a straight line on an open, straight, or flat road may generate warnings unnecessarily because the warning time interval is fixed. This may make current systems inefficient in effectively generating driver warnings during automated driving. Summary of the Invention

[0005] In one embodiment, an exemplary system and method relates to a method for improving driver alerts of an automated driving system (ADS) during driving. Certain ADS modes may require driver feedback for safe and effective automated driving. If driver feedback is not received within a certain period of automated driving, a vehicle operating in an ADS mode may generate an alert to indicate insufficient driver interaction. However, driving behaviors and driving conditions may differ, thereby hindering the functionality of such systems. In various implementations, current solutions for ADS that adapt driving behaviors and driving conditions to driver alerts may be very time-consuming, inconvenient, or ineffective. Thus, an improved approach for automated driving is disclosed in which a warning system uses a point value that adapts the period before alerting the driver. The warning system may adapt the point value to meet before alerting the driver according to different feedback types, driving conditions, etc. A vehicle system that detects the driver feedback may adapt the point value. In one approach, the warning system may also vary the rate at which the point value is adapted depending on the automated driving state, the driver feedback, the driver's awareness, or the complexity of the driver's interaction. In this way, the vehicle adapts the driver's warnings to improve autonomous driving by adjusting the time intervals depending on the driving behavior, driving complexity or driving conditions.

[0006] In one embodiment, a warning system for improving driver warning for automated driving by a vehicle is disclosed. The warning system includes one or more processors and a memory communicatively coupled to the one or more processors. The memory stores a monitoring module including instructions that, when executed by the one or more processors, cause the one or more processors to monitor a vehicle control system for driver feedback during automated driving. The memory also stores an adaptation module including instructions that, when executed by the one or more processors, cause the one or more processors to adapt a points value at a prescribed ratio according to whether driver feedback is present. The adaptation module further includes instructions for generating a warning to a driver in response to determining that the points value meets a threshold value before the driver feedback is present.

[0007] In one embodiment, a non-transitory computer-readable medium is disclosed that includes instructions for improving driver alerts for automated driving of a vehicle, the instructions including instructions that, when executed by one or more processors, cause the one or more processors to perform one or more functions. The instructions include instructions for monitoring a vehicle control system for driver feedback during automated driving. The instructions also include instructions for adapting a points value at a prescribed rate depending on whether driver feedback is present. The instructions also include instructions for generating a driver alert in response to determining that the points value meets a threshold value before the driver feedback is present.

[0008] In one embodiment, a method for improving driver alerts for automated driving of a vehicle is disclosed. In one embodiment, the method includes monitoring a vehicle control system for driver feedback during automated driving. The method also includes adapting a points value at a prescribed rate depending on whether driver feedback is present. The method also includes generating a driver alert in response to determining that the points value meets a threshold value before the driver feedback is present. [Brief description of the drawings]

[0009] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate various systems, methods, and other embodiments of the present disclosure. It will be understood that the illustrated element boundaries (e.g., boxes, groups of boxes, or other shapes) in the figures represent one embodiment of boundaries. In some embodiments, one element may be designed as multiple elements, or multiple elements may be designed as one element. In some embodiments, an element shown as an internal component of another element may be implemented as an external component, and vice versa. Additionally, elements may not be drawn to scale.

[0010] [Figure 1] FIG. 1 illustrates an embodiment of a vehicle in which the systems and methods disclosed herein may be implemented. [Diagram 2] FIG. 2 illustrates an embodiment of a warning system for monitoring driver feedback and generating driver warnings using a compatibility point system during automated driving of the vehicle of FIG. [Diagram 3] FIG. 1 illustrates an embodiment of a method associated with a warning system for monitoring driver feedback during automated driving using a fitness point system. [Figure 4] FIG. 1 illustrates a driving environment in which warnings are adapted for automated driving on a road involving other vehicles. [Diagram 5] FIG. 1 illustrates the use of a points system during autonomous driving to generate warnings depending on driver takeover or the complexity of driving in autonomous mode. [Figure 6] FIG. 1 illustrates the use of a compatibility point system to generate warnings according to different driving complexities in autonomous driving modes. [Figure 7] FIG. 1 illustrates the use of a compliance point system with varying prescribed rates of change to generate warnings during automated driving. [Figure 8] FIG. 1 illustrates the use of a compatibility point system whereby various types of driver warnings are provided after thresholds are met during automated driving. [Figure 9] FIG. 1 illustrates the use of a compatibility point system in which a prescribed ratio changes depending on the driver's state during automated driving. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Systems, methods, and other embodiments related to improved driver alerts for automated driving are disclosed herein. In one embodiment, a warning system may use a point value that adapts how a driver alert is triggered during a particular automated driving system (ADS) mode according to driver feedback, driving complexity, sensor data, and the like. In such an ADS mode, driver interaction, engagement, or attention related to the automated driving function may be used. By reducing the point value over time when the driver controls the vehicle, the alert is triggered less frequently. In one approach, the warning system may adapt how the alert is triggered by increasing, decreasing, or maintaining a prescribed rate of change of the point value during automated driving. For example, the warning system may increase or decrease a prescribed rate of change of the point value depending on the location or risky maneuver to adapt the time period before triggering the driver alert. Thus, the adapted point value changes the time and manner in which a threshold is reached to more effectively alert the driver during automated driving.

[0012] Further, the warning system may warn the driver such that the driver's awareness, interaction, engagement, etc., is sufficient for different automated driving conditions. For example, the type of warning may differ depending on the point value meeting various thresholds. In one approach, an audible warning may be prioritized over a haptic warning to the driver, making it more severe as the point value exceeds different thresholds over time during automated driving. In this way, the vehicle adapts the driver warning to improve automated driving by adjusting the time interval depending on the driving behavior, driving complexity, or driving state.

[0013] Referring to FIG. 1, an example of a vehicle 100 is shown. As used herein, a "vehicle" is any form of motorized transportation. In one or more implementations, the vehicle 100 is an automobile. Although the device is described herein with respect to an automobile, it will be understood that the embodiments are not limited to automobiles. In some implementations, the vehicle 100 may be in the form of any robotic device or motorized transportation including sensors for perceiving aspects of operating in ADS mode, for example. As further described herein, the ADS may include an autonomous driving module 160, components of a sensor system 120, components of a vehicle system 140, actuators 150, and a data storage device 115 that work together to autonomously drive and control the vehicle 100 in ADS mode. In ADS mode, the vehicle 100 may use a warning system that adapts the points system during autonomous driving according to driver actions or conditions related to the driving situation or operation. The warning system may generate a driver warning according to driver feedback to meet an adapted points value threshold. The alert may be an alarm, a displayed prompt, haptic feedback, or the like.

[0014] Additionally, the vehicle 100 also includes various elements. It will be appreciated that in various embodiments, a vehicle 100 having all of the elements shown in FIG. 1 may be unnecessary. The vehicle 100 may have any combination of the various elements shown in FIG. 1. Additionally, the vehicle 100 may have elements in addition to those shown in FIG. 1. In some configurations, the vehicle 100 may be implemented without one or more elements shown in FIG. 1. Although FIG. 1 illustrates various elements as being located within the vehicle 100, it will be appreciated that one or more of such elements may be located outside the vehicle 100. Additionally, the illustrated elements may be physically remote and separated. For example, as discussed, one or more components of the disclosed system may be implemented within the vehicle, while additional components of the system are implemented in a cloud computing environment or other system remote from the vehicle 100.

[0015] Some of the possible elements of the vehicle 100 are shown in FIG. 1 and described in conjunction with the subsequent figures. However, a description of many of the elements of FIG. 1 will be provided following the description of FIGS. 2-9 to simplify this description. Additionally, it will be appreciated that, where necessary, reference numbers have been repeated among different figures to indicate corresponding or similar elements for simplicity and clarity of illustration. Additionally, the discussion outlines many specific details to provide a thorough understanding of the embodiments described herein. However, one of ordinary skill in the art will appreciate that the embodiments described herein may be implemented using various combinations of such elements. In any case, the vehicle 100 operates in an environment with improved driver alerting through the use of a compatibility point system during automated driving.

[0016] 2 illustrates an embodiment of a warning system for monitoring driver feedback and generating driver warnings using the adaptation point system during automated driving of the vehicle of FIG. 1. The warning system 170 is shown as including the processor 110 from the vehicle 100 of FIG. 1. Thus, the processor 110 may be part of the warning system 170, the warning system 170 may include a processor separate from the processor 110 of the vehicle 100, or the warning system 170 may access the processor 110 via a data bus or another communication path. In one embodiment, the warning system 170 includes a memory 210 that stores a monitoring module 220 and an adaptation module 230. The memory 210 may be a random access memory (RAM), a read only memory (ROM), a hard disk drive, a flash memory, or other suitable memory for storing the modules 220 and 230. The modules 220 and 230 are, for example, computer readable instructions that, when executed by the processor 110, cause the processor 110 to perform various functions disclosed herein.

[0017] The warning system 170 as shown in FIG. 2 is generally in an abstracted form including a monitoring module 220 and an adaptation module 230. The monitoring module 220 and the adaptation module 230 may generally include instructions that function to control the processor 110 to receive data inputs from one or more vehicle systems or sensors of the vehicle 100. In one approach, the modules 220 and 230 may use the received data inputs to adapt the point value 260 during autonomous driving of the vehicle 100. In one embodiment, the monitoring module 220 may control the respective sensors (e.g., inertial measurement unit (IMU), input sensors, etc.) to provide data inputs in the form of sensor data 250. In one approach, the sensor data 250 may include vehicle input data from the sensor data 119. The warning system 170 and the monitoring module 220 may use the sensor data 250 to detect driver feedback during autonomous driving and adapt the point value 260 accordingly to prevent premature driver warning. For example, warning system 170 may determine that the driver's operation is a takeover and reduce point value 260. Point value 260 may be lowered below the driver warning threshold for sufficient engagement during automated driving of vehicle 100. This may indicate to warning system 170 that the driver is aware of the operation of vehicle 100 and is performing expected monitoring of vehicle 100 during automated driving.

[0018] Additionally, the monitoring module 220 may actively or passively acquire the sensor data 250. For example, the monitoring module 220 may passively intercept the sensor data 250 from a set of electronic information provided by various sensors to additional components within the vehicle 100. Thus, the warning system 170 may undertake various approaches to fuse data from multiple sensors when providing the sensor data 250 and / or from sensor data acquired via wireless communication links. Thus, in one embodiment, the sensor data 250 represents a combination of perceptions acquired from multiple sensors.

[0019] Typically, the sensor data 250 includes at least vehicle control inputs. In one example, the vehicle control inputs include steering inputs (e.g., steering wheel angle, rotational speed, and direction, etc.), braking inputs (e.g., degree of brake pedal actuation / pressure), and acceleration inputs (e.g., degree of accelerator pedal actuation / pressure). In additional aspects, the vehicle control inputs also identify transmission control inputs (e.g., gear selection), drive mode (e.g., two-wheel drive, four-wheel drive, etc.), engine / motor parameters (e.g., engine revolutions per minute (RPM), hybrid vehicle drive mode, etc.), and the like. In yet additional aspects, the sensor data 250 includes current dynamic data, such as angular velocity, G-forces (e.g., longitudinal, lateral, etc.), speed profile, wheel speeds, actuation controls (e.g., anti-lock braking system (ABS) actuation, traction control actuation, stability control actuation, etc.).

[0020] As an example, according to a particular implementation, the vehicle 100 may be equipped with different versions of the IMU sensor that are separately capable of different measurements. That is, in one implementation, the IMU sensor may provide yaw rate, lateral acceleration, and vertical acceleration, whereas in another implementation with a more robust IMU sensor, the IMU sensor may provide additional data such as pitch rate, roll rate, vertical acceleration, etc. Thus, the alert system 170 may be configured to accommodate different electronic inputs, depending on the availability of such information, in one or more approaches. As an additional note, telematics data, as used herein, generally encompasses the sensor data 250 and may include additional information, such as a vehicle identifier, location information (e.g., Global Positioning System (GPS) location), and other information that the alert system 170 may use to generate alerts related to the location of the vehicle 100.

[0021] Additionally, in one embodiment, the alert system 170 includes a data store 240. In one embodiment, the data store 240 is a database. In one embodiment, the database is an electronic data structure stored in the memory 210 or another data store and is comprised of routines that the processor 110 may execute to analyze the stored data, present the stored data, organize the stored data, etc. Thus, in one embodiment, the data store 240 stores data used by the modules 220 and 230 in performing various functions. In one embodiment, the data store 240 includes the sensor data 250, for example, along with metadata characterizing various aspects of the sensor data 250.

[0022] In one embodiment, the data storage device 240 also includes a point value 260, a threshold 270, and a prescribed ratio 280. The warning system 170 may adapt (e.g., increase, decrease, etc.) the point value 260 in units or steps over time at the prescribed ratio 280 according to the driver feedback. The prescribed ratio 280 may be a rate of increase, decrease, or step size for accumulating or decreasing the point value 260. For example, the point value 260 may change at a rate of 0.7, 1, or 1.5 per second. The warning system 170 may use a higher ratio for more complex or difficult driving environments during automated driving of the vehicle 100. In one approach, the warning system 170 may use a higher ratio to trigger a warning for insufficient driver interaction, engagement, awareness, etc. during automated driving.

[0023] Further, the automated driving module (ADM) 160 may use the adapted point value 260 to generate a warning in an ADM mode using driver feedback. In one example, the warning system 170 may adapt the point value 260 according to the driver's behavior, driving complexity, driving conditions, traffic conditions, driver's experience, etc. The driver's behavior may include the driver frequently controlling the vehicle 100 by touching the steering wheel according to the perceived safety during automated driving. This driver's behavior may be unnecessary if the automated driving of the vehicle 100 meets the conditions of the motion plan. In one approach, when a takeover occurs, the point value 260 may be reset since the driver is fully conscious during the automated driving of the vehicle 100. The takeover during the automated driving may be the driver's operation, braking, acceleration, etc. of the vehicle 100 instead of the control by the automated driving module 160. The driving conditions may include situations during the automated driving including complex curves, intersections, lane changes, etc. at a specific location. For example, for complex driving routes, the defined ratio 280 to the point value 260 may be increased to keep the driver alert by issuing warnings more frequently.

[0024] With respect to road curves, the warning system 170 may shorten the time interval for issuing a warning by decreasing the point value 260 to increase the driver's awareness during automated driving on winding roads. Furthermore, the traffic conditions may include driving on highways, urban environments, densely populated areas, areas with high traffic volume, etc. For example, the warning system 170 may set a lower point value 260 or threshold value 270 on roads with fewer vehicles. In a driving environment with low traffic volume, a longer interval for issuing a safety-related warning may be sufficient. Conversely, the warning system 170 may operate with a higher point value 260 or threshold value 270 on roads with more vehicles to issue more frequent driver warnings.

[0025] In one approach, the warning system 170 and adaptation module 230 may adapt the points according to the deceleration of the vehicle 100 at a particular rate during a dangerous driving condition. Additionally, the warning system 170 may adapt the points value 260 if the vehicle 100 maintains a stable speed or distance between another vehicle according to the sensor data 250. In one approach, the warning system 170 may decrease the points value 260 when the speed of the vehicle 100 is low (e.g., 5 miles per hour (MPH)) and increase the points value 260 at higher speeds (e.g., 90 MPH) so that the driver warning is adapted to the speed during autonomous driving. The adaptation module 230 may decrease the points value 260 of the vehicle 100 if the steering wheel feedback indicates sufficient responsiveness, attention, alertness, sensitivity, etc. for autonomous driving of the vehicle 100. In this way, the vehicle 100 has an accurate and reliable system for generating driver warnings during certain ADS modes.

[0026] In the following example, the monitoring module 220 and the adaptation module 230 of the test system 170 may utilize the sensor data 250, the point value 260, and / or the threshold value 270 stored in the data storage device 240 to adapt the warning system 170 during the autonomous driving of the vehicle 100. In particular, the monitoring module 220 may use the sensor data 250 and / or the sensor data 119 for driver feedback from the vehicle system 140 during the autonomous driving. The adaptation module 230 may adapt the point value 260 at a prescribed ratio 280 according to whether the driver feedback is present or not. The warning system 170 then generates a driver warning when it determines that the point value 260 meets the threshold value 270 while waiting for the driver feedback. Thus, the warning system 170 adapts the point system according to the driver's behavior or driving conditions to more accurately and precisely warn the driver during the autonomous driving.

[0027] Figure 3 illustrates one embodiment of a method associated with a warning system for monitoring driver feedback using a fitness point system during automated driving. Method 300 is discussed in conjunction with Figures 1 and 2. Although method 300 is discussed in conjunction with warning system 170, it should be understood that method 300 is not limited to being implemented within warning system 170, but is instead one example of a system that may implement method 300.

[0028] As a brief introduction to the method 300, prior to a consideration of the explicitly identified features, the warning system 170 may monitor driver feedback during automated driving of the vehicle 100. The warning system 170 generates a driver warning after meeting a threshold 270 associated with a compatibility point value 260 for lack of driver feedback in a particular ADS mode. The warning system 170 may alert or inform the driver of a current need for increased attention, awareness, interaction, etc. to improve the safety of the automated driving. The driver feedback may be inputs related to steering wheel operation, acceleration, braking, etc., according to the sensor data 250 used by the particular ADS mode for operation.

[0029] As an example, the monitoring module 220 may use the sensor data 250 and / or the sensor data 119 for driver feedback from the vehicle system 140 during autonomous driving of the vehicle 100. The adaptation module 230 may adapt the point value 260 at a prescribed ratio 280 until receiving the driver feedback. The warning system 170 and the adaptation module 230 adapt and adjust the point value 260 to trigger a driver warning during autonomous driving. For example, this may be achieved by modifying the prescribed ratio 280 for the point value 260 depending on the driver's state, driving complexity, driving conditions, vehicle location, etc. during autonomous driving of the vehicle 100.

[0030] Referring back to adapting driver warnings to improve automated driving in FIG. 3, at 310, the warning system 170 may adapt the point value 260 over time. For example, the warning system 170 may adapt (e.g., increase, decrease, etc.) the point value 260 all at once or in increments over time at a prescribed rate 280. As described herein, the prescribed rate 280 may be an increase, decrease, or step rate for accumulating or reducing the point value 260. As described herein, the warning system 170 may adapt the point value 260 depending on the driver's behavior or driving complexity. In one approach, the prescribed rate 280 may be increased when the vehicle 100 is driving on a winding road at high speed during automated driving. The prescribed rate may be decreased when the vehicle 100 is driving on a road with low traffic during automated driving. For each situation, the warning system 170 adapts to warn the driver more or less frequently during automated driving by taking into account particular aspects of the current circumstances.

[0031] In 320, the monitoring module 220 may detect driver feedback using the sensor data 250 and / or the sensor data 119. The monitoring may include collecting and analyzing information about the driver in the form of the sensor data 250 and / or the sensor data 119. In one approach, the warning system 170 may analyze the sensor data 250 to determine when the driver is changing the control input of the vehicle 100. The warning system 170 may further analyze certain characteristics of the control input to further measure the nature of the input by the driver. As an example, the measured strength of the driver holding the steering wheel may be used to determine whether a takeover of the vehicle 100 may occur. The warning system 170 may decrease the point value 260 after the takeover because no warning is necessary due to the driver control. In another example, the warning system 170 may use the detected gaze of the driver feedback to measure the driver's attention, awareness, etc. The warning system 170 may increase the point value 260 by a higher prescribed ratio 280 if the driver is looking outside the visual range due to insufficient engagement during automated driving of the vehicle 100 .

[0032] At 330, the warning system 170 decreases the point value 260 after detecting the driver feedback at 320. The warning system 170 may decrease the point value 260 according to a comparison with the threshold value 270. In one approach, the rate of decrease may depend on a prescribed ratio 280. As described herein, the prescribed ratio 280 may be an increase, decrease, or step rate for accumulating or decreasing the point value 260. The adaptation module 230 may use a higher ratio for increasing complexity or difficulty of the driving environment during automated driving to increase the driver's involvement or awareness required in a particular ADS mode. The warning system 170 may use a higher prescribed ratio 280 to keep the driver engaged longer in a particular automated driving mode by issuing warnings more frequently. Conversely, the warning system 170 may use a lower prescribed ratio 280 to issue warnings less frequently during automated driving for a simpler driving environment.

[0033] At 340, if the monitoring module 220 does not detect the presence of driver feedback, the adaptation module 230 may compare the point value 260 to the threshold value 270. In particular, the adaptation module 230 may determine whether the point value 260 meets the threshold value 270 in the data storage device 240. The threshold value 270 may be met if the point value 260 is equal to or greater than the threshold value 270. As described further herein, the warning system 170 may use multiple threshold values. At each threshold level, a different warning is triggered according to one or more dangerous situations. As described herein, the point value 260 may increase or decrease over time until it meets the threshold value 270 that triggers a warning according to the driver's behavior, driving complexity, driving conditions, traffic conditions, driver experience, and the like. For example, the warning system 170 may decrease the point value 260 if the speed and direction of the vehicle 100 are stable, or may increase the point value 260 rapidly otherwise, so that the driver warning is adapted accordingly during automated driving.

[0034] At 350, the adaptation module 220 determines that the point value 260 meets the threshold 270. The point value 260 may significantly exceed the threshold 270 to issue a significant warning to the driver. In another approach, the warning system 170 may gradually increase the point value 260 until it reaches the threshold 270. The warning system 170 may determine that there is insufficient driver engagement, interaction, etc. for automated driving of the vehicle 100 if the point value 260 meets the threshold 270.

[0035] In 360, the warning system 170 and the adaptation module 220 may warn the driver of the vehicle 100. The warning may be visual, audible, tactile, etc. In one approach, the warning system 170 may adapt the amount or level of warning from low to very urgent depending on the amount of exceedance of the threshold 270. In one approach, the warning system 170 may use multiple thresholds. At each threshold level, a different warning is triggered according to one or more dangerous situations. For example, if the warning system 170 suddenly increases the defined ratio 280 due to a possible collision, the threshold 270 may be greatly exceeded and an urgent warning may be generated.

[0036] At 370, the alert system 170 may stop or cancel the alert. In certain circumstances, the alert system 170 may have to stop or cancel the alert before the adaptation module 230 determines that the point value 260 does not meet the threshold 270. In one approach, the alert system 170 may continue to adapt the point value 260 after the alert has stopped.

[0037] Turning now to FIG. 4, this figure illustrates a driving environment that adapts warnings 400 for automated driving on roads with other vehicles present. In FIG. 4, the warning system 170 may adapt the point value 260 during automated driving depending on the driving behavior on the highway, the complexity of the driving, the driving conditions, the driving state, etc. The driving environment 410 may include the vehicle 100 traveling on a highway 420. If the driving environment 410 meets the safety standards of the vehicle 100, the warning system 170 may adapt the point value 260 while the vehicle 100 is traveling on the highway 420. The warning system 170 may adapt the point value 260 to provide more accurate driver warnings during automated driving. In this approach, the presence of other vehicles on the highway 420 may result in a rapid increase in the point value 260 to increase the frequency of warnings. As a result, the warning system 170 may request more driver attention for automated driving on highways with more vehicles. In this way, the safety and reliability of automated driving may be improved by having the warning system 170 warn the driver more frequently.

[0038] Consider now Figs. 5-9. Figs. 5-9 show various situations and examples for adapting the warning system 170. Fig. 5 illustrates the use of a points system 500 during autonomous driving of the vehicle 100 to generate warnings according to driver takeover or driving complexity. The warning system 170 may accumulate points values ​​260 in the points system 510 over time in the absence of driver feedback using a fixed prescribed ratio 280. The points system 510 may be non-adaptive to driver behavior, driving complexity, driver condition, etc. The warning system 170 may also generate a driver warning without detecting driver feedback before the threshold 270 is reached. In another approach, the warning system 170 and adaptation module 230 in the points system 520 may generate a driver warning according to driver takeover of the vehicle 100, t 1The point value 260 may be reset to zero at t. The point value 260 remains at zero while the driver is in control of the vehicle 100, and when automatic driving of the vehicle 100 resumes, 2 In this manner, the points system 520 adapts the driver warnings according to the driver takeover during the disengaging and engaging periods.

[0039] In addition, the warning system 170 and the adaptation module 230 in the point system 530 may be configured to adapt to driving conditions such as complex driving conditions, dangerous driving conditions, etc. during the autonomous driving of the vehicle 100. 1 The warning system 170 may use an increased prescribed ratio 280 at t . The warning system 170 may vary from the point function 532 in response to changing conditions to increase safety by alerting the driver more frequently during automated driving. In one approach, the warning system 170 at point function 540 may use an increased prescribed ratio 280 at t . in accordance with the monitoring module 220 that detects driver feedback. 1 and may continue to increase at a prescribed rate 280 after driver feedback. In this manner, points systems 530 and 540 adapt warnings according to changing driving conditions or driver feedback during the autonomous driving mode.

[0040] FIG. 6 illustrates the use of a matched point system 600 to generate warnings in response to various driving complexities in an autonomous driving mode. In one approach, the warning system 170 in the matched point system 610 may generate warnings based on the complex driving conditions, dangerous driving conditions, and other driving conditions during autonomous driving of the vehicle 100. 1 The warning system 170 may transition to a higher prescribed ratio 280 at t . A complex driving condition may be a driving environment that includes many moving objects, vehicles, pedestrians, cyclists, etc. A complex driving condition may also include rough terrain, steep slopes, intersections, junctions, unpaved roads, winding roads, closures, blind spots, poor visibility, high speeds, etc. When entering a simpler driving condition during autonomous driving of the vehicle 100, the warning system 170 may transition to a higher prescribed ratio 280 at t .2 For example, a simple driving condition may be a driving environment that includes few moving objects, vehicles, pedestrians, bicycles, etc. A simple driving condition may also include flat roads, gentle slopes, paved roads, straight roads, good visibility, slower speeds, etc. Thus, the warning system 170 may adapt the point system 610 instead of using the point function 612 to reduce the prescribed ratio 280 during complex maneuvers by the vehicle 100. 1 To improve safety by catching the driver's attention earlier.

[0041] Additionally, the warning system 170 using the points system 620 may be configured to reset and take over the driver, reduce the prescribed ratio 280 during driver control, or delay the duration of the automated driving period t 1 and t 2 The warning system 170 may also adapt the point value 260 according to resets during and driver takeover. Additionally, the warning system 170 may adjust the point value 260 according to the occurrence of a reset during and driver takeover during driver control. 1~ t 3 The points value 260 may be adapted according to driver takeover resulting in inactivity for a period of time. In one approach, the frequency of warnings should be reduced when the driver controls the vehicle as part of a particular automated driving mode. The monitoring module 220 may discover the presence of driver feedback according to touching, grasping, turning, etc. of the steering wheel of the vehicle 100. Other examples of driver feedback may be the driver depressing the accelerator pedal, depressing the brake pedal, activating a turn signal, etc. of the vehicle 100. In the points system 620, the warning system 170 may substantially continuously decrease the points value 260 while the driver is in control of the vehicle 100.

[0042] 7 illustrates the use of a compliance point system 700 with a prescribed rate of change to generate warnings during autonomous driving. In one approach, the warning system 170 in the point system 710 may generate a warning at t 1The warning system 170 may change or reduce the value of the prescribed ratio 280 to zero after t. The warning system 170 may change or reduce the value of the prescribed ratio 280 to zero depending on the driver's behavior, driving complexity, driving conditions, etc. For example, the vehicle 100 may be transitioning to a lighter traffic area that requires less frequent warnings during automated driving. In one approach, the points system 720 may change or reduce the points value 260 to zero for driver control during automated driving of the vehicle 100 after t. 1 and 2 The alert may be met when a threshold 270 between the threshold 270 and t is met. For example, driver control may lower the point value 260 below the threshold 270 to end or stop the alert. The point value 260 may have accumulated because the driver was asleep or unaware during automated driving of the vehicle 100. The alert may wake the driver up to take control of the vehicle 100. The alert system 170 may be configured to automatically adjust the alert to t 1 Depending on the amount of driver awareness or attention after the warning, the value may be decreased at a prescribed rate 280 or the point value 260 may be reset. In this manner, the warning system 170 automatically adapts by returning to a pre-warning state depending on the driver's behavior, habits, driving complexity, etc., to improve warnings during automated driving.

[0043] 8 is a diagram illustrating the use of a compliance point system 800 where a warning system provides different types of driver warnings after a threshold is met during automated driving. 1 Or t 2 At the transition point t 1 Or t 2 The points value 260 may be adapted according to driver control or inactivity between t 1 The point value 260 may also be increased or decreased by driver control of the vehicle 100 after the start of the vehicle 100. 2 In this manner, the warning system 170 automatically adapts according to driver control and inactivity to improve warnings during automated driving of the vehicle 100.

[0044] In one approach, the alert system 170 may use a points system 810 that includes multiple values ​​or levels associated with the thresholds 270. For example, the alert system 170 may use a points system 810 that includes multiple values ​​or levels associated with the thresholds 270. 1 The alert system 170 may generate an audible alert when the point value 260 meets an "Alert A" threshold at time t. The alert system 170 may also generate a visual alert when the point value 260 meets an "Alert B" threshold. The alert system 170 may also generate a tactile alert when the point value 260 meets an "Alert C" threshold. Additionally, the alert system 170 may generate an audible alert when the point value 260 meets an "Alert A" threshold at time t 1 Or t 2 At time t 1 Or t 2 During this time, the prescribed ratio 280 may be adapted according to driving behavior, driving conditions, driving complexity, driver state, etc. In this manner, the warning system 170 improves driver warning by adapting the type and level of driver warning to changing conditions.

[0045] 9 is a diagram illustrating the use of an adaptation point system 900 in which a prescribed ratio changes depending on the driver's state during automated driving. Using the point system 910, the warning system 170 may adapt the point value 260 according to the driver's behavior and control during automated driving of the vehicle 100. For example, the warning system 170 may adjust the point value 260 according to the driver's behavior and control during automated driving of the vehicle 100. 2 The point value 260 at may be reset to the minimum warning threshold. In one approach, the warning system 170 at the point system 920 may selectively change or transition the point value 260 from a highest haptic warning level to an intermediate visual warning level. The warning system 170 may then reduce the point value 260 to pass through a minimum audible warning threshold level depending on the driver's interaction or driving conditions during automated driving of the vehicle 100. Additionally, the warning system 170 may selectively change or transition the point value 260 at 2 For subsequent driver control, the points value 260 may be decreased at a prescribed rate 280 .

[0046] Additionally, the warning system 170 in the points system 930 may adapt the points value 260 according to the driver state. The warning system 170 may adapt the prescribed ratio 280 according to the sensor data 119 or 250 related to the driver state. For example, if eye tracking or attention data indicates that the driver is awake and the prescribed ratio 280 is adjusted accordingly, the warning system 170 may adjust the prescribed ratio 280 according to the sensor data 119 or 250 related to the driver state. 1 The warning system 170 may determine from the sensor data 119 or 250 that the driver is focused and has sufficient control over the vehicle 100. As a result, the prescribed ratio 280 is also adjusted to t 1 may decrease to zero at , and the point value 260 remains constant until an additional fit is triggered.

[0047] 1 will now be considered in greater detail generally as an example of an environment in which the systems and methods disclosed herein may operate. In some cases, the vehicle 100 is configured to selectively switch between different modes of operation / control according to the orientation of one or more modules / systems of the vehicle 100. In one approach, the modes include: 0 - no automation, 1 - driver assistance, 2 - partial automation, 3 - conditional automation, 4 - high automation, and 5 - full automation. In one or more configurations, the vehicle 100 may be configured to operate in only a subset of the possible modes.

[0048] In one or more embodiments, the vehicle 100 is an automated or autonomous vehicle. As an automated vehicle, the vehicle 100 may be configured to use ADS to perform autonomous functions via the self-driving module 160. As used herein, an "autonomous vehicle" refers to a vehicle that can operate in an autonomous, automated, or ADS mode (e.g., Category 5, fully automated). An "autonomous mode" or ADS mode refers to using one or more computing systems to navigate and / or operate the vehicle 100 along a travel path with minimal or no input from a human driver. In one or more embodiments, the vehicle 100 is highly automated or fully automated. In one embodiment, the vehicle 100 is configured with one or more semi-autonomous operating modes in which one or more computing systems perform some of the navigation and / or operation of the vehicle along the travel path, and a vehicle operator (i.e., a driver) provides input to the vehicle to perform some of the navigation and / or operation of the vehicle 100 along the travel path.

[0049] The vehicle 100 may include one or more processors 110. In one or more configurations, the processor 110 may be the main processor of the vehicle 100. For example, the processor 110 may be an electronic control unit (ECU), an application specific integrated circuit (ASIC), a microprocessor, etc. The vehicle 100 may include one or more data storage devices 115 for storing one or more types of data. The data storage devices 115 may include volatile and / or non-volatile memory. Examples of suitable data storage devices 115 may include RAM (random access memory), flash memory, ROM (read only memory), PROM (programmable read only memory), EPROM (erasable programmable read only memory), EEPROM (electrically erasable programmable read only memory), registers, magnetic disks, optical disks, and hard drives. The data storage devices 115 may be components of the processor 110, or the data storage devices 115 may be operably connected to the processor 110 for use thereby. As used throughout this description, the term "operably connected" can include direct or indirect connections, including connections without direct physical contact.

[0050] In one or more configurations, the one or more data stores 115 may include map data 116. The map data 116 may include maps of one or more geographic regions. In some cases, the map data 116 may include information or data regarding roads, traffic control devices, road markings, structures, features, and / or landmarks in one or more geographic regions. The map data 116 may be in any suitable form. In some cases, the map data 116 may include an aerial photograph of the region. In some cases, the map data 116 may include a ground view of the region, including a 360 degree ground view. The map data 116 may include measurements, dimensions, distances, and / or information for one or more items included in the map data 116 and / or measurements, dimensions, distances, and / or information relative to other items included in the map data 116. The map data 116 may include a digital map with information regarding road geometry.

[0051] In one or more configurations, the map data 116 may include one or more topographical maps 117. The topographical maps 117 may include information about the terrain, roads, surfaces, and / or other features of one or more geographical regions. The topographical maps 117 may include elevation data for one or more geographical regions. The topographical maps 117 may define one or more terrains, which may include paved roads, unpaved roads, land, and other defining terrains.

[0052] In one or more configurations, the map data 116 may include one or more static obstacle maps 118. The static obstacle map 118 may include information about one or more static obstacles located within one or more geographic regions. A "static obstacle" is a physical object whose location does not change or does not substantially change over a period of time and / or whose size does not change or does not substantially change over a period of time. Examples of static obstacles may include trees, buildings, curbs, fences, railings, medians, utility poles, statues, monuments, signs, benches, furniture, mailboxes, large rocks, hills, and the like. A static obstacle may be an object that extends above the ground. One or more static obstacles included in the static obstacle map 118 may have location data, size data, dimension data, material data, and / or other data associated with the static obstacle. The static obstacle map 118 may include measurements, dimensions, distances, and / or information of one or more static obstacles. The static obstacle map 118 may be of high quality and / or highly detailed and may be updated to reflect changes in the mapped area.

[0053] The one or more data stores 115 may include sensor data 119. In this context, "sensor data" means any information related to sensors equipped with the vehicle 100, including performance and other information related to such sensors. As described below, the vehicle 100 may be equipped with a sensor system 120. The sensor data 119 may be related to one or more sensors of the sensor system 120. As an example, in one or more configurations, the sensor data 119 may include information related to one or more light detection and ranging (LIDAR) sensors 124 of the sensor system 120.

[0054] The sensor data 119 includes at least vehicle control inputs. In one example, the vehicle control inputs include steering inputs (e.g., steering wheel angle, rotational speed, and direction, etc.), braking inputs (e.g., degree of brake pedal actuation / pressure), and acceleration inputs (e.g., degree of accelerator pedal actuation / pressure). In additional aspects, the vehicle control inputs also specify transmission control inputs (e.g., gear selection), drive mode (e.g., two-wheel drive, four-wheel drive, etc.), engine / motor parameters (e.g., engine RPM, hybrid vehicle drive mode, etc.), and the like. In yet additional aspects, the sensor data 119 includes current dynamic data such as angular velocity, G-forces (e.g., longitudinal, lateral, etc.), speed profile, wheel speeds, actuation controls (e.g., anti-lock braking system (ABS) actuation, traction control actuation, stability control actuation, etc.).

[0055] In some cases, at least a portion of the map data 116 and / or the sensor data 119 may be located in one or more data stores 115 located on-board the vehicle 100. Alternatively, or in addition, at least a portion of the map data 116 and / or the sensor data 119 may be located in one or more data stores 115 located remotely from the vehicle 100.

[0056] As described above, the vehicle 100 can include a sensor system 120. The sensor system 120 can include one or more sensors. A "sensor" means a device that can detect and / or sense something. In at least one embodiment, the one or more sensors detect and / or sense in real-time. As used herein, the term "real-time" refers to a degree of processing responsiveness that a user or system perceives as immediate enough for a particular process or decision to be performed or that allows a processor to keep up with some external process.

[0057] In configurations in which sensor system 120 includes multiple sensors, the sensors may function independently or two or more sensors may function in combination. Sensor system 120 and / or one or more sensors may be operatively connected to processor 110, data storage 115, and / or other elements of vehicle 100. Sensor system 120 may generate observations about a portion of the environment of vehicle 100 (e.g., nearby vehicles).

[0058] The sensor system 120 may include any suitable type of sensor. Various examples of different types of sensors are described herein. However, it will be understood that the embodiments are not limited to the particular sensors described. The sensor system 120 may include one or more vehicle sensors 121. The vehicle sensors 121 may detect information about the vehicle 100 itself. In one or more configurations, the vehicle sensors 121 may be configured to detect changes in position and orientation of the vehicle 100, for example, based on inertial acceleration. In one or more configurations, the vehicle sensors 121 may include one or more accelerometers, one or more gyroscopes, an inertial measurement unit (IMU), a dead reckoning system, a global navigation satellite system (GNSS), a GPS, a navigation system 147, and / or other suitable sensors. The vehicle sensors 121 may be configured to detect one or more characteristics of the vehicle 100 and / or the manner in which the vehicle 100 is operating. In one or more configurations, the vehicle sensors 121 may include a speedometer for determining the current speed of the vehicle 100 .

[0059] Alternatively or additionally, the sensor system 120 may include one or more environmental sensors 122 configured to obtain data about the environment surrounding the vehicle 100 in which the vehicle 100 is operating. "Around environment data" includes data about the external environment in which the vehicle is located or one or more portions thereof. For example, the one or more environmental sensors 122 may be configured to sense obstacles and / or data about such obstacles in at least a portion of the external environment of the vehicle 100. Such obstacles may be stationary objects and / or dynamic objects. The one or more environmental sensors 122 may be configured to detect other things in the external environment of the vehicle 100, such as, for example, lane markers, signs, traffic lights, traffic signs, lanes, pedestrian crossings, curbs proximate to the vehicle 100, objects outside the general roadway, etc.

[0060] Described herein are various examples of sensors for sensor system 120. The example sensors may be part of one or more environmental sensors 122 and / or one or more vehicle sensors 121. However, it will be understood that embodiments are not limited to the particular sensors described.

[0061] As an example, in one or more configurations, the sensor system 120 may include one or more of each of a radar sensor 123, a LIDAR sensor 124, a sonar sensor 125, a weather sensor, a tactile sensor, a position sensor, and / or one or more cameras 126. In one or more configurations, the one or more cameras 126 may be high dynamic range (HDR) cameras, stereo or infrared (IR) cameras.

[0062] Vehicle 100 may include an input system 130. An "input system" includes any component or configuration, or grouping thereof, that allows various entities to input data into the machine. Input system 130 may receive input from an occupant of the vehicle. Vehicle 100 may include an output system 135. An "output system" includes one or more components that facilitate the presentation of data to an occupant of the vehicle.

[0063] The vehicle 100 may include one or more vehicle systems 140. Various examples of the one or more vehicle systems 140 are shown in FIG. 1. However, the vehicle 100 may include more, fewer, or different vehicle systems. Although certain vehicle systems are separately defined, it should be understood that each or any of the systems or portions thereof may be otherwise combined or separated via hardware and / or software within the vehicle 100. The vehicle 100 may include a propulsion system 141, a braking system 142, a steering system 143, a throttle system 144, a transmission system 145, a signal system 146, and / or a navigation system 147. Each such system may include one or more devices, components, and / or combinations thereof, now known or later developed.

[0064] Navigation system 147 may include one or more now known or later developed devices, applications, and / or combinations thereof configured to determine the geographic location of vehicle 100 and / or determine a route traveled by vehicle 100. Navigation system 147 may include one or more mapping applications for determining a route traveled by vehicle 100. Navigation system 147 may include a global positioning system, a local positioning system, or a geolocation system.

[0065] The processor 110 and / or the autonomous driving module 160 may be operatively connected to communicate with the various vehicle systems 140 and / or their individual components. For example, the processor 110 and / or the autonomous driving module 160 may communicate to send and / or receive information from the various vehicle systems 140 to control the movement of the vehicle 100. The processor 110 and / or the autonomous driving module 160 may control some or all of the vehicle systems 140 and thus may be partially or fully autonomous as defined by the Society of Automotive Engineers (SAE) levels 0 to 5.

[0066] As another example, the processor 110 and / or the autonomous driving module 160 may be operatively connected to communicate with the various vehicle systems 140 and / or their individual components. For example, the processor 110 and / or the autonomous driving module 160 may communicate to send and / or receive information from the various vehicle systems 140 to control the movement of the vehicle 100. The processor 110 and / or the autonomous driving module 160 may control some or all of the vehicle systems 140.

[0067] The processor 110 and / or the self-driving module 160 may be operable to control the navigation and operation of the vehicle 100 by controlling the vehicle systems 140 and / or one or more of its components. For example, the processor 110 and / or the self-driving module 160 may control the direction and / or speed of the vehicle 100 when operating in an automatic or autonomous mode. The processor 110 and / or the self-driving module 160 may accelerate, decelerate, and / or turn the vehicle 100. As used herein, "cause" or "causing" means to cause, compel, force, direct, command, command, and / or enable an event or action, or at least be in a state in which such an event or action may occur in a direct or indirect manner.

[0068] Vehicle 100 may include one or more actuators 150. Actuator 150 may be an element or combination of elements operable to modify one or more of vehicle systems 140 or components in response to receiving signals or other inputs from processor 110 and / or autonomous driving module 160. For example, one or more actuators 150 may include motors, pneumatic actuators, hydraulic pistons, relays, solenoids, piezoelectric actuators, etc.

[0069] Vehicle 100 may include one or more modules, at least some of which are described herein. The modules may be implemented as computer readable program code that, when executed by processor 110, performs one or more of the various processes described herein. Although one or more of the modules may be components of processor 110, one or more of the modules may be executed on and / or distributed to other processing systems to which processor 110 is operatively connected. A module may include instructions (e.g., program logic) executable by one or more processors 110. Alternatively, or in addition, one or more data stores 115 may include such instructions.

[0070] In one or more configurations, one or more of the modules described herein may include artificial intelligence elements, such as neural networks, fuzzy logic, or other machine learning algorithms. Additionally, in one or more configurations, one or more of the modules may be distributed across multiple modules described herein. In one or more configurations, two or more of the modules described herein may be combined into a single module.

[0071] The vehicle 100 may include one or more autonomous driving modules 160. The autonomous driving module 160 may be configured to receive data from the sensor system 120 and / or any other type of system capable of capturing information related to the vehicle 100 and / or the vehicle's 100's external environment. In one or more configurations, the autonomous driving module 160 may use such data to generate one or more driving scene models. The autonomous driving module 160 may determine the position and speed of the vehicle 100. The autonomous driving module 160 may determine the location of obstacles or other environmental features, including traffic signs, trees, shrubs, adjacent vehicles, pedestrians, etc.

[0072] The autonomous driving module 160 may be configured to receive and / or determine position information of obstacles in the external environment of the vehicle 100 for use by the processor 110, and / or one or more of the modules described herein may be configured to estimate the position and orientation of the vehicle 100, the vehicle's position in global coordinates based on signals from multiple satellites, or any other data and / or signals that may be used to determine the position of the vehicle 100 relative to its environment, for use in either determining the current state of the vehicle 100 or in creating a map or determining the position of the vehicle 100 relative to the map data.

[0073] The autonomous driving module 160 may be configured to determine a driving path, a current autonomous driving maneuver of the vehicle 100, a future autonomous driving maneuver and / or modifications to the current autonomous driving maneuver based on data acquired by the sensor system 120, a driving scene model and / or data from the sensor data 250 implemented by the occupancy module, or any other suitable source of data. A "driving maneuver" refers to one or more actions that affect the movement of the vehicle. Examples of driving maneuvers include accelerating, decelerating, braking, turning, moving the vehicle 100 laterally, changing lanes of travel, merging into lanes of travel, backing up, and the like. The autonomous driving module 160 may be configured to implement the determined driving maneuver. The autonomous driving module 160 may directly or indirectly cause such an autonomous driving maneuver to be implemented. As used herein, "causing" or "causing" means causing, commanding, directing, and / or enabling an event or action, or at least being in a state in which such an event or action may occur directly or indirectly. Autonomous driving module 160 may be configured to perform various vehicle functions and / or send data to, receive data from, interact with, and / or control vehicle 100 or one or more of its systems (e.g., one or more of vehicle systems 140).

[0074] Detailed embodiments are disclosed herein. However, it should be understood that the disclosed embodiments are intended as examples only. For this reason, the specific structural and functional details disclosed herein should not be interpreted as limitations, but merely as a basis for the claims, as well as a representative basis for teaching those skilled in the art to employ the aspects of the present specification in various ways in virtually any appropriately detailed structure. Furthermore, the terms and phrases used herein are not intended to be limiting, but rather to provide an understandable description of possible implementations. Although various embodiments are shown in Figures 1-9, the embodiments are not limited to the structures or applications shown.

[0075] The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments. In this regard, each block in the flowcharts or block diagrams may represent a module, segment, or portion of code that includes one or more executable instructions for implementing the specified logical function(s). It should also be noted that in some alternative implementations, the functions shown in the blocks may occur out of the order shown. For example, two blocks shown in succession may in fact be executed substantially simultaneously, or the blocks may be executed in the reverse order depending on the functionality involved.

[0076] The above systems, components and / or processes can be realized in hardware or a combination of hardware and software, either in a centralized manner in one processing system or in a distributed manner where different elements are spread across several interconnected processing systems. Any kind of processing system or other device configured to perform the methods described herein is suitable. A typical combination of hardware and software may be a processing system with computer usable program code that, when loaded and executed, controls the processing system to perform the methods described herein. The systems, components and / or processes may also be embedded in a computer readable storage device, such as a computer program product or other data program storage device, that is readable by a machine and tangibly embodies a program of instructions executable by the machine to perform the methods and processes described herein. These elements may also be embedded in an application product that includes all functionality enabling the implementation of the methods described herein and that, when loaded into a processing system, can perform such methods.

[0077] Further, the arrangements described herein may take the form of a computer program product in which computer readable program code is embodied, e.g., stored, on one or more computer readable media. Any combination of one or more computer readable media may be utilized. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. The phrase "computer readable storage medium" refers to a non-transitory storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of computer readable storage media (a non-exhaustive list) include a portable computer diskette, a hard disk drive (HDD), a solid state drive (SSD), a ROM, an erasable programmable read-only memory (EPROM or flash memory), a portable compact disk read-only memory (CD-ROM), a digital versatile disk (DVD), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer-readable storage medium may be any tangible medium that can contain or store a program for use by or in connection with an instruction execution system, apparatus, or device.

[0078] Generally, as used herein, a module includes a routine, program, object, component, data structure, etc. that performs a particular task or implements a particular data type. In an additional aspect, a memory generally stores the noted modules. The memory associated with a module may be a buffer or cache embedded within the processor, RAM, ROM, flash memory, or another suitable electronic storage medium. In yet an additional aspect, the modules contemplated by the present disclosure are implemented as hardware components in an ASIC, a system-on-chip (SOC), as a programmable logic array (PLA), or as another suitable hardware component embedded with a defined configuration set (e.g., instructions) to perform the disclosed functions.

[0079] The program code embodied on the computer readable medium may be transmitted using any suitable medium, including, but not limited to, wireless, wired, optical fiber, cable, radio frequency (RF), or the like, or any suitable combination thereof. TM The program code may be written in any combination of one or more programming languages, including object-oriented programming languages ​​such as, for example, .NET, Smalltalk, C++, and traditional procedural programming languages ​​such as the "C" programming language or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a stand-alone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. If entirely executed, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection may be made to an external computer (e.g., via the Internet using an Internet Service Provider).

[0080] The terms "a" and "an," as used herein, are defined as one or more than one. The term "multiple," as used herein, is defined as two or more than two. The term "another," as used herein, is defined as at least a second or more. The terms "including" and / or "having," as used herein, are defined as comprising (i.e., open language). The phrase "and at least one of," as used herein, refers to and encompasses some or all possible combinations of one or more of the associated listed items. As an example, the phrase "at least one of A, B, and C" includes only A, only B, only C, or any combination thereof (e.g., AB, AC, BC, or ABC).

[0081] Aspects of the present specification may be embodied in other forms without departing from the spirit or essential attributes thereof, and reference should therefore be made to the following claims, rather than the foregoing specification, as indicating the scope of the present specification. The invention disclosed in this specification includes the following aspects. [Aspect 1] 1. A warning system for improving driver warnings for automated driving of a vehicle, comprising: one or more processors; a memory communicatively coupled to the one or more processors, A monitoring module including instructions that, when executed by the one or more processors, cause the one or more processors to: a monitoring module that monitors a vehicle control system for driver feedback during the automated driving; An adaptation module including instructions that, when executed by one or more processors, cause the one or more processors to: adapting the points value in a prescribed ratio depending on whether the driver feedback is present; an adaptation module that generates a driver alert in response to determining that the point value meets a threshold before the driver feedback is present; and A warning system comprising: [Aspect 2] The warning system of claim 1, wherein the adaptation module includes instructions for adapting the point value, including instructions for adjusting the point value from a reduced value and resuming the automated driving upon detecting the presence of the driver feedback. [Aspect 3] The warning system of claim 2, wherein the adaptation module includes instructions for adapting the point value, including instructions for maintaining the point value constant before the autonomous driving resumes. Aspect 4 The warning system of embodiment 1, wherein the adaptation module includes instructions for adapting a point value, including instructions for adapting the specified ratio depending on the complexity of the driving maneuver of the autonomous vehicle associated with a driving state including the location of the vehicle. Aspect 5 The warning system of claim 4, wherein the adaptation module includes instructions for adapting the point value, including instructions for adapting the specified ratio, on the condition that the driver feedback is not present before the threshold is met. Aspect 6 The warning system of claim 1, wherein the adaptation module further includes instructions for adapting the point value, including instructions for adapting the specified ratio according to the complexity of the driving maneuver of the autonomous driving system relative to the speed of the vehicle. Aspect 7 2. The warning system of claim 1, wherein the adaptation module further comprises instructions for adapting the point value, including instructions for adapting the specified ratio according to a driver condition including a driver experience level. Aspect 8 The warning system of aspect 1, wherein the adaptation module further includes instructions that, when executed by the one or more processors, cause the one or more processors to reset the point value to zero if the driver feedback is an operation by the driver that is a vehicle takeover. Aspect 9 1. A non-transitory computer-readable medium for improving driver alerts for automated driving of a vehicle, the medium comprising instructions that, when executed by one or more processors, cause the one or more processors to: monitoring a vehicle control system for driver feedback during said automated driving; adapting the points value in a prescribed ratio depending on whether the driver feedback is present; and a non-transitory computer readable medium for generating a driver warning in response to determining that the points value meets a threshold value prior to the presence of the driver feedback. Aspect 10 A non-transitory computer-readable medium as described in claim 9, wherein the instructions for adapting the point value include instructions for adjusting a point value from a reduced value and resuming the automated driving when detecting that the driver feedback is present. Aspect 11 11. The non-transitory computer-readable medium of claim 10, wherein the instructions for adapting the point value include instructions for maintaining the point value constant before the automated driving resumes. Aspect 12 A non-transitory computer-readable medium as described in claim 9, wherein the instructions for adapting the point value include instructions for adapting the specified ratio depending on the complexity of the driving maneuver of the automated driving system associated with a driving state including the location of the vehicle. Aspect 13 1. A method for improving driver alerting for automated driving of a vehicle, the method comprising: monitoring a vehicle control system for driver feedback during the automated driving; adapting a points value in a prescribed ratio depending on whether the driver feedback is present; generating a warning to a driver in response to determining that the points value meets a threshold value prior to the driver feedback being present; A method comprising: Aspect 14 14. The method of claim 13, further comprising adjusting the points value from a decreased value upon detecting the presence of the driver feedback and resuming the automated driving. Aspect 15 15. The method of claim 14, further comprising maintaining the point value constant before the automated driving resumes. Aspect 16 The method of claim 13, wherein adapting the point value further includes adapting the specified ratio depending on the complexity of the driving maneuver of the automated driving system associated with a driving state including the location of the vehicle. Aspect 17 17. The method of claim 16, wherein adapting the point value further comprises adapting the specified ratio on a condition that the driver feedback is not present prior to satisfying the threshold. Aspect 18 The method of claim 13, wherein adapting the point value further includes adapting the specified ratio according to a complexity of the driving maneuver of the automated driving system relative to a speed of the vehicle. Aspect 19 14. The method of embodiment 13, wherein adapting the point value further comprises adapting the defined ratio according to a driver state including a driver experience level. Aspect 20 14. The method of claim 13, further comprising resetting the point value to zero if the driver feedback is an action by the driver that is a takeover of a vehicle.

Claims

1. 1. A warning system for improving driver warnings for automated driving of a vehicle, comprising: one or more processors; a memory communicatively coupled to the one or more processors, A monitoring module including instructions that, when executed by the one or more processors, cause the one or more processors to: a monitoring module that monitors a vehicle control system for driver feedback during the automated driving; An adaptation module including instructions that, when executed by one or more processors, cause the one or more processors to: adapting the points value in a prescribed ratio depending on whether the driver feedback is present; an adaptation module that generates a driver alert in response to determining that the point value meets a threshold before the driver feedback is present; and Equipped with The adaptation module includes instructions for adapting a point value, the instructions including instructions for adapting the specified ratio according to a complexity of a driving maneuver of the automated driving system associated with a driving state including a location of the vehicle. Warning system.

2. A warning system for improving driver warnings for automated driving of a vehicle, comprising: one or more processors; a memory communicatively coupled to the one or more processors, A monitoring module including instructions that, when executed by the one or more processors, cause the one or more processors to: a monitoring module that monitors a vehicle control system for driver feedback during the automated driving; An adaptation module including instructions that, when executed by one or more processors, cause the one or more processors to: adapting the points value in a prescribed ratio depending on whether the driver feedback is present; an adaptation module that generates a driver alert in response to determining that the point value meets a threshold before the driver feedback is present; and Equipped with The adaptation module further includes instructions for adapting the point value, the instructions including instructions for adapting the predetermined ratio according to a complexity of a driving maneuver of the automated driving system related to a speed of the vehicle. Warning system.

3. A warning system for improving driver warnings for automated driving of a vehicle, comprising: one or more processors; a memory communicatively coupled to the one or more processors, A monitoring module including instructions that, when executed by the one or more processors, cause the one or more processors to: a monitoring module that monitors a vehicle control system for driver feedback during the automated driving; An adaptation module including instructions that, when executed by one or more processors, cause the one or more processors to: adapting the points value in a prescribed ratio depending on whether the driver feedback is present; an adaptation module that generates a driver alert in response to determining that the point value meets a threshold before the driver feedback is present; and Equipped with the adaptation module further comprises instructions for adapting the point value, including instructions for adapting the prescribed ratio according to a driver condition, including a driver experience level; Warning system.

4. 2. The warning system of claim 1, wherein the adaptation module includes instructions for adapting the point value, including instructions for adapting the specified ratio, provided that the driver feedback is not present before the threshold is met.

5. 1. A non-transitory computer-readable medium for improving driver alerts for automated driving of a vehicle, the medium comprising instructions that, when executed by one or more processors, cause the one or more processors to: monitoring a vehicle control system for driver feedback during said automated driving; adapting the points value in a prescribed ratio depending on whether the driver feedback is present; generating a driver warning in response to determining that the points value meets a threshold value prior to the driver feedback being present; The instructions for adapting the point value include instructions for adapting the specified ratio in response to a complexity of a driving maneuver of the automated driving system associated with a driving state including a location of the vehicle. Non-transitory computer-readable medium.

6. 1. A method for improving driver alerting for automated driving of a vehicle, the method comprising: monitoring a vehicle control system for driver feedback during the automated driving; adapting a points value in a prescribed ratio depending on whether the driver feedback is present; generating a warning to a driver in response to determining that the points value meets a threshold value prior to the driver feedback being present; Including, Adapting the point value further includes adapting the specified ratio in response to a complexity of a driving maneuver of the automated driving system associated with a driving state including a location of the vehicle. method.

7. A method for improving driver warnings for automated driving of a vehicle, the method comprising: monitoring a vehicle control system for driver feedback during the automated driving; adapting a points value in a prescribed ratio depending on whether the driver feedback is present; generating a warning to a driver in response to determining that the points value meets a threshold value prior to the driver feedback being present; Including, Adapting the point value further includes adapting the specified ratio according to a complexity of a driving maneuver of the automated driving system relative to a speed of the vehicle. method.

8. A method for improving driver warnings for automated driving of a vehicle, the method comprising: monitoring a vehicle control system for driver feedback during the automated driving; adapting a points value in a prescribed ratio depending on whether the driver feedback is present; generating a warning to a driver in response to determining that the points value meets a threshold value prior to the driver feedback being present; Including, and adapting the point value further comprises adapting the defined ratio according to a driver state including a driver experience level. method.

9. The method of claim 6 , wherein adapting the point value further comprises adapting the prescribed ratio on a condition that the driver feedback is not present prior to satisfying the threshold.

Images