Driver status display

Abstract

A system for providing a driver status to a driver of a vehicle includes a data processor, a plurality of sensors mounted within the vehicle and adapted to send vehicle information to the data processor, a driver monitoring system within the vehicle adapted to send driver information to the data processor, the data processor further adapted to collect information from external sources via a wireless data communication network, and a driver status display adapted to receive information from the data processor and display a short term status indicator, a long term status indicator, and textual information.

Description

TECHNICAL FIELD

[0001] The present disclosure relates to a system and method for displaying a driver's state of attention. Current systems use sensors and driver monitoring systems to "monitor" the driver and provide an alert or warning in the event the driver is distracted to bring the driver's attention back to driving. These systems typically operate on a binary basis, meaning either the system determines that the driver is paying adequate attention or the driver is not paying adequate attention. In such systems, action is taken when the system determines that the driver is not paying adequate attention. BACKGROUND

[0002] Accordingly, while current systems and methods achieve their intended purpose, there is a need for a new and improved system and method for providing a display of a driver's state that displays a short-term state indicator that provides an indication of the driver's current state and a long-term state indicator that provides an indication of how the driver's state is trending. SUMMARY

[0003] According to aspects of the present disclosure, a system for providing a driver's state to a driver of a vehicle includes a data processor, a plurality of sensors mounted within the vehicle and adapted to send vehicle information to the data processor, a driver monitoring system within the vehicle adapted to send driver information to the data processor, the data processor further adapted to collect information from external sources via a wireless data communication network, and a driver state display adapted to receive information from the data processor and display a short-term state indicator, a long-term state indicator, and textual information.

[0004] According to another aspect of the system, the short-term state indicator is a graphical indicator of the current driver state.

[0005] According to another aspect of the system, the long-term state indicator is one of a plurality of long-term graphical indicators that represent how the driver's state is trending.

[0006] According to another aspect of the system, the long-term graphical indicator is adapted to warn the driver of a gradual change in the driver's state prior to a vehicle alert warning, the gradual change indicating an increase in driver distraction.

[0007] According to another aspect of the system, the plurality of long-term graphical indicators includes a first long-term graphical indicator representing an excellent driver state, a second long-term graphical indicator representing a normal driver state, a third long-term graphical indicator representing a cautionary driver state, and a fourth long-term graphical indicator representing a poor driver state.

[0008] According to another aspect of the system, the data processor is further adapted to run a driver state algorithm and update the displayed short-term state indicator and the displayed long-term state indicator based on output from the driver state algorithm.

[0009] According to another aspect of the system, the data processor is further adapted to update the threshold within the driver state algorithm based on information of environmental factors collected by an external source.

[0010] According to another aspect of the system, the data processor is further adapted to update the threshold within the driver state algorithm based on a level of autonomy of the vehicle.

[0011] According to another aspect of the system, the textual information includes an explanation of the displayed long-term driver state and a suggestion to improve the long-term driver state.

[0012] According to aspects of the present disclosure, a method of providing a driver of a vehicle with a driver state includes collecting, with a data processor located within the vehicle, vehicle information from a plurality of sensors installed within the vehicle; collecting, with the data processor, driver information from a driver monitoring system within the vehicle; collecting, with the data processor, information from an external source via a wireless data communication network; transmitting, with the data processor, the information to a driver state display within the vehicle; and displaying, via the driver state display, a short-term state indicator, a long-term state indicator, and textual information.

[0013] According to another aspect of the method, displaying, via the driver state display, the short-term state indicator further includes displaying a graphical indicator of a current driver state.

[0014] According to another aspect of the method, displaying, via the driver state display, the long-term state indicator further includes displaying one of a plurality of long-term graphical indicators representing how the driver state is trending.

[0015] According to another aspect of the method, the long-term graphical indicator is adapted to warn the driver of a gradual change in the driver state prior to a vehicle alert warning, the gradual change indicating an increase in driver distraction.

[0016] According to another aspect of the method, displaying one of a plurality of long-term graphical indicators representing how the driver state is trending further includes displaying one of a first long-term graphical indicator representing an excellent driver state, a second long-term graphical indicator representing a normal driver state, a third long-term graphical indicator representing a cautionary driver state, and a fourth long-term graphical indicator representing a poor driver state.

[0017] According to another aspect of the method, sending information to the driver state display and displaying the short-term status indicator and the long-term status indicator via the driver state display with the data processor further comprises: running a driver state algorithm with the data processor, the driver state algorithm adapted to determine a driver state based on information from the driver monitoring system; and updating the displayed short-term status indicator and the displayed long-term status indicator based on output from the driver state algorithm.

[0018] According to another aspect, the method comprises updating a threshold within the driver state algorithm based on information of environmental factors collected by an external source.

[0019] According to another aspect, the method comprises updating a threshold within the driver state algorithm based on a level of autonomy of the vehicle.

[0020] According to another aspect of the method, displaying textual information via the driver state display further comprises displaying information to the driver via the driver state display that explains the long-term driver state and provides suggestions for improving the long-term driver state.

[0021] The present invention can also comprise the following solutions.

[0022] 1. A system for providing a driver state to a driver of a vehicle, comprising:

[0023] a data processor;

[0024] a plurality of sensors mounted within the vehicle and adapted to send vehicle information to the data processor;

[0025] a driver monitoring system within the vehicle adapted to send driver information to the data processor;

[0026] the data processor is further adapted to collect information from external sources via a wireless data communication network; and

[0027] a driver state display adapted to receive information from the data processor and display a short-term status indicator, a long-term status indicator, and textual information.

[0028] 2. The system according to solution 1, wherein the short-term status indicator is a graphical indicator of a current driver state.

[0029] 3. The system according to solution 2, wherein the long-term status indicator is one of a plurality of long-term graphical indicators representing how the driver state is trending.

[0030] 4. The system of aspect 3, wherein the long-term graphical indicator is adapted to warn the driver of a gradual change in the driver state prior to a vehicle alert warning, the gradual change indicating an increasing driver distraction.

[0031] 5. The system of aspect 4, wherein the plurality of long-term graphical indicators includes a first long-term graphical indicator representing an excellent driver state, a second long-term graphical indicator representing a normal driver state, a third long-term graphical indicator representing a caution driver state, and a fourth long-term graphical indicator representing a poor driver state.

[0032] 6. The system of aspect 5, wherein the data processor is further adapted to run a driver state algorithm and update the displayed short-term state indicator and the displayed long-term state indicator based on output from the driver state algorithm.

[0033] 7. The system of aspect 6, wherein the data processor is further adapted to update thresholds within the driver state algorithm based on information of environmental factors collected by the external source.

[0034] 8. The system of aspect 7, wherein the data processor is further adapted to update thresholds within the driver state algorithm based on a level of autonomy of the vehicle.

[0035] 9. The system of aspect 8, wherein the textual information includes an explanation of the displayed long-term driver state and a suggestion to improve the long-term driver state.

[0036] 10. A method of providing a driver state to a driver of a vehicle, comprising:

[0037] collecting, with a data processor located within the vehicle, vehicle information from a plurality of sensors installed within the vehicle;

[0038] collecting, with the data processor, driver information from a driver monitoring system within the vehicle;

[0039] collecting, with the data processor, information from an external source via a wireless data communication network;

[0040] sending, with the data processor, information to a driver state display within the vehicle; and

[0041] displaying, via the driver state display, a short-term state indicator, a long-term state indicator, and textual information.

[0042] 11. The method of aspect 10, wherein displaying, via the driver state display, a short-term state indicator further comprises displaying a graphical indicator of a current driver state.

[0043] 12. The method of paragraph 11, wherein displaying a long-term status indicator via the driver status display further comprises displaying one of a plurality of long-term graphical indicators representative of how the driver status is trending.

[0044] 13. The method of paragraph 12, wherein the long-term graphical indicator is adapted to warn the driver of a gradual change in driver status prior to a vehicle alert warning, the gradual change indicating an increasing driver distraction.

[0045] 14. The method of paragraph 13, wherein displaying one of a plurality of long-term graphical indicators representative of how the driver status is trending further comprises displaying one of a first long-term graphical indicator representative of an excellent driver status, a second long-term graphical indicator representative of a normal driver status, a third long-term graphical indicator representative of a caution driver status, and a fourth long-term graphical indicator representative of a poor driver status.

[0046] 15. The method of paragraph 14, wherein transmitting information to the driver status display with the data processor and displaying the short-term status indicator and the long-term status indicator via the driver status display further comprises:

[0047] running a driver status algorithm with the data processor, the driver status algorithm adapted to determine a driver status based on information from the driver monitoring system; and

[0048] updating the displayed short-term status indicator and the displayed long-term status indicator based on output from the driver status algorithm.

[0049] 16. The method of paragraph 15, further comprising updating a threshold value within the driver status algorithm based on information of environmental factors collected by the external source.

[0050] 17. The method of paragraph 16, further comprising updating a threshold value within the driver status algorithm based on a level of autonomy of the vehicle.

[0051] 18. The method of paragraph 17, wherein displaying textual information via the driver status display further comprises displaying information to the driver via the driver status display that explains the long-term driver status and provides suggestions for improving the long-term driver status.

[0052] 19. A system for providing a driver status to a driver of a vehicle, comprising:

[0053] a data processor;

[0054] a plurality of sensors mounted within the vehicle and adapted to send vehicle information to the data processor;

[0055] a driver monitoring system within the vehicle adapted to send driver information to the data processor;

[0056] the data processor is further adapted to collect information from external sources via a wireless data communication network and run a driver state algorithm;

[0057] a driver state display adapted to receive information from the data processor and display:

[0058] a short-term state indicator that is a graphical indicator of the current driver state based on output from the driver state algorithm;

[0059] a long-term state indicator that is one of a plurality of long-term graphical indicators representing how the driver state is trending based on output from the driver state algorithm and adapted to warn the driver of a gradual change in the driver state indicating an increase in driver distraction prior to a vehicle alert warning; and

[0060] textual information including an explanation of the displayed long-term driver state and suggestions to improve the long-term driver state.

[0061] 20. The system of Scheme 19, wherein the data processor is further adapted to update thresholds within the driver state algorithm based on information of environmental factors collected by the external sources and based on an autonomous level of the vehicle.

[0062] Further areas of applicability will become apparent from the description provided herein. It should be understood that the description and specific examples are intended for purposes of illustration only and are not intended to limit the scope of the present disclosure. BRIEF DESCRIPTION OF DRAWINGS

[0063] The drawings described herein are for illustrative purposes only and are not intended to limit the scope of the present disclosure in any way.

[0064] Figure 1 is a schematic diagram of a system according to exemplary embodiments of the present disclosure;

[0065] Figure 2 is a perspective view of a portion of a dashboard display including a driver state display according to exemplary embodiments of the present disclosure;

[0066] Figure 3A is a perspective view of a driver state display including a first long-term state indicator;

[0067] Figure 3B is a perspective view of a driver state display including a second long-term status indicator;

[0068] Figure 3C is a perspective view of a driver state display including a third long-term status indicator;

[0069] Figure 3D is a perspective view of a driver state display including a fourth long-term status indicator;

[0070] Figure 4 is a flowchart illustrating a driver state algorithm according to example embodiments of the present disclosure;

[0071] Figure 5 is a flowchart illustrating a method according to example embodiments of the present disclosure; and

[0072] Figure 6 is a flowchart illustrating Figure 5 an example implementation of the method shown.

[0073] The drawings are not necessarily to scale and some features can be exaggerated or minimized, e.g., for clarity. In some instances, detailed descriptions of well-known components, systems, materials, or methods can not be discussed in detail to avoid obscuring the disclosure. Thus, specific structural and functional details disclosed herein are not to be interpreted as limiting, but merely as a representative basis for the claims and as a representative basis for teaching one skilled in the art to use the present disclosure in a variety of ways. DETAILED DESCRIPTION

[0074] The following description is merely exemplary in nature and is not intended to limit the disclosure, application or uses. Furthermore, there is no intention to be bound by any expressed or implied theory presented in the preceding technical field, background, summary or the following detailed description. It should be appreciated that the same reference numerals and characters represent like elements throughout the accompanying drawings. As used herein, the term module, alone or in any combination, refers to any hardware, software, firmware, electronic control component, processing logic, and / or processor means comprising any of the items listed in the following list, including but not limited to: application specific integrated circuits (ASICs), electronic circuits, processors (shared, dedicated, or group) and memories that execute one or more software or firmware programs, combinational logic circuits, and / or other suitable components that provide the described functionality. Although the drawings shown herein depict examples with certain arrangements of elements, additional intermediate elements, means, features, or components can be present in the actual embodiments. It will be further understood that the drawings are merely illustrative and can not be drawn to scale.

[0075] As used herein, the term "vehicle" is not limited to automobiles. While the present technology is primarily described herein in connection with automobiles, the technology is not limited to automobiles. The concept can be used in various applications, for example in connection with airplanes, watercraft, other vehicles, and consumer electronics components.

[0076] Referring to Figure 1 A system 10 for providing a driver status to a driver of a vehicle includes a data processor 12 adapted to collect information from external sources 14 via a wireless data communication network 16, a plurality of sensors 18 mounted within the vehicle and adapted to send vehicle information to the data processor 12, a driver monitoring system 20 within the vehicle adapted to send driver information to the data processor 12, and a driver status display 22 adapted to receive information from the data processor 12.

[0077] The data processor 12 is a non-generic electronic control device having a preprogrammed digital computer or processor, a memory or non-transitory computer readable medium for storing data such as control logic, software applications, instructions, computer code, data, lookup tables, and the like, and a transceiver or input / output port. The computer readable medium includes any type of medium capable of being accessed by a computer, such as read only memory (ROM), random access memory (RAM), a hard disk drive, a compact disc (CD), a digital video disc (DVD), or any other type of memory. The "non-transitory" computer readable medium excludes wired, wireless, optical, or other communication links transferring transitory electromagnetic signals or other signals. The non-transitory computer readable medium includes media in which data can be permanently stored and media in which data can be stored and later overwritten such as a rewritable optical disc or an erasable memory device. The computer code includes any type of program code, including source code, object code, and executable code.

[0078] The data processor 12 is adapted to collect information from external sources 14 over the wireless data communication network 16. The data processor 12 includes a transceiver that allows the data processor 12 to wirelessly communicate with remote databases of the external sources 14 over a WLAN, 4G or 5G network, or the like. Such databases can communicate directly via the Internet, or can be cloud-based databases. Information that can be collected by the data processor 12 from such external sources 14 includes, but is not limited to, road and highway databases maintained by transportation divisions, global positioning systems, the Internet, other vehicles via V2V communication networks, traffic information sources, vehicle-based support systems such as OnStar, and the like.

[0079] A plurality of sensors 18 installed within the vehicle and adapted to send vehicle information to the data processor 12 can include, but are not limited to, vehicle sensors adapted to monitor operating conditions of the vehicle such as speed, steering wheel input, braking, cruise control, acceleration, and infotainment systems for the vehicle and vehicle control systems within the vehicle. The plurality of sensors can also include a driver's mobile device equipped with an application that allows for communication with and control of the in-vehicle vehicle systems.

[0080] A driver monitoring system 20 within the vehicle is adapted to monitor the behavior of the vehicle driver. The driver monitoring system typically uses a driver-facing camera equipped with infrared light emitting diodes (LEDs) or lasers so that the camera can "see" the driver's face even at night and even if the driver is wearing dark sunglasses. Advanced in-vehicle software collects data points from the driver and creates an initial baseline of what the driver's normal state of attention looks like. The software can then determine if the driver is blinking more than usual, if the eyes are narrowing or closing, and if the head is tilting at an odd angle. It can also determine if the driver is looking at the road ahead and if the driver is actually paying attention or just gazing mindlessly. The driver monitoring system 20 uses cameras and sensors to monitor the driver's behavior, including but not limited to eye gaze behavior / patterns, body posture, and hand position. The driver monitoring system 20 can also monitor the driver's physiological characteristics such as, but not limited to, heart rate, respiration, galvanic skin response, EEG, and skin temperature.

[0081] The data processor 12 uses information collected by the driver monitoring system 20 to determine if the driver of the vehicle is distracted, drowsy, intoxicated, experiencing biomedical or other health distress, etc. The data processor 12 can communicate with the vehicle systems that take action to get the driver's attention by sounding an audio alert, lighting a visual indicator on the dashboard, or vibrating the seat. If the data processor determines that the driver is distracted while external sensors of the vehicle determine that it is about to have a collision, the vehicle systems can use information from the internal and external sensor fusion to automatically apply the brakes.

[0082] The data processor 12 is adapted to communicate with a driver status display 22. Referring to Figure 2 , a portion of the instrument panel display 24 is shown. The instrument panel display 24 includes a speed display 26 and a driver status display 22. The driver status display includes a short-term status indicator 28, a long-term status indicator 30, and text information 32. Referring to Figure 3AIn the example embodiment, the short-term status indicator 28 is a graphical indicator of the current driver status. In the example shown in the figure, the driver status display includes a graphical representation of the roadway 34, a graphical representation of the steering wheel 36, and the short-term status indicator 28 is an arrow indicating the current, real-time level of attention of the driver. In Figure 3A the short-term indicator 28 is a single arrow aligned with the graphical representation of the roadway 34 indicating that the driver is not distracted. In Figure 3B , Figure 3C and Figure 3D the short-term indicator 28 is a pair of outwardly angled arrows indicating that the vehicle driver is at least slightly distracted and not paying close attention to the roadway ahead.

[0083] The long-term status indicator 30 is one of a plurality of long-term graphical indicators 30A, 30B, 30C, 30D representing how the driver status is trending. The long-term graphical indicators 30A, 30B, 30C, 30D are adapted to warn the driver of a gradual change in the driver status indicating an increasing distraction of the driver prior to a vehicle alert warning. In the example embodiment, the long-term status indicator 30 includes four selectively illuminated indicator boxes 38A, 38B, 38C, 38D.

[0084] Referring to Figure 3A , the driver status display 22 includes a first long-term graphical indicator 30A representing an excellent driver status. For the first long-term indicator 30A, the first selectively illuminated indicator box 38A is illuminated. In the example embodiment, the first selectively illuminated indicator box 38A is illuminated in green. The first long-term graphical indicator 30A indicates to the driver that the driver is and has been driving in an undistracted manner.

[0085] Referring to Figure 3B , the driver status display 22 includes a second long-term graphical indicator 30B representing a normal driver status. For the second long-term indicator 30B, the first selectively illuminated indicator box 38A and the second selectively illuminated indicator box 38B are illuminated. In the example embodiment, the first and second selectively illuminated indicator boxes 38A, 38B are illuminated in yellow. The second long-term graphical indicator 30B indicates to the driver that the driver is and has been driving at a level of distraction that is considered normal according to predetermined thresholds applied by the data processor 12.

[0086] Referring to Figure 3CThe driver state display 22 includes a third long-term graphical indicator 30C representing an advisory driver state. For the third long-term indicator 30C, the first selectively illuminated indicator box 38A, the second selectively illuminated indicator box 38B, and the third selectively illuminated indicator box 38C are illuminated. In an exemplary embodiment, the first, second, and third selectively illuminated indicator boxes 38A, 38B, 38C are illuminated in orange. The third long-term graphical indicator 30C indicates to the driver that the driver’s level of distraction is trending toward a level of distraction that will trigger a distracted driving alert from the vehicle. The third long-term graphical indicator 30C is adapted to give the driver a warning prior to any active response by the vehicle in response to a determination by the driver monitoring system 20 that the driver is distracted.

[0087] Referring to Figure 3D The driver state display 22 includes a fourth long-term graphical indicator 30D representing a poor driver state. For the fourth long-term indicator 30D, the first selectively illuminated indicator box 38A, the second selectively illuminated indicator box 38B, the third selectively illuminated indicator box 38C, and the fourth selectively illuminated indicator box 38D are illuminated. In an exemplary embodiment, the first, second, third, and fourth selectively illuminated indicator boxes 38A, 38B, 38C, 38D are illuminated in red. The fourth long-term graphical indicator 30D indicates to the driver that the driver’s level of distraction exceeds a level that is considered normal according to predetermined thresholds applied by the driver monitoring system 20 and the data processor 12, and that an active response by the vehicle (an alert, a vibrating seat, a modification of autonomous control) is imminent. The fourth long-term graphical indicator 30D is adapted to give the driver a warning that the driver must immediately modify driving behavior to avoid an active distracted driving alert by the vehicle.

[0088] Referring again to Figure 3D The driver state display is adapted to display textual information 32. In an exemplary embodiment, the textual information includes an explanation of the displayed long-term driver state and a suggestion for improving the long-term driver state. As shown in the example of Figure 3D The textual information 32 includes the printed message “DISTRACTED” indicating that the driver is distracted and the suggestion “FOCUS ON DRIVING!” to get the driver’s attention and to promote the driver to increase attention.

[0089] The data processor uses information collected from the external sources 14, the plurality of sensors 18, and the driver monitoring system 20 to run the driver state algorithm 40 and update the displayed short-term state indicator 28 and the displayed long-term state indicator 30 based on the output of the driver state algorithm 40. The data processor 12 runs the driver state algorithm 40 at a repeating predetermined interval. In an exemplary embodiment, the data processor 12 runs the driver state algorithm 40 once every ten seconds.

[0090] refer to Figure 4 An exemplary embodiment of the driver state algorithm 40 is shown. Algorithm 40 begins at block 50, where the driver begins driving the vehicle. For a first criterion, moving to block 52, the data processor 12 determines whether the driver's eyes are properly focused on the road for more than 85% of a previously predetermined interval. Moving to block 54, the data processor 12 determines whether the driver's eyes are continuously focused on the road for an average of at least four (4) seconds during the previously predetermined interval. Moving to block 56, the data processor 12 determines whether the driver's eyes are continuously diverted from the road for an average of less than one (1) second during the previously predetermined interval. Moving to block 58, if the driver's eyes are properly focused on the road for more than 85% of the previously predetermined interval, and the driver's eyes are continuously focused on the road for an average of at least four (4) seconds during the previously predetermined interval, and the driver's eyes are continuously diverted from the road for an average of less than one (1) second during the previously predetermined interval, then the data processor 12 will change the long-term state indicator 30 by decreasing the indication by one.

[0091] For example, if the currently displayed long-term status indicator 30 is the third long-term graphic indicator 30C, and during the next run of the driver status algorithm 40, the data processor determines that the driver's eyes are properly focused on the road for more than 85% of a previously predetermined interval, and that the driver's eyes are continuously focused on the road for an average of at least four (4) seconds during the previously predetermined interval, and that the driver's eyes are continuously diverted from the road for an average of less than one (1) second during the previously predetermined interval, then the data processor 12 will update the long-term status indicator 30 by changing it from the third long-term graphic indicator 30C to the second long-term graphic indicator 30B. If the currently displayed long-term status indicator 30 is the first long-term graphic indicator 30A, no action is taken.

[0092] For the second criteria, moving from block 50 to block 60, the data processor 12 determines whether the driver's eyes are properly focused on the roadway for less than 50% of the previous predetermined interval. Moving to block 62, the data processor 12 determines whether the driver's eyes are continuously diverted from the roadway for an average of more than one and one-half (1.5) seconds of time interval and whether the number of glances away from the roadway during the previous predetermined interval is more than one (1). Moving to block 64, the data processor 12 determines whether the driver's eyes are persistently distracted from the roadway for more than three (3) seconds of a single time interval during the previous predetermined interval. Moving to block 66, if the driver's eyes are properly focused on the roadway for less than 50% of the previous predetermined interval, or if the driver's eyes are persistently diverted from the roadway for an average of more than one and one-half (1.5) seconds of time interval, and if the number of glances away from the roadway during the previous predetermined interval is more than one (1), or if the driver's eyes are persistently diverted from the roadway for more than three (3) seconds of a single time interval during the previous predetermined interval, the data processor 12 will change the long-term status indicator 30 by incrementing the indication by one.

[0093] For example, if the currently displayed long-term status indicator 30 is the second long-term graphical indicator 30B, and at the next run of the driver status algorithm 40, the data processor determines that the driver's eyes are properly focused on the roadway for less than 50% of the previous predetermined interval, or if the driver's eyes are persistently diverted from the roadway for an average of more than one and one-half (1.5) seconds of time interval, and if the number of glances away from the roadway during the previous predetermined interval is more than one (1), or if the driver's eyes are persistently diverted from the roadway for more than three (3) seconds of a single time interval during the previous predetermined interval, the data processor 12 will update the long-term status indicator 30 by changing from the second long-term graphical indicator 30B to the third long-term graphical indicator 30C. If the currently displayed long-term status indicator 30 is the fourth long-term graphical indicator 30D, no action is taken.

[0094] Moving from block 50 to block 68, if all of the first criteria in blocks 52, 54, and 56 are less than (not met) and if none of the second criteria in blocks 60, 62, and 64 are met; and moving to block 70, the long-term status indicator 30 is currently displaying the fourth long-term graphical indicator 38D; moving to block 72, the data processor 12 will update the long-term status indicator 30 by changing from the fourth long-term graphical indicator 30D to the third long-term graphical indicator 30C.

[0095] Alternatively, if fewer than all of the first criteria in blocks 52, 54, and 56 are met, and if any of the second criteria in blocks 60, 62, and 64 are not met at block 68, then move to block 74, if the long-term status indicator 30 is currently displaying the first long-term graphic indicator 38A, move to block 76, the data processor 12 will update the long-term status indicator 30 by changing from the first long-term graphic indicator 30A to the second long-term graphic indicator 30B.

[0096] In an exemplary embodiment, the data processor 12 is further adapted to update the thresholds within the driver state algorithm 40 based on information collected by the external sources 14 regarding environmental factors. For example, if the vehicle is traveling in adverse weather conditions or the weather conditions are about to deteriorate, it would be beneficial for the driver of the vehicle to pay closer attention to the road. Thus, if the information collected by the data processor 12 indicates that the vehicle is traveling in adverse weather conditions or the weather conditions are about to deteriorate, the data processor 12 will change the thresholds for what is considered "excellent," "normal," "caution," and "poor" distracted driving by the driver of the vehicle. This will cause the system 10 to more closely monitor the driving behavior of the driver to keep the driver more focused while driving in adverse weather conditions.

[0097] In another exemplary embodiment, the data processor 12 is further adapted to update the threshold values within the driver state algorithm 40 based on the level of autonomy of the vehicle. Autonomous vehicles are rated on a level / grade scale according to the degree of automation of the vehicle's driving. Level 0 automation means that the vehicle is not equipped with any automation. The driver is in full control of the vehicle at all times with zero automation assistance. Level 1 automation is the lowest level of automated / assisted vehicle operation. The driver is in full control but receives a minimal amount of guidance from a single advanced driver assistance system (ADAS) for things like acceleration, cruise control, or braking, usually for one task at a time. For level 2 automation or "partial driving automation," the driver is still in full control of the vehicle, paying full attention to the road, but the assistance from the ADAS is slightly more refined. The ADAS has combined automation functions, which for a human means that the system can potentially control steering and braking / acceleration at the same time. Level 3 automation or conditional driving automation is the vehicle operating fully autonomously but requires full human intervention in the event of a need for override. In this case, the vehicle can operate itself under certain conditions. Functions like steering, braking, and acceleration are automatic, but the driver must be ready to intervene. Level 4 automation or high driving automation is "hands off," as the car can perform all driving tasks and can intervene if something becomes chaotic. That is, level 4 only works for location-limited trips from point A to point B and back. Level 5 automation is full automation. This is the holy grail of autonomous vehicles. With a fully autonomous self-driving car, you can essentially read a book or play with your phone, as the vehicle can perform all driving tasks in all situations.

[0098] Thus, as the level of automation in the vehicle increases, the amount of attention required by the driver decreases. Accordingly, the data processor 12 will apply different threshold values for "excellent," "normal," "caution," and "terrible" distracted driving as deemed by the vehicle's driver depending on the level of automation of the vehicle.

[0099] Referring to Figure 5 The method 100 of providing a driver state to a driver of a vehicle includes, at block 102, collecting vehicle information with a data processor 12 located within the vehicle from a plurality of sensors 18 installed within the vehicle, moving to block 104, collecting driver information with the data processor 12 from a driver monitoring system 20 within the vehicle, moving to block 106, collecting information with the data processor 12 from external sources 14 via a wireless data communication network 16, moving to block 108, sending the information with the data processor 12 to a driver state display 22 within the vehicle, and moving to block 110, displaying a short-term state indicator 28, a long-term state indicator 30, and textual information 32 via the driver state display 22.

[0100] In an example embodiment, displaying the short-term status indicator 28 via the driver status display 22 at block 110 further comprises displaying a graphical indicator of the current driver status, as described above. In addition, displaying the long-term status indicator 30 via the driver status display 22 at block 110 further comprises displaying one of a plurality of long-term graphical indicators 30A, 30B, 30C, 30D that indicate how the driver status is trending and is adapted to warn the driver of a gradual change in the driver status indicating an increase in driver distraction prior to a vehicle alert warning. The plurality of long-term graphical indicators 30A, 30B, 30C, 30D includes a first long-term graphical indicator 30A that indicates an excellent driver status, a second long-term graphical indicator 30B that indicates a normal driver status, a third long-term graphical indicator 30C that indicates a caution driver status, and a fourth long-term graphical indicator 30D that indicates a poor driver status.

[0101] In an example embodiment, transmitting the information to the driver status display 22 and displaying the short-term status indicator 28 and the long-term status indicator 30 via the driver status display 22 at blocks 108 and 110 with the data processor 12 further comprises running a driver status algorithm 40 with the data processor 12 that is adapted to determine the driver status based on the information from the driver monitoring system 20 and updating the displayed short-term status indicator 28 and the displayed long-term status indicator 30 based on the output from the driver status algorithm 40.

[0102] In another example embodiment, the method 100 further comprises updating the threshold values within the driver status algorithm 40 based on information of environmental factors collected by the external source 14 and based on the autonomous level of the vehicle.

[0103] In another example embodiment, displaying the textual information 32 via the driver status display 22 at block 110 further comprises displaying information via the driver status display 22 that explains the long-term driver status and provides suggestions for improving the long-term driver status.

[0104] Reference Figure 6 is shown a flowchart 200 that describes an example embodiment of the method 100. At block 200, the driver begins driving the vehicle. Moving to block 204, the driver monitoring system 20 collects information about the driver behavior and transmits the information to the data processor 12. Moving to block 206, the data processor 12 runs a driver status algorithm using the information received from the driver monitoring system 20. Moving to block 208, the data processor 12 determines whether the driver behavior meets predetermined threshold criteria for a distracted driving condition, such as distraction, drowsiness, intoxication, impairment, stress.

[0105] Moving to block 210, if the driver behavior does not satisfy the predetermined threshold criteria for distracted driving within the driver state algorithm 40, no action is taken.

[0106] If the driver behavior satisfies the predetermined threshold criteria for distracted driving within the driver state algorithm 40, moving to block 212, the data processor 12 determines whether the short-term status indicator 28 currently displayed needs to be updated, and if so, updates the displayed short-term status indicator 28. Moving to block 214, the data processor 12 determines whether the long-term status indicator 30 currently displayed needs to be updated, and if so, updates the displayed long-term status indicator 30. Moving to block 216, the data processor 12 determines whether the text information 32 currently displayed needs to be updated, and if so, updates the displayed text information 32.

[0107] Moving to block 218, the data processor 12 determines whether information collected by the external sources 14 (e.g., time of day, weather conditions, and other environmental factors) requires a change in the threshold values within the driver state algorithm 40. If the data processor 12 determines that such information does not require updating of the threshold values within the driver state algorithm 40, the method loops back to block 204 as indicated by arrow 220. If the data processor 12 determines that such information requires updating of the threshold values within the driver state algorithm 40, moving to block 222, the threshold values within the driver state algorithm 40 are updated accordingly.

[0108] The system and method of the present disclosure provides a number of advantages. These advantages include displaying a driver state that displays both a short-term status indicator 28 that provides an indication of the current state of the driver and a long-term status indicator 30 that provides an indication of how the driver's state is trending. The short-term status indicator 28 provides a real-time indication of the degree of distraction of the driver of the vehicle, and the long-term status indicator 30 provides an indication of how the driver's behavior is trending to provide a warning to the driver that the driver must modify the driving behavior to avoid an active distracted driving alert of the vehicle. Additionally, the text information 32 displayed by the driver state display 22 provides an explanation of the displayed long-term status indicator 30 and suggestions for improving the long-term status indicator 30.

[0109] The description of the present disclosure is merely exemplary in nature and variations that do not depart from the gist of the present disclosure are intended to be within the scope of the present disclosure. Such variations are not to be regarded as a departure from the spirit and scope of the present disclosure.

Claims

1. A system for providing a driver state to a driver of a vehicle, comprising: a data processor; a plurality of sensors mounted within the vehicle and adapted to send vehicle information to the data processor; a driver monitoring system within the vehicle adapted to send driver information to the data processor; the data processor further adapted to collect information from external sources via a wireless data communication network; and a driver state display adapted to receive information from the data processor and display a short term state indicator, a long term state indicator, and textual information; wherein the long term state indicator is one of a plurality of long term graphical indicators representing how the driver state is trending, and the long term state indicator is adapted to warn the driver of a gradual change in the driver state prior to a vehicle alert warning; wherein the driver state is based on a predetermined time interval in which the driver is appropriately focused on a road ahead of the vehicle indicative of the driver's attentiveness; wherein the short term state indicator is a graphical indicator of the current driver state; wherein the plurality of long term graphical indicators includes a first long term graphical indicator representing an excellent driver state, a second long term graphical indicator representing a normal driver state, a third long term graphical indicator representing a cautionary driver state, and a fourth long term graphical indicator representing a poor driver state; wherein the data processor is further adapted to run a driver state algorithm, and update the displayed short term state indicator and the displayed long term state indicator based on output from the driver state algorithm; wherein the data processor is further adapted to: determine if the driver's eyes are appropriately focused on the road for more than 85% of a previous predetermined interval; determine if the driver's eyes are continuously focused on the road for an average of at least four seconds of time interval during a previous predetermined interval; determine if the driver's eyes are continuously diverted from the road for an average of less than one second of time interval during a previous predetermined interval; wherein the data processor changes the long term state indicator by decreasing an indicator when the driver's eyes are appropriately focused on the road for more than 85% of a previous predetermined interval, the driver's eyes are continuously focused on the road for an average of at least four seconds of time interval during a previous predetermined interval, and the driver's eyes are continuously diverted from the road for an average of less than one second of time interval during a previous predetermined interval.

2. The system of claim 1, wherein, the data processor is further adapted to update thresholds within the driver state algorithm based on information of environmental factors collected by the external sources.

3. The system of claim 2, wherein, the data processor is further adapted to update thresholds within the driver state algorithm based on a level of autonomy of the vehicle.

4. The system of claim 3, wherein, the textual information includes an explanation of the displayed long term driver state and a suggestion to improve the long term driver state.

5. The system of claim 1, wherein, the data processor is further adapted to: determine if the driver's eyes are appropriately focused on the road for less than 50% of a previous predetermined interval; determine if the driver's eyes are continuously diverted from the road for an average of more than one and a half seconds of time interval; determine if the number of glances away from the road during a previous predetermined time interval is more than one; and determining whether the driver's eyes were continuously distracted from the roadway for more than three seconds for a single time interval during the previous predetermined interval; wherein the data processor changes the long term status indicator by incrementing the indicator by one when at least one of the following occurs: the driver's eyes are properly focused on the roadway for less than 50% of the previous predetermined interval; the driver's eyes are continuously distracted from the roadway for an average of more than one and one-half seconds for a time interval, and if the number of glances away from the roadway is more than one during the previous predetermined interval; the driver's eyes are continuously distracted from the roadway for more than three seconds for a single time interval during the previous predetermined interval.

6. A method of providing a driver status to a driver of a vehicle, comprising: collecting vehicle information from a plurality of sensors installed within the vehicle with a data processor located within the vehicle; collecting driver information from a driver monitoring system within the vehicle with the data processor; collecting information from external sources via a wireless data communication network with the data processor; sending information to a driver status display within the vehicle with the data processor; and displaying a short term status indicator, a long term status indicator, and textual information via the driver status display; wherein the long term status indicator is one of a plurality of long term graphical indicators representing how the driver status is trending, and the long term status indicator is adapted to warn the driver of a gradual change in driver status prior to a vehicle alert warning; wherein the driver status is based on a predetermined time interval indicating the driver's attention is properly focused on the roadway ahead of the vehicle; wherein displaying a short term status indicator via the driver status display further comprises displaying a graphical indicator of the current driver status; wherein displaying one of a plurality of long term graphical indicators representing how the driver status is trending further comprises displaying one of a first long term graphical indicator representing an excellent driver status, a second long term graphical indicator representing a normal driver status, a third long term graphical indicator representing a cautionary driver status, and a fourth long term graphical indicator representing a poor driver status; wherein sending information to the driver status display with the data processor and displaying the short term status indicator and the long term status indicator via the driver status display further comprises: running a driver status algorithm with the data processor, the driver status algorithm adapted to determine a driver status based on information from the driver monitoring system; and updating the displayed short term status indicator and the displayed long term status indicator based on output from the driver status algorithm; wherein the method further comprises performing the following operations with the data processor: determining whether the driver's eyes are properly focused on the roadway for more than 85% of the previous predetermined interval; determining whether the driver's eyes are continuously focused on the roadway for an average of at least four seconds for a time interval during the previous predetermined interval; ​ whether the driver's eyes are continuously diverted from the roadway for an average of less than one second during the previous predetermined interval; and when the driver's eyes are properly focused on the roadway for more than 85% of the previous predetermined interval, the driver's eyes are continuously focused on the roadway for an average of at least four seconds during the previous predetermined interval, and the driver's eyes are continuously diverted from the roadway for an average of less than one second during the previous predetermined interval, changing the long term status indicator by one by decreasing it.

7. The method of claim 6, further comprising: updating the thresholds within the driver status algorithm based on information collected by the external source of environmental factors.

8. The method of claim 7, further comprising: updating the thresholds within the driver status algorithm based on the autonomous level of the vehicle.

9. The method of claim 8, wherein, displaying textual information via the driver status display further comprises displaying information to the driver via the driver status display that explains the long term driver status and provides suggestions for improving the long term driver status.

10. The method of claim 9, further comprising executing the following operations with the data processor: determining whether the driver's eyes are properly focused on the roadway for less than 50% of the previous predetermined interval; determining whether the driver's eyes are continuously diverted from the roadway for an average of more than one and a half seconds; determining whether the number of glances away from the roadway during the previous predetermined interval is more than one; determining whether the driver's eyes are continuously distracted from the roadway for more than three seconds during the previous predetermined interval for a single time interval; and when at least one of the following occurs, changing the long term status indicator by one by increasing it: the driver's eyes are properly focused on the roadway for less than 50% of the previous predetermined interval; the driver's eyes are continuously distracted from the roadway for an average of more than one and a half seconds, and if the number of glances away from the roadway during the previous predetermined interval is more than one; the driver's eyes are continuously distracted from the roadway for more than three seconds during the previous predetermined interval for a single time interval.

11. A system for providing a driver status to a driver of a vehicle, comprising: a data processor; a plurality of sensors mounted within the vehicle and adapted to send vehicle information to the data processor; a driver monitoring system within the vehicle adapted to send driver information to the data processor; the data processor is further adapted to collect information from an external source via a wireless data communication network and run a driver status algorithm; a driver status display adapted to receive information from the data processor and display the following: a short term status indicator that is a graphical indicator of the current driver status based on the output from the driver status algorithm; a long term status indicator that is one of a plurality of long term graphical indicators representing how the driver status is trending based on the output from the driver status algorithm, and is adapted to warn the driver of a gradual change in the driver status indicating an increase in driver distraction before a vehicle alert warning; and ​ textual information including an explanation of the displayed long-term driver state and suggestions for improving the long-term driver state; when the driver's eyes are properly focused on the road for more than 85% of a previous predetermined interval, the driver's eyes are continuously focused on the road for an average of at least four seconds of time interval during the previous predetermined interval, and the driver's eyes are persistently distracted from the road for an average of less than one second of time interval during the previous predetermined interval, the data processor changes the long-term status indicator by indicating a decrease of one; and when at least one of the following occurs: the driver's eyes are properly focused on the road for less than 50% of a previous predetermined interval; the driver's eyes are persistently distracted from the road for an average of more than one and a half seconds of time interval, and if the number of glances away from the road is more than once during the previous predetermined interval; the driver's eyes are persistently distracted from the road for more than three seconds of single time interval during the previous predetermined interval.

12. The system of claim 11, wherein, the data processor is further adapted to update the thresholds within the driver state algorithm based on information of environmental factors collected by the external sources and based on the autonomous level of the vehicle.

Images