Utilizing human-machine interface HMI when driver is distracted

Abstract

A system for attracting at least one passenger with human-machine interfaces when a driver of a vehicle is distracted includes a system controller in communication with a plurality of passenger human-machine interfaces and adapted to modify a display screen of a front seat passenger human-machine interface (HMI), and a passenger monitoring system adapted to monitor the driver of the vehicle and at least one passenger within the vehicle, the system controller is adapted to determine that the vehicle driver is distracted using a distracted driver algorithm within the system controller and data from the occupant monitoring system, and when the vehicle driver is distracted, actuate a plurality of occupant human machine interfaces (HMIs) to attract and encourage at least one occupant to interact with the vehicle driver.

Description

Technical Field

[0001] The present disclosure relates to a system and method for engaging a vehicle occupant using a human-machine interface for the vehicle occupant when the vehicle driver is distracted. Background Art

[0002] The vehicle is equipped with a driver monitoring system that detects when the driver of the vehicle is distracted and provides a signal to the driver to draw the driver's attention back to driving the vehicle. The current system does not engage the passengers in the vehicle, but prompts the passengers in the vehicle to interact with the driver to ensure that the driver is properly focused on driving the vehicle and is not distracted.

[0003] Therefore, while current systems and methods achieve their intended purposes, a need remains for a new and improved system and method for utilizing a human-machine interface within a vehicle to engage passengers within the vehicle to interact with a distracted driver. Summary of the invention

[0004] According to several aspects of the present disclosure, a method for engaging at least one passenger in a vehicle using a human-machine interface in a vehicle when a driver of the vehicle is distracted includes: modifying a display screen of a front passenger HMI using a system controller in communication with a plurality of passenger HMIs so that the display screen of the front passenger HMI is visually obscured from view by the vehicle driver, monitoring the vehicle driver and at least one passenger in the vehicle using an occupant monitoring system in communication with a plurality of onboard sensors in the vehicle and the system controller, and determining that the vehicle driver is distracted using a distracted driver algorithm in the system controller and data from the occupant monitoring system, and when the vehicle driver is distracted, actuating the plurality of passenger HMIs to engage at least one passenger and encourage the at least one passenger to interact with the vehicle driver.

[0005] According to another aspect, the method further includes determining, using a distracted driver algorithm within the system controller and data from an occupant monitoring system, that a vehicle driver is distracted by a display screen of a front passenger HMI, and when the driver is distracted by the display screen of the front passenger HMI, modifying an audio output of the front passenger HMI to reduce the driver's ability to hear the audio output of the front passenger HMI.

[0006] According to another aspect, the method further includes, after modifying the audio output of the front passenger HMI to reduce the driver's ability to hear the audio output of the front passenger HMI, performing one of the following operations: determining, using a distracted driver algorithm within a system controller and data from an occupant monitoring system, that the vehicle driver is distracted by the display screen of the front passenger HMI and actuating a plurality of passenger HMIs to engage at least one passenger and encourage at least one passenger to interact with the vehicle driver, or determining, using a distracted driver algorithm within a system controller and data from an occupant monitoring system, that the vehicle driver is no longer distracted by the display screen of the front passenger HMI and restoring the audio output of the front passenger HMI.

[0007] According to another aspect, actuating the multiple occupant HMIs to engage at least one occupant and encourage at least one occupant to interact with the vehicle driver further includes reducing the quality of all audio output and video output in the multiple occupant HMIs.

[0008] According to another aspect, actuating multiple passenger HMIs to engage at least one passenger and encourage at least one passenger to interact with the vehicle driver further includes: after reducing the quality of all audio and video outputs in the multiple passenger HMIs, monitoring the driver and at least one passenger using an occupant monitoring system, and displaying a message indicating that the vehicle driver is distracted on each of the multiple passenger HMIs using a system controller when one of the following occurs: the system controller determines using data from the occupant monitoring system that at least one passenger has interacted with the vehicle driver, and the system controller determines using a distracted driver algorithm within the system controller and data from the occupant monitoring system that the vehicle driver is still distracted, or the system controller determines using data from the occupant monitoring system that at least one passenger is not interacting with the vehicle driver.

[0009] According to another aspect, the method further includes restoring the quality of all audio and video outputs in the plurality of passenger HMIs when the system controller determines, using data from the occupant monitoring system, that at least one passenger has interacted with the vehicle driver and when the system controller determines, using a distracted driver algorithm within the system controller and data from the occupant monitoring system, that the vehicle driver is no longer distracted.

[0010] According to another aspect, actuating multiple passenger HMIs to engage at least one passenger and encourage at least one passenger to interact with the vehicle driver further includes: after displaying a message indicating that the vehicle driver is distracted on each of the multiple passenger HMIs using the system controller, monitoring the driver and at least one passenger using the occupant monitoring system, and pausing audio and video output of each of the multiple passenger HMIs using the system controller when one of the following occurs: the system controller determines using data from the occupant monitoring system that the at least one passenger has interacted with the vehicle driver and determines using a distracted driver algorithm within the system controller and data from the occupant monitoring system that the vehicle driver is still distracted, or determines using data from the occupant monitoring system that the at least one passenger is not interacting with the vehicle driver.

[0011] According to another aspect, the method further includes removing a message indicating that the vehicle driver is distracted and restoring all audio and video outputs in the plurality of passenger HMIs when the system controller determines, using data from the occupant monitoring system, that at least one passenger has interacted with the vehicle driver and determines, using a distracted driver algorithm within the system controller and data from the occupant monitoring system, that the vehicle driver is no longer distracted.

[0012] According to another aspect, actuating multiple passenger HMIs to engage at least one passenger and encourage at least one passenger to interact with the vehicle driver further includes: after pausing the audio and video output of each of the multiple passenger HMIs using the system controller, monitoring the driver and at least one passenger using the occupant monitoring system, and providing a tactile alert to the at least one passenger via at least one tactile alert device in the vehicle using the system controller when one of the following occurs: the system controller determines using data from the occupant monitoring system that the at least one passenger has interacted with the vehicle driver, and determines using a distracted driver algorithm in the system controller and data from the occupant monitoring system that the vehicle driver is still distracted, or determines using data from the occupant monitoring system that the at least one passenger has not interacted with the vehicle driver.

[0013] According to another aspect, the method further includes restoring all audio and video outputs in the plurality of passenger HMIs when the system controller determines, using data from the occupant monitoring system, that at least one passenger has interacted with the vehicle driver and when the system controller determines, using a distracted driver algorithm within the system controller and data from the occupant monitoring system, that the vehicle driver is no longer distracted.

[0014] According to another aspect, the method further includes continuously providing, using the system controller, the haptic alert until the system controller determines, using a distracted driver algorithm within the system controller and data from the occupant monitoring system, that the vehicle driver is no longer distracted.

[0015] According to several aspects of the present disclosure, a system for engaging at least one passenger in a vehicle using a human-machine interface in a vehicle when the vehicle driver is distracted includes a system controller in communication with a plurality of passenger human-machine interfaces (HMIs) and adapted to modify a display screen of a front passenger HMI so that the display screen of the front passenger HMI is visually unclear to the vehicle driver, and an occupant monitoring system in communication with a plurality of onboard sensors and the system controller in the vehicle and adapted to monitor the vehicle driver and at least one passenger in the vehicle, the system controller being adapted to determine that the vehicle driver is distracted using a distracted driver algorithm in the system controller and data from the occupant monitoring system, and when the vehicle driver is distracted, actuating the plurality of passenger HMIs to engage at least one passenger and encourage the at least one passenger to interact with the vehicle driver.

[0016] According to another aspect, the system controller is further adapted to determine, using the distracted driver algorithm and data from the occupant monitoring system, that the vehicle driver is distracted by a display screen of the front passenger HMI, and, when the driver is distracted by the display screen of the front passenger HMI, modify the audio output of the front passenger HMI to reduce the driver's ability to hear the front passenger HMI audio output.

[0017] According to another aspect, after modifying the audio output of the front passenger HMI to reduce the driver's ability to hear the front passenger HMI audio output, the system controller is further adapted to perform one of the following: when the system controller determines that the vehicle driver is distracted by the display screen of the front passenger HMI using the distracted driver algorithm and data from the occupant monitoring system, actuate the multiple passenger HMIs to engage at least one passenger and encourage at least one passenger to interact with the vehicle driver, or when the system controller determines that the vehicle driver is no longer distracted by the display screen of the front passenger HMI using the distracted driver algorithm and data from the occupant monitoring system, restore the audio output of the front passenger HMI.

[0018] According to another aspect, when the multiple occupant HMIs are actuated to engage at least one occupant and encourage at least one occupant to interact with the vehicle driver, the system controller is further adapted to reduce the quality of all audio output and video output in the multiple occupant HMIs.

[0019] According to another aspect, after reducing the quality of all audio and video outputs in the multiple passenger HMIs, the system controller is further adapted to monitor the driver and at least one passenger using an occupant monitoring system, and display a message indicating that the vehicle driver is distracted on each of the multiple passenger HMIs when the system controller determines using data from the occupant monitoring system that at least one passenger has interacted with the vehicle driver and the system controller determines using the distracted driver algorithm and data from the occupant monitoring system that the vehicle driver is still distracted, or display a message indicating that the vehicle driver is distracted on each of the multiple passenger HMIs when the system controller determines using data from the occupant monitoring system that at least one passenger has not interacted with the vehicle driver, or restore the quality of all audio and video outputs in the multiple passenger HMIs when the system controller determines using data from the occupant monitoring system that at least one passenger has interacted with the vehicle driver and the system controller determines using the distracted driver algorithm and data from the occupant monitoring system that the vehicle driver is no longer distracted.

[0020] According to another aspect, after displaying, using the system controller, a message indicating that the vehicle driver is distracted on each of the plurality of passenger HMIs, the system controller is further adapted to perform one of the following: monitoring the driver and at least one passenger using an occupant monitoring system, and when the system controller determines, using data from the occupant monitoring system, that the at least one passenger has interacted with the vehicle driver, and the system controller determines, using a distracted driver algorithm and data from the occupant monitoring system, that the vehicle driver is still distracted, pausing audio and video output from each of the plurality of passenger HMIs, or when the system controller determines, using data from the occupant monitoring system, that the at least one passenger has not interacted with the vehicle driver, pausing audio and video output from each of the plurality of passenger HMIs, or when the system controller determines, using data from the occupant monitoring system, that the at least one passenger has interacted with the vehicle driver, and the system controller determines, using a distracted driver algorithm and data from the occupant monitoring system, that the vehicle driver is no longer distracted, removing the message indicating that the vehicle driver is distracted and resuming all audio and video outputs in the plurality of passenger HMIs.

[0021] According to another aspect, after pausing the audio and video outputs of each of the plurality of passenger HMIs using the system controller, the system controller is further adapted to monitor the driver and at least one passenger using the occupant monitoring system and perform one of the following: when the system controller determines using data from the occupant monitoring system that the at least one passenger has interacted with the vehicle driver, and the system controller determines using the distracted driver algorithm and data from the occupant monitoring system that the vehicle driver is still distracted, provide a tactile alert to the at least one passenger via at least one tactile alert device within the vehicle, or when the system controller determines using data from the occupant monitoring system that the at least one passenger has not interacted with the vehicle driver, provide a tactile alert for the at least one passenger via at least one tactile alert device within the vehicle, or when the system controller determines using data from the occupant monitoring system that the at least one passenger has interacted with the vehicle driver, and the system controller determines using the distracted driver algorithm and data from the occupant monitoring system that the vehicle driver is no longer distracted, resume all audio and video outputs in the plurality of passenger HMIs.

[0022] According to another aspect, the system controller is further adapted to continuously provide the haptic alert until the system controller determines, using the distracted driver algorithm and data from the occupant monitoring system, that the vehicle driver is no longer distracted.

[0023] Further areas of applicability will become apparent from the description provided herein.It should be understood that the description and specific examples are intended for purposes of illustration only and are not intended to limit the scope of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] The drawings described herein are for illustration purposes only and are not intended to limit the scope of the present disclosure in any way.

[0025] Figure 1 is a schematic diagram of a vehicle having a system utilizing a human machine interface within the vehicle to engage a passenger within the vehicle to interact with a distracted driver according to an exemplary embodiment;

[0026] Figure 2 is a schematic diagram of a system according to an exemplary embodiment;

[0027] Figure 3 is a top schematic view of a vehicle having a system according to an exemplary embodiment;

[0028] Figure 4 is a perspective schematic diagram of a human-machine interface on which the message is displayed; and

[0029] Figure 5 is a flow chart illustrating a method according to an exemplary embodiment of the present disclosure.

[0030] The drawings are not necessarily drawn to scale, and some features may be exaggerated or minimized to show details of particular components. In some cases, well-known components, systems, materials, or methods are not described in detail to avoid obscuring the present disclosure. Therefore, the specific structural and functional details disclosed herein should not be interpreted as limiting, but merely as a basis for the claims and as a representative basis for teaching those skilled in the art to adopt the present disclosure in different ways. DETAILED DESCRIPTION

[0031] The following description is merely exemplary in nature and is not intended to limit the present disclosure, application or use. In addition, it is not intended to be constrained by any express or implied theory presented in the aforementioned technical field, background technology, content of the invention or the following specific embodiments. It should be understood that throughout the drawings, the corresponding reference numerals represent similar or corresponding parts and features. As used herein, the term "module" refers to any hardware, software, firmware, electronic control component, processing logic and / or processor device, individually or in any combination, including but not limited to: application-specific integrated circuits (ASICs), electronic circuits, processors (shared, dedicated or groups) and memories that execute one or more software or firmware programs, combinational logic circuits and / or other suitable components that provide the described functions. Although the drawings shown herein depict examples with certain element arrangements, additional intermediate elements, devices, features or components may exist in actual embodiments. It should also be understood that the drawings are merely illustrative and may not be drawn to scale.

[0032] As used herein, the term "vehicle" is not limited to automobiles. Although this article mainly describes the present technology in conjunction with automobiles, the present technology is not limited to automobiles. These concepts can be used in a variety of applications, such as aircraft, ships, other vehicles, and consumer electronic components.

[0033] According to an exemplary embodiment, Figure 1 A vehicle 10 is shown with an associated system 11 for engaging at least one passenger in the vehicle 10 using a human-machine interface in the vehicle 10 when the driver of the vehicle 10 is distracted, according to various embodiments. Generally speaking, the system 11 works in conjunction with other systems in the vehicle 10 to display various information and infotainment content to the passenger. The vehicle 10 generally includes a chassis 12, a body 14, front wheels 16, and rear wheels 18. The body 14 is disposed on the chassis 12 and substantially surrounds the components of the vehicle 10. The body 14 and the chassis 12 may together form a frame. The front wheels 16 and the rear wheels 18 are each rotatably connected to the chassis 12 near respective corners of the body 14.

[0034] In various embodiments, the vehicle 10 is an autonomous vehicle and the system 11 is incorporated into the autonomous vehicle 10. The autonomous vehicle 10 is, for example, a vehicle 10 that is automatically controlled to transport passengers from one location to another. Although the vehicle 10 is depicted as a passenger car in the illustrated embodiment, it should be understood that any other vehicle may also be used, including motorcycles, trucks, sport utility vehicles (SUVs), recreational vehicles (RVs), etc. In an exemplary embodiment, the vehicle 10 is equipped with a so-called level four or level five automation system. The level four system represents "high automation" and refers to the driving mode-specific performance of the autonomous driving system in all aspects of dynamic driving tasks, even if the human driver does not respond appropriately to the intervention request. The level five system represents "full automation" and refers to the full-time performance of the autonomous driving system in all aspects of dynamic driving tasks under all road and environmental conditions that the human driver can manage. The novel aspects of the present disclosure are equally applicable to non-autonomous vehicles.

[0035] As shown, the vehicle 10 generally includes a propulsion system 20, a transmission system 22, a steering system 24, a braking system 26, a sensor system 28, an actuator system 30, at least one data storage device 32, a vehicle controller 34, and a wireless communication module 36. In embodiments where the vehicle 10 is an electric vehicle, the transmission system 22 may not be present. In various embodiments, the propulsion system 20 may include an internal combustion engine, an electric motor such as a traction motor, and / or a fuel cell propulsion system. The transmission system 22 is configured to transmit power from the propulsion system 20 to the front wheels 16 and rear wheels 18 of the vehicle according to a selectable speed ratio. According to various embodiments, the transmission system 22 may include a stepped automatic transmission, a continuously variable transmission, or other suitable transmission. The braking system 26 is configured to provide braking torque to the front wheels 16 and rear wheels 18 of the vehicle. In various embodiments, the braking system 26 may include friction brakes, wire control brakes, regenerative braking systems (e.g., motors), and / or other suitable braking systems. The steering system 24 affects the position of the front wheels 16 and rear wheels 18. Although depicted as including a steering wheel for illustrative purposes, in some embodiments contemplated within the scope of the present disclosure, the steering system 24 may not include a steering wheel.

[0036] The sensor system 28 includes one or more sensing devices 40a-40n that sense observable conditions of the external environment and / or the internal environment of the autonomous vehicle 10. The sensing devices 40a-40n may include, but are not limited to, radar, lidar, global positioning system, optical camera, thermal camera, ultrasonic sensor, and / or other sensors. The camera may include two or more digital cameras spaced at a selected distance from each other, wherein the two or more digital cameras are used to obtain stereo images of the surrounding environment in order to obtain a three-dimensional image or map. The plurality of sensing devices 40a-40n are used to determine information about the environment surrounding the vehicle 10. In an exemplary embodiment, the plurality of sensing devices 40a-40n include at least one of a motor speed sensor, a motor torque sensor, an electric drive motor voltage and / or current sensor, an accelerator pedal position sensor, a coolant temperature sensor, a cooling fan speed sensor, and a transmission oil temperature sensor. In another exemplary embodiment, the plurality of sensing devices 40a-40n also include sensors for determining information about the environment surrounding the vehicle 10, such as an ambient air temperature sensor, an atmospheric pressure sensor, and / or a photo and / or video camera positioned to observe the environment in front of the vehicle 10. In another exemplary embodiment, at least one of the plurality of sensing devices 40 a - 40 n is capable of measuring distances in the environment surrounding the vehicle 10 .

[0037] In a non-limiting example where the plurality of sensing devices 40a-40n include a camera 38, the plurality of sensing devices 40a-40n measure distance using an image processing algorithm configured to process images from the camera and determine the distance between objects. In another non-limiting example, the plurality of vehicle sensors 40a-40n include a stereo camera with distance measurement capabilities. In one example, at least one of the plurality of sensing devices 40a-40n is fixed to the interior of the vehicle 10, for example, fixed in the roof of the vehicle 10, and can be observed through the windshield of the vehicle 10. In another example, at least one of the plurality of sensing devices 40a-40n is a camera fixed to the exterior of the vehicle 10 (for example, fixed on the roof of the vehicle 10), which can see the environment surrounding the vehicle 10 and is adapted to collect information (images) related to the environment outside the vehicle 10. It should be understood that various additional types of sensing devices, such as LiDAR sensors, ultrasonic ranging sensors, radar sensors, and / or time-of-flight sensors are within the scope of the present disclosure. The actuator system 30 includes one or more actuator devices 42 a - 42 n that control one or more features of the vehicle 10 , such as, but not limited to, the propulsion system 20 , the transmission system 22 , the steering system 24 , and the braking system 26 .

[0038] The vehicle controller 34 includes at least one processor 44 and a computer readable storage device or medium 46. The at least one data processor 44 can be any custom or commercially available processor, a central processing unit (CPU), a graphics processing unit (GPU), an auxiliary processor in a plurality of processors associated with the vehicle controller 34, a microprocessor-based semiconductor (in the form of a microchip or chipset), a macroprocessor, any combination thereof, or any device generally used to execute instructions. The computer readable storage device or medium 46 can include volatile and non-volatile storage devices such as read-only memory (ROM), random access memory (RAM), and keep-alive memory (KAM). KAM is a persistent or non-volatile memory that can be used to store various operating variables when the at least one data processor 44 is powered off. The computer readable storage device or medium 46 can be implemented using any of a variety of known storage devices, such as PROM (programmable read-only memory), EPROM (electrical PROM), EEPROM (electrically erasable PROM), flash memory, or any other electrical, magnetic, optical, or combination storage device capable of storing data used by the controller 34 in controlling the vehicle 10, some of which represents executable instructions.

[0039] The instructions may include one or more separate programs, each of which includes an ordered list of executable instructions for implementing logical functions. When executed by at least one processor 44, the instructions receive and process signals from the sensor system 28, perform logic, calculations, methods and / or algorithms for automatically controlling components of the vehicle 10, and generate control signals to the actuator system 30 to automatically control components of the vehicle 10 based on the logic, calculations, methods and / or algorithms. Although Figure 1 Only one controller 34 is shown, and embodiments of the vehicle 10 may include any number of controllers 34 that communicate via any suitable communication medium or combination of communication mediums and collaborate to process sensor signals, execute logic, calculations, methods and / or algorithms, and generate control signals for automatically controlling the functions of the autonomous vehicle 10.

[0040] In various embodiments, one or more instructions of the vehicle controller 34 are instantiated in the trajectory planning system and, when executed by at least one data processor 44, generate trajectory outputs that solve the kinematic and dynamic constraints of the environment. For example, the instructions receive as input process sensor and map data. The instructions execute a graph-based approach with a customized cost function to handle different road scenarios of cities and highways.

[0041] The wireless communication module 36 is configured to wirelessly transmit information to and from other remote entities 48, such as, but not limited to, other vehicles ("V2V" communication), infrastructure ("V2I" communication), remote systems, remote servers, cloud computers, and / or personal devices. In an exemplary embodiment, the communication system 36 is a wireless communication system configured to communicate via a wireless local area network (WLAN) using the IEEE 802.11 standard or by using cellular data communications. However, additional or alternative communication methods such as dedicated short-range communication (DSRC) channels are also considered to be within the scope of the present disclosure. A DSRC channel refers to a one-way or two-way short-range to medium-range wireless communication channel designed specifically for automotive use and a set of corresponding protocols and standards.

[0042] The vehicle controller 34 is a non-universal electronic control device having a pre-programmed digital computer or processor, memory or non-transitory computer-readable medium, and a transceiver [or input / output port] for storing data such as control logic, software applications, instructions, computer code, data, look-up tables, etc. Computer-readable media include any type of media that can be accessed by a computer, such as read-only memory (ROM), random access memory (RAM), hard drive, compact disk (CD), digital video disk (DVD), or any other type of memory. "Non-transitory" computer-readable media excludes wired, wireless, optical or other communication links that transmit temporary electrical or other signals. Non-transitory computer-readable media include media that can store data permanently and media that can store data and then be rewritten, such as rewritable optical disks or erasable storage devices. Computer code includes any type of program code, including source code, object code, and executable code.

[0043] refer to Figure 2 , which shows a schematic diagram of the system 11. The system 11 includes a system controller 34A in communication with a plurality of sensing devices (onboard sensors) 40a-40n. The system controller 34A may be the vehicle controller 34, or the system controller 34A may be a separate controller in communication with the vehicle controller 34. In addition to the plurality of onboard sensors 40a-40n, the system controller 34A communicates with an occupant monitoring system 50, a plurality of passenger human machine interfaces (HMIs) 52, and at least one haptic device 54.

[0044] In an exemplary embodiment, the occupant monitoring system 50 is adapted to monitor the driver 56 and passengers 58 within the vehicle 10. The occupant monitoring system 50 views the driver 56 and passengers 58 within the vehicle 10 through cameras 60, microphones 62, and other sensors strategically placed within the vehicle 10. These cameras 60 can capture images of the face, eyes, and head position of the driver 56 and passengers 58 within the vehicle 10, while other sensors can monitor steering wheel movement, pedal use, and even vital signs such as heart rate. As is known in the industry, the occupant monitoring system 50 collects data that is continuously analyzed in real time by a distracted driver algorithm 64 within the system controller 34A. The distracted driver algorithm 64 uses advanced image recognition and machine learning algorithms to detect signs of distraction, drowsiness, or impairment of the driver 56.

[0045] Each of the plurality of passenger HMIs is adapted to provide infotainment content (audio and video) to passengers within the vehicle 10. Figure 3 , which shows an example of a vehicle 10 having a system 11 according to the present disclosure, wherein the vehicle includes a driver seat 66 for a driver 56 of the vehicle 10, a front passenger seat 68 for a front passenger 58A of the vehicle 10, and two rear passenger seats 70 for two rear passengers 58B of the vehicle 10. The vehicle 10 includes three passenger HMIs 52. The front passenger HMI 52A is positioned for viewing and interaction by the front passenger 70, and the two rear passenger HMIs 52B are positioned for viewing and interaction by the rear passengers 58B.

[0046] In an exemplary embodiment, each of the passenger HMIs 52A, 52B includes a touch screen display 72 adapted to display images and video and allow the passenger 58A, 58B to input information into the system 11 by touching the touch screen display 72, a microphone 74 adapted to receive verbal input from the passenger 58A, 58B, and a speaker 76 adapted to provide audio output for the passenger 58A, 58B.

[0047] In an exemplary embodiment, the system controller 34A is adapted to modify the display screen (touch screen display 72) of the front passenger HMI 52A so that the display screen 72 of the front passenger HMI 52A is not visually clear to the driver 56 of the vehicle 1. Making the display screen 72 of the front passenger HMI 52A visually unclear may include reducing the brightness of the front passenger HMI 52A, or implementing features of the touch screen display 72 so that images displayed thereon are out of focus when viewed from a certain angle, wherein when the driver 56 looks at the front passenger HMI 52A, the images displayed thereon will be out of focus, but when the front passenger 58A looks at the front passenger HMI 52A, the images displayed thereon will be clear.

[0048] This measure is designed to prevent the driver 56 from viewing or interacting with the front passenger seat HMI 52A when the driver 56 is driving the vehicle 10. The occupant monitoring system 50 communicates with a plurality of onboard sensors 40a-40n and a system controller 34A within the vehicle 10 and is adapted to monitor the driver 56 of the vehicle 10 and at least one passenger 58A, 58B within the vehicle 10.

[0049] In an exemplary embodiment, when the system controller 34A determines that the driver 56 of the vehicle 10 is distracted using the distracted driver algorithm 64 within the system controller 34A and data from the occupant monitoring system 50, the system controller is further adapted to actuate the plurality of passenger HMIs 52A, 52B to interact with at least one passenger 58A, 58B and encourage at least one passenger 58A, 58B to interact with the vehicle driver 56. This measure is intended to engage the passengers 58A, 58B within the vehicle 10 in actively participating in keeping the driver 56 focused while driving the vehicle 10.

[0050] The system controller 34A, in conjunction with the distracted driver algorithm 64, will deem the driver 56 "distracted" at any time such that the driver 56 is unable to safely operate the vehicle 10. For example, a distracted driver 56 may be a driver 56 distracted in the traditional sense, where the driver 56 is taking his eyes off the road, eating, drinking, discussing with another passenger 58A, 58B, etc. A distracted driver 56 may also be a driver 56 that appears tired or unresponsive. In an exemplary embodiment, the plurality of onboard sensors 40a-40n include physiological sensors to monitor the physical / medical condition of the driver 56, wherein the system controller 34A may deem the driver 56 distracted for purposes of the system 11 when the physiological sensors indicate that the driver 56 is experiencing a physical / medical condition that makes the driver 56 unfit to safely operate the vehicle 10. For example, physiological sensors within the vehicle 10 may detect an increased heart rate or palpitations and determine that the driver 56 may be suffering from a heart condition, and therefore deem the driver distracted and trigger an action of the system 11 to engage at least one passenger 58A, 58B.

[0051] Further, when determining whether the driver 56 is distracted, the system controller 34A uses a centralized risk calculator within the system controller 34A that receives input from a plurality of onboard sensors 40a-40n. The plurality of sensors include internal sensors that provide information about, for example, but not limited to, the driver's state, the driver's 56 driving behavior and physiological condition, external sensors that provide information about, for example, but not limited to, weather conditions, time of day, and road conditions / complexity, and information received from cloud-based resources and infrastructure systems that provide relevant information, for example, but not limited to, traffic conditions, road conditions, and construction. The system controller 34A, using the centralized risk calculator, can adjust the threshold used to determine when a driver is considered "distracted" and when to initiate the system 11 to engage at least one passenger 58A, 58B when the centralized risk calculator determines that the driving risk is increased due to, for example, but not limited to, traffic congestion, adverse weather conditions, etc.

[0052] In another exemplary embodiment, when the system controller 34A determines that the driver 56 of the vehicle 10 is distracted by the display screen 72 of the front passenger HMI 52A using the distracted driver algorithm 64 and data from the occupant monitoring system 50, the system controller 34A is adapted to modify the audio output of the front passenger HMI 52A to reduce the driver's ability to hear the audio output from the front passenger HMI 52A. Such modification may include reducing the volume of the audio output of the speaker 76 of the front passenger HMI 52A, or implementing techniques known in the industry to direct the audio output of the speaker 76 of the front passenger HMI 52A to the front passenger 58A, making it difficult for the driver 56 to hear the audio output of the speaker 76 of the front passenger HMI 52A and preventing the driver 56 from being distracted by the front passenger HMI 52A.

[0053] After modifying the audio output of the front seat passenger HMI 52A to reduce the driver 56's ability to hear the audio output of the front seat passenger HMI 52A, if the system controller 34A determines using the distracted driver algorithm 64 and data from the occupant monitoring system 50 that the driver 56 of the vehicle 10 is still distracted by the display screen 72 of the front seat passenger HMI 52A, the system controller is further adapted to actuate the plurality of passenger HMIs 52A, 52B to interact with and encourage at least one passenger 58A, 58B to interact with the driver 56 of the vehicle 10.

[0054] After modifying the audio output of the front passenger HMI 52A to reduce the driver 56's ability to hear the audio output of the front passenger HMI 52A, the system controller 34A is further adapted to restore the audio output of the front passenger HMI 52A if the system controller 34A determines, using the distracted driver algorithm 64 and data from the occupant monitoring system 50, that the driver 56 of the vehicle 10 is no longer distracted by the display screen 72 of the front passenger HMI 52A.

[0055] In an exemplary embodiment, the system controller 34A is also adapted to reduce the quality of all audio and video outputs from the plurality of passenger HMIs 52A, 52B when the plurality of passenger HMIs 52A, 52B are actuated to interact with at least one passenger 58A, 58B and to encourage at least one passenger 58A, 58B to interact with the driver 56 of the vehicle 10. This measure is intended to attract the attention of the passengers 58A, 58B by disrupting the audio and video outputs of the passenger HMIs 52A, 52B, which in turn will encourage the passengers 58A, 58B to interact with the driver 56, knowing that keeping the driver 56 focused will prevent further disruption of the audio and video outputs of the passenger HMIs 52A, 52B.

[0056] The system controller 34A is also adapted to monitor the driver 56 and at least one passenger 58A, 58B using the occupant monitoring system 50 after reducing the quality of all audio and video outputs from the plurality of passenger HMIs 52A, 52B.

[0057] After reducing the quality of all audio and video outputs in the multiple passenger HMIs 52A, 52B, if the system controller 34A determines using data from the occupant monitoring system 50 that at least one occupant 58A, 58B has interacted with the occupant 56 of the vehicle 10, and the system controller 34A determines using the distracted driver algorithm 64 and data from the occupant monitoring system 50 that the driver 56 of the vehicle 10 is still distracted, then the system controller 34A is adapted to display a message 78 on each of the multiple passenger HMIs 52A, 52B indicating that the driver 56 of the vehicle 10 is distracted.

[0058] The system controller 34A uses the occupant monitoring system 50 to verify that one of the passengers 58A, 58B is actually interacting with the driver 56. The occupant monitoring system 50 may use the camera 60 to detect movements or gestures of at least one of the passengers 58A, 58B, such as at least one of the passengers 58A, 58B reaching out to touch the shoulder of the driver 56, or using the microphone 62, the occupant monitoring system may detect that at least one of the passengers 58A, 58B is talking to the driver 56. However, if the system controller 34A determines that the driver 56 is still distracted despite the engagement of one or more of the passengers 58A, 58B, a message 78 is displayed.

[0059] refer to Figure 4 , the message 78 may include one or both of a text message 78A and a graphic 78B, wherein the text message 78A and / or the graphic 78B are intended to attract the attention of the passengers 58A, 58B and to prompt the passengers 58A, 58B to interact with the driver 58. The audio and video output of the passenger HMIs 52A, 52B will continue while the message 78 is displayed on the touch screen display 72 of each passenger HMI 52A, 52B, overlaid on the video output.

[0060] After reducing the quality of all audio and video outputs in the plurality of passenger HMIs 52A, 52B, if the system controller 34A determines using data from the occupant monitoring system 50 that at least one passenger 58A, 58B is not interacting with the driver 56 of the vehicle 10, the system controller 34A is adapted to display a message 78 on each of the plurality of passenger HMIs 52A, 52B, such as Figure 4 As shown, it indicates that the driver 56 of the vehicle 10 is distracted. If reducing the quality of the audio and video does not succeed in prompting any of the passengers 58A, 58B to interact with the driver 56, the system controller 34A will increase its efforts to attract the passengers 58A, 58B by displaying a message 78 on each of the multiple passenger HMIs 52A, 52B.

[0061] After reducing the quality of all audio and video outputs in the multiple occupant HMIs 52A, 52B, if the system controller 34A determines using data from the occupant monitoring system 50 that at least one occupant 58A, 58B has interacted with the driver 56 of the vehicle 10, and the system controller 34A determines using the distracted driver algorithm 64 and data from the occupant monitoring system 50 that the driver 56 of the vehicle 10 is no longer distracted, then the system controller 34A is adapted to restore the quality of all audio and video outputs in the multiple occupant HMIs 52A, 52B.

[0062] After displaying the message 78 on each of the plurality of passenger HMIs 52A, 52B with the system controller 34A indicating that the driver 56 of the vehicle 10 is distracted, the system controller 34A is further adapted to monitor the driver 56 and at least one passenger 58A, 58B with the occupant monitoring system 50 .

[0063] The system controller is also adapted to pause the audio and video output of each of the plurality of passenger HMIs 52A, 52B if the system controller 34A determines, using data from the occupant monitoring system 50, that at least one occupant 58A, 58B has interacted with the driver 56 of the vehicle 10 and the system controller 34A determines, using the distracted driver algorithm 64 and data from the occupant monitoring system 50, that the driver 56 of the vehicle 10 remains distracted.

[0064] The system controller 34A uses the occupant monitoring system 50 to verify that one of the passengers 58A, 58B is indeed interacting with the driver 56. However, if the system controller 34A determines that the driver 56 is still distracted despite the engagement of one or more of the passengers 58A, 58B, the audio and video output from each of the plurality of passenger HMIs 52A, 52B is paused. The previously displayed message 78 may remain on the screen, such as Figure 4 As shown, any video being displayed will be paused and the speaker 76 will not broadcast any audio.

[0065] The system controller 34A is also adapted to pause the audio and video output of each of the plurality of passenger HMIs 52A, 52B if the system controller 34A determines using data from the occupant monitoring system 50 that at least one passenger 58A, 58B has not interacted with the driver 56 of the vehicle 10 .

[0066] If the system controller 34A determines using data from the occupant monitoring system 50 that at least one occupant 58A, 58B has interacted with the driver 56 of the vehicle 10, and the system controller 34A determines using the distracted driver algorithm 64 and data from the occupant monitoring system 50 that the driver 56 of the vehicle 10 is no longer distracted, the system controller 34A is also adapted to remove the message 78 indicating that the driver 56 of the vehicle 10 is distracted and restore all audio and video outputs in the multiple occupant HMIs 52A, 52B.

[0067] In an exemplary embodiment, after pausing audio and video output from each of the plurality of passenger HMIs 52A, 52B using the system controller 34A, the system controller 34A is further adapted to monitor the driver 56 and at least one passenger 58A, 58B using the occupant monitoring system 50 .

[0068] If the system controller 34A determines using data from the occupant monitoring system 50 that at least one occupant 58A, 58B has interacted with the driver 56 of the vehicle 10, and the system controller 34A determines using the distracted driver algorithm 64 and data from the occupant monitoring system 50 that the driver 56 of the vehicle 10 is still distracted, then the system controller 34A is also adapted to provide a tactile alert for the at least one occupant 58A, 58B via at least one tactile alert device 54 within the vehicle 10.

[0069] The haptic device 54 may be any known device for providing a haptic alert within a vehicle, such as a buzzer or chime, or vibration of the passenger seat 68, 70, or vibration of the seat belt, in non-limiting examples. Such haptic alerts are intended to provide a more intrusive signal to get the attention of at least one passenger 58A, 58B to prompt at least one passenger 58A, 58B to interact with the distracted driver 56.

[0070] If the system controller 34A determines, using data from the occupant monitoring system 50, that at least one of the passengers 58A, 58B has not interacted with the driver 56 of the vehicle 10, the system controller 34A is further adapted to provide a tactile alert to the at least one of the passengers 58A, 58B via at least one tactile alert device 54 within the vehicle 10. If pausing the audio and video output from each of the plurality of passenger HMIs 52A, 52B does not successfully prompt any of the passengers 58A, 58B to interact with the distracted driver 56, the system controller 34A increases efforts to engage the at least one of the passengers 58A, 58B by providing a tactile alert in conjunction with pausing the audio and video output of each of the passenger HMIs 52A, 52B and displaying the message 78.

[0071] If the system controller 34A determines, using data from the occupant monitoring system 50, that at least one occupant 58A, 58B has interacted with the driver 56 of the vehicle 10, and the system controller 34A determines, using the distracted driver algorithm 64 and data from the occupant monitoring system 50, that the driver 56 of the vehicle 10 is no longer distracted, then the system controller 34A is also adapted to restore all audio and video output from the plurality of occupant HMIs 52A, 52B and remove the displayed message 78.

[0072] In an exemplary embodiment, the system controller 34A is also adapted to continue to provide the haptic alert until the system controller 34A determines, using the distracted driver algorithm 64 and data from the occupant monitoring system 50 , that the driver 56 of the vehicle 10 is no longer distracted.

[0073] refer to Figure 5A method 100 of using a human-machine interface 52A, 52B in a vehicle 10 to attract at least one passenger 58A, 58B in the vehicle 10 when the driver 56 of the vehicle 10 is distracted includes: starting from box 102, using a system controller 34A in communication with multiple passenger human-machine interfaces (HMIs) 52A, 52B to modify the display screen 72 of the front passenger HMI 52A so that the driver 56 of the vehicle 10 cannot visually see the display screen 72 of the front passenger HMI 52A; moving to box 104, using Monitor the driver 56 of the vehicle 10 and at least one passenger 58A, 58B in the vehicle 10 using an occupant monitoring system 50 that communicates with multiple onboard sensors 40a-40n and a system controller 34A in the vehicle 10; and move to box 106, determine that the driver 56 of the vehicle 10 is distracted using the distracted driver algorithm 64 in the system controller 34A and data from the occupant monitoring system 50, and when the driver 56 of the vehicle 10 is distracted at box 106, move to box 108, actuate multiple passenger HMIs 52A, 52B to attract at least one passenger 58A, 58B and encourage at least one passenger 58A, 58B to interact with the driver 56 of the vehicle 10.

[0074] In an exemplary embodiment, the method 100 also includes: moving from frame 106 to frame 110, using the distracted driver algorithm 64 within the system controller 34A and data from the occupant monitoring system 50 to determine that the driver 56 of the vehicle 10 is distracted by the display screen 72 of the front passenger HMI 52A, and when the driver 56 is distracted by the display screen 72 of the front passenger HMI 52A at frame 110, moving to frame 112 to modify the audio output of the front passenger HMI 52A to reduce the ability of the driver 56 to hear the audio output of the front passenger HMI 52A.

[0075] In an exemplary embodiment, after modifying the audio output of the front passenger HMI 52A at box 112 to reduce the driver 56's ability to hear the audio output of the front passenger HMI 52A, the method also includes: moving to box 114, using the distracted driver algorithm 64 within the system controller 34A and data from the occupant monitoring system 50 to determine that the driver 56 of the vehicle 10 is still distracted by the display screen 72 of the front passenger HMI 52A, moving to box 108, actuating multiple passenger HMIs 52A, 52B to attract at least one passenger 58A, 58B and encourage at least one passenger 58A, 58B to interact with the driver 56 of the vehicle 10.

[0076] In another exemplary embodiment, after modifying the audio output of the front passenger HMI 52A at frame 112 to reduce the driver 56's ability to hear the audio output of the front passenger HMI 52A, the method further includes: moving to frame 114, utilizing the distracted driver algorithm 64 within the system controller 34A and data from the occupant monitoring system 50 to determine that the driver 56 of the vehicle 10 is no longer distracted by the display screen 72 of the front passenger HMI 52A, and moving to frame 116 to restore the audio output of the front passenger HMI 52A.

[0077] In an exemplary embodiment, actuating the multiple occupant HMIs 52A, 52B to engage and encourage at least one occupant 58A, 58B to interact with the driver 56 of the vehicle 10 further includes moving to block 118 to reduce the quality of all audio and video outputs in the multiple occupant HMIs 52A, 52B.

[0078] In another exemplary embodiment, actuating the multiple passenger HMIs 52A, 52B to engage at least one passenger 58A, 58B and encourage at least one passenger 58A, 58B to interact with the driver 56 of the vehicle 10 at box 108 further includes: after reducing the quality of all audio and video outputs in the multiple passenger HMIs 52A, 52B at box 118, moving to box 120 to monitor the driver 56 and at least one passenger 58A, 58B with the occupant monitoring system 50.

[0079] At box 122, when the system controller 34A determines that at least one of the passengers 58A, 58B has interacted with the driver 56 of the vehicle 10 using data from the occupant monitoring system 50, and at box 124, the system controller 34A determines that the driver 56 of the vehicle 10 is still distracted using the distracted driver algorithm 64 within the system controller 34A and data from the occupant monitoring system 50, then moving to box 126, the method 100 also includes displaying, by the system controller 34A, a message 78 indicating that the driver 56 of the vehicle 10 is distracted on each of the plurality of passenger HMIs 52A, 52B.

[0080] At box 122, when the system controller 34A determines using data from the occupant monitoring system 50 that at least one of the passengers 58A, 58B has interacted with the driver 56 of the vehicle 10, then moving to box 126, the method 100 also includes displaying, with the system controller 34A, a message 78 on each of the plurality of passenger HMIs 52A, 52B indicating that the driver 56 of the vehicle 10 is distracted.

[0081] At box 122, when the system controller 34A determines using data from the occupant monitoring system 50 that at least one occupant 58A, 58B has interacted with the driver 56 of the vehicle 10, and at box 124, the system controller 34A determines using the distracted driver algorithm 64 within the system controller 34A and data from the occupant monitoring system 50 that the driver 56 of the vehicle 10 is no longer distracted, moving to box 128, the method 100 also includes restoring the quality of all audio and video outputs in the multiple occupant HMIs 52A, 52.

[0082] In an exemplary embodiment, at box 108, actuating the plurality of passenger HMIs 52A, 52B to engage at least one passenger 58A, 58B and encourage at least one passenger 58A, 58B to interact with the driver 56 of the vehicle 10 further includes, at box 126, after displaying a message 78 indicating that the driver 56 of the vehicle 10 is distracted on each of the plurality of passenger HMIs 52A, 52B using the system controller 34A, further including moving to box 130 to monitor the driver 56 and at least one passenger 58A, 58B using the occupant monitoring system 50.

[0083] At box 132, when the system controller 34A determines using data from the occupant monitoring system 50 that at least one occupant 58A, 58B has interacted with the driver 56 of the vehicle 10, and at box 134, the system controller 34A determines using the distracted driver algorithm 64 within the system controller 34A and data from the occupant monitoring system 50 that the driver 56 of the vehicle 10 is still distracted, the method 100 also includes: moving to box 136, pausing the audio and video output of each of the multiple occupant HMIs 52A, 52B by the system controller 34A.

[0084] At box 132 , when the system controller 34A determines using data from the occupant monitoring system 50 that at least one passenger 58A, 58B has interacted with the driver 56 of the vehicle 10 , the method 100 further includes moving to box 136 and pausing the audio and video output of each of the plurality of passenger HMIs 52A, 52B with the system controller 34A.

[0085] In box 132, when the system controller 34A determines that at least one passenger 58A, 58B has interacted with the driver 56 of the vehicle 10 using data from the occupant monitoring system 50, and in box 134, the system controller 34A determines that the driver 56 of the vehicle 10 is no longer distracted using the distracted driver algorithm 64 within the system controller 34A and data from the occupant monitoring system 50, the method 100 also includes: moving to box 138, removing the message 78 indicating that the driver 56 of the vehicle 10 is distracted and restoring all audio and video outputs in the multiple passenger HMIs 52A, 52B.

[0086] In another exemplary embodiment, at box 108, actuating the multiple passenger HMIs 52A, 52B to engage at least one passenger 58A, 58B and encourage at least one passenger 58A, 58B to interact with the driver 56 of the vehicle 10 further includes: after pausing the video and audio output of each of the multiple passenger HMIs 52A, 52B using the system controller 34A at box 136, moving to box 140 to monitor the driver 56 and at least one passenger 58A, 58B using the occupant monitoring system 50.

[0087] In box 142, when the system controller 34A determines that at least one passenger 58A, 58B has interacted with the driver 56 of the vehicle 10 using data from the occupant monitoring system 50, and in box 144, the system controller 34A determines that the driver 56 of the vehicle 10 is still distracted using the distracted driver algorithm 64 within the system controller 34A and data from the occupant monitoring system 50, the method 100 also includes: moving to box 146, using the system controller 34A to provide a tactile alert to at least one passenger 58A, 58B via at least one tactile alert device 54 within the vehicle 10.

[0088] In box 142, when the system controller 34A uses data from the occupant monitoring system 50 to determine that at least one passenger 58A, 58B is not interacting with the driver 56 of the vehicle 10, the method 100 also includes: moving to box 146, using the system controller 34A to provide a tactile alert to at least one passenger 58A, 58B via at least one tactile alert device 54 in the vehicle 10.

[0089] At box 142, when the system controller 34A determines using data from the occupant monitoring system 50 that at least one occupant 58A, 58B has interacted with the driver 56 of the vehicle 10, and at box 144, the system controller 34A determines using the distracted driver algorithm 64 within the system controller 34A and data from the occupant monitoring system 50 that the driver 56 of the vehicle 10 is no longer distracted, the method 100 also includes: moving to box 148, restoring all audio and video outputs in the multiple occupant HMIs 52A, 52B and removing the message 78.

[0090] In the exemplary embodiment, the method 100 also includes continuously providing the haptic alert using the system controller 34A until the system controller 34A determines at box 144 that the driver 56 of the vehicle 10 is no longer distracted using the distracted driver algorithm 64 within the system controller 34A and data from the occupant monitoring system 50 .

[0091] The systems and methods of the present disclosure provide the advantage of utilizing a human-machine interface within a vehicle to engage passengers within the vehicle to interact with a distracted driver.

[0092] The description of the present disclosure is merely exemplary in nature, and variations that do not depart from the gist of the present disclosure are intended to fall within the scope of the present disclosure. Such variations should not be regarded as departing from the spirit and scope of the present disclosure.

Claims

1. A method for engaging at least one passenger in a vehicle using a human-machine interface in a vehicle when a driver of the vehicle is distracted, comprising: modifying, using a system controller in communication with a plurality of passenger human machine interfaces (HMIs), a display screen of a front seat passenger HMI so that the display screen of the front seat passenger HMI is visually obscured from view by a vehicle driver; monitoring the vehicle driver and the at least one passenger in the vehicle using an occupant monitoring system in communication with a plurality of onboard sensors in the vehicle and the system controller; as well as The distracted driver algorithm within the system controller and data from the occupant monitoring system are used to determine that the vehicle driver is distracted, and when the vehicle driver is distracted, actuating the plurality of passenger HMIs to engage the at least one passenger and encourage the at least one passenger to interact with the vehicle driver.

2. The method according to claim 1, further comprising: determining, using the distracted driver algorithm within the system controller and data from the occupant monitoring system, that the vehicle driver is distracted by the display screen of the front passenger HMI; as well as When the driver is distracted by the display screen of the front passenger HMI, the audio output of the front passenger HMI is modified to reduce the driver's ability to hear the audio output of the front passenger HMI.

3. The method according to claim 2, further comprising: After modifying the audio output of the front seat passenger HMI to reduce the driver's ability to hear the audio output of the front seat passenger HMI, further comprising one of: determining, using the distracted driver algorithm within the system controller and data from the occupant monitoring system, that the vehicle driver is distracted by the display screen of the front passenger HMI, and actuating the plurality of passenger HMIs to engage the at least one passenger and encourage the at least one passenger to interact with the vehicle driver; or The distracted driver algorithm within the system controller and data from the occupant monitoring system are used to determine that the vehicle driver is no longer distracted by the display screen of the front passenger HMI, and audio output of the front passenger HMI is restored.

4. The method of claim 3, wherein actuating the plurality of passenger HMIs to engage the at least one passenger and encourage the at least one passenger to interact with the vehicle driver further comprises: The quality of all audio output and video output in the plurality of passenger HMIs is reduced.

5. The method of claim 4, wherein actuating the plurality of passenger HMIs to engage the at least one passenger and encourage the at least one passenger to interact with the vehicle driver further comprises: after reducing the quality of all audio and video outputs in the plurality of passenger HMIs; monitoring the driver and the at least one passenger using the occupant monitoring system; as well as displaying, using the system controller, a message on each of the plurality of passenger HMIs indicating that the vehicle driver is distracted when one of the following occurs: the system controller determines using data from the occupant monitoring system that the at least one occupant has interacted with the vehicle driver, and the system controller determines using the distracted driver algorithm within the system controller and data from the occupant monitoring system that the vehicle driver remains distracted, or The system controller determines, using data from the occupant monitoring system, that the at least one occupant is not interacting with the vehicle driver.

6. The method according to claim 5, further comprising: When the system controller determines, using data from the occupant monitoring system, that the at least one occupant has interacted with the vehicle driver, and the system controller determines, using the distracted driver algorithm within the system controller and data from the occupant monitoring system, that the vehicle driver is no longer distracted, restoring the quality of the audio output and the video output of the plurality of occupant HMIs.

7. The method of claim 5, wherein actuating the plurality of passenger HMIs to engage the at least one passenger and encourage the at least one passenger to interact with the vehicle driver further comprises: After displaying, using the system controller, a message on each of the plurality of passenger HMIs indicating that the vehicle driver is distracted, monitoring the driver and the at least one passenger using the occupant monitoring system, and pausing, using the system controller, the audio output and the video output of each of the plurality of passenger HMIs when one of the following occurs: the system controller determines, using data from the occupant monitoring system, that the at least one occupant has interacted with the vehicle driver, and the system controller determines, using the distracted driver algorithm within the system controller and data from the occupant monitoring system, that the vehicle driver remains distracted, or The system controller determines, using data from the occupant monitoring system, that the at least one occupant is not interacting with the vehicle driver.

8. The method according to claim 7, further comprising: When the system controller determines, using data from the occupant monitoring system, that the at least one occupant has interacted with the vehicle driver and the system controller determines, using the distracted driver algorithm within the system controller and data from the occupant monitoring system, that the vehicle driver is no longer distracted, removing a message indicating that the vehicle driver is distracted and restoring all audio and video outputs in the plurality of occupant HMIs.

9. The method of claim 7, wherein actuating the plurality of passenger HMIs to engage the at least one passenger and encourage the at least one passenger to interact with the vehicle driver further comprises: After pausing, by the system controller, the audio output and the video output of each of the plurality of passenger HMIs, monitoring the driver and the at least one passenger using the occupant monitoring system, and Providing a tactile warning to the at least one passenger via at least one tactile warning device in the vehicle using the system controller when one of the following conditions occurs: the system controller determines, using data from the occupant monitoring system, that the at least one occupant has interacted with the vehicle driver, and the system controller determines, using the distracted driver algorithm within the system controller and data from the occupant monitoring system, that the vehicle driver remains distracted, or The system controller determines, using data from the occupant monitoring system, that the at least one occupant is not interacting with the vehicle driver.

10. The method according to claim 9, further comprising: When the system controller determines, using data from the occupant monitoring system, that the at least one occupant has interacted with the vehicle driver, and the system controller determines, using the distracted driver algorithm within the system controller and data from the occupant monitoring system, that the vehicle driver is no longer distracted, all audio output and video output in the plurality of occupant HMIs are restored.

Images