BENEFITS OF HMI WHEN THE DISTRACTED DRIVER

Abstract

A system for utilizing human-machine interfaces to contact at least one passenger when a driver of a vehicle is distracted comprises a control unit communicating with a plurality of passenger human-machine interfaces, capable of modifying a display screen of a front-seat passenger HMI, and an occupant monitoring system capable of monitoring the driver of the vehicle and the at least one passenger inside the vehicle, wherein the control unit is capable of using an algorithm for distracted drivers within the control unit and data from the occupant monitoring system to determine that the driver of the vehicle is distracted, and when the driver of the vehicle is distracted, of activating the plurality of passenger HMIs to contact the at least one passenger and to request the at least one passenger to contact the driver of the vehicle.

Description

INTRODUCTION

[0001] The present disclosure relates to a system and method for utilizing human-machine interfaces for passengers within a vehicle to contact the passengers within the vehicle when a driver of the vehicle is distracted.

[0002] Vehicles are equipped with driver monitoring systems that detect when a driver is distracted and provide signals to the driver to redirect their attention back to driving. Current systems do not contact passengers inside the vehicle, so passengers inside the vehicle are prompted to interact with the driver to ensure the driver is properly engaged in driving and not distracted.

[0003] Although the current systems and methods thus serve their purpose, there is a need for a new and improved system and method for utilizing human-machine interfaces within a vehicle to contact passengers within the vehicle to contact a distracted driver. SUMMARY

[0004] According to several aspects of the present disclosure, a method for utilizing human-machine interfaces within a vehicle includes contacting at least one passenger within the vehicle when a driver of the vehicle is distracted, modifying a display screen of a front seat passenger HMI with a system controller in communication with a plurality of passenger human-machine interfaces (HMIs) to make the display screen of the front seat passenger HMI visually unclear to a driver of the vehicle, monitoring the driver of the vehicle and the at least one passenger within the vehicle with an occupant monitoring system in communication with a plurality of in-vehicle sensors within the vehicle and the system controller, and determining that the driver of the vehicle is distracted,with a distracted driver algorithm within the system controller and data from the occupant monitoring system, and when the driver of the vehicle is distracted, actuating the plurality of passenger HMIs to contact the at least one passenger and requesting the at least one passenger to contact the driver of the vehicle.

[0005] In another aspect, the method further comprises determining that the driver of the vehicle is distracted by the front seat passenger HMI display screen using the distracted driver algorithm within the system controller and data from the occupant monitoring system, and if the driver is distracted by the front seat passenger HMI display screen, modifying the audio output from the front seat passenger HMI to reduce the driver's ability to hear the audio output from the front seat passenger HMI.

[0006] According to another aspect, the method comprises, after modifying the audio output from the front seat passenger HMI to reduce the driver's ability to hear the audio output from the front seat passenger HMI, one of determining that the driver of the vehicle is distracted by the display screen of the front seat passenger HMI with the distracted driver algorithm within the system controller and data from the occupant monitoring system, and actuating the plurality of passenger HMIs to contact the at least one passenger and request the at least one passenger to contact the driver of the vehicle, or determining that the driver of the vehicle is distracted by the display screen of the front seat passenger HMI with the distracted driver algorithm within the system controller and data from the occupant monitoring system, and restoring the audio output from the front seat passenger HMI.

[0007] In another aspect, actuating the plurality of passenger HMIs to contact the at least one passenger and requesting the at least one passenger to contact the driver of the vehicle further comprises reducing the quality of the audio output and the video output of all of the plurality of passenger HMIs.

[0008] According to another aspect, if one of the system controllers determines with data from the occupant monitoring system that the at least one passenger has interacted with the driver of the vehicle, and the system controller determines with the distracted driver algorithm within the system controller and data from the occupant monitoring system that the driver of the vehicle remains distracted, actuating the plurality of passenger HMIs to contact the at least one passenger and requesting the at least one passenger to contact the driver of the vehicle further comprises, after reducing the quality of the audio and video output from all of the plurality of passenger HMIs, monitoring the driver and the at least one passenger with the occupant monitoring system, and displaying a message on each of the plurality of passenger HMIs with the system controller indicating that the driver of the vehicle is distracted,or the system controller determines with data from the occupant monitoring system that at least one passenger has not interacted with the driver of the vehicle.

[0009] In another aspect, the method further comprises restoring the quality of the audio and video output from all of the plurality of passenger HMIs when the system controller determines with data from the occupant monitoring system that the at least one passenger has interacted with the driver of the vehicle, and the system controller determines with the distracted driver algorithm within the system controller and data from the occupant monitoring system that the driver of the vehicle is no longer distracted.

[0010] According to another aspect, actuating the plurality of passenger HMIs to contact the at least one passenger and prompt the at least one passenger to interact with the driver of the vehicle, further comprising displaying a message on each of the plurality of passenger HMIs with the system controller indicating that the driver of the vehicle is distracted, monitoring the driver and the at least one passenger with the occupant monitoring system, and pausing the audio and video output of each of the plurality of passenger HMIs with the system controller if one of the system controllers determines with data from the occupant monitoring system that the at least one passenger has interacted with the driver of the vehicle, and the system controller determines with the distracted driver algorithm within the system controller and data from the occupant monitoring system that the driver of the vehicle remains distracted,or the system controller determines with data from the occupant monitoring system that at least one passenger has not interacted with the driver of the vehicle.

[0011] In another aspect, the method further comprises removing the message indicating that the driver of the vehicle is distracted and resuming the audio and video output from all of the plurality of passenger HMIs when the system controller determines with data from the occupant monitoring system that the at least one passenger has interacted with the driver of the vehicle, and the system controller determines with the distracted driver algorithm within the system controller and data from the occupant monitoring system that the driver of the vehicle is no longer distracted.

[0012] According to another aspect, actuating the plurality of passenger HMIs comprises contacting the at least one passenger and requesting the at least one passenger to contact the driver of the vehicle, further comprising, after pausing the audio and video output from each of the plurality of passenger HMIs with the system controller, monitoring the driver and the at least one passenger with the occupant monitoring system, and providing a haptic warning signal to the at least one passenger with the system controller via at least one haptic warning device within the vehicle if one of the system controllers determines with data from the occupant monitoring system that the at least one passenger has interacted with the driver of the vehicle, and the system controller determines with the distracted driver algorithm within the system controller and data from the occupant monitoring system that the driver of the vehicle remains distracted,or the system controller determines with data from the occupant monitoring system that at least one passenger has not interacted with the driver of the vehicle.

[0013] In another aspect, the method further comprises resuming the audio and video output from all of the plurality of passenger HMIs when the system controller determines with data from the occupant monitoring system that the at least one passenger has interacted with the driver of the vehicle, and the system controller determines with the distracted driver algorithm within the system controller and data from the occupant monitoring system that the driver of the vehicle is no longer distracted.

[0014] In another aspect, the method further comprises continuously providing the haptic warning signal with the system controller until the system controller determines, using the distracted driver algorithm in the system controller and data from the occupant monitoring system, that the driver of the vehicle is no longer distracted.

[0015] According to several aspects of the present disclosure, a system for utilizing human-machine interfaces within a vehicle to contact at least one passenger within the vehicle when a driver of the vehicle is distracted includes a system controller in communication with a plurality of passenger human-machine interfaces (HMIs) for passengers, adapted to modify a display screen of a front seat passenger HMI to make the display screen of the front seat passenger HMI visually unclear to a driver of the vehicle, and an occupant monitoring system in communication with a plurality of in-vehicle sensors within the vehicle and the system controller, adapted to monitor the driver of the vehicle and the at least one passenger within the vehicle, wherein the system controller is adapted tousing a distracted driver algorithm within the system controller and data from the occupant monitoring system to determine that the driver of the vehicle is distracted, and when the driver of the vehicle is distracted, to actuate the plurality of passenger HMIs to contact the at least one passenger and request that they contact the driver of the vehicle.

[0016] In another aspect, the system controller is further configured to determine, with the distracted driver algorithm and data from the occupant monitoring system, that the driver of the vehicle is distracted by the front seat passenger HMI display screen and to modify the audio output from the front seat passenger HMI to reduce the driver's ability to hear the audio output from the front seat passenger HMI when the driver is distracted by the front seat passenger HMI display screen.

[0017] In another aspect, after modifying the audio output from the front seat passenger HMI to reduce the driver's ability to hear the audio output from the front seat passenger HMI, the system controller is further configured to do one of actuating the plurality of passenger HMIs to contact the at least one passenger and requesting the at least one passenger to contact the driver of the vehicle when the system controller determines, with the distracted driver algorithm and data from the occupant monitoring system, that the driver of the vehicle is distracted by the display screen of the front seat passenger HMI, or restoring the audio output from the front seat passenger HMI when the system controller determines, with the distracted driver algorithm and data from the occupant monitoring system, that the driver of the vehicle is no longer distracted by the display screen of the front seat passenger HMI.

[0018] According to another aspect, when actuating the plurality of passenger HMIs to contact the at least one passenger and request the at least one passenger to contact the driver of the vehicle, the system controller is further adapted to reduce the quality of the audio output and video output from all of the plurality of passenger HMIs.

[0019] According to another aspect, after reducing the quality of the audio and video output from all of the plurality of passenger HMIs, the system controller is further configured to monitor the driver and the at least one passenger with the occupant monitoring system and to perform one of displaying a message on each of the plurality of passenger HMIs indicating that the driver of the vehicle is distracted if the system controller determines with data from the occupant monitoring system that the at least one passenger has interacted with the driver of the vehicle, and the system controller determines with the distracted driver algorithm and data from the occupant monitoring system that the driver of the vehicle remains distracted, or displaying a message on each of the plurality of passenger HMIs indicating that the driver of the vehicle is distracted if the system controller determines with data from the occupant monitoring system,that the at least one passenger has not interacted with the driver of the vehicle, or restore the quality of the audio and video output from all of the plurality of passenger HMIs if the system controller determines, using data from the occupant monitoring system, that the at least one passenger has interacted with the driver of the vehicle, and the system controller determines, using the distracted driver algorithm and data from the occupant monitoring system, that the driver of the vehicle is no longer distracted.

[0020] According to another aspect, the system controller is further configured, after displaying a message indicating that the driver of the vehicle is distracted on each of the plurality of passenger HMIs with the system controller, to monitor the driver and the at least one passenger with the occupant monitoring system, and to pause one of the audio and video outputs of each of the plurality of passenger HMIs if the system controller determines with data from the occupant monitoring system that the at least one passenger has interacted with the driver of the vehicle, and the system controller determines with the distracted driver algorithm and data from the occupant monitoring system that the driver of the vehicle remains distracted, or to pause the audio and video outputs of each of the plurality of passenger HMIs if the system controller determines with data from the occupant monitoring system that the at least one passenger has not interacted with the driver of the vehicle,or remove the message indicating that the driver of the vehicle is distracted and resume the audio and video output from all of the plurality of passenger HMIs when the system controller determines, with data from the occupant monitoring system, that the at least one passenger has interacted with the driver of the vehicle, and the system controller determines, with the distracted driver algorithm and data from the occupant monitoring system, that the driver of the vehicle is no longer distracted.

[0021] According to another aspect, the system controller is further configured to, after pausing the audio and video output with the system controller from each of the plurality of passenger HMIs, monitor the driver and the at least one passenger with the occupant monitoring system and provide one of a haptic warning signal to the at least one passenger with the system controller via at least one haptic warning device within the vehicle if one of the system controllers determines with data from the occupant monitoring system that the at least one passenger has interacted with the driver of the vehicle, and the system controller determines with the distracted driver algorithm and data from the occupant monitoring system that the driver of the vehicle remains distracted, or a haptic warning signal to the at least one passenger with the system controller via at least one haptic warning device within the vehicle,if the system controller determines with data from the occupant monitoring system that the at least one passenger has not interacted with the driver of the vehicle, or resuming the audio and video output from all of the plurality of passenger HMIs if the system controller determines with data from the occupant monitoring system that the at least one passenger has interacted with the driver of the vehicle, and the system controller determines with the distracted driver algorithm and data from the occupant monitoring system that the driver of the vehicle is no longer distracted.

[0022] According to another aspect, the system controller is further adapted to continuously output the haptic warning signal until the system controller determines, using the distracted driver algorithm and the occupant monitoring system data, that the driver of the vehicle is no longer distracted.

[0023] Further areas of applicability will become apparent from the description provided herein. It should be understood that the description and specific examples are for illustrative purposes only and are not intended to limit the scope of the disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] The drawings described herein are for illustrative purposes only and are not intended to limit the scope of the present disclosure in any way. Fig. 1 is a schematic diagram of a vehicle incorporating a system for utilizing human-machine interfaces within a vehicle to contact passengers within the vehicle to contact a distracted driver according to an exemplary embodiment; Fig. 2 is a schematic diagram of the system according to an exemplary embodiment; Fig. 3 is a top-down schematic view of a vehicle having a system according to an exemplary embodiment; Fig. 4 is a schematic perspective view of a human-machine interface with a message displayed thereon; and Fig. 5 is a flowchart illustrating a method according to an exemplary embodiment of the present disclosure.

[0025] The figures are not necessarily to scale, and some features may be larger or smaller to illustrate details of particular components. In some cases, well-known components, systems, materials, or methods have not been described in detail to avoid obscuring the present disclosure. Therefore, the specific structural and functional details disclosed herein are not to be construed as limiting, but merely as a basis for the claims and as a representative basis for teaching one skilled in the art to variously employ the present disclosure. DETAILED DESCRIPTION

[0026] The following description is merely exemplary and is not intended to limit the disclosure, application, or uses. Furthermore, there is no intention to be bound by any expressed or implied theory presented in the preceding technical field, background, summary, or the following detailed description. It should be understood that throughout the drawings, corresponding reference characters designate like or corresponding parts and features.As used herein, the term module refers to any hardware, software, firmware, electronic control component, processing logic, and / or processor device, individually or in any combination, including, but not limited to, an application-specific integrated circuit (ASIC), an electronic circuit, a processor (common, dedicated, or group), and memory that executes one or more software or firmware programs, combinational logic circuitry, and / or other suitable components that provide the described functionality. Although the figures shown herein represent an example with particular arrangements of elements, in actual embodiments, additional intermediate elements, devices, features, or components may be present.

[0027] It is understood that the figures are for illustrative purposes only and may not be drawn to scale.

[0028] The term "vehicle" used herein is not limited to motor vehicles. Although the present technology is primarily described in the context of motor vehicles, the technology is not limited to motor vehicles. The concepts can be used in a variety of applications, such as in connection with aircraft, watercraft, other vehicles, and consumer electronics components.

[0029] According to an exemplary embodiment, Fig. 1 illustrates a vehicle 10 with an associated system 11 for utilizing human-machine interfaces within a vehicle 10 to contact at least one passenger within the vehicle 10 when a driver of the vehicle 10 is distracted, according to various embodiments. In general, the system 11 cooperates with other systems within the vehicle 10 to display various information and infotainment content to the passenger. The autonomous vehicle 10 generally includes a chassis 12, a body 14, front wheels 16, and rear wheels 18. The body 14 is disposed on the chassis 12 and substantially encloses components of the vehicle 10. The body 14 and the chassis 12 together may form a frame. The front wheels 16 and the rear wheels 18 are each rotatably connected to the chassis 12 near a corner of the body 14.

[0030] In various embodiments, the vehicle 10 is an autonomous vehicle, and the system 11 is integrated into the autonomous vehicle 10. For example, an autonomous vehicle 10 is a vehicle 10 that is automatically controlled to transport passengers from one location to another. The vehicle 10 is shown as a passenger car in the illustrated embodiment; however, it should be understood that any other vehicle, including motorcycles, trucks, sport utility vehicles (SUVs), recreational vehicles (RVs), etc., may also be used. In one exemplary embodiment, the vehicle 10 is equipped with a so-called level four or level five automation system.A Level Four system indicates a "high degree of automation" and refers to the driving mode-specific execution of all aspects of the dynamic driving task by an automated driving system, even if a human driver does not respond appropriately to a request for intervention. A Level Five system indicates "full automation," meaning that an automated driving system fully executes all aspects of the dynamic driving task under all road and environmental conditions that can be handled by a human driver. The novel aspects of the present disclosure are also applicable to non-autonomous vehicles.

[0031] As illustrated, the vehicle 10 generally includes a drive system 20, a transmission system 22, a steering system 24, a braking system 26, a sensor system 28, an actuator system 30, at least one data storage device 32, at least one vehicle controller 34, and a wireless communication module 36. In an embodiment where the vehicle 10 is an electric vehicle, a transmission system 22 may not be present. The drive system 20, in various embodiments, may include an internal combustion engine, an electric machine such as a traction motor, and / or a fuel cell drive system. The transmission system 22 is configured to transfer power from the drive system 20 to the front wheels 16 and rear wheels 18 of the vehicle according to selectable gear ratios. According to various embodiments, the transmission system 22 may include a stepped-ratio automatic transmission, a continuously variable transmission, or other suitable transmission.The braking system 26 is configured to provide braking torque to the front wheels 16 and rear wheels 18 of the vehicle. In various embodiments, the braking system 26 may include friction brakes, wire-based brakes, a regenerative braking system such as an electric machine, and / or other suitable braking systems. The steering system 24 influences a position of the front wheels 16 and rear wheels 18. Although shown for illustrative purposes as including a steering wheel, in some embodiments contemplated by the present disclosure, the steering system 24 may not include a steering wheel.

[0032] The sensor system 28 includes one or more sensor devices 40a-40n that detect observable conditions of the external environment and / or the internal environment of the autonomous vehicle 10. The sensor devices 40a-40n may include, but are not limited to, radars, lidars, global positioning systems, optical cameras, thermal cameras, ultrasonic sensors, and / or other sensors. The cameras may include two or more digital cameras spaced apart from each other, wherein the two or more digital cameras are used to obtain stereoscopic images of the environment to obtain a three-dimensional image or map. The plurality of sensor devices 40a-40n are used to determine information about the environment of the vehicle 10.In one exemplary embodiment, the plurality of sensor devices 40a-40n includes at least one engine speed sensor, an engine torque sensor, an electric drive motor voltage and / or current sensor, an accelerator pedal position sensor, a coolant temperature sensor, a cooling fan speed sensor, and a transmission oil temperature sensor. In another exemplary embodiment, the plurality of sensor devices 40a-40n further includes sensors for determining information about the surroundings of the vehicle 10, for example, an ambient air temperature sensor, a barometric pressure sensor, and / or a photo and / or video camera positioned to view the surroundings in front of the vehicle 10. In another exemplary embodiment, at least one of the plurality of sensor devices 40a-40n is capable of measuring distances in the surroundings of the vehicle 10.

[0033] In one non-limiting example, where the plurality of sensor devices 40a-40n includes a camera 38, the plurality of sensor devices 40a-40n measure distances using an image processing algorithm configured to process images from the camera and determine distances between objects. In another non-limiting example, the plurality of vehicle sensors 40a-40n includes a stereoscopic camera having distance measurement capabilities. In one example, at least one of the plurality of sensor devices 40a-40n is mounted inside the vehicle 10, for example, in a headliner of the vehicle 10 that is viewable through the windshield of the vehicle 10.In another example, at least one of the plurality of sensor devices 40a-40n is a camera mounted outside the vehicle 10, for example, on a roof of the vehicle 10, that has a view of the surroundings of the vehicle 10 and is suitable for collecting information (images) related to the surroundings outside the vehicle 10. It is understood that various additional types of sensor devices, such as, for example, LiDAR sensors, ultrasonic positioning sensors, radar sensors, and / or time-of-flight sensors, are within the scope of the present disclosure. The actuator system 30 includes one or more actuator devices 42a-42n that control one or more functions of the vehicle 10, such as, but not limited to, the drive system 20, the transmission system 22, the steering system 24, and the braking system 26.

[0034] The vehicle controller 34 includes at least one processor 44 and a computer-readable storage device or medium 46. The at least one data processor 44 may be any custom or off-the-shelf processor, a central processing unit (CPU), a graphics processing unit (GPU), an auxiliary processor among the processors associated with the vehicle controller 34, a semiconductor-based microprocessor (in the form of a microchip or chipset), a macroprocessor, any combination thereof, or generally any device for executing instructions. The computer-readable storage device or media 46 may include volatile and non-volatile memory, such as read-only memory (ROM), random access memory (RAM), and keep-alive store (KAM).A KAM is a persistent or non-volatile memory that can be used to store various operating variables while the at least one data processor 44 is powered off. The computer-readable storage device(s) or media 46 can be implemented using any number of known storage devices, such as PROMs (programmable read-only memories), EPROMs (erasable PROMs), EEPROMs (electrically erasable PROMs), flash memory, or any other electrical, magnetic, optical, or combination storage devices capable of storing data, some of which represent executable instructions used by the controller 34 in controlling the vehicle 10.

[0035] The instructions may comprise one or more separate programs, each comprising an ordered collection of executable instructions for implementing logical functions. The instructions, when executed by the at least one processor 44, receive and process signals from the sensor system 28, perform logic, calculations, methods, and / or algorithms for automatically controlling the components of the vehicle 10, and generate control signals for the actuator system 30 to automatically control one or more components of the vehicle 10 based on the logic, calculations, methods, and / or algorithms. Although only a single controller 34 in Fig. 1, embodiments of the vehicle 10 may include any number of controllers 34 that communicate and cooperate via a suitable communication medium or combination of communication media to process the sensor signals, perform logic, calculations, methods and / or algorithms, and generate control signals to automatically control features of the autonomous vehicle 10.

[0036] In various embodiments, one or more instructions of the vehicle controller 34 are embodied in a trajectory planning system and, when executed by the at least one data processor 44, generate a trajectory output that accounts for kinematic and dynamic constraints of the environment. For example, the instructions receive process sensor and map data as input. The instructions are based on a graph-based approach with an adapted cost function to handle various road scenarios, both in cities and on highways.

[0037] The wireless communication module 36 is configured to wirelessly communicate information to and from other remote units 48, such as, but not limited to, other vehicles ("V2V" communication), infrastructure ("V2I" communication), remote systems, remote servers, cloud computers, and / or personal devices. In an exemplary embodiment, the communication system 36 is a wireless communication system configured to communicate via a wireless local area network (WLAN) using IEEE 802.11 standards or via cellular data communication. However, additional or alternative communication methods, such as Dedicated Short Range Communications (DSRC), are also contemplated within the scope of the present disclosure.DSRC channels refer to short- to medium-range, one-way or two-way wireless communication channels specifically designed for use in vehicles, along with a corresponding set of protocols and standards.

[0038] The vehicle controller 34 is a non-general electronic controller that includes a preprogrammed digital computer or processor, a memory or non-transitory computer-readable medium used to store data such as control logic, software applications, instructions, computer code, data, lookup tables, etc., and a transmit / receive device (or input / output ports). Computer-readable media includes any type of media accessible by a computer, such as read-only memory (ROM), random access memory (RAM), hard disk drive, compact disc (CD), digital video disc (DVD), or any other type of storage. A "non-transitory" computer-readable medium excludes wired, wireless, optical, or other communication connections that carry transitory electrical or other signals.A non-transitory computer-readable medium includes media on which data can be permanently stored and media on which data can be stored and later overwritten, such as a rewritable optical disk or an erasable storage device. Computer code includes all types of program code, including source code, object code, and executable code.

[0039] With reference to Fig. 2 illustrates a schematic diagram of system 11. System 11 includes a system controller 34A in communication with a plurality of sensor devices (onboard sensors) 40a-40n. System controller 34A may be the vehicle controller 34, or system controller 34A may be a separate control device in communication with the vehicle controller 34. In addition to the plurality of in-vehicle sensors 40a-40n, system controller 34A is in communication with an occupant monitoring system 50, a plurality of passenger human machine interfaces (HMIs) 52, and at least one haptic device 54.

[0040] In an exemplary embodiment, the occupant monitoring system 50 is adapted to monitor the driver 56 and passengers 58 within the vehicle 10. The occupant monitoring system 50 observes the driver 56 and passengers 58 within the vehicle 10 using cameras 60, microphones 62, and other sensors strategically placed within the interior of the vehicle 10. These cameras 60 can capture images of the face, eyes, and head position of both the driver 56 and passengers 58 within the vehicle 10, while other sensors can monitor steering wheel movements, pedal usage, and even vital signs such as heart rate. As is known in the industry, the occupant monitoring system 50 collects data that is continuously analyzed in real time by a distracted driver algorithm 64 within the system controller 34A.The distracted driver algorithm 64 uses advanced image recognition and machine learning algorithms to detect signs of distraction, drowsiness, or impairment of the driver 56.

[0041] Each of the plurality of passenger HMIs is adapted to provide infotainment content (audio and video) to the passengers within the vehicle 10. With reference to Fig. 3 illustrates an example of a vehicle 10 having a system 11 according to the present disclosure, the vehicle including a driver seat 66 for a driver 56 of the vehicle 10, a front passenger seat 68 for a front passenger 58A of the vehicle 10, and two rear passenger seats 70 for two rear passengers 58B of the vehicle 10. The vehicle 10 includes three passenger HMIs 52. One passenger HMI 52A is positioned for the front passenger 70 to view and interact with it, and two rear passenger HMIs 52B are positioned for the rear passenger 58B to view and interact with them.

[0042] In an exemplary embodiment, each of the passenger HMIs 52A, 52B includes a touchscreen display 72 suitable for displaying images and videos and allowing a passenger 58A, 58B to input information into the system 11 by touching the touchscreen display 72, a microphone 74 suitable for receiving verbal input from the passengers 58A, 58B, and a speaker 76 suitable for providing audio output to the passengers 58A, 58B.

[0043] In an exemplary embodiment, the system controller 34A is capable of modifying a display screen (the touchscreen display 72) of the front seat passenger HMI 52A such that the display screen 72 of the front seat passenger HMI 52A is visually unclear to the driver 56 of the vehicle 10. To make the display screen 72 of the front seat passenger HMI 52A visually unclear, the brightness of the front seat passenger HMI 52A may be reduced, or features of the touchscreen display 72 may be implemented to make the images displayed thereon unclear when viewed from an angle, wherein when the driver 56 looks toward the front seat passenger HMI 52A, the images displayed thereon are blurred, but when the passenger 56A looks toward the front seat passenger HMI 52A, the images displayed thereon are clear.

[0044] This measure is intended to prevent the driver 56 from viewing or interacting with the front seat passenger HMI 52A while the driver 56 is driving the vehicle 10. The occupant monitoring system 50 is in communication with the plurality of in-vehicle sensors 40a-40n within the vehicle 10 and the system controller 34A and is adapted to monitor the driver 56 of the vehicle 10 and the at least one passenger 58A, 58B within the vehicle 10.

[0045] In an exemplary embodiment, when the system controller 34A determines, using the distracted driver algorithm 64 within the system controller 34A and data from the occupant monitoring system 50, that the driver 56 of the vehicle 10 is distracted, the system controller is further configured to actuate the plurality of passenger HMIs 52A, 52B to contact the at least one passenger 58A, 58B and to request the at least one passenger 58A, 58B to contact the driver 56 of the vehicle. This action is intended to encourage the passengers 58A, 58B within the vehicle 10 to actively participate in maintaining the driver 56's focus while driving the vehicle 10.

[0046] The system controller 34A and the distracted driver algorithm 64 consider a driver 56 to be "distracted" whenever the driver 56 is unable to safely operate the vehicle 10. For example, a distracted driver 56 may be a driver 56 who is distracted in the traditional sense, where the driver 56 is looking away from the road, eating, drinking, conversing with another passenger 58A, 58B, etc. A distracted driver 56 could also be a driver 56 who exhibits fatigue or inattention. In an exemplary embodiment, the plurality of in-vehicle sensors 40a-40n include physiological sensors for monitoring the physical / medical condition of the driver 56, wherein the system controller 34A may consider the driver 56 distracted for purposes of the system 11 if physiological sensors indicate that the driver 56 has a physical / medical condition that makes the driver 56 unfit to safely operate the vehicle 10.For example, physiological sensors within the vehicle 10 may detect an increased heart rate or palpitations and determine that the driver 56 may be experiencing a heart attack, and thus consider the driver distracted and trigger an action by the system 11 to contact the at least one passenger 58A, 58B.

[0047] Further, in determining whether the driver 56 is distracted, the system controller 34A utilizes a centralized risk calculator within the system controller 34A that receives inputs from the plurality of in-vehicle sensors 40a-40n, including internal sensors that provide information relating, for example, but not limited to, the driver's condition, driving behavior, and physiological states of the driver 56, external sensors that provide information relating, for example, but not limited to, weather conditions, time of day, and road conditions / complexity, and information received from cloud-based resources and infrastructure systems that provide information relating, for example, but not limited to, traffic conditions, road conditions, and construction.The system controller 34A may, using the centralized risk calculator, adjust the thresholds used to determine when a driver is considered "distracted" and thus when the system 11 initiates contacting the at least one passenger 58A, 58B when the centralized risk calculator determines that the driving risk is increased due to, for example, but not limited to, heavy traffic, poor weather conditions, etc.

[0048] In another exemplary embodiment, when the system controller 34A determines, using the distracted driver algorithm 64 and data from the occupant monitoring system 50, that the driver 56 of the vehicle 10 is distracted by the screen 72 of the front seat passenger HMI 52A, the system controller 34A is operable to modify the audio output from the front seat passenger HMI 52A to reduce the driver's ability to hear the audio output from the front seat passenger HMI 52A.Such a modification may include reducing the volume of the audio output from the speaker 76 of the front seat passenger HMI 52A or implementing techniques known in the industry to direct the audio output from the speaker 76 of the front seat passenger HMI 52A toward the passenger 58A, making it difficult for the driver 56 to hear the audio output from the speaker 76 of the front seat passenger HMI 52A and preventing the driver 56 from being distracted by the front seat passenger HMI 52A.

[0049] If the system controller 34A, after modifying the audio output from the front seat passenger HMI 52A to enhance the ability of the driver 56 to hear the audio output from the front seat passenger HMI 52A with the distracted driver algorithm 64 and data from the occupant monitoring system 50, determines that the driver 56 of the vehicle 10 is still distracted by the display screen 72 of the front seat passenger HMI 52A, then the system controller is further operable to actuate the plurality of front seat passenger HMIs 52A, 52B to contact the at least one passenger 58A, 58B and to request the at least one passenger 58A, 58B to contact the driver 56 of the vehicle 10.

[0050] If, after modifying the audio output from the front seat passenger HMI 52A to enhance the ability of the driver 56 to hear the audio output from the front seat passenger HMI 52A using the distracted driver algorithm 64 and data from the occupant monitoring system 50, the system controller 34A determines that the driver 56 of the vehicle 10 is no longer distracted by the display screen 72 of the front seat passenger HMI 52A, the system controller 34A is further operable to restore the audio output from the front seat passenger HMI 52A.

[0051] In an exemplary embodiment, when actuating the plurality of passenger HMIs 52A, 52B to contact the at least one passenger 58A, 58B and requesting the at least one passenger 58A, 58B to contact the driver 56 of the vehicle 10, the system controller 34A is further configured to reduce the quality of the audio and video output from all of the plurality of passenger HMIs 52A, 52B. This action is intended to attract the attention of the passengers 58A, 58B by disrupting the audio and video output of the human-machine interface 52A, 52B, which in turn encourages the passengers 58A, 58B to contact the driver 56, knowing that the driver 56's concentration will prevent further disruption to the audio and video output from the passenger HMI 52A, 52B.

[0052] After reducing the quality of the audio and video output from all of the plurality of passenger HMIs 52A, 52B, the system controller 34A is further adapted to monitor the driver 56 and the at least one passenger 58A, 58B with the occupant monitoring system 50.

[0053] If, after reducing the quality of the audio and video output from all of the plurality of passenger HMIs 52A, 52B, the system controller 34A determines with data from the occupant monitoring system 50 that the at least one passenger 58A, 58B has interacted with the driver 56 of the vehicle 10, and the system controller 34A determines with the distracted driver algorithm 64 and data from the occupant monitoring system 50 that the driver 56 of the vehicle 10 remains distracted, then the system controller 34A is adapted to display a message 78 on each of the plurality of passenger HMIs 52A, 52B indicating that the driver 56 of the vehicle 10 is distracted.

[0054] The system controller 34A uses the occupant monitoring system 50 to check whether any of the passengers 58A, 58B have contacted the driver 56. The occupant monitoring system 50 may detect movements or gestures of the at least one passenger 58A, 58B using the camera 60, such as the at least one passenger 58A, 58B reaching out to touch the shoulder of the driver 56, or the occupant monitoring system may detect that the at least one passenger 58A, 58B has spoken to the driver 56 using the microphone 62. However, if the system controller 34A determines that the driver 56 is still distracted despite being contacted by one or more passengers 58A, 58B, the message 78 is displayed.

[0055] With reference to Fig. 4, the message 78 may include one or both of a text message 78A and a graphic 78B, wherein the text message 78A and / or the graphic 78B are intended to attract the attention of the passengers 58A, 58B and prompt the passengers 58A, 58B to contact the driver 58. The audio and video output of the passenger HMIs 52A, 52B continues while the message 78 is displayed on the touchscreen display 72 of each of the passenger HMIs 52A, 52B, overlaid with the video output.

[0056] If, after reducing the quality of the audio and video output from all of the plurality of passenger HMIs 52A, 52B, the system controller 34A determines with data from the occupant monitoring system 50 that the at least one passenger 58A, 58B has not interacted with the driver 56 of the vehicle 10, then the system controller 34A is adapted to display a message 78 on each of the plurality of passenger HMIs 52A, 52B, as in Fig. 4, indicating that the driver 56 of the vehicle 10 is distracted. If reducing the audio and video quality does not successfully cause any of the passengers 58A, 58B to contact the driver 56, then the system controller 34A increases its efforts to contact the passengers 58A, 58B by displaying the message 78 on each of the plurality of passenger HMIs 52A, 52B.

[0057] If, after reducing the quality of the audio and video output from all of the plurality of passenger HMIs 52A, 52B, the system controller 34A determines with data from the occupant monitoring system 50 that the at least one passenger 58A, 58B has interacted with the driver 56 of the vehicle 10, and the system controller 34A determines with the distracted driver algorithm 64 and data from the occupant monitoring system 50 that the driver 56 of the vehicle 10 is no longer distracted, then the system controller 34A is operable to restore the quality of the audio and video output from all of the plurality of passenger HMIs 52A, 52B.

[0058] After the system controller 34A displays the message 78 indicating that the driver 56 of the vehicle 10 is distracted on each of the plurality of passenger HMIs 52A, 52B, the system controller 34A is further configured to monitor the driver 56 and the at least one passenger 58A, 58B with the occupant monitoring system 50.

[0059] If the system controller 34A determines with data from the occupant monitoring system 50 that the at least one passenger 58A, 58B has interacted with the driver 56 of the vehicle 10, and the system controller 34A determines with the distracted driver algorithm 64 and data from the occupant monitoring system 50 that the driver 56 of the vehicle 10 is still distracted, then the system controller is further operable to pause the audio and video output from each of the plurality of passenger HMIs 52A, 52B.

[0060] The system controller 34A uses the occupant monitoring system 50 to check whether any of the passengers 58A, 58B have contacted the driver 56. However, if the system controller 34A determines that the driver 56 is still distracted despite being contacted by one or more passengers 58A, 58B, the audio and video output from each of the plurality of passenger HMIs 52A, 52B is paused. The previously displayed message 78 may remain on the screen, as shown in Fig. 4, any video displayed is paused and no sound is transmitted from the speakers 76.

[0061] If the system controller 34A determines, using data from the occupant monitoring system 50, that the at least one passenger 58A, 58B has not interacted with the driver 56 of the vehicle 10, then the system controller 34A is further configured to pause the audio and video output from each of the plurality of passenger HMIs 52A, 52B.

[0062] If the system controller 34A determines with data from the occupant monitoring system 50 that the at least one passenger 58A, 58B has interacted with the driver 56 of the vehicle 10, and the system controller 34A determines with the distracted driver algorithm 64 and data from the occupant monitoring system 50 that the driver 56 of the vehicle 10 is no longer distracted, then the system controller 34A is further adapted to remove the message 78 indicating that the driver 56 of the vehicle 10 is distracted and resume the audio and video output from each of the plurality of passenger HMIs 52A, 52B.

[0063] In an exemplary embodiment, after pausing the audio and video output from each of the plurality of passenger HMIs 52A, 52B with the system controller 34A, the system controller 34A is further configured to monitor the driver 56 and the at least one passenger 58A, 58B with the occupant monitoring system 50.

[0064] If the system controller 34A determines with data from the occupant monitoring system 50 that the at least one passenger 58A, 58B has interacted with the driver 56 of the vehicle 10, and the system controller 34A determines with the distracted driver algorithm 64 and data from the occupant monitoring system 50 that the driver 56 of the vehicle 10 remains distracted, then the system controller 34A is further adapted to issue a haptic warning to the at least one passenger 58A, 58B via at least one haptic warning device 54 within the vehicle 10.

[0065] The haptic device 54 may be any known device that emits haptic warning signals within a vehicle, such as a buzzer or audible signal, a vibration of the passenger seat 68, 70, or a vibration of a seatbelt, to name a few examples. Such a haptic warning signal is intended to provide a more intrusive signal to attract the attention of the at least one passenger 58A, 58B and prompt the at least one passenger 58A, 58B to contact the distracted driver 56.

[0066] If the system controller 34A determines with data from the occupant monitoring system 50 that the at least one passenger 58A, 58B has not interacted with the driver 56 of the vehicle 10, then the system controller 34A is further configured to issue a haptic warning to the at least one passenger 58A, 58B via the at least one haptic warning device 54 within the vehicle 10. If pausing the audio and video output from each of the plurality of passenger HMIs 52A, 52B does not successfully cause any of the passengers 58A, 58B to contact the distracted driver 56, then the system controller 34A increases efforts to contact the at least one passenger 58A, 58B by providing the haptic alert in conjunction with pausing the audio and video output from each of the passenger HMIs 52A, 52B and displaying the message 78.

[0067] If the system controller 34A determines with data from the occupant monitoring system 50 that the at least one passenger 58A, 58B has interacted with the driver 56 of the vehicle 10, and the system controller 34A determines with the distracted driver algorithm 64 and data from the occupant monitoring system 50 that the driver 56 of the vehicle 10 is no longer distracted, then the system controller 34A is further adapted to resume the audio and video output from all of the plurality of passenger HMIs 52A, 52B and remove the displayed message 78.

[0068] In an exemplary embodiment, the system controller 34A is further configured to continuously output the haptic warning until the system controller 34A determines, using the distracted driver algorithm 64 and the data from the occupant monitoring system 50, that the driver 56 of the vehicle 10 is no longer distracted.

[0069] With reference to Fig.5 includes a method 100 for utilizing human-machine interfaces 52A, 52B within a vehicle 10 to contact at least one passenger 58A, 58B within the vehicle 10 when a driver 56 of the vehicle 10 is distracted. Beginning at block 102, with a system controller 34A in communication with a plurality of passenger human-machine interfaces (HMIs) 52A, 52B, modifying a display screen 72 of a front seat passenger HMI 52A to make the display screen 72 of the front seat passenger HMI 52A visually unclear to a driver 56 of the vehicle 10, moving to block 104, monitoring the driver 56 of the vehicle 10 and the system controller 34A with an occupant monitoring system 50 in communication with a plurality of in-vehicle sensors. 40a-40n within the vehicle 10, the driver 56 of the vehicle 10 and the at least one passenger 58A, 58B within the vehicle 10, moving to block 106,Determine, using a distracted driver algorithm 64 within the system controller 34A and data from the occupant monitoring system 50, that the driver 56 of the vehicle 10 is distracted, and if the driver 56 of the vehicle 10 is distracted at block 106, moving to block 108, actuating the plurality of passenger HMIs 52A, 52B to contact the at least one passenger 58A, 58B and requesting the at least one passenger 58A, 58B to contact the driver 56 of the vehicle 10.

[0070] In an exemplary embodiment, the method 100 further includes moving from block 106 to block 110 and determining, with the distracted driver algorithm 64 in the system controller 34A and data from the occupant monitoring system 50, that the driver 56 of the vehicle 10 is distracted by the display screen 72 of the front seat passenger HMI 52A, and if the driver 56 is distracted by the display screen 72 of the front seat passenger HMI 52A, at block 110 moving to block 112, modifying the audio output from the front seat passenger HMI 52A to reduce the ability of the driver 56 to hear the audio output from the front seat passenger HMI 52A.

[0071] In an exemplary embodiment, after modifying the audio output from the front seat passenger HMI 52A to reduce the ability of the driver 56 to hear the audio output from the front seat passenger HMI 52A, at block 112, the method further includes moving to block 114, determining with the distracted driver algorithm 64 within the system controller 34A and data from the occupant monitoring system 50 that the driver 56 of the vehicle 10 is still distracted through the display screen 72 of the front seat passenger HMI 52A, and moving to block 108, actuating the plurality of passenger HMIs 52A, 52B to contact the at least one passenger 58A, 58B and requesting the at least one passenger 58A, 58B to contact the driver 56 of the vehicle 10.

[0072] In another exemplary embodiment, after modifying the audio output from the front seat passenger HMI 52A to reduce the ability of the driver 56 to hear the audio output from the front seat passenger HMI 52A, at block 112, the method further includes moving to block 114, determining, with the distracted driver algorithm 64 within the system controller 34A and data from the occupant monitoring system 50, that the driver 56 of the vehicle 10 is no longer distracted through the display screen 72 of the front seat passenger HMI 52A, and moving to block 116, restoring the audio output from the front seat passenger HMI 52A.

[0073] In an exemplary embodiment, actuating the plurality of passenger HMIs 52A, 52B to contact the at least one passenger 58A, 58B and requesting the at least one passenger 58A, 58B to contact the driver 56 of the vehicle 10 further comprises moving to block 118, reducing the quality of the audio output and the video output of all of the plurality of passenger HMIs 52A, 52B.

[0074] In another exemplary embodiment, actuating the plurality of passenger HMIs 52A, 52B to contact the at least one passenger 58A, 58B and requesting the at least one passenger 58A, 58B to contact the driver 56 of the vehicle 10 at block 108, further comprises, after reducing the quality of the audio and video output from all of the plurality of passenger HMIs 52A, 52B at block 118, moving to block 120, monitoring the driver 56 and the at least one passenger 58A, 58B with the occupant monitoring system 50.

[0075] If the system controller 34A determines with data from the occupant monitoring system 50 that the at least one passenger 58A, 58B has interacted with the driver 56 of the vehicle 10, at block 122, and the system controller 34A determines with the distracted driver algorithm 64 within the system controller 34A and data from the occupant monitoring system 50 that the driver 56 of the vehicle 10 remains distracted, at block 124, then, moving to block 126, the method 100 further includes displaying a message 78 with the system controller 34A on each of the plurality of passenger HMIs 52A, 52B indicating that the driver 56 of the vehicle 10 is distracted.

[0076] If the system controller 34A determines with data from the occupant monitoring system 50 that the at least one passenger 58A, 58B has interacted with the driver 56 of the vehicle 10 at block 122, then, moving to block 126, the method 100 further includes displaying a message 78 with the system controller 34A on each of the plurality of passenger HMIs 52A, 52B indicating that the driver 56 of the vehicle 10 is distracted.

[0077] If the system controller 34A determines with data from the occupant monitoring system 50 that the at least one passenger 58A, 58B has interacted with the driver 56 of the vehicle 10, at block 122, and the system controller 34A determines with the distracted driver algorithm 64 within the system controller 34A and data from the occupant monitoring system 50 that the driver 56 of the vehicle 10 is no longer distracted, at block 124, then moving to block 128, the method 100 further includes restoring the quality of the audio and video output from all of the plurality of passenger HMIs 52A, 52B.

[0078] In an exemplary embodiment, actuating the plurality of passenger HMIs 52A, 52B to contact the at least one passenger 58A, 58B and requesting the at least one passenger 58A, 58B to contact the driver 56 of the vehicle 10 at block 108, further comprises, after displaying a message 78 on each of the plurality of passenger HMIs 52A, 52B with the system controller 34A indicating that the driver 56 of the vehicle 10 is distracted at block 126, and further moving to block 130, monitoring the driver 56 and the at least one passenger 58A, 58B with the occupant monitoring system 50.

[0079] If the system controller 34A determines with data from the occupant monitoring system 50 that the at least one passenger 58A, 58B has interacted with the driver 56 of the vehicle 10, at block 132, and the system controller 34A determines with the distracted driver algorithm 64 within the system controller 34A and data from the occupant monitoring system 50 that the driver 56 of the vehicle 10 is no longer distracted, at block 134, the method 100 further includes moving to block 136, pausing the audio and video output from each of the plurality of passenger HMIs 52A, 52B with the system controller 34A.

[0080] If the system controller 34A determines with data from the occupant monitoring system 50 that the at least one passenger 58A, 58B has not interacted with the driver 56 of the vehicle 10 at block 132, the method 100 further includes moving to block 136, pausing the audio and video output from each of the plurality of passenger HMIs 52A, 52B with the system controller 34A.

[0081] If the system controller 34A determines with data from the occupant monitoring system 50 that the at least one passenger 58A, 58B has interacted with the driver 56 of the vehicle 10 at block 132, and the system controller 34A determines with the distracted driver algorithm 64 within the system controller 34A and data from the occupant monitoring system 50 that the driver 56 of the vehicle 10 is no longer distracted at block 134, the method 100 further includes moving to block 138, removing the message 78 indicating that the driver 56 of the vehicle 10 is distracted, and resuming the audio and video output from all of the plurality of passenger HMIs 52A, 52B.

[0082] In another exemplary embodiment, actuating the plurality of passenger HMIs 52A, 52B to contact the at least one passenger 58A, 58B and requesting the at least one passenger 58A, 58B to contact the driver 56 of the vehicle 10 at block 108 further comprises, after pausing the audio and video output from all of the plurality of passenger HMIs 52A, 52B with the system controller 34A at block 136, moving to block 140, monitoring the driver 56 and the at least one passenger 58A, 58B with the occupant monitoring system 50.

[0083] If the system controller 34A determines with data from the occupant monitoring system 50 that the at least one passenger 58A, 58B has interacted with the driver 56 of the vehicle 10, in block 142, and the system controller 34A determines with the distracted driver algorithm 64 within the system controller 34A and data from the occupant monitoring system 50 that the driver 56 of the vehicle 10 is no longer distracted, in block 144, the method 100 further comprises moving to block 146, providing a haptic warning to the at least one passenger 58A, 58B with the system controller 34A via at least one haptic warning device 54 within the vehicle 10.

[0084] If the system controller 34A determines with data from the occupant monitoring system 50 that the at least one passenger 58A, 58B has not interacted with the driver 56 of the vehicle 10 at block 142, then the method 100 further includes moving to block 146, providing a haptic warning to the at least one passenger 58A, 58B by the system controller 34A via at least one haptic warning device 54 within the vehicle 10.

[0085] If the system controller 34A determines with data from the occupant monitoring system 50 that the at least one passenger 58A, 58B has interacted with the driver 56 of the vehicle 10 at block 142, and the system controller 34A determines with the distracted driver algorithm 64 within the system controller 34A and data from the occupant monitoring system 50 that the driver 56 of the vehicle 10 is no longer distracted at block 144, then the method 100 further includes moving to block 148, resuming the audio and video output from all of the plurality of passenger HMIs 52A, 52B, and removing the message 78.

[0086] In an exemplary embodiment, the method 100 further includes continuously providing the haptic warning signal with the system controller 34A until the system controller 34A determines, at block 144, using the distracted driver algorithm 64 within the system controller 34A and data from the occupant monitoring system 50, that the driver 56 of the vehicle 10 is no longer distracted.

[0087] A system and method of the present disclosure provides the advantage of utilizing human-machine interfaces within a vehicle to contact passengers within the vehicle to contact a distracted driver.

[0088] The description of the present disclosure is merely exemplary, and variations that do not depart from the gist of the present disclosure are to be considered within the scope of the present disclosure. Such variations are not to be regarded as a departure from the spirit and scope of the present disclosure.

Claims

[1] A method for using human-machine interfaces within a vehicle to contact at least one passenger within the vehicle when a driver of the vehicle is distracted, comprising: modifying a display screen of a passenger human machine interface (HMI) with a system controller in communication with a plurality of front seat passenger human machine interfaces to make the display screen of the front seat passenger HMI visually unclear to a driver of the vehicle; Monitoring the driver of the vehicle and at least one passenger within the vehicle with an occupant monitoring system in communication with a plurality of in-vehicle sensors within the vehicle and the system controller; and Determining that the driver of the vehicle is distracted using a distracted driver algorithm within the system controller and data from the occupant monitoring system, and if the driver of the vehicle is distracted, actuating the plurality of passenger HMIs to contact the at least one passenger and requesting the at least one passenger to contact the driver of the vehicle. [2] The method of claim 1, further comprising: Determining that the driver of the vehicle is distracted through the front seat passenger HMI display screen, using the distracted driver algorithm within the system controller and data from the occupant monitoring system; and When the driver is distracted by the front seat passenger HMI screen, modifying the audio output from the front seat passenger HMI to reduce the driver's ability to hear the audio output from the front seat passenger HMI. [3] The method of claim 2, further comprising: after modifying the audio output from the front seat passenger HMI to reduce the driver's ability to hear the audio output from the front seat passenger HMI, one of: Determining that the driver of the vehicle is distracted through the front seat passenger HMI display screen, with the distracted driver algorithm within the system controller and data from the occupant monitoring system, and actuating the plurality of passenger HMIs to contact the at least one passenger and requesting the at least one passenger to contact the driver of the vehicle; or Determine that the vehicle driver is no longer distracted through the front seat passenger HMI display screen using the distracted driver algorithm within the system control and data from the occupant monitoring system, and restore audio output from the front seat passenger HMI. [4] The method of claim 3, wherein actuating the plurality of passenger HMIs to contact the at least one passenger and requesting the at least one passenger to contact the driver of the vehicle further comprises reducing the quality of the audio output and the video output of all of the plurality of passenger HMIs. [5] The method of claim 4, wherein actuating the plurality of passenger HMIs to contact the at least one passenger and requesting the at least one passenger to contact the driver of the vehicle after reducing the quality of the audio and video output from all of the plurality of passenger HMIs comprises: Monitoring the driver and at least one passenger with the occupant monitoring system; and Displaying a message on each of the plurality of passenger HMIs with the system controller indicating that the driver of the vehicle is distracted when one of: the system controller determines, using data from the occupant monitoring system, that the at least one passenger has interacted with the driver of the vehicle, and the system controller determines, using the distracted driver algorithm within the system controller and data from the occupant monitoring system, that the driver of the vehicle remains distracted; or The system controller determines, using data from the occupant monitoring system, that at least one passenger has not interacted with the driver of the vehicle. [6] The method of claim 5, further comprising restoring the quality of the audio and video output from all of the plurality of passenger HMIs when the system controller determines with data from the occupant monitoring system that the at least one passenger has interacted with the driver of the vehicle, and the system controller determines with the distracted driver algorithm within the system controller and data from the occupant monitoring system that the driver of the vehicle is no longer distracted. [7] The method of claim 5, wherein actuating the plurality of passenger HMIs to contact the at least one passenger and requesting the at least one passenger to contact the driver of the vehicle after displaying a message on each of the plurality of passenger HMIs with the system controller indicating that the driver of the vehicle is distracted comprises: Monitoring the driver and at least one passenger with the occupant monitoring system; and Pause the audio and video output from each of the plurality of passenger HMIs with the system control when one of: the system controller determines, using data from the occupant monitoring system, that the at least one passenger has interacted with the driver of the vehicle, and the system controller determines, using the distracted driver algorithm within the system controller and data from the occupant monitoring system, that the driver of the vehicle remains distracted; or The system controller determines, using data from the occupant monitoring system, that at least one passenger has not interacted with the driver of the vehicle. [8] The method of claim 7, further comprising removing the message indicating that the driver of the vehicle is distracted and resuming the audio and video output from all of the plurality of passenger HMIs when the system controller determines with data from the occupant monitoring system that the at least one passenger has interacted with the driver of the vehicle, and the system controller determines with the distracted driver algorithm within the system controller and data from the occupant monitoring system that the driver of the vehicle is no longer distracted. [9] The method of claim 7, wherein actuating the plurality of passenger HMIs to contact the at least one passenger and requesting the at least one passenger to contact the driver of the vehicle further comprises, after pausing with the system controller, controlling the audio and video output from each of the plurality of passenger HMIs: Monitoring the driver and at least one passenger with the occupant monitoring system; and Providing a haptic warning signal to the at least one passenger with the system control via at least one haptic warning device within the vehicle when one of: the system controller determines, using data from the occupant monitoring system, that the at least one passenger has interacted with the driver of the vehicle, and the system controller determines, using the distracted driver algorithm within the system controller and data from the occupant monitoring system, that the driver of the vehicle remains distracted; or The system controller determines, using data from the occupant monitoring system, that at least one passenger has not interacted with the driver of the vehicle. [10] The method of claim 9, further comprising resuming audio and video output from all of the plurality of passenger HMIs when the system controller determines with data from the occupant monitoring system that the at least one passenger has interacted with the driver of the vehicle, and the system controller determines with the distracted driver algorithm within the system controller and data from the occupant monitoring system that the driver of the vehicle is no longer distracted.

Images