Occupant awareness monitoring for autonomous vehicles

By connecting with the wireless equipment of the vehicle occupants to monitor and determine their level of awareness, the problem that existing systems are difficult to monitor the awareness of highly autonomous vehicles is solved, and the safety of vehicle operation is improved.

CN112292081BActive Publication Date: 2024-11-19RIVIAN HOLDINGS LLC
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN201980009590.5
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2018-01-22
Filing Date
2019-01-18
Publication Date
2024-11-19
Estimated Expiration
2039-01-18

AI Technical Summary

Technical Problem

Existing driver surveillance systems are difficult to monitor whether drivers in Level 3, Level 4 or Level 5 autonomous vehicles have sufficient level of awareness to control the vehicle when needed.

Method used

By connecting with the vehicle occupant's wireless device (such as a smartphone or health tracker), the occupant's activity signal is received and processed, determine whether his level of awareness meets the threshold, and generate an alarm or take appropriate action as needed.

Benefits of technology

Improve the safety of vehicle operation and ensure that the driver or occupant can pay attention and control the vehicle in a timely manner when needed, especially in highly autonomous vehicles, reducing the risk of potential accidents caused by insufficient awareness.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN112292081B_ABST
    Figure CN112292081B_ABST
Patent Text Reader

Abstract

The present invention describes systems and methods for monitoring the consciousness of a vehicle occupant. A method may include connecting, by the vehicle, a wireless device of the vehicle occupant, receiving, by the vehicle, a signal from the wireless device indicating an activity of the vehicle occupant, and processing the signal to determine a level of consciousness of the vehicle occupant, determining whether the level of consciousness of the vehicle occupant meets a threshold, and generating, by the vehicle, an alert based on whether the level of consciousness of the vehicle occupant meets the threshold.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims priority to U.S. Patent Application No. 15 / 876,766, filed on January 22, 2018, the entire contents of which are incorporated herein by reference. Technical Field

[0003] The present disclosure relates to motor vehicles and, more particularly, to vehicle driver awareness monitoring systems and methods. Background Art

[0004] Depending on the level of autonomy of the vehicle, the driver may be required to maintain a specified degree of attention to the road in order to properly control the vehicle. The Society of Automotive Engineers (SAE) defines five levels of vehicle autonomy that have been adopted by the National Highway Traffic Safety Administration, from Level 0 (no automation) to Level 5 (full automation). The higher the level, the less attention the human driver is allowed to pay. For example, when operating a vehicle with Level 1 and Level 2 autonomy (driver assistance and partial automation, respectively), the driver should always be fully focused because these systems work in parallel with the human driver. When operating a vehicle with Level 3 autonomy (conditional automation), the human driver can divert attention from driving, but be ready to take control back when the vehicle requests it. In vehicles with Level 4 autonomy (high automation), the vehicle is fully capable of driving itself within limits such as speed limits or geographical constraints, beyond which the human driver must be ready to take control back. At Level 5 autonomy (full automation), the driver may not be driving the vehicle at all (can be considered a passenger at this point), and may be distracted, but may still need to stay awake in order to react appropriately to certain situations. The present inventors recognized technical issues regarding the operation of autonomous motor vehicles characterized by Level 3, Level 4, or Level 5 autonomy that may require human intervention, and noted a need for technical solutions to monitor the awareness of vehicle occupants. Summary of the invention

[0005] The inventors have noted a need for systems and methods for monitoring awareness of vehicle occupants in a motor vehicle characterized, for example, by Level 3, Level 4, or Level 5 autonomy. The exemplary methods described herein may satisfy these needs.

[0006] According to one example, a method of monitoring the consciousness of a vehicle occupant may include connecting, by the vehicle, a wireless device of the vehicle occupant, receiving, by the vehicle, a signal from the wireless device indicating an activity of the vehicle occupant, and processing the signal to determine a level of consciousness of the vehicle occupant, determining whether the level of consciousness of the vehicle occupant satisfies a threshold, and generating, by the vehicle, an alert based on whether the level of consciousness of the vehicle occupant satisfies the threshold. A system for performing the exemplary method may include a computer processing system and a memory containing program instructions, wherein the computer processing system is configured to perform the above steps. A non-transitory computer-readable medium for performing the exemplary method may contain program instructions suitable for causing a computer processing system to perform the above steps. BRIEF DESCRIPTION OF THE DRAWINGS

[0007] Figure 1 An exemplary framework of a method of monitoring vehicle occupant awareness according to examples of the present disclosure is illustrated.

[0008] Figure 2 A flow chart illustrating an exemplary method of monitoring vehicle occupant awareness according to examples of the present disclosure. DETAILED DESCRIPTION

[0009] As described in the examples herein, the systems and methods of the present invention provide monitoring of the awareness of vehicle occupants in order to improve the safety of the operation of the vehicle. For example, previously known driver monitoring systems (DMS) can be used for Level 1-2 autonomous vehicles. Such DMS can use infrared sensors and cameras capable of eye tracking through such infrared sensors to detect whether the driver is paying attention to the road. If the DMS determines that the driver is not paying enough attention to the road, the DMS can flash warnings and generate sounds to attract the driver's attention; if the driver does not take sufficient action, the DMS can cause the vehicle to automatically apply brakes. In Level 3, Level 4, and Level 5 autonomous vehicles, the driver can be safely partially or completely distracted. However, even when used in such vehicles, previously known DMSs are not sufficient to monitor whether the driver (who can be considered an occupant in a Level 5 autonomous vehicle) has an appropriate level of awareness to control the vehicle when necessary.

[0010] As described herein, a vehicle occupant's smartphone and / or health monitor and / or other medical monitoring device can be paired with the vehicle and can send signals to the vehicle that the vehicle can use to monitor the occupant's level of consciousness and take appropriate action based thereon. For example, the vehicle can automatically pair with the occupant's smartphone and / or health tracker when the occupant enters the vehicle. The smartphone and / or health tracker can send one or more signals to the vehicle indicating the activity of the vehicle occupant, whereby the level of consciousness of the vehicle occupant can be determined by processing the activity data. For example, the smartphone can send one or more signals to the vehicle indicating the occupant's physical activity and / or electronic use of the smartphone, and / or the health tracker can send one or more signals to the vehicle indicating one or more of the occupant's physical characteristics associated with the occupant's consciousness, and such information can be considered activity data in accordance with the present disclosure. An alarm module on the vehicle including a computer processor may receive and process the occupant activity data to determine whether the activity data meets a threshold, thereby determining whether the vehicle occupant is paying enough attention to assume driving control of the vehicle if necessary, for example due to external factors such as adverse weather conditions, road traffic, or other conditions in which the vehicle occupant must assume the primary role as driver. Alternatively, a health tracker or medical monitoring device may be paired with a smartphone, and the health tracker / monitoring device may send such a signal to the smartphone, which may then send such a signal to the vehicle. Optionally, pairing the smartphone and / or health tracker with the vehicle may include installing an application to the smartphone and / or health tracker and / or medical monitoring device, which causes the smartphone and / or health tracker and / or medical monitoring device to send an appropriate signal to the vehicle indicating the occupant's level of consciousness.

[0011] In a non-limiting example, a smartphone of an occupant who may be required to take control of the vehicle may be paired with a vehicle processing system, and the smartphone may include functionality to detect the number of touch screen presses and / or taps at regular intervals, such as 1 minute, 2 minutes, 5 minutes, etc. Such smartphone activity may be transmitted to the vehicle processing system, or to the processing system of the smartphone itself, which may process the activity data to determine whether the number of touch screen presses and / or taps exceeds a threshold, which may indicate that the occupant is not paying enough attention. How much smartphone activity may constitute a threshold level of distraction that requires an alert may depend on the vehicle's autonomy level, road conditions, environmental conditions, traffic conditions, etc., and the vehicle processing system or smartphone processing system may receive real-time information about such factors related to the vehicle's current location in order to dynamically determine the appropriate threshold level. The appropriate threshold may be determined through appropriate controlled testing based on such conditions, real-world accident data, government regulations, etc. As another non-limiting example, if the occupant wears a health tracker or monitoring device configured to monitor heart rate and paired with the occupant's smart phone, the vehicle can monitor the occupant's heart rate through appropriate signaling between the health tracker, the smart phone, and the vehicle. Based on the occupant's heart rate value and / or changes in the occupant's heart rate, the vehicle can detect physical problems with the occupant and can generate an alarm, and can also stop the vehicle and / or send a signal to a third party (such as calling 911) for help as appropriate. In other examples, the vehicle can prompt the driver to complete a task to demonstrate alertness, such as touching certain parts of the vehicle's touch screen to generate a signal indicating the occupant's alertness level. Based on any appropriate combination of one or more signals received by the vehicle, and comparison of such signals with corresponding thresholds, the vehicle can detect whether the occupant is sufficiently alert, and if appropriate, can safely pull over, and can call 911 or other third parties for help.

[0012] Figure 1An exemplary framework of a method of monitoring vehicle occupant awareness in accordance with an example of the present disclosure is illustrated. The framework 100 includes a vehicle 110 including a monitoring and control system 120 and a wireless device 130. The monitoring and control system 120 may be configured to wirelessly communicate with the wireless device 130 and control the vehicle 110 based thereon. The wireless device 130 may include a smartphone 130' and / or a fitness tracker / monitor 130", and the monitoring and control system 120 may receive signals from the smartphone 130' and / or the fitness tracker / monitor 130" indicating the occupant's level of awareness and may take appropriate actions based on such signals, as described in greater detail herein. In some configurations, the vehicle is an autonomous vehicle, such as a Level 4 or Level 5 autonomous vehicle. However, it should be appreciated that the systems and methods of the present invention may be appropriately used with any type of vehicle, including Level 0 vehicles, Level 1 vehicles, Level 2 vehicles, Level 3 vehicles, Level 4 vehicles, and / or Level 5 vehicles, as well as vehicles using different categories of automation, fully non-automated vehicles, or vehicles with any appropriate level of automation. The autonomous vehicle may be configured with an array of sensors, including LIDAR (Light Detection and Ranging) and camera systems 113 for acquiring real-time video images of obstacles and other vehicles, GPS (Global Positioning System) 114, wireless communication systems for sending and receiving communications about road information and traffic in real time, and computers for applying driving rules and making driving decisions based on data and information acquired from the aforementioned sensors in an appropriate manner such as is conventionally known in the art. In addition, the functionality described herein may be combined with a conventional DMS to simultaneously provide multiple modes of monitoring and detection, such as monitoring eye movements, head position and movement, etc., and monitoring occupant awareness using one or more wireless devices in proximity to a vehicle occupant (e.g., held by a vehicle occupant, supported by a vehicle occupant, worn by a vehicle occupant, connected to a vehicle occupant, etc.), as described herein.

[0013] exist Figure 1In the example illustrated in the diagram, the monitoring and control system 120 includes a processing system 121, such as one or more central processing units (CPUs), and one or more memories used by the processing system 121, such as random access memory (RAM) 122, random online memory (ROM) 123, and / or non-volatile memory 124, and an interface 125 through which the vehicle can communicate with occupants, wireless devices 130, and / or third parties. The non-volatile memory 124 may include program instructions configured to cause the processing system 121 to perform one or more operations such as the operations provided herein. For example, the non-volatile memory 124 may include program instructions for occupant monitoring, which are configured to cause the processing system 121 to monitor the corresponding consciousness levels of one or more occupants of the vehicle 110 by using signals received from one or more of the interfaces 125, and program instructions for control, which are configured to take one or more actions, such as generating an alarm based on the occupant monitoring through one or more of the interfaces 125 when it is determined that the occupant's consciousness level triggers a threshold that is insufficient for safe operation of the vehicle.

[0014] exist Figure 1In the exemplary configuration illustrated in the diagram, the monitoring and control system 120 includes a wireless transceiver 126 and an optional touch screen 128. The wireless transceiver 126 may be configured to connect to a wireless device 130 of a vehicle occupant, such as a smart phone 130' held by the occupant and / or a fitness tracker / monitoring device 130" worn by the occupant, and receive signals from the wireless device that indicate occupant activity that can be used to calculate the vehicle occupant's level of consciousness. The monitoring and control system 120 may be configured to determine whether the vehicle occupant's level of consciousness is triggered, such as above or below a threshold. For example, the wireless transceiver 126 may include a cellular transceiver configured to provide communication between the vehicle 110 and the wireless device 130 of the intended passenger via a cellular connection. The wireless transceiver 126 may also include a The wireless transceiver 126 may include a Bluetooth transceiver configured to allow communication with the wireless device 130 via a Bluetooth connection, and / or a Wi-Fi transceiver configured to allow communication with the wireless device 130 via a Wi-Fi connection. In certain configurations where the wireless device 130 includes a smartphone 130', the wireless transceiver 126 may be configured to receive a signal including a value indicative of the motion of the smartphone. For example, the smartphone 130' may include an accelerometer 131' that is configured to detect movement of the smartphone based on, for example, response to the occupant's handling of the smartphone (whether in the occupant's hand, in the occupant's pocket, or otherwise in sufficient contact with the occupant so as to The physical movement of a smartphone (such as a smart phone that moves with the occupant's movements) can generate one or more values. For another example, the wireless transceiver can be configured to receive a value indicative of the occupant's use of the smartphone. In a non-limiting example, a smartphone 130' of an occupant who may be required to control the vehicle can be paired with the vehicle processing system 121 via the transceiver 126, and the smartphone 130' can include functionality to detect the number of touch screen presses and / or taps at regular intervals, such as 1 minute, 2 minutes, 5 minutes, etc. Such smartphone activity can be transmitted to the vehicle processing system 121, or to the processing unit of the smartphone itself. The system may process the activity data to determine whether the number of touch screen presses and / or taps exceeds a threshold, which may indicate that the occupant is not paying enough attention. How much smartphone activity may constitute a threshold level of distraction that requires an alert may depend on the vehicle's autonomy level, road conditions, environmental conditions, traffic conditions, etc. The vehicle processing system 121 or smartphone processing system may wirelessly receive real-time information about such factors related to the vehicle's current location from a backend vehicle monitoring and control system or other information source (e.g., any appropriate online information source of location-based traffic, weather, road conditions, and other information) to dynamically determine the appropriate threshold level.Appropriate thresholds may be predetermined through appropriate controlled testing based on such conditions, real world accident data, government regulations, etc., and the vehicle processing system 121 or the smartphone 130' processing system may set a given threshold level based on the conditions experienced by the vehicle at the given location at the time. In an example, the smartphone 130' may include a usage monitor 132' configured to generate one or more values ​​based on the occupant's usage of the smartphone's electronic features (e.g., based on the smartphone's CPU usage, the smartphone's memory usage, the number of applications being used on the smartphone, etc.).

[0015] Additionally, or alternatively, the wireless device 130 may include a health monitor 130″ and / or other monitoring devices, such as a medical device worn by the occupant, and the wireless transceiver 126 may be configured to receive signals from the health monitor 130″, including values ​​indicative of the occupant's level of consciousness. For example, the wireless transceiver 126 may be configured to connect directly to the health monitor 130″ and receive the signals, or may be configured to connect to a smartphone 130′ that is in wireless communication with the health monitor 130″ and receive signals from the health monitor 130″ via the smartphone 130′. The signals received by the wireless transceiver 126 from the health monitor 130″ (whether directly or indirectly via the smartphone 130′) may include any appropriate biometric values, such as values ​​indicative of the occupant's heart rate, blood oxygen level, or blood glucose level. For example, health monitor 130" may include one or more of the following: a heart rate monitor configured to monitor the occupant's heart rate and generate a value 131" (64 beats per minute (BPM) indicative of such heart rate); a blood glucose monitor configured to monitor the occupant's blood glucose level and generate a value 132" (5.5 mmol / L in the illustrated non-limiting example) indicative of such blood glucose level; and / or a blood oxygen monitor configured to monitor the occupant's blood oxygen level and generate a value 133" (98% SpO2 in the illustrated non-limiting example) indicative of such blood oxygen level. However, it should be appreciated that health monitor 130" may include any appropriate type of monitor or combination of such monitors. Other exemplary monitors may include a breathalyzer. Additionally, it should be appreciated that health monitor 130" may include an accelerometer 134" that may operate similarly to accelerometer 131'. Wireless transceiver 126 may be configured to receive signals from wireless device 130, such as smart phone 130' and / or health tracker 130", at any appropriate time, for example, continuously or periodically.

[0016] The vehicle 110 is configured to monitor the consciousness of the occupant using signals received from the occupant's wireless device 130, and more specifically, to monitor the consciousness of the occupant using values ​​carried in such signals and indicative of the occupant's level of consciousness. For example, program instructions for occupant monitoring may be stored in the non-volatile memory 124 and may be configured to cause the processing system 121 to obtain values ​​carried by signals from the wireless device 130 from the wireless transceiver 126 and to assess the occupant's level of consciousness based on such values. For example, for each type of value that the wireless transceiver 126 may receive from the wireless device 130, the ROM 123 and / or the non-volatile memory 124 may store one or more thresholds to which the received values ​​may be compared in order to quantify the occupant's level of consciousness. For example, the occupant monitoring program instructions may cause the processing system 121 to obtain a received value from the wireless receiver 126 and a corresponding threshold from the ROM 123 or the non-volatile memory 124, and compare the received value and the corresponding threshold to determine whether the received value is within a range indicating an acceptable level of consciousness or within a range indicating an unacceptable level of consciousness.

[0017] For example, a threshold value for movement of a wireless device may correspond to a minimum amount of physical movement that an occupant should have that is sufficiently alert, such as corresponding to the occupant breathing and / or movement of the occupant's muscles slightly moving even when sitting still. The occupant monitoring program instructions may cause the processing system 121 to compare the values ​​received from the smartphone 130' or fitness tracker 130" with such threshold values ​​to quantify whether the occupant is moving at least the minimum amount to be sufficiently alert (to take control of the vehicle when needed, e.g., based on the vehicle's autonomy level). For another example, a threshold value for use of a wireless device may correspond to a minimum amount of electronic activity that an occupant should have that is sufficiently alert, such as corresponding to the occupant's activity of regularly checking their smartphone messages or responding to messages over a specified period of time. The occupant monitoring program instructions may cause the processing system 121 to compare the values ​​received from the smartphone 130' with such threshold values ​​to quantify whether the occupant is using the wireless device at least the minimum amount to be sufficiently alert.

[0018] For another example, the threshold value for heart rate may correspond to one or more of the minimum heart rate that a sufficiently alert occupant should have, the maximum heart rate that a sufficiently alert occupant should have, and / or the maximum change in heart rate (e.g., increase or decrease) that a sufficiently alert occupant should have. The occupant monitoring program instructions may cause the processing system 121 to compare the values ​​received from the fitness tracker 130″ with such threshold values ​​in order to quantify whether the occupant's heart rate and / or the change in such heart rate have values ​​that a sufficiently alert occupant should have. For another example, the threshold value for blood glucose may correspond to one or more of the minimum blood glucose that a sufficiently alert occupant should have, the maximum blood glucose that a sufficiently alert occupant should have, and / or the maximum change in blood glucose (e.g., increase or decrease) that a sufficiently alert occupant should have. The occupant monitoring program instructions may cause the processing system 121 to compare the values ​​received from the fitness tracker 130″ with such threshold values ​​in order to quantify whether the occupant's blood glucose and / or the change in such blood glucose have values ​​that a sufficiently alert occupant should have.

[0019] As another example, the threshold value for blood oxygen level may correspond to one or more of a minimum blood oxygen level for a sufficiently alert occupant, and / or a maximum change (e.g., decrease) in blood oxygen level for a sufficiently alert occupant. The occupant monitoring program instructions may be configured to cause the processing system 121 to compare values ​​received from the fitness tracker 130″ to such threshold values ​​in order to quantify whether the occupant's blood oxygen level and / or changes in such blood oxygen level have values ​​for a sufficiently alert occupant. Other thresholds and values ​​may be established, obtained, and compared as appropriate in order to quantify whether the occupant is sufficiently alert. For example, the occupant monitoring program instructions may cause the processing system 121 to prompt a user to complete a task using the touch screen 128, and compare the user's ability to complete such tasks to appropriate threshold values ​​in order to quantify whether the user's ability to complete the task has values ​​for a sufficiently alert occupant.

[0020] Still see Figure 1, the monitoring and control system 120 may be configured to cause the alarm activation interface 127 to generate a visual alarm, sound, or vibration within the vehicle based on the level of consciousness of the vehicle occupant being below a threshold, or to cause the wireless receiver 126 to send an alarm signal to, for example, the occupant's wireless device and / or a third party, such as a 911 operator. For example, in response to an occupant monitoring determination that the level of consciousness of the vehicle occupant triggers a threshold, such as below an attention threshold or above a distraction threshold, for example, based on a value received from the wireless device 130 and a corresponding threshold, the monitoring and control system 120 may be configured to cause the processing system 121 to control the vehicle 110 to react appropriately. For example, the monitoring and control system 120 may be configured to cause the processing system 121 to generate any appropriate alarm or combination of alarm signals for transmission by the wireless transceiver 126 to the vehicle occupant and / or a third party, such as a 911 operator, through the interface 125. In addition, for example, the monitoring and control system 120 may be configured to cause the alarm activation interface 127 to generate a visual alarm in response to a signal from the processing system 121; such a visual alarm may include (but is not limited to) colored or flashing lights, and / or messages projected on a dashboard and / or a head-up display (not specifically shown) or projected on the touch screen 128. In this regard, the alarm activation interface 127 may include one or more integrated circuits, transistor circuits, and switch circuits to control appropriate indicators based on the receipt of an alarm signal, such as from the processing system 121. For example, the processing system 121 may send an appropriate alarm signal to the alarm activation interface 127 to trigger, for example, an audible alarm, including (but not limited to) an alarm tone and / or a message generated by a vehicle speaker (not specifically shown). For another example, the alarm activation interface 127 may be configured to trigger a vibration in response to a signal from the processing system 121; such a vibration may include (but is not limited to) vibrations generated by a seat and / or steering wheel (not specifically shown) of the vehicle through an appropriate vibration actuator. Additionally, or alternatively, the processing system 121 may cause the wireless transceiver 126 to send a signal to an occupant's wireless device (e.g., a smartphone to cause a visual, audible, or vibration indication at the device) or a third party. For example, a message may be sent to a third party, such as 911 or other emergency assistance service, that responds to such a signal. As another or alternative option, the monitoring and control system 120 may be configured to bring the vehicle 110 to a safe, controlled stop based on the level of consciousness of the vehicle occupant that triggers a threshold.

[0021] Figure 2 A flow chart illustrating an exemplary method of monitoring vehicle occupant awareness according to an example of the present disclosure. Figure 2 The method 200 shown in the diagram is a reference Figure 1The framework 100 illustrated in the diagram is illustrated, however, such operations may be suitably used with any appropriate combination of hardware and software, such as any non-autonomous or autonomous vehicle, such as a Level 3, Level 4, or Level 5 autonomous vehicle. The occupant may be the driver of the vehicle or a non-driving passenger in the vehicle (note that in a Level 5 autonomous vehicle, the driver may be a non-driving passenger).

[0022] Figure 2 The method 200 illustrated in FIG. 1 includes, at step 202, connecting to a wireless device of a vehicle occupant via the vehicle. For example, Figure 1 The vehicle 110 illustrated in FIG. 1 may be configured to periodically or continuously connect to a wireless device 130 via a wireless transceiver 126, such as via a Bluetooth, cellular and / or Wi-Fi connection. The wireless device 130 may include a smartphone 130' held by an occupant and / or a health monitor worn by an occupant.

[0023] See again Figure 2 , the method 200 may include, at step 204, receiving, by the vehicle, a signal from a wireless device indicating an activity of a vehicle occupant and processing the signal to determine a level of consciousness of the vehicle occupant. Figure 1 In the manner described, the signal from the wireless device may include a value indicating movement of a smart phone or fitness tracker / monitoring device, a value indicating the occupant's use of a smart phone, a value indicating the occupant's heart rate, blood oxygen level, or blood glucose level, or any other appropriate type of value.

[0024] See again Figure 2 , the method 200 may also include, at step 206, generating an alarm by the vehicle based on the vehicle occupant's level of consciousness being below a threshold. For example, the processing system 121 may determine whether the vehicle occupant is alert enough to operate the vehicle based on the received value and the stored threshold, and send an appropriate signal to the alarm module 127 to generate an alarm based on the vehicle occupant's lack of alertness. As shown in reference Figure 1 As described, the warning may include a light or message, sound, or vibration within the vehicle, and / or may include a signal sent to a third party, or to an occupant's wireless device to present a visual, audible, and / or vibratory indication of the signal at the device. As another option, the vehicle may be controlled by an autonomous function to bring the vehicle to a safe, controlled stop based on the level of awareness of the vehicle occupant at the triggering threshold, such as using sensors that collect and receive information, such as vehicle LIDAR and camera 113 and GPS 114, which is then processed by the vehicle control system to control the drive system and steering system through appropriate actuators.

[0025] This specification describes exemplary embodiments of the present invention, but other variations are also within the scope of the present disclosure. For example, the system and method may include and utilize data signals transmitted via a network (e.g., a local area network, a wide area network, the Internet, a combination thereof, etc.), an optical fiber medium, a carrier wave, a wireless network, etc. to communicate with one or more data processing devices. The data signal may carry any or all data disclosed herein provided to or from the device.

[0026] The method and system described in this article can utilize program code containing program instructions that can be executed by the device processing system, and can be realized on many different types of processing devices.Software program instructions can include source code, object code, machine code or any other storage data that can be operated to make the processing system carry out the method and operation described in this article.Those skilled in the art will appreciate that any suitable computer language can be used, such as C, C++, Java etc.But other implementations can also be used, such as firmware, or even appropriately designed hardware configured to implement the method and system described in this article.

[0027] The data of the systems and methods (e.g., associations, mappings, data inputs, data outputs, intermediate data results, final data results, etc.) may be stored and implemented in one or more different types of computer-implemented data storage areas, such as different types of storage devices and programming structures (e.g., RAM, ROM, flash memory, flat files, databases, programming data structures, programming variables, IF-THEN (or similar type) statement structures, etc.). Note that a data structure describes a format for organizing and storing data in a database, program, memory, or other non-transitory computer-readable medium for use by a computer program.

[0028] The computer components, software modules, functions, data stores, and data structures described herein may be interconnected, directly or indirectly, to allow for the flow of data required for their operation. It is also noted that a module or processor includes, but is not limited to, a unit of code that performs software operations, and may be implemented, for example, as a subroutine unit of code, or as a software functional unit of code, or as an object (as in an object-oriented paradigm), or as an applet, or in a computer scripting language, or as another type of computer code. Depending on the circumstances at the time, software components and / or functions may be located on a single computer, or distributed across multiple computers.

[0029] It should be understood that the meaning of the singular forms used in the description herein and in the claims that follow includes plural references unless the context clearly dictates otherwise. In addition, the meaning of "in..." used in the description herein and in the claims that follow includes "in..." and "on..." unless the context clearly dictates otherwise. In addition, the meanings of "and" and "or" used in the description herein and in the claims that follow include both conjunctive and disjunctive and can be used interchangeably unless the context clearly dictates otherwise; the phrase "exclusive or" can be used to indicate situations in which only the disjunctive meaning is applicable. In addition, the meanings of "about" and / or "approximately" used in the description herein and in the claims that follow refer to ±10% of the amount shown, unless otherwise specified.

[0030] Although the present invention has been described by way of exemplary embodiments, those skilled in the art will appreciate that various modifications may be made to the exemplary embodiments without departing from the scope of the invention as recited in the claims.

Claims

1. A method of monitoring the consciousness of a vehicle occupant, the method comprising: a wireless device connected by the vehicle to an occupant of the vehicle; receiving, by the vehicle, a signal from the wireless device indicative of at least one characteristic selected from the attention and activity of the vehicle occupant, and processing the signal to determine a level of at least one attribute selected from the attention and awareness of the vehicle occupant; determining whether a level of at least one attribute selected from attention and awareness of the vehicle occupant satisfies a threshold; wherein the threshold is determined based at least in part on at least one of a level of autonomy of the vehicle, road conditions, environmental conditions, traffic conditions, and a biometric characteristic that an occupant of sufficient alertness is expected to possess, and wherein the threshold is dynamically determined based on real-time information about the level of autonomy of the vehicle, road conditions, environmental conditions, traffic conditions related to a current position of the vehicle; and generating, by the vehicle, an alert based on whether a level of at least one attribute selected from attention and awareness of the vehicle occupant satisfies a threshold; Wherein determining whether the level of at least one attribute selected from the attention and awareness of the vehicle occupant satisfies a threshold comprises at least one of the following: The movement of the wireless device corresponds to the minimum amount of physical movement that an occupant would be expected to have to be sufficiently alert; The use of wireless devices corresponds to the minimum amount of electronic activity that an occupant would be expected to have to be sufficiently alert; and The ability of a user to complete tasks using the touch screen of the wireless device is of a value that an occupant would be expected to have if they were sufficiently alert; and The alert comprises a signal sent to a third party.

2. The method of claim 1, wherein the vehicle is a Level 3, Level 4, or Level 5 autonomous vehicle.

3. The method of claim 1, wherein the wireless device comprises a smart phone in proximity to the occupant.

4. The method of claim 3, wherein the signal from the wireless device includes a value indicative of motion of the smartphone.

5. The method of claim 3, wherein the signal from the wireless device includes a value indicative of the occupant's use of the smartphone.

6. The method of claim 1, wherein the wireless device comprises a health monitor worn by the occupant.

7. The method of claim 6, wherein the signal from the wireless device includes a value indicative of the occupant's heart rate, blood oxygen level, or blood glucose level.

8. The method of claim 1, wherein the alarm comprises a visual alarm, an audible alarm, or a vibration alarm within the vehicle.

9. The method of claim 1 further comprising autonomously stopping the vehicle based on whether the vehicle occupant's level of consciousness meets the threshold.

10. A system for monitoring the consciousness of a vehicle occupant, the system comprising: a wireless transceiver of the vehicle, the wireless transceiver configured to connect to a wireless device of a vehicle occupant and receive a signal from the wireless device indicative of at least one characteristic selected from the attention and activity of the vehicle occupant; a computer processing system configured to process the vehicle occupant data and determine whether a level of at least one attribute selected from attention and awareness of the vehicle occupant based on the processed data satisfies a threshold; wherein the threshold is determined based at least in part on at least one of a level of autonomy of the vehicle, road conditions, environmental conditions, traffic conditions, and a biometric characteristic that an occupant of sufficient alertness is expected to possess, and wherein the threshold is dynamically determined based on real-time information about the level of autonomy of the vehicle, road conditions, environmental conditions, traffic conditions related to a current position of the vehicle; and an electrical interface configured to receive a first warning signal based on a determination of whether a level of at least one attribute selected from attention and awareness of the vehicle occupant satisfies a threshold, the electrical interface configured to control an alarm; Wherein determining whether the level of at least one attribute selected from the attention and awareness of the vehicle occupant based on the processed data satisfies a threshold comprises at least one of the following: The movement of the wireless device corresponds to the minimum amount of physical movement that an occupant would be expected to have to be sufficiently alert; The use of wireless devices corresponds to the minimum amount of electronic activity that an occupant would be expected to have to be sufficiently alert; and The ability of a user to complete tasks using the touch screen of the wireless device is of a value that an occupant would be expected to have if they were sufficiently alert; and The alert comprises a signal sent to a third party.

11. The system of claim 10, wherein the vehicle is a Level 3, Level 4, or Level 5 autonomous vehicle.

12. The system of claim 10, wherein the wireless device comprises a smart phone in proximity to the occupant.

13. The system of claim 12, wherein the signal from the wireless device includes a value indicative of motion of the smartphone.

14. The system of claim 12, wherein the signal from the wireless device includes a value indicative of usage of the smartphone by the occupant.

15. The system of claim 10, wherein the wireless device comprises a health monitor worn by the occupant.

16. The system of claim 15, wherein the signal from the wireless device includes a value indicative of the occupant's heart rate, blood oxygen level, or blood glucose level.

17. The system of claim 10, wherein the electrical interface includes circuitry configured to control a visual alarm, an audible alarm, or a vibration alarm within the vehicle.

18. The system of claim 10, wherein the computer processing system is configured to initiate a controlled stop of the vehicle based on whether the level of consciousness of the vehicle occupant satisfies the threshold.