Driver Engageability Scoring for Autonomous Handoff Alerts
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing autonomous vehicle systems lack sophisticated driver monitoring and notification strategies, particularly in higher automation levels, leading to potential safety risks when drivers are not fully engaged or alert.
Innovation Solution
A system and method that utilizes a remote device, such as a smartphone, to enhance driver monitoring by capturing multimodal data, including facial and eye tracking, to generate an engageability score, which informs a state machine about the driver's alertness and initiates appropriate escalation responses, such as alerts or vehicle maneuvers, to ensure safe operation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Extent of automation
If autonomous vehicle systems operate at higher automation levels (L3-L5) without sophisticated driver monitoring, then the extent of automation is improved, but safety and reliability deteriorate due to potential driver disengagement
Solution Approach 1:
The system continuously monitors driver engagement status through multiple sensors (eye tracking, facial recognition, steering wheel interaction) and provides real-time feedback to the autonomous driving system. When disengagement is detected, the system escalates through multiple alert stages (visual, auditory, haptic) to restore driver awareness, ensuring reliable operation at higher automation levels
Solution Approach 2:
The system performs preliminary monitoring of driver engagement metrics before critical disengagement occurs. By continuously tracking eye position, facial orientation, and steering interactions, the system can initiate preventive escalation sequences before the driver becomes fully disengaged, maintaining safety margins at higher automation levels
2Device complexity
If traditional driver monitoring systems are used without remote device integration, then device complexity is reduced, but measurement precision and driver engagement detection accuracy deteriorate
Solution Approach 1:
The remote device (smartphone/tablet) serves multiple functions: it acts as a secondary display for vehicle information, a communication device, and a driver engagement monitoring sensor. The device's camera, accelerometer, and other sensors are utilized to detect driver status, eliminating the need for dedicated complex monitoring hardware while improving measurement precision through diverse sensor inputs
3Reliability
If driver monitoring and notification systems provide comprehensive real-time monitoring, then driver safety and engagement are improved, but loss of information and notification overload may worsen
Solution Approach 1:
The notification system uses periodic escalation rather than continuous alerts. Monitoring occurs continuously, but notifications are triggered at specific thresholds of disengagement. The system progresses through periodic escalation stages (subtle visual cues, more prominent alerts, auditory warnings) allowing the driver to respond at appropriate intervals without information overload
Solution Approach 2:
The system applies partial monitoring intensity based on driving context and driver state. During normal operation, monitoring is subtle and unobtrusive. When disengagement is detected, the system increases monitoring intensity and notification prominence proportionally, providing just enough information to restore engagement without overwhelming the driver with excessive notifications during all conditions
Data Source
AI summary
A system to enhance performance and usability of a state machine implementation by an electronic control unit within a vehicle having autonomous operating capabilities is provided. The state machine provides an escalation state used to exit from status quo. The vehicle driver has a mobile device within the vehicle. The system includes an enhanced state machine configured to use the mobile device. The mobile device non-intrusively captures multimodal driver engageability data and generates an enhanced engageability score. The enhanced engageability score augmenting a decision by the state machine on whether the escalation stat transition shall occur. The enhanced state machine additionally provides a signal to alert the driver through the mobile device that the escalation state is imminent.