Driver Attentiveness Control for In-Vehicle Extended Reality Displays
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In vehicular environments, extended reality content presented to drivers through head-mounted displays or in-vehicle displays can distract drivers if they are not attentive, potentially leading to disengagement from the real-world driving environment, especially in situations requiring attention or manual control.
Innovation Solution
A system that determines a driver's level of attentiveness using sensors and adjusts the amount of extended reality content in the video feed accordingly, reducing or removing augmented elements when the driver is not attentive to focus their attention on the driving environment.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If extended reality content is presented to the driver through head-mounted displays or in-vehicle displays, then driver entertainment and engagement are improved, but driver distraction and disengagement from the real-world driving environment worsen
Solution Approach 1:
The system dynamically adjusts the amount of extended reality content presented to the driver based on real-time detection of attentiveness levels. When attentiveness drops below a threshold, the system reduces or removes augmented elements from the video feed, creating a dynamic adaptation between entertainment provision and safety maintenance
Solution Approach 2:
The system implements a feedback loop where driver attentiveness is continuously monitored through sensor data (camera, microphone, inertial measurement unit), and this feedback is used to control the presentation of extended reality content. The closed-loop control ensures that entertainment delivery is automatically adjusted based on the driver's actual state
2Reliability
If extended reality content is reduced when driver attentiveness is low, then driver safety is improved, but driver entertainment and engagement worsen
Solution Approach 1:
The system creates a dynamic balance between safety and entertainment by continuously adjusting extended reality content delivery based on real-time attentiveness monitoring. When attentiveness is high, full entertainment content is provided; when attentiveness drops, safety takes precedence and content is reduced, creating a dynamic prioritization system
3Reliability
If sensors and processing systems are added to monitor driver attentiveness, then driver safety is improved, but device complexity worsens
Solution Approach 1:
The system uses a multi-functional sensor suite where cameras, microphones, and inertial measurement units serve multiple purposes: they monitor driver attentiveness for safety, track head and eye movements for content delivery optimization, and detect environmental conditions. This multi-functionality reduces the need for separate dedicated sensors for each function
Solution Approach 2:
The system combines multiple sensing modalities (visual, auditory, inertial) into a unified attentiveness assessment framework. By merging data from camera, microphone, and IMU into a single attentiveness determination, the system achieves comprehensive safety monitoring without requiring entirely separate processing systems for each sensor type
Data Source
AI summary
Extended reality content in a video can be varied based on driver attentiveness. The video can be of an external environment of a vehicle and can be presented in real-time on a display located within the vehicle. The display can be a video pass through display. The display can be an in-vehicle display, or it can be a part of a video pass-through extended reality headset. The video can present a view of an external environment of the vehicle as well as extended reality content. A level of attentiveness of a driver of the vehicle can be determined. An amount of the extended reality content presented in the video can be varied based on the level of attentiveness.