Adaptive Vehicle Display System Gaze Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current vehicle display systems require excessive driver attention due to multiple displays with limited viewable areas, especially in critical driving situations, as they are not automatically adaptable to the driver's gaze direction.
Innovation Solution
An adaptive display system that uses gaze-tracking technology to determine which display is closest to the driver's line of sight and automatically alters its functionality, such as simplifying content or dimming, unless the driver maintains focus for a predefined time or a warning signal is issued, thereby optimizing the viewable area without manual manipulation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If multiple displays are provided in the vehicle, then the driver can access various vehicle information (navigation, speed, fuel level, entertainment), but the driver's attention is excessively diverted due to the limited viewable area of each display and the distances between displays
Solution Approach 1:
The display system dynamically adjusts its behavior based on real-time gaze detection. When the driver looks at a display, the system detects this through eye-tracking cameras and automatically modifies the display state (e.g., showing only critical information, dimming other displays, or providing audio feedback) to minimize distraction while ensuring necessary information is conveyed.
Solution Approach 2:
The system implements a feedback loop where the driver's gaze direction is continuously monitored and this information is fed back to control the display behavior. The eye-tracking system provides real-time feedback about whether the driver is looking at the road or at a display, allowing the system to adaptively adjust display visibility and content to reduce distraction while maintaining information access.
2Ease of operation
If the display functionality is automatically altered based on gaze direction, then the viewable area is optimized without manual manipulation, but the system may incorrectly alter displays when the driver is not actually paying attention to them
Solution Approach 1:
The system performs preliminary calibration of the eye-tracking system during vehicle setup or initialization. This calibration process establishes the relationship between the camera position, driver eye position, and gaze direction, creating a baseline model that improves the accuracy of subsequent gaze detections and reduces false positives.
Solution Approach 2:
The system uses the driver's own physiological responses (eye movements, pupil dilation, blink patterns) as additional signals to verify genuine gaze direction. By analyzing multiple eye-tracking parameters simultaneously, the system can distinguish between intentional gaze (when the driver is actually looking at a display) and incidental eye movements, improving detection reliability.
3Adaptability or versatility
If the gaze monitoring system continuously monitors the driver's eye position, then the system can respond to critical driving situations, but the system complexity and processing requirements increase
Solution Approach 1:
The gaze monitoring system is divided into multiple independent components: eye position detection (cameras), feature extraction (pupil center, iris boundaries), gaze direction calculation, and display control logic. Each component processes specific aspects of gaze information independently, allowing parallel processing and reducing the computational burden on any single processing unit.
Solution Approach 2:
The system processes only the most critical gaze parameters (horizontal and vertical gaze angle, fixation duration) with high precision, while other eye movement parameters are processed with lower precision or ignored. This selective processing approach provides sufficient information for safety-critical responses without the computational overhead of analyzing all eye movement characteristics in detail.
Data Source
Figure 1~4
Figure 5~7
Figure 8
AI summary
A method and system for controlling a human machine interface disposed in a vehicle and having at least two displays, includes monitoring a gaze direction of a vehicle driver. Based on the monitoring, it is determined which of the at least two displays is closest to the gaze direction of the vehicle driver, and in response to the determining, a functionality of the closest of the at least two displays is automatically altered.