Driver Concentration Analysis via Multi-Modal HMI
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current methods for analyzing driver line of sight (LOS) dispersion during driving, particularly in multi-modal interfaces, are inadequate due to safety concerns and legal regulations, necessitating a system that evaluates usability and user experience without relying on touch-based schemes, especially with the increasing complexity of vehicular infotainment systems.
Innovation Solution
An apparatus and method that analyze the concentration level of a driver by quantifying LOS dispersion and reaction speed using a multi-modal interface, incorporating a LOS dispersion analyzer, reaction speed analyzer, and evaluator, which calculate weighted values, concentration levels, and obstruction frequencies based on device input, voice, and gesture information, linked with a UX platform to assess driver interaction and environmental factors.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a touch-based HMI manipulation scheme is used, then the ease of operation is improved, but the driver safety deteriorates due to LOS dispersion
Solution Approach 1:
The patent replaces the mechanical touch-based interaction system with a voice recognition and gesture recognition system. This substitution eliminates the need for physical contact with the HMI interface, allowing drivers to interact without moving their hands from the steering wheel, thereby maintaining ease of operation while improving safety by reducing LOS dispersion.
Solution Approach 2:
The patent introduces voice commands and gesture recognition as intermediary mechanisms between the driver and the HMI system. These intermediaries enable communication with the vehicle's infotainment system without requiring direct visual contact with the display or physical touching of the screen, thus resolving the contradiction between ease of operation and driver safety.
2Productivity
If the vehicular infotainment system provides more diversified and complex information, then the productivity is improved, but the driver concentration deteriorates due to increased LOS dispersion
Solution Approach 1:
The patent segments the information delivery system into multiple channels: voice commands for control, auditory feedback for information delivery, and minimal visual displays. This segmentation allows the infotainment system to provide diversified and complex information while reducing the need for continuous visual attention, thereby maintaining productivity while preserving driver concentration.
Solution Approach 2:
The patent implements periodic action by providing information through voice commands and auditory feedback at scheduled intervals rather than requiring continuous visual monitoring. This allows drivers to receive necessary information without sustained LOS dispersion, maintaining both information provision capability and driver concentration.
3Object-affected harmful factors
If voice recognition and gesture recognition are implemented, then the driver safety is improved by reducing LOS dispersion, but the device complexity increases
Solution Approach 1:
The patent applies universality by designing a multi-functional system where voice recognition and gesture recognition modules serve multiple purposes: controlling infotainment systems, providing navigation instructions, adjusting climate controls, and monitoring driver state. This multi-functionality reduces the need for separate systems, thereby improving driver safety through reduced LOS dispersion while managing device complexity through integrated design.
4Measurement precision
If the HMI interface requires visual attention for manipulation, then the measurement precision of driver state is improved, but the driver safety deteriorates due to LOS dispersion
Solution Approach 1:
The patent replaces visual-based driver state monitoring with audio-based and sensor-based monitoring systems. By using voice command analysis, gesture recognition patterns, and existing vehicle sensors (such as steering wheel angle, pedal position), the system maintains measurement precision of driver state while eliminating the need for visual attention during manipulation, thereby improving driver safety.
Data Source
AI summary
Provided is an apparatus and method for analyzing a concentration level of a driver, the method including analyzing quantitative data associated with a time at which a line of sight (LOS) of a driver is dispersed and a time at which the LOS of the driver is focused, analyzing a reaction speed of a human machine interface (HMI) when a command based on device input information, voice information, and gesture information is input, and evaluating a degree of LOS dispersion of the driver based on the quantitative data of the driver and the reaction speed of a user interface (UI) of the HMI.