In-Vehicle Speech Dialogue Control for Driver Emotion and Warning Status
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing vehicle systems with small screens and buttons pose a safety risk by diverting driver attention and requiring manual input, which can compromise safe driving.
Innovation Solution
A vehicle system that processes a driver's speech, determining dialogue scenarios based on emotions and vehicle status to provide optimal notifications, including voice messages, vehicle inspections, and emergency calls, adjusting notification modes and frequencies according to driver excitement, warning light status, and driving risk.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a dialogue system is applied to process driver speech, then driver convenience and safety are improved, but system complexity increases
Solution Approach 1:
The dialogue processing system is divided into multiple independent modules: speech recognition module, emotion recognition module, speech-to-text conversion module, and dialogue management module. Each module handles a specific aspect of speech processing, allowing the system to maintain high functionality while reducing overall complexity through modular design.
Solution Approach 2:
The user interface is designed to handle multiple functions through a unified speech-based interaction system. The same interface processes both speech recognition and emotion recognition, and can trigger various vehicle functions (navigation, climate control, entertainment) through natural language commands, reducing the need for separate control mechanisms for each function.
2Measurement precision
If speech processing with emotion and status recognition is implemented, then dialogue accuracy is improved, but processing time increases
Solution Approach 1:
The system performs preliminary speech-to-text conversion and emotion recognition in parallel during the speech input phase. By preparing processed data structures and pre-loading relevant dialogue scenarios before the actual dialogue occurs, the system reduces the time required for final dialogue processing while maintaining high accuracy through comprehensive analysis.
Solution Approach 2:
The speech recognition and emotion recognition processes operate continuously and concurrently rather than sequentially. The system maintains continuous monitoring of speech input and emotional state, allowing it to process multiple aspects of the driver's input simultaneously, thereby reducing total processing time while improving dialogue accuracy through integrated analysis.
Data Source
AI summary
A vehicle includes a user interface; and at least one processor configured to control the user interface, wherein the at least one processor is configured to: determine an intention of a speech of a driver and an emotion of the driver based on the driver's speech input through the user interface; determine vehicle status information based on a driving status and a warning light status; determine a dialogue processing scenario based on the intention of the driver's speech, the driver's emotion and the vehicle status information; and control to perform the dialogue processing scenario.