In-Cabin Gesture and Voice Control for Faster Vehicle Menu Selection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing vehicle control interfaces, such as touch, speech recognition, and motion recognition, suffer from limitations like distracted driving, noise interference, and time delays, making them less effective for accurate and immediate responses.
Innovation Solution
A hybrid interface method combining hand motion recognition and voice recognition, using a camera to detect hand gestures and a microphone to enhance accuracy and speed, allowing for quick and precise vehicle function control.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If speech recognition is used to control vehicle functions, then the ease of operation is improved, but noise inside and outside the vehicle hinders accurate recognition, worsening the reliability
Solution Approach 1:
The patent combines speech recognition with hand gesture recognition to form a hybrid interface system. The speech recognition handles command interpretation while hand gestures provide precise selection and confirmation, allowing the system to overcome noise interference by using visual gesture input to complement audio input in noisy vehicle environments.
2Ease of operation
If motion recognition is used to control vehicle functions, then the ease of operation is improved, but time delay occurs during operation, worsening the productivity
Solution Approach 1:
The patent segments the control process into distinct phases: hand gestures are used for quick menu selection and pointing (immediate visual feedback), while speech recognition handles the actual command execution. This segmentation allows the system to leverage the speed of gesture recognition for selection while using speech for confirmed command input, reducing overall response time.
3Measurement precision
If touch input is used to control vehicle functions, then the precision of selection is improved, but distracted driving increases, worsening the safety
Solution Approach 1:
The patent replaces the mechanical touch-based interface with a non-contact hybrid interface combining hand gesture recognition and speech recognition. Users can point at menu items with their hands (without touching the screen) and confirm selections through voice commands, maintaining precise selection capability while eliminating the need for visual attention to the touchscreen, thereby reducing distracted driving.
Data Source
AI summary
A vehicle may include: a microphone provided inside the vehicle and configured to receive a voice uttered by an occupant of the vehicle; a camera configured to obtain an image inside the vehicle; a display device configured to display a menu screen comprising a plurality of menu items; and a controller configured to control the display device. The controller may be configured to recognize, based on the image obtained via the camera, a hand gesture of the occupant, determine, based on the hand gesture, a menu item, of the plurality of menu items on the menu screen, pointed to by the occupant, and execute, based on the voice uttered by the occupant, a command corresponding to the pointed menu item.