Vehicle Gesture and Voice Control Interface

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current vehicle user interfaces face limitations in expandability and usability due to physical buttons, complex touch displays, and the difficulty of learning and utilizing numerous voice commands, which can compromise safe driving.

Innovation Solution

A multi-modal user interface that combines gesture detection using a 3D camera with voice recognition to identify and operate vehicle controls, allowing drivers to designate manipulation targets through gestures and voice commands, ensuring accurate and efficient control.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If physical buttons are used for vehicle controls, then the interface is simple and reliable, but the expandability is limited due to limited space

Engineering Contradiction:
ImproveexpandabilityVSAvoidinterface complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent replaces physical mechanical buttons with a gesture recognition system using a 3D camera. The gesture detector captures hand movements and translates them into control commands, eliminating the need for physical buttons while maintaining simple operation. This substitution enables unlimited expandability since software-based gestures can be programmed for any function without requiring additional physical space in the vehicle.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Adaptability or versatility

If touch displays are used to increase control options, then expandability improves, but the number of screen transitions increases complicating the interface

Engineering Contradiction:
ImproveexpandabilityVSAvoidoperation simplicity
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent substitutes touch display interactions with gesture-based control. Instead of requiring drivers to navigate through multiple screen transitions and menu layers, the system directly maps gestures to control functions. For example, a pointing gesture combined with voice command can directly activate a function without intermediate screen transitions, maintaining simplicity while achieving high expandability.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces voice recognition as an intermediary between the driver's intent and the vehicle's control system. The voice recognizer translates spoken commands into control signals, working in conjunction with gesture detection to eliminate the need for complex screen transitions. This intermediary layer allows direct access to functions while maintaining natural and simple operation.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Adaptability or versatility

If many voice commands are provided for high expandability, then adaptability improves, but the difficulty of learning and utilizing commands increases

Engineering Contradiction:
ImproveexpandabilityVSAvoidlearning difficulty
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent merges gesture recognition with voice command processing into a unified control system. The gesture detector identifies the driver's intended target or function through hand movements, while the voice recognizer processes the verbal command. This combination allows the system to interpret intent more accurately with fewer commands needed, reducing learning difficulty while maintaining high expandability. The gesture component provides contextual information that reduces the need for verbose voice commands.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS11535268B2Vehicle and control method thereof
Publication Date: 2022.12.27 HYUNDAI MOTOR CO LTD
  • US11535268B2 patent drawing
  • US11535268B2 patent drawing
  • US11535268B2 patent drawing

AI summary

A vehicle is provided and includes a gesture detector that detects a gesture of a driver to designate a manipulation target object and a voice recognizer that recognizes a voice command generated by the driver to operate the designated manipulation target object. A controller is configured to transmit a control signal corresponding to the voice command to the manipulation target object, and to operate the manipulation target object to perform an operation corresponding to the voice command.