3D Gesture Control for Vehicle Infotainment
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing user interface systems for transportation, such as motor vehicles and airplanes, do not fully exploit the potential for intuitive and efficient operation using contactless gestures, leading to incomplete utilization of their intuitive operation capabilities.
Innovation Solution
A method and device that recognize and respond to three-dimensional pointing gestures in space, allowing users to control functions of application systems like audio and entertainment systems without physical contact, using sensors and evaluation units to automatically assign spatial positions and activate corresponding functions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If conventional haptic control elements (switches, buttons) are used, then device complexity is reduced and ease of manufacture is improved, but ease of operation becomes more cumbersome and requires more driver attention
Solution Approach 1:
The patent replaces mechanical control elements (switches, buttons) with a contactless gesture recognition system using sensors and cameras to detect hand movements and gestures in three-dimensional space, eliminating the need for physical contact with control elements
Solution Approach 2:
The patent introduces an intermediary evaluation unit that processes sensor data and translates gestures into control commands, serving as a mediator between the driver's natural gestures and the vehicle's control systems
2Ease of operation
If gesture recognition-based controls are implemented, then ease of operation is improved and driver distraction is reduced, but device complexity increases and measurement precision requirements increase
Solution Approach 1:
The patent extends gesture recognition from two-dimensional touch screens to three-dimensional space, enabling detection of hand positions, movements, and gestures in volumetric space using multiple sensors and cameras positioned throughout the vehicle interior
Solution Approach 2:
The patent divides the vehicle interior into multiple detection zones and segments gesture recognition into distinct phases (activation gesture, target selection gesture, confirmation gesture), allowing systematic processing of complex interaction sequences
3Measurement precision
If multiple operating steps are required for gesture-based control, then measurement precision and control accuracy are improved, but productivity decreases and time consumption increases
Solution Approach 1:
The patent combines multiple operating steps into a continuous gesture sequence where the activation gesture simultaneously initiates control mode and selects the first target, and subsequent gestures build upon previous selections without requiring separate confirmation steps for each action
Solution Approach 2:
The system performs preliminary recognition and validation of gestures in real-time, pre-processing sensor data to identify intent before full execution, allowing rapid response to gesture sequences without requiring post-processing verification steps
Data Source
Figure 1
Figure 2~3
Figure 4
AI summary
The invention relates to a device and to a method for controlling a function of an application system (A1, A2, A3) of a means of transportation (10), in particular a motor vehicle. The method comprises the following steps: sensing (400) a pointing gesture (4), which is performed three-dimensionally in space by a user (1) and is sensed by means of a sensor (401); automatically assigning (500) a spatial position (5) on and/or within the means of transportation (10) that is addressed by the pointing gesture (4); and, in response thereto: controlling (600) the function in accordance with the addressed spatial position (5).