Vehicle Gesture Control Confidence Feedback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing gesture control systems in vehicles require prior knowledge of recognized gestures and cannot provide reliable and quick feedback for correct gesture execution, especially when the vehicle is in motion, limiting their usability.

Innovation Solution

A method and device that utilize a touch-sensitive display surface and a determination unit to detect gestures, calculate a confidence measure, and provide visual and acoustic feedback to ensure accurate gesture recognition, including a system for dividing the detection space into sectors with optimal and non-optimal areas for gesture detection and recognition.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If gesture control is implemented in vehicles, then the number of control elements can be reduced, but the user requires prior knowledge of gestures which limits ease of operation

Engineering Contradiction:
Improvenumber of control elementsVSAvoidprior knowledge of gestures
Core Design Contradiction:
Device complexityVSEase of operation

Solution Approach 1:

The system provides immediate feedback when a gesture is detected by displaying visual cues (arrows indicating movement direction) and generating acoustic signals. This feedback loop allows users to learn and adjust their gestures in real-time without needing prior knowledge, resolving the contradiction between reducing control elements and maintaining ease of operation

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system automatically adapts to user input by providing contextual guidance through visual and acoustic feedback. Instead of requiring users to learn predetermined gestures, the system serves itself by interpreting raw gestures and providing real-time correction cues, enabling intuitive operation without formal training

Inventive Principle:
Principle #25Self-service

2Ease of operation

If help menu is provided for gesture information, then user can learn gestures, but this is only possible when vehicle is stationary which limits productivity

Engineering Contradiction:
Improveaccess to gesture informationVSAvoidvehicle motion status
Core Design Contradiction:
Ease of operationVSProductivity

Solution Approach 1:

The system transitions from a static help menu (available only when stationary) to a dynamic feedback system that operates continuously during vehicle motion. Visual and acoustic cues are provided in real-time based on detected gestures, allowing users to learn and operate gestures dynamically regardless of vehicle status, thus maintaining productivity while improving ease of operation

Inventive Principle:
Principle #15Dynamics

3Adaptability or versatility

If gesture recognition system is added to vehicle, then control functionality is improved, but system complexity increases

Engineering Contradiction:
Improvecontrol functionalityVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The existing display surface and acoustic output systems are utilized for dual purposes: normal vehicle information display and gesture feedback. By making these existing components multi-functional, the system achieves enhanced control functionality without proportionally increasing system complexity, as the same hardware serves multiple functions

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentEP3056972B1Method for operating a user interface in a vehicle
Publication Date: 2018.08.01 VOLKSWAGEN AG
  • EP3056972B1 patent drawingFigure 1
  • EP3056972B1 patent drawingFigure 2
  • EP3056972B1 patent drawingFigure 3a~3b

AI summary

The invention relates to a method for operating a user interface (2) in a vehicle (9), wherein at least one function can be operated via the user interface (2) by means of an operating gesture. In the method according to the invention, a gesture executed by means of an operating element (12) is detected in a detection area (6, 18) which is assigned to the user interface (2). Furthermore, a confidence measure (Ke) is determined, which indicates the certainty that the gesture corresponds to the operating gesture. If it is determined that the determined confidence measure (Ke) is below a defined confidence value (Ko), the gesture is not recognized as the operating gesture. System feedback is generated, wherein the system feedback includes an indication (11) of a correct execution of the operating gesture. The present invention further relates to a device (1) for operating a user interface (2) in a vehicle (9).