Vehicle HMI Gesture Navigation Across Hierarchical Menu Levels

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing vehicle operating systems are limited by their design for specific operating modalities, making it difficult for users to easily access and utilize various operating options, especially when transitioning between different modes of operation.

Innovation Solution

A method that generates an output with a first operating object in an output area, where an operating gesture with a direction perpendicular to the output area changes the object to a second object at a different hierarchy level, allowing for intuitive and quick navigation through hierarchical levels using gestures, and adapts to different operating modes based on user context and vehicle conditions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If the operating system is designed for specific operating modalities, then the system structure remains simple and manageable, but the ease of operation deteriorates because users cannot easily access different operating options

Engineering Contradiction:
Improveease of accessing operating optionsVSAvoidsystem structure complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The operating system is designed to support multiple operating modalities (voice commands, gestures, touchscreen, physical buttons) within a single unified system. The system can adaptively switch between different modalities based on the current context, such as preferring voice commands when the vehicle is moving to reduce distraction, while maintaining the ability to use other modalities when appropriate. This multi-functionality approach allows users to easily access different operating options without requiring separate specialized systems for each modality.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Adaptability or versatility

If multiple operating modalities are supported, then the versatility of the system improves, but the device complexity increases making it harder to manage and operate

Engineering Contradiction:
Improveoperating modality versatilityVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The operating system dynamically adapts its behavior and preferred operating modality based on the current vehicle context and user needs. For example, when the vehicle is in motion, the system may prefer voice commands or gestures that don't require visual attention, while when parked, it may allow more complex touchscreen interactions. The system continuously monitors contextual parameters (vehicle state, user behavior patterns, environmental conditions) and adjusts its modality preferences accordingly, making the complexity management adaptive rather than static.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent replaces traditional mechanical control systems with sensor-based detection systems. Instead of relying on physical switches and buttons that require direct contact, the system uses cameras, microphones, and other sensors to detect gestures, voice commands, and other non-contact inputs. This substitution reduces mechanical complexity while enabling more versatile operating modalities, as sensor-based systems can detect a wider range of input types without requiring additional physical components.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Adaptability or versatility

If the system requires users to be familiar with multiple operating modalities, then the adaptability improves, but the ease of operation deteriorates due to the learning burden

Engineering Contradiction:
Improveoperating option availabilityVSAvoiduser operation simplicity
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The operating system automatically detects and adapts to the user's preferred operating modality without requiring explicit configuration or learning. The system monitors user behavior patterns, such as which modalities the user frequently employs or which gestures are most successful, and automatically adjusts its behavior to prioritize those modalities. The system also provides contextual hints and suggestions to guide users toward more effective operating methods based on the current situation, reducing the learning burden while maintaining adaptability.

Inventive Principle:
Principle #25Self-service

Data Source

PatentEP3966064B1Method for operating an operating system in a vehicle and operating system in a vehicle
Publication Date: 2024.11.20 VOLKSWAGEN AG
  • EP3966064B1 patent drawingFigure 1
  • EP3966064B1 patent drawingFigure 2
  • EP3966064B1 patent drawingFigure 3

AI summary

The invention relates to a method for operating an operating system in a vehicle, wherein an output having at least one first operating object is generated and output in an output region. The first operating object is associated with a first element of a first hierarchy level of a hierarchically organized database. An operating gesture is detected, wherein the detected operating gesture comprises a movement direction of an actuation object perpendicular to the output region, and the output is changed according to the movement direction of the operating gesture such that the first operating object is replaced by a second operating object. A movement of the first operating object in the movement direction of the operating gesture is perspectively output when the output is changed, and the second operating object is associated with a second hierarchical level of the hierarchically organized database. The operating system comprises a control unit (8), a detection unit (4, 5) and an output unit (3) which is coupled to the control unit (8) and has an output region.