Multi-modal Vehicle Input Channel Switching

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing speech dialogue systems in vehicles face challenges in usability due to high noise levels, as they often require a single input method and may lose previously submitted instructions when noise interference exceeds a threshold, making it difficult for users to control electronic devices effectively.

Innovation Solution

A control system that integrates both audio and haptic input channels, allowing users to switch between them automatically or manually, combining inputs to form control commands and maintaining ongoing data processing without restarting the dialogue, even in high noise conditions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If a single audio input channel is used for speech commands, then the system structure is simple, but the system becomes unusable when noise levels exceed a threshold

Engineering Contradiction:
Improvesystem structureVSAvoidusability under noise
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The control system incorporates multiple input channels (audio and haptic) that can function independently or together. The system can switch between audio-only mode, haptic-only mode, and combined mode, making it universally adaptable to different noise environments and user preferences, thereby resolving the contradiction between simple structure and reliability under noise.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system dynamically adjusts its input channel configuration based on detected noise levels. When noise exceeds a threshold, the system automatically transitions from audio-only to haptic-assisted or haptic-only mode, providing dynamic adaptability that maintains reliability while managing complexity through intelligent control.

Inventive Principle:
Principle #15Dynamics

2Reliability

If the system switches to haptic input when audio is unintelligible, then reliability under noise improves, but device complexity increases

Engineering Contradiction:
Improvecontrol functionality under noiseVSAvoidmulti-channel input system
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The input system is segmented into distinct audio and haptic channels, each handling specific types of input. This segmentation allows the system to activate only the necessary channel based on noise conditions, reducing the effective complexity at any given time while maintaining the capability for reliable operation under various noise levels.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

A noise detection intermediary monitors audio quality and triggers automatic switching between input channels. This intermediary component manages the complexity by providing a simple decision-making layer that determines when to switch from audio to haptic input, thereby improving reliability without requiring complex user intervention.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Device complexity

If the system requires manual switching between input channels, then device complexity is reduced, but ease of operation deteriorates

Engineering Contradiction:
Improvechannel switching mechanismVSAvoiduser interaction convenience
Core Design Contradiction:
Device complexityVSEase of operation

Solution Approach 1:

The system performs self-service by automatically detecting noise levels and switching input channels without user intervention. The noise detection mechanism and automatic switching algorithm enable the system to adapt to changing conditions independently, greatly improving ease of operation while maintaining manageable complexity through automated decision-making.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system uses feedback from noise level detection to automatically adjust its input channel configuration. This closed-loop feedback mechanism allows the system to respond dynamically to environmental conditions, providing ease of operation through automatic adaptation while keeping the switching logic simple and rule-based.

Inventive Principle:
Principle #23Feedback

4Device complexity

If the system loses previously submitted instructions when noise exceeds threshold, then device complexity is reduced, but loss of information increases

Engineering Contradiction:
Improvedata retention mechanismVSAvoidsubmitted commands
Core Design Contradiction:
Device complexityVSLoss of information

Solution Approach 1:

The system performs preliminary actions by buffering and retaining previously submitted instructions before noise levels become critical. This preliminary data retention ensures that when the system switches to haptic input due to noise, it can resume processing from where it left off rather than losing accumulated commands, thereby reducing information loss while maintaining simple data storage mechanisms.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system provides beforehand cushioning by maintaining a buffer of previously processed but not yet executed commands. This cushioning mechanism protects against information loss during channel transitions caused by noise, allowing the system to recover and continue processing without restarting the dialogue, thus reducing information loss with minimal additional complexity.

Inventive Principle:
Principle #11Beforehand cushioning (Prior cushioning)

Data Source

PatentUS7761204B2Multi-modal data input
Publication Date: 2010.07.20 HARMAN BECKER AUTOMOTIVE SYST GMBH
  • US7761204B2 patent drawing
  • US7761204B2 patent drawing
  • US7761204B2 patent drawing

AI summary

A control system processes commands received from a user. The control system may control one or more devices within a vehicle. A switch allows the control system to choose one of multiple input channels. The method that receives the data selects a channel through a process that minimizes data losses. The switching occurs upon a user request, when the control system does not recognize an input, or when an interference masks a user request.