Vehicle HMI Input Switching Under Low-Confidence Driver Commands

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Human machine interfaces (HMIs) in vehicles face challenges in accurately interpreting driver inputs due to environmental factors like road noise, vibrations, and distracting events, leading to increased driver distraction and safety concerns.

Innovation Solution

An apparatus with processing circuitry that receives initial driver inputs, compares confidence levels, requests subsequent inputs via alternative modalities, and delays actions until adverse conditions subside, using external and internal sensors to detect emergency vehicles and distracting events within the vehicle environment.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If the HMI interprets driver inputs using voice recognition methods, then the driver can interact with the HMI without shifting focus from the road, but road noise and engine noise reduce the accuracy of identifying spoken inputs

Engineering Contradiction:
Improvedriver interaction convenienceVSAvoidinput recognition accuracy
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The HMI system incorporates multiple input modalities (voice recognition, gesture recognition, touch interface) within a single system. When voice recognition accuracy deteriorates due to noise, the system switches to alternative modalities such as gesture recognition or touch interface, ensuring continuous operational effectiveness without requiring driver distraction

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system dynamically adjusts the primary input modality based on real-time environmental conditions. The controller monitors noise levels and automatically switches between voice recognition, gesture recognition, and touch interface modalities, allowing the system to adapt its operation to maintain both ease of use and recognition accuracy under varying driving conditions

Inventive Principle:
Principle #15Dynamics

2Measurement precision

If the HMI requests multiple alternative inputs when confidence level is low, then input recognition accuracy improves, but driver distraction increases

Engineering Contradiction:
Improveinput recognition accuracyVSAvoiddriver interaction burden
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The system performs preliminary assessment of input confidence levels before executing the primary action. When confidence is insufficient, the system proactively requests alternative inputs in advance, allowing the driver to provide additional information without interrupting the main task flow. This preliminary verification approach maintains accuracy while minimizing distraction by preparing alternative verification methods before critical decisions

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system implements a feedback mechanism where the controller evaluates confidence levels of received inputs and communicates this status to the driver. When confidence is low, the system requests alternative inputs and provides feedback on recognition status, allowing the driver to understand when additional input is needed and reducing unnecessary interactions when confidence is high

Inventive Principle:
Principle #23Feedback

3Reliability

If the HMI delays actions when adverse conditions are present, then driver safety improves by maintaining focus on the road, but response time to driver inputs increases

Engineering Contradiction:
Improvedriver safetyVSAvoidaction response time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system performs preliminary detection of adverse conditions (emergency vehicles, distracting events) before executing driver requests. When adverse conditions are detected, the system proactively delays non-critical actions until conditions improve, while still processing and queueing the driver's input. This preliminary safety check ensures critical safety matters are addressed first, reducing overall response time for time-sensitive operations

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system maintains continuous processing of driver inputs by queueing requests during adverse conditions rather than completely halting operation. Non-critical actions are delayed and executed when safe, while critical safety-related functions continue to operate. This continuous processing approach minimizes perceived response time while maintaining safety priorities

Inventive Principle:
Principle #20Continuity of useful action

Data Source

PatentUS12077160B2Apparatus and method for performing an action associated with a driver input indicated via an input modality of a human machine interface of a vehicle
Publication Date: 2024.09.03 TOYOTA JIDOSHA KK
  • US12077160B2 patent drawing
  • US12077160B2 patent drawing
  • US12077160B2 patent drawing

AI summary

The present disclosure relates to driver interaction with a user interface of a vehicle. In particular, the present disclosure relates to an apparatus for performing an action associated with a driver input indicated via an input modality of an HMI of a vehicle, the apparatus comprising processing circuitry configured to receive initial data corresponding to an initial driver input via a first input modality of the HMI of the vehicle, compare a confidence level of the initial data to a confidence level threshold associated with the first input modality of the HMI of the vehicle, request, based on the comparison, a subsequent driver input via a second input modality of the HMI of the vehicle, determine a presence of an adverse condition within a vehicle environment, and perform an action associated with the subsequent driver input based on the presence of the adverse condition within the vehicle environment.