Autonomous Driving HMI Sequencing for Accurate Driver Response

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Autonomous driving systems often overwhelm drivers with consecutive operation instructions, leading to impatience, discomfort, and reduced accuracy due to information and operational processing limitations, which hinders smooth vehicle travel and system reliability.

Innovation Solution

The autonomous driving system prohibits sending the next operation instruction until the previous one is completed or predicted to be completed, reducing the concurrent information and operations for the driver, thereby minimizing impatience and anxiety and ensuring accurate responses.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Extent of automation

If multiple operation instructions are sent consecutively to the driver during autonomous driving, then the system can provide comprehensive guidance and maintain high automation control, but the driver experiences information overload, impatience, and reduced response accuracy

Engineering Contradiction:
Improveautonomous driving controlVSAvoiddriver response accuracy
Core Design Contradiction:
Extent of automationVSEase of operation

Solution Approach 1:

The system implements periodic action by establishing a prohibition period after sending each operation instruction, during which no additional instructions are sent to the driver. This rhythmic control pattern allows the driver sufficient time to process each instruction and respond accurately, preventing information overload while maintaining comprehensive autonomous driving control.

Inventive Principle:
Principle #19Periodic action

2Productivity

If multiple operation instructions are sent consecutively within a short period of time, then the system can address multiple driving situations promptly, but the driver feels impatient and uncomfortable due to limited processing capacity

Engineering Contradiction:
Improveresponse speed to driving situationsVSAvoiddriver impatience and discomfort
Core Design Contradiction:
ProductivityVSObject-affected harmful factors

Solution Approach 1:

The system applies preliminary action by proactively establishing a prohibition period immediately after sending an operation instruction, before the driver completes their response. This preventive measure ensures that subsequent instructions are not sent during the driver's processing time, eliminating impatience and discomfort before they occur while still maintaining prompt responses to driving situations.

Inventive Principle:
Principle #10Preliminary action

3Reliability

If the system waits for complete response before sending next instruction, then driver comfort and accuracy improve, but the time delay between addressing consecutive driving situations increases

Engineering Contradiction:
Improvedriver response accuracyVSAvoidtime delay in addressing situations
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system implements dynamics by making the prohibition period adjustable and adaptive rather than fixed. The prohibition period can be modified based on the complexity of the driving situation, the type of instruction given, and the driver's response characteristics. This dynamic adjustment optimizes both driver response accuracy and the timing of addressing consecutive driving situations.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS11797002B2Autonomous driving system
Publication Date: 2023.10.24 TOYOTA JIDOSHA KK
  • US11797002B2 patent drawing
  • US11797002B2 patent drawing
  • US11797002B2 patent drawing

AI summary

An autonomous driving system includes: a Human Machine Interface; and a control device configured to control autonomous driving of a vehicle, present a first operation instruction to a driver of the vehicle during the autonomous driving, the first operation instruction requesting the driver to perform a first response operation performed in response to a first request or a first proposal by presenting the first request or the first proposal to the driver via the Human Machine Interface, and prohibit presenting a second operation instruction different from the first operation instruction until the first response operation is completed or until a timing at which the first response operation is predicted to be completed, the second operation instruction requesting the driver to perform a second response operation performed in response to a second request or a second proposal by presenting the second request or the second proposal.