Driver Comprehension Monitoring for Semi-Autonomous Hazard Handover

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional semi-autonomous driving systems face challenges in recognizing hazards and avoiding them effectively when the driver is also attempting to control steering and braking, leading to control conflicts that may result in neither the driver nor the system successfully avoiding the hazard.

Innovation Solution

A vehicle control system that integrates hazard detection, eye-tracking, and brain-function monitoring to determine if the driver comprehends a hazard, allowing the system to autonomously control steering and braking only when the driver is not responding appropriately, using a combination of sensors and EEG analysis to assess driver attention and reaction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the semi-autonomous driving system autonomously controls steering and braking to avoid hazards, then hazard avoidance capability is improved, but control conflicts arise when the driver also tries to control steering and braking

Engineering Contradiction:
Improvehazard avoidance capabilityVSAvoiddriver control authority
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The system dynamically adjusts the level of autonomous control based on real-time assessment of driver comprehension and response. When the driver is assessed as comprehending the hazard and responding appropriately, the system maintains driver control. When the driver is assessed as not comprehending or not responding appropriately, the system transitions to autonomous control, thus dynamically resolving the control conflict between driver and system.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system implements a feedback mechanism using eye-tracking and brain-function monitoring to continuously assess driver comprehension and response to hazards. This feedback loop allows the system to determine when to transfer control authority between the driver and the autonomous system, ensuring that autonomous control is activated only when the driver is not adequately responding to the hazard.

Inventive Principle:
Principle #23Feedback

2Measurement precision

If the system monitors driver comprehension using eye-tracking and brain-function analysis, then control transfer accuracy is improved, but device complexity increases

Engineering Contradiction:
Improvedriver comprehension detection accuracyVSAvoidmonitoring system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system integrates multiple monitoring functions (eye-tracking, brain-function analysis, hazard detection) into a unified control framework. The hazard-detection system, eye-tracking system, and brain-function system work together to assess driver comprehension and trigger appropriate control responses, making the complex system serve multiple functions simultaneously and justifying the added complexity through enhanced hazard avoidance capability.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS20240400114A1Brainwave analysis for transfer of control in semi-autonomous vehicles
Publication Date: 2024.12.05 TOYOTA MOTOR ENG & MFG NORTH AMERICA INC
  • US20240400114A1 patent drawing
  • US20240400114A1 patent drawing
  • US20240400114A1 patent drawing

AI summary

A vehicle control system is provided for use with a semi-autonomous vehicle. The vehicle control system includes: a hazard-detection system configured to output a hazard-detection signal based on a detected hazard; an eye-tracking system configured to output an eye-tracking signal based on where the driver is looking; a brain-function system configured to output a brain-function signal based on a detected parameter; and a driving-control system configured to determine whether the driver comprehends the hazard based on the hazard-detection signal, the eye-tracking signal and the brain-function signal, and operate in a driver-controlled state so as to enable the driver to control at least one of steering of the semi-autonomous vehicle, breaking of the semi-autonomous vehicle, and a combination thereof, and a driving-control-system-controlled state so as to enable the driving-control system to control the at least one of steering of the semi-autonomous vehicle, breaking of the semi-autonomous vehicle, and a combination thereof.