Driver Alertness Monitoring for Manual Driving Return Timing

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing technologies do not provide an effective method for safely switching from automatic driving to manual driving, as they fail to accurately assess the driver's level of alertness and timing for notification.

Innovation Solution

An information processing device and moving apparatus that determine the driver's alertness level by acquiring observation information and controlling the timing of a manual driving return request notification based on that alertness level.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If the driver is allowed to perform secondary tasks during automatic driving, then productivity and ease of operation are improved, but the driver's level of alertness deteriorates

Engineering Contradiction:

Improvedriver's ability to perform secondary tasksVSAvoiddriver's level of alertness

Core Design Contradiction:

ProductivityVSReliability

Solution Approach 1:

The system continuously monitors the driver's alertness level through observation information (eye movement, head position, etc.) and uses this feedback to dynamically adjust the notification timing for mode switching. This closed-loop feedback mechanism ensures that the driver is notified at the appropriate time based on their actual alertness state, resolving the contradiction between allowing secondary tasks and maintaining safety

Inventive Principle:

Principle #23Feedback

Solution Approach 2:

The system performs preliminary assessment of the driver's alertness level before initiating the mode switching notification process. By evaluating observation information in advance and determining the appropriate notification timing beforehand, the system ensures that the driver will be alert enough when the notification is issued, even while performing secondary tasks during automatic driving

Inventive Principle:

Principle #10Preliminary action

2Loss of time

If the notification timing for mode switching is delayed, then the driver has more time to complete secondary tasks, but the driver's level of alertness drops below safe thresholds

Engineering Contradiction:

Improvetime for driver to complete secondary tasksVSAvoiddriver's level of alertness

Core Design Contradiction:

Loss of timeVSReliability

Solution Approach 1:

The notification timing is made dynamic rather than fixed. The system continuously adjusts the notification timing based on the driver's real-time alertness level, allowing the notification to be issued earlier or later as needed. This dynamic adjustment resolves the contradiction by adapting the timing to the driver's actual state rather than using a predetermined schedule

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The system changes the timing parameter of the notification based on the driver's alertness level. By monitoring observation information and adjusting the notification timing parameter dynamically, the system optimizes the balance between allowing sufficient time for secondary tasks and ensuring the driver remains alert enough for safe manual driving transition

Inventive Principle:

Principle #35Parameter changes

3Reliability

If the notification timing is advanced, then the driver's alertness level is maintained, but the driver loses time to complete secondary tasks

Engineering Contradiction:

Improvedriver's level of alertnessVSAvoiddriver's ability to complete secondary tasks

Core Design Contradiction:

ReliabilityVSProductivity

Solution Approach 1:

The system uses real-time feedback from observation information to determine the optimal notification timing. By continuously monitoring the driver's alertness level and adjusting the notification timing accordingly, the system maximizes the time available for secondary tasks while ensuring the driver remains alert enough when the notification is issued

Inventive Principle:

Principle #23Feedback

Solution Approach 2:

The system performs preliminary assessment of the driver's alertness and secondary task status before issuing the notification. This preliminary action allows the system to advance or delay the notification timing appropriately, ensuring both driver alertness and sufficient time for completing secondary tasks

Inventive Principle:

Principle #10Preliminary action

Data Source

PatentUS12202489B2Information processing device, moving apparatus, method, and program

Publication Date: 2025.01.21 SONY SEMICON SOLUTIONS CORP

AI summary

An alertness level that is the consciousness level of the driver of a vehicle is determined, and the timing of a manual driving return request notification is controlled in accordance with the alertness level. A data processing unit determines the alertness level of the driver of the vehicle, and records evaluation data. The data processing unit acquires observation information about the driver, determines the alertness level of the driver, and evaluates and records the return rate at each time. The vehicle is a vehicle capable of switching between automatic driving and manual driving, and the data processing unit controls the timing of a manual driving return request notification for the driver's return from automatic driving to manual driving, in accordance with the alertness level of the driver. The observation information to be acquired by the data processing unit includes observation information about the driver both before and after the driver gets in the vehicle. For example, passive monitoring, information about the driver's response to a notification, and the like are observed.