Driver Cognitive State Detection Using Stimulus-Evoked Ocular Responses

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods fail to effectively assess and predict the cognitive state of drivers, particularly in regards to factors like alcohol or drug consumption, fatigue, and emotional stress, which can impair driving capabilities, often leading to accidents.

Innovation Solution

A system that applies a series of stimuli to drivers while they are operating a vehicle, analyzing ocular responses to determine their cognitive state, using a combination of visual, audible, and haptic stimuli, and employing machine learning techniques to assess ocular features and alert a controller system if the driver's state is not compatible with safe driving.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a series of stimuli is applied to the driver to induce ocular responses for cognitive state detection, then the measurement precision of cognitive state is improved, but the device complexity increases due to multiple stimuli delivery systems and sensors

Engineering Contradiction:
Improvecognitive state detection accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system integrates multiple stimuli delivery mechanisms (visual displays, audible speakers, haptic actuators) and sensor arrays into a unified driver monitoring platform that can deliver different stimulus types and measure various ocular responses (pupil diameter, saccades, fixation duration) through a single integrated system, reducing overall complexity despite the multi-functional capabilities

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent introduces a processing unit that acts as an intermediary between the stimuli delivery system and the sensor array. This intermediary component receives raw sensor data, processes it to extract ocular response features, and correlates them with cognitive states, thereby simplifying the overall system architecture by centralizing the complex processing tasks in a dedicated module

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If multiple types of stimuli (visual, audible, haptic) are used to assess cognitive state, then the reliability of cognitive state assessment is improved, but the ease of operation deteriorates due to multiple input channels requiring calibration

Engineering Contradiction:
Improvecognitive state assessment reliabilityVSAvoidsystem operation simplicity
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The system incorporates automated calibration routines that adjust stimulus parameters and sensor sensitivity based on real-time driver responses. The processing unit automatically adapts the stimuli delivery and measurement parameters to each driver's characteristics, eliminating the need for manual calibration by operators and simplifying system operation while maintaining assessment reliability across different users

Inventive Principle:
Principle #25Self-service

3Productivity

If ocular responses are monitored continuously while driving, then the productivity of safety monitoring is improved, but the object-generated harmful factors increase due to potential driver distraction from stimuli

Engineering Contradiction:
Improvesafety monitoring efficiencyVSAvoiddriver distraction
Core Design Contradiction:
ProductivityVSObject-generated harmful factors

Solution Approach 1:

Instead of continuous stimulus delivery, the system employs periodic stimulus presentation with intervals between stimulus sequences. The processing unit analyzes ocular responses during these periodic measurement cycles and interpolates cognitive state between cycles, maintaining monitoring productivity while reducing the frequency of stimuli that could potentially distract the driver

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The system applies stimuli at selective moments rather than continuously, using partial action where stimulus delivery is concentrated in specific measurement cycles. This approach achieves sufficient cognitive state assessment accuracy through targeted measurements without the cumulative distraction effect of constant stimulus exposure, balancing productivity with driver safety

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS12156735B2Detection of cognitive state of a driver
Publication Date: 2024.12.03 ADAM COGTECH LTD
  • US12156735B2 patent drawing
  • US12156735B2 patent drawing
  • US12156735B2 patent drawing

AI summary

A method, a system, an apparatus and a computer program product, for detecting and monitoring cognitive capabilities pertain to driving. The method comprises applying a series of stimuli on a driver while is driving a vehicle. The series of stimuli comprises a first portion matching a pattern and a second portion deviating from the pattern, and configured to induce an ocular response from eyes of the driver. The method further comprises obtaining a set of images of the eyes of the driver, that are captured during the application of the series of stimuli. The method further comprises analyzing the set of images to determine a set of ocular features corresponding each image; and determining, based thereon, a cognitive state of the driver. Based on the cognitive state of the driver, a determination whether the driver is capable of operating the vehicle safely may be performed.