Driver Gaze Prediction for Vehicle Alertness Assessment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing vehicle systems are inadequate in assessing driver alertness, as they fail to provide an optimal evaluation of a driver's attention to the external environment, leading to potential safety issues.

Innovation Solution

A system comprising onboard sensors and a processor that determine a predicted gaze angle of the driver based on external environment data and compare it with the measured gaze angle, enabling control of vehicle actions such as automatic braking and steering when the alertness threshold is exceeded.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If existing vehicle systems monitor driver behavior using basic sensors, then the system complexity is reduced, but the driver alertness assessment precision deteriorates

Engineering Contradiction:
Improvedriver alertness assessment precisionVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system segments driver alertness assessment into multiple independent measurement components: gaze angle measurement, head position measurement, and environmental context analysis. Each component is measured separately by dedicated sensors (eye-tracking camera, head-position sensor, exterior cameras) and then integrated by the processor to form a comprehensive alertness assessment, thereby improving measurement precision without overwhelming system complexity

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The processor performs multiple functions using the same sensor data: it determines gaze angles, assesses alertness levels, identifies environmental objects, and controls vehicle actions. This multi-functionality allows the system to achieve high assessment precision while avoiding the need for separate dedicated systems for each function, thus managing complexity

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Measurement precision

If the system uses multiple sensors to obtain external environment data and driver eye data, then the driver alertness assessment precision is improved, but the device complexity increases

Engineering Contradiction:
Improvegaze angle measurement precisionVSAvoidsensor system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system merges exterior cameras and interior cameras into a unified monitoring system controlled by a single processor. The exterior cameras capture environmental context while interior cameras capture driver eye position, and the processor integrates both data streams to determine predicted versus measured gaze angles. This merging approach improves measurement precision through multi-source data fusion while managing complexity through centralized processing

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The processor acts as an intermediary that receives raw data from multiple sensors, processes and correlates the information, and produces meaningful alertness assessments. It mediates between the complex sensor inputs and the simple output of driver alertness status, thereby improving measurement precision while shielding the user from sensor system complexity

Inventive Principle:
Principle #24Intermediary (Mediator)

3Reliability

If the system compares predicted gaze angle with measured gaze angle to assess driver alertness, then the reliability of driver monitoring is improved, but the loss of time for data processing increases

Engineering Contradiction:
Improvedriver monitoring reliabilityVSAvoiddata processing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system pre-calculates predicted gaze angles based on environmental data from exterior cameras before comparing them with actual measured gaze angles from interior cameras. By preparing the predicted values in advance and continuously updating them as new environmental data arrives, the system minimizes real-time processing delays while maintaining high reliability through accurate comparison

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system performs continuous gaze angle comparison without interruption, constantly updating predicted gaze angles based on new environmental data and immediately comparing them with current measured gaze angles. This continuous operation ensures reliable real-time monitoring while optimizing processing time by maintaining persistent data streams rather than periodic batch processing

Inventive Principle:
Principle #20Continuity of useful action

4Reliability

If the system provides notifications and automatic vehicle control when alertness threshold is exceeded, then the safety is improved, but the device complexity increases

Engineering Contradiction:
Improvevehicle safetyVSAvoidcontrol system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system provides self-service through automatic vehicle control actions when driver alertness falls below thresholds. The processor directly controls vehicle functions (such as activating warnings or adjusting driving parameters) without requiring separate control systems or manual intervention, thereby improving safety while managing complexity through integrated control

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system implements feedback loops where driver alertness assessment results immediately trigger appropriate vehicle responses. When the processor determines that alertness thresholds are exceeded, it automatically provides notifications or controls vehicle actions, creating a closed-loop system that improves safety through real-time response while managing complexity through direct processor control rather than separate control hardware

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11760318B2Predictive driver alertness assessment
Publication Date: 2023.09.19 GM GLOBAL TECHNOLOGY OPERATIONS LLC
  • US11760318B2 patent drawing
  • US11760318B2 patent drawing
  • US11760318B2 patent drawing

AI summary

In an exemplary embodiment, a system is provided that includes one or more first sensors, one or more second sensors, and a processor disposed onboard a vehicle. The first sensors are configured to at least facilitate obtaining first sensor data with regard to an external environment outside the vehicle. The second sensors are configured to at least facilitate obtaining second sensor data with regard to one or more eyes of a driver of the vehicle. The processor is configured to at least facilitate: determining a predicted gaze angle of the one or more eyes of the driver based on the external environment outside the vehicle, using the first sensor data; determining a measured gaze angle of the one or more eyes of the driver, using the second sensor data, and controlling one or more vehicle actions based on a comparison of the predicted and measured gaze angles.