Driver Attention Warning Logic for Autonomous Lane Changes

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing driving assistance systems face challenges in determining whether a warning is necessary, often issuing unnecessary warnings by detecting visual observation using vehicle exterior and in-vehicle cameras, which can be inaccurate when relying solely on driver orientation.

Innovation Solution

A driving assistance system that includes external and internal sensors, such as cameras and radar, to monitor the vehicle's surroundings and the driver's state, using facial recognition and touch sensors to determine appropriate visual observation and handle engagement, thereby reducing unnecessary warnings through more accurate assessment.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If visual observation is detected using vehicle exterior and in-vehicle cameras to determine whether a warning is necessary, then driver attention can be monitored, but unnecessary warnings may be issued due to inaccurate detection relying solely on driver orientation

Engineering Contradiction:
Improveaccuracy of driver attention detectionVSAvoidunnecessary warnings
Core Design Contradiction:
ReliabilityVSObject-generated harmful factors

Solution Approach 1:

The detection system is divided into multiple independent components: vehicle exterior cameras for monitoring the environment, in-vehicle cameras for capturing driver orientation, touch sensors for detecting handle engagement, and facial recognition systems for analyzing driver gaze direction. Each component independently assesses a specific aspect of driver attention, and their combined evaluation reduces false warnings by cross-validating multiple data sources.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system introduces an intermediary assessment layer that processes data from multiple sensors before determining whether a warning is necessary. This intermediary layer integrates camera-based orientation detection, touch sensor data, and facial recognition results to form a comprehensive judgment, preventing premature or inaccurate warnings that would result from relying on a single detection method.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If driver orientation is detected using in-vehicle camera to determine warning necessity, then driver visual state can be monitored, but detection precision decreases when relying only on face or eyes orientation

Engineering Contradiction:
Improvesimplicity of detection methodVSAvoidaccuracy of visual focus detection
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The system merges multiple detection methods into a unified assessment framework: camera-based orientation detection is combined with touch sensor data for handle engagement detection and facial recognition for gaze direction analysis. This combination maintains operational simplicity while significantly improving measurement precision by cross-validating results across multiple independent detection channels.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The in-vehicle camera system performs multiple functions simultaneously: capturing driver orientation, detecting facial expressions, and analyzing eye direction. The touch sensors detect both handle engagement and pressure magnitude. This multi-functionality allows the system to maintain simple hardware configuration while achieving high detection precision through diverse data collection from the same components.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Measurement precision

If multiple sensors and detection methods are used to reduce unnecessary warnings, then detection accuracy improves, but device complexity increases

Engineering Contradiction:
Improveaccuracy of driver state assessmentVSAvoidnumber of sensors and processing systems
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

Existing vehicle components are made multi-functional to reduce overall system complexity. The in-vehicle camera that originally detected driver orientation is enhanced to also perform facial recognition and gaze direction analysis. Touch sensors on the handle are designed to detect both engagement presence and pressure magnitude. This approach achieves high measurement precision using enhanced versions of standard components rather than adding numerous specialized sensors.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system merges data processing functions into a unified control unit that integrates information from camera systems, touch sensors, and existing vehicle sensors. By consolidating the intelligence layer rather than distributing it across multiple independent systems, the architecture reduces overall complexity while maintaining high detection accuracy through comprehensive data fusion.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentEP3971858B1Driving assistance method and driving assistance system
Publication Date: 2025.01.15 NISSAN MOTOR CO LTD
  • EP3971858B1 patent drawingFigure 1
  • EP3971858B1 patent drawingFigure 2
  • EP3971858B1 patent drawingFigure 3

AI summary

Provided is a driving assistance method of, by a controller, acquiring state information of a driver during travelling of autonomous driving and issuing a warning to the driver when the controller determines that the driver is not facing forward based on the state information of the driver. In the driving assistance method, a warning is prohibited when the driver is facing a lane change direction during the travelling of autonomous driving.