Driver State Detection Using Mobile Data in Autonomous Driving

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing autonomous driving systems face challenges in accurately determining a driver's state, particularly during conditional autonomous driving, as they rely solely on in-vehicle camera information, which can lead to incorrect assessments, such as mistaking a driver looking at a smartphone for being drowsy.

Innovation Solution

An apparatus and method that communicate with a mobile device to determine the driver's state by using a combination of in-vehicle sensors and mobile device data, including proximity, manipulation frequency, and camera information, to accurately assess driver availability and send transition demands to switch between autonomous and manual driving modes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If only in-vehicle camera information is used to determine driver state, then the system complexity is reduced, but the measurement precision of driver state deteriorates

Engineering Contradiction:
Improvesystem complexityVSAvoiddriver state determination accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent combines multiple data sources including in-vehicle camera information, mobile device location data, and mobile device operation status to comprehensively determine driver state. This merging of information sources resolves the contradiction by improving measurement precision through multi-source validation while managing system complexity through structured data integration.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent introduces mobile device information as an intermediary to verify driver state. The mobile device's location relative to the driver seat and its operation status serve as intermediate indicators that help accurately infer whether the driver is attentive or distracted, thereby improving measurement precision without requiring direct complex sensing of driver physiological states.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Device complexity

If in-vehicle camera alone is used for driver monitoring, then the device complexity is low, but the reliability of driver state assessment deteriorates due to false alarms

Engineering Contradiction:
Improvemonitoring system complexityVSAvoiddriver state assessment reliability
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The patent implements a feedback mechanism where mobile device information continuously validates and corrects camera-based driver state assessments. The system uses mobile device location and operation status as feedback signals to confirm or refute camera interpretations, thereby eliminating false alarms and improving reliability while maintaining manageable system complexity through iterative validation.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent performs preliminary verification of driver state by checking mobile device location and operation status before finalizing driver state determination. This preliminary action using mobile device data prevents false assessments from camera alone, improving reliability by filtering out incorrect interpretations before they trigger system responses.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If mobile device data is integrated to determine driver state, then the measurement precision improves, but the device complexity increases

Engineering Contradiction:
Improvedriver state determination accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the driver state determination process into distinct modules: camera-based initial assessment, mobile device location verification, mobile device operation status checking, and integrated decision-making. This segmentation improves measurement precision through comprehensive validation while managing system complexity by organizing functions into separate, manageable components with clear interfaces.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS20240425086A1Apparatus for controlling automatic driving of vehicle and method for determining state of a driver
Publication Date: 2024.12.26 HYUNDAI MOTOR CO LTD
  • US20240425086A1 patent drawing
  • US20240425086A1 patent drawing
  • US20240425086A1 patent drawing

AI summary

The present disclosure relates to an autonomous driving control apparatus and a driver state determining method thereof. An example of the present disclosure provides an autonomous driving control apparatus including: a processor, memory storing instructions, when executed by the processor, may cause the apparatus to communicate with a mobile device during driving of the vehicle in an autonomous driving mode, determine, based on the communication with the mobile device, whether a driver state is an available state for a manual driving mode, and based on the determination, may cause the vehicle to remain in the autonomous driving mode or may cause the mobile device to send a transition demand (TD) to switch the driving mode of the vehicle from the autonomous driving mode to the manual driving mode.