Mobile Device Driver Warning System Using Facial Gaze Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional vehicle warning systems are rigidly integrated into the vehicle and fail to effectively alert drivers of potential hazards, such as pedestrians or bicycles, due to driver distraction or limited viewing angles, leading to potential accidents.

Innovation Solution

A mobile device system equipped with front and rear cameras captures the driver's facial aspects and road views, compares them with scenario databases, and issues notifications or warnings based on the driver's response and environmental factors to prevent accidents, ensuring independence from the vehicle and relevance of alerts.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If conventional warning systems are rigidly built into the vehicle, then the system structure is stable and integrated, but the system cannot effectively alert drivers of potential hazards due to driver distraction or limited viewing angles

Engineering Contradiction:
Improveaccident prevention effectivenessVSAvoiddriver alertness requirement
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The patent introduces a mobile device as an intermediary between the road environment and the driver. The mobile device captures images of the road ahead and the driver's face, processes this information, and provides warnings independently of the vehicle's built-in systems. This intermediary approach allows the system to operate effectively regardless of the driver's current attention state or viewing angle.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system uses the driver's own mobile device and facial features for monitoring. The mobile device's camera captures the driver's face to determine gaze direction, and the system processes this information to provide targeted warnings. This self-service approach eliminates the need for separate dedicated monitoring hardware while maintaining effectiveness.

Inventive Principle:
Principle #25Self-service

2Adaptability or versatility

If the warning system is built into the vehicle, then the system has stable integration, but it lacks independence from the specific vehicle and driver characteristics

Engineering Contradiction:
Improveindependence from vehicleVSAvoidsystem integration complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent employs a mobile device that serves multiple functions: capturing road images, capturing driver facial images, processing visual information, and providing warnings. This universal device approach eliminates the need for vehicle-specific integration while maintaining adaptability to different drivers and driving conditions through software-based processing.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Reliability

If the system issues warnings based solely on hazard detection, then all potential hazards are alerted, but unnecessary alerts are generated leading to driver distraction

Engineering Contradiction:
Improvewarning accuracyVSAvoidunnecessary alerts
Core Design Contradiction:
ReliabilityVSObject-generated harmful factors

Solution Approach 1:

The system continuously monitors the driver's gaze direction by capturing facial images and determining where the driver is looking. This feedback mechanism allows the system to distinguish between hazards that require alerting (those in the driver's blind spots) and hazards that the driver is already observing (reducing unnecessary alerts). The gaze information feeds back into the warning decision process to filter out redundant notifications.

Inventive Principle:
Principle #23Feedback

Data Source

PatentEP3366541B1Method and device for warning driver of vehicle using mobile device
Publication Date: 2022.05.11 WIPRO LTD
  • EP3366541B1 patent drawingFigure 1
  • EP3366541B1 patent drawingFigure 2
  • EP3366541B1 patent drawingFigure 3

AI summary

The invention relates to methods and systems for warning a driver (110) of a vehicle (102) through a mobile device (204). The method includes capturing images of at least one facial aspect of the driver and a path view (206) visible ahead of the vehicle up to a predefined distance and performing image analytics based on the captured images to identify at least one path event demanding attention of the driver based on a path view and a field of view of the driver. The method further includes detecting absence of a driver response in response to the identified at least one path event within the field of view of the driver, extracting driver details associated with the driver, and issuing a notification to the driver based on the driver details, when the absence of the driver response is detected.