Haptic Driver Alert System Using Facial and Hand Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing audio and visual alert systems in vehicles are ineffective in scenarios where the driver is distracted or drowsy, as they require high driver attention and can disturb passengers, and may not be noticed by the driver if they are not focusing on the dashboard or unable to hear/hear clearly.

Innovation Solution

A driver assistance system that uses image capturing, hand tracking, and haptic devices to generate touch-based alerts by analyzing facial and eye attributes to provide haptic sensations based on estimated sensory information, allowing alerts to be experienced by the driver regardless of their focus direction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If audio or visual alert systems are used to alert the driver, then the driver can be notified of events, but the system requires high driver attention and may not be effective when the driver is distracted or drowsy

Engineering Contradiction:
Improvealert effectivenessVSAvoiddriver attention requirement
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The patent replaces audio and visual alert systems with a haptic feedback system that uses tactile sensations delivered through the steering wheel. This substitution allows the driver to receive alerts through touch rather than requiring visual or auditory attention, effectively solving the problem of alert effectiveness when the driver is distracted or drowsy.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces a haptic feedback mechanism as an intermediary between the alert system and the driver. The haptic device translates alert information into tactile patterns that the driver can feel through the steering wheel, serving as a mediator that communicates event information without requiring direct sensory engagement from the driver.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If frequent audio alerts are generated to notify the driver of events, then the driver can be kept informed, but other passengers in the vehicle are disturbed

Engineering Contradiction:
Improvedriver notificationVSAvoidpassenger disturbance
Core Design Contradiction:
ReliabilityVSObject-affected harmful factors

Solution Approach 1:

The patent applies local quality by directing the alert signal specifically to the driver through the steering wheel haptic feedback, rather than broadcasting audio alerts that affect the entire vehicle interior. The tactile feedback is localized to the driver's hands on the steering wheel, providing notification without disturbing passengers in other locations within the vehicle.

Inventive Principle:
Principle #3Local quality

3Reliability

If visual warning lights are displayed on the dashboard to alert the driver, then the driver can be notified of events, but the alert is not noticed if the driver is not looking at the dashboard

Engineering Contradiction:
Improvealert visibilityVSAvoiddriver line of sight requirement
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The patent segments the alert delivery mechanism from the driver's visual field by using haptic feedback through the steering wheel. Instead of relying on a unified visual alert system that requires the driver to look at the dashboard, the alert is segmented and delivered through tactile sensations that the driver can feel regardless of visual orientation, eliminating the line of sight requirement.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11110940B2Method and system for generating touch-based alerts to a driver in a vehicle
Publication Date: 2021.09.07 WIPRO LTD
  • US11110940B2 patent drawing
  • US11110940B2 patent drawing
  • US11110940B2 patent drawing

AI summary

A method and driver assistance system for generating touch-based alerts to a driver in a vehicle is disclosed. The driver assistance system receives frames including the driver in vehicle and detects position of face of the driver in plurality of frames. Facial attributes of the driver are identified based on position of the face and one or more eye attributes of the driver are determined based on the identified one or more facial attributes. Based on the facial attributes and the one or more eye attribute sensory information is estimated from a plurality of sensory data. Further, information regarding haptic sensation is computed for the driver based on estimated sensory information and a position of hands of the driver received from a hand tracking device. Thereafter, an alert is generated using signals relating to the haptic sensation to the driver for taking one or more corrective measure.