Near-Infrared Eye Tracking for Driver Drowsiness Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for detecting driver drowsiness in vehicles are costly, complex, and lack accuracy in tracking the eye region to monitor alertness, especially in situations involving driver fatigue and lack of sleep.

Innovation Solution

A cost-effective and robust system using a near-infrared (IR) camera to track the drowsiness state of drivers by implementing real-time face and eye localization, histogram equalization, morphological operations, and texture-based parameters, with a processor-based method that computes target model and candidate model histograms to identify eye displacement and detect drowsiness.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If complex sensor technologies and multiple algorithms are used for drowsiness detection, then detection accuracy may improve, but system cost and complexity increase significantly

Engineering Contradiction:
Improvedrowsiness detection accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system segments the detection task into distinct stages: face detection, eye region localization, and drowsiness state classification. Each stage processes specific features independently, simplifying the overall system while maintaining accuracy. The face detection module identifies the face bounding box, which then guides the eye region analysis, creating a hierarchical segmentation that reduces computational complexity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system extracts only the critical eye region from the full face image using the face bounding box as a guide. By focusing computational resources on the extracted eye region rather than processing the entire face image, the system achieves accurate drowsiness detection with reduced computational load and simpler processing requirements.

Inventive Principle:
Principle #2Taking out (Extraction)

2Measurement precision

If advanced image processing techniques are implemented for eye tracking, then tracking accuracy improves, but computational cost and processing time increase

Engineering Contradiction:
Improveeye tracking accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary face detection and establishes the face bounding box before proceeding to eye region analysis. This preliminary action pre-defines the search space for eye tracking, eliminating the need for complex full-image processing and significantly reducing computation time while maintaining tracking accuracy.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system applies high-quality image processing techniques specifically to the eye region within the face bounding box, rather than processing the entire image with the same intensity. This localized approach concentrates computational resources where they are most needed, achieving accurate eye tracking with reduced overall processing time.

Inventive Principle:
Principle #3Local quality

3Reliability

If traditional RGB cameras and complex algorithms are used, then system cost increases, but if simpler methods are used, detection reliability decreases

Engineering Contradiction:
Improvedrowsiness detection reliabilityVSAvoidsystem cost
Core Design Contradiction:
ReliabilityVSEase of manufacture

Solution Approach 1:

The system changes the analysis parameters from color-based RGB analysis to grayscale intensity analysis. By converting the image to grayscale and analyzing intensity variations in the eye region, the system achieves reliable drowsiness detection using simpler, lower-cost processing methods that do not require complex color analysis algorithms.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The system replaces complex mechanical sensor arrays with a simpler camera-based optical detection system. By using standard camera hardware combined with intelligent image processing algorithms, the system achieves reliable drowsiness detection without requiring expensive specialized sensors or multiple camera systems.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The system provides accurate and independent eye tracking, effectively detecting drowsiness states and alerting drivers through audio or visual warnings, reducing the risk of accidents by improving monitoring accuracy and reducing costs.

Implementation Method 1

using images captured by near infrared (IR) camera disposed on the vehicle

Methodology Applied
Scientific EffectNear-infrared radiation detection: Infrared Radiation

Data Source

PatentUS9483695B2Cost effective and robust system and method for eye tracking and driver drowsiness identification
Publication Date: 2016.11.01 TATA CONSULTANCY SERVICES LTD
  • US9483695B2 patent drawing
  • US9483695B2 patent drawing
  • US9483695B2 patent drawing

AI summary

A cost-effective and robust method for localizing and tracking drowsiness state of the eyes of driver by using images captured by near infrared (IR) camera disposed on the vehicle, the said method comprising the processor implemented steps of: Real-time tracking of the face and localizing eye bounding box within the face bounding box in the captured image by comparing the gray values with threshold using the segmentation process; tracking the eyes by computing the centroid of the eye, target model histogram and target candidate model histogram for one location to another by comparing them to identify distance and calculating the displacement of the target center by the weighted means, wherein the target model histogram and target candidate model histogram are computed based on the feature space; and detecting the drowsiness state of the eyes using histogram equalization, Morphological operations and texture based parameters using histogram and grey level co-occurrence matrices.