Eye Blink Rate Analysis for Mental State Inference

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Traditional methods for monitoring mental states during human-computer interaction are unreliable and intrusive, with surveys and physiological monitoring devices having low participation rates and being impractical for computer workstations.

Innovation Solution

A computer-implemented method that analyzes video to detect eye blink events and infer mental states such as attention, concentration, boredom, or fatigue, using a webcam or other image capture devices to unobtrusively monitor individuals interacting with computers, and aggregates this information with contextual data to provide accurate and practical mental state analysis.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If surveys are used to determine mental state, then mental state information can be obtained, but participation rates are low and reliability is poor

Engineering Contradiction:
Improvemental state information reliabilityVSAvoidsurvey participation rate
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The system automatically collects mental state data through video analysis of natural eye blink behavior without requiring user participation or input. The computer vision algorithm processes video feeds to detect blink events and infer mental states, eliminating the need for user-driven surveys while providing continuous, objective measurement of attention and engagement levels.

Inventive Principle:
Principle #25Self-service

2Measurement precision

If physiological monitoring devices are used, then accurate mental state data can be obtained, but the devices are intrusive and impractical for computer workstations

Engineering Contradiction:
Improvemental state measurement accuracyVSAvoiddevice intrusiveness
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The system uses a standard webcam to capture video of the user's face and eyes, creating a visual copy of natural behavior. The computer vision algorithm analyzes this video copy to detect eye blink patterns and infer mental states, providing accurate measurement without requiring specialized physiological sensors or intrusive equipment at the computer workstation.

Inventive Principle:
Principle #26Copying

3Ease of operation

If eye blink analysis is performed, then non-intrusive mental state monitoring is achieved, but additional video processing complexity is introduced

Engineering Contradiction:
Improvemonitoring intrusivenessVSAvoidvideo processing complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system replaces complex physiological sensing mechanisms with optical video capture and computer vision analysis. Instead of using elaborate physiological monitoring equipment, the invention uses standard video technology combined with algorithmic detection of eye blink events, substituting mechanical/sensor-based complexity with software-based pattern recognition that achieves the same measurement goal with simpler, more widely available components.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS9723992B2Mental state analysis using blink rate
Publication Date: 2017.08.08 AFFECTIVA
  • US9723992B2 patent drawing
  • US9723992B2 patent drawing
  • US9723992B2 patent drawing

AI summary

Mental state analysis is performed by obtaining video of an individual as the individual interacts with a computer, either by performing various operations or by consuming a media presentation. The video is analyzed to determine eye-blink information on the individual, such as eye-blink rate or eye-blink duration. A mental state of the individual is then inferred based on the eye blink information. The blink-rate information and associated mental states can be used to modify an advertisement, a media presentation, or a digital game.