Noncontact Vision-Based 3D Cognitive Fatigue Measurement

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for measuring 3D visual fatigue, such as analyzing event-related potential (ERP) and heartbeat evoked potential (HEP), are burdensome and time-consuming due to the need for bio-sensor attachment, limiting their practical application.

Innovation Solution

A noncontact method and system that evaluates cognitive fatigue using task-evoked pupillary response (TEPR) by acquiring and processing pupil images from subjects exposed to visual stimuli, detecting dominant peaks, calculating latency, and comparing it to a reference value to determine cognitive fatigue.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If bio-sensors are attached to measure cognitive fatigue through ERP and HEP analysis, then measurement precision is improved, but device complexity and measurement burden increase

Engineering Contradiction:
Improvecognitive fatigue measurement precisionVSAvoidmeasurement system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent replaces the mechanical/electrical bio-sensor system with an optical imaging system. Instead of using electrodes attached to the skin to detect neural signals (ERP) or cardiac signals (HEP), the system uses a camera to capture pupillary responses, which are optical images of the pupil. This substitution eliminates the need for complex bio-sensor attachment while maintaining the ability to measure cognitive fatigue through pupillary diameter changes that reflect neural processing load.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent creates an optical copy of the physiological state through pupillary imaging. Rather than directly measuring neural or cardiac activity with invasive sensors, the system measures the pupillary response, which is a visible optical manifestation of cognitive load. The pupillary diameter changes serve as a non-invasive proxy or copy of the underlying neural processing, allowing fatigue assessment without direct brain or heart measurement.

Inventive Principle:
Principle #26Copying

2Measurement precision

If bio-sensors are attached to measure cognitive fatigue, then measurement precision is improved, but ease of operation deteriorates due to attachment time

Engineering Contradiction:
Improvecognitive fatigue measurement precisionVSAvoidmeasurement operation ease
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent replaces the time-consuming bio-sensor attachment process with a non-invasive optical imaging system. The camera-based pupillary response measurement requires no physical contact or sensor placement, eliminating the time and complexity associated with preparing and attaching electrodes or sensors to the participant's body.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system enables self-service measurement by automatically capturing and analyzing pupillary responses without requiring operator intervention for sensor placement or calibration. The optical system passively records pupillary diameter changes during cognitive tasks, and the analysis is performed automatically through image processing algorithms, making the measurement process as easy as having the participant view stimuli while being filmed.

Inventive Principle:
Principle #25Self-service

3Measurement precision

If conventional bio-sensor methods are used for cognitive fatigue measurement, then measurement precision is improved, but productivity decreases due to time-consuming procedures

Engineering Contradiction:
Improvecognitive fatigue measurement precisionVSAvoidmeasurement efficiency
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent replaces the slow, methodical bio-sensor setup and data collection process with rapid optical imaging. The camera can continuously capture pupillary responses throughout the entire cognitive task without interruption, eliminating the time lost in sensor attachment, calibration, and signal preparation. This allows for faster measurement cycles and higher productivity while maintaining measurement precision through continuous optical monitoring.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach reduces measurement burden, provides a quantitative assessment of 3D cognitive fatigue, and is more practical than existing methods, with high reliability and validity as demonstrated by the Multitrait-Multimethod (MTMM) matrix analysis.

Implementation Method 1

acquiring pupil images of a subject exposed to visual stimuli

Methodology Applied
Scientific EffectLight reflection: Reflection

Data Source

PatentUS10368740B2Method and system for noncontact vision-based 3D cognitive fatigue measuring by using task evoked pupillary response
Publication Date: 2019.08.06 SANGMYUNG UNIV IND ACAD COOP FOUND
  • US10368740B2 patent drawing
  • US10368740B2 patent drawing
  • US10368740B2 patent drawing

AI summary

Provided are a method and system for noncontact vision-based 3D cognitive fatigue measuring. The method comprises: acquiring pupil images of a subject exposed to visual stimuli; extracting a task evoked pupillary response (TEPR) by using the pupil images; detecting dominant peaks from the TEPR; calculating latency of dominant peaks; and determining cognitive fatigue of the subject by comparing a value of the latency to a predetermined reference value.