EEG-Integrated HMD for Real-Time Cognitive State Monitoring

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current head-mounted display (HMD) systems lack effective methods to monitor user attention, comprehension, and drowsiness, which are crucial for enhancing user experience and interaction in augmented, mixed, and virtual reality environments.

Innovation Solution

A computing system integrated with EEG interfaces in an HMD device that detects event-related potentials (ERPs) such as P300/P3b and N400 waveforms to assess user attention and comprehension, combining these with ocular camera data to determine drowsiness levels, and performs operations based on these measurements.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If EEG interfaces are integrated into HMD to monitor user attention and comprehension, then user engagement monitoring capability is improved, but device complexity increases

Engineering Contradiction:

Improveuser attention and comprehension monitoringVSAvoidHMD system complexity

Core Design Contradiction:

Measurement precisionVSDevice complexity

Solution Approach 1:

The HMD device integrates multiple functions including EEG signal acquisition, ocular tracking, and content delivery through a single unified platform. The EEG interfaces and ocular cameras are incorporated into the HMD structure to simultaneously monitor cognitive states and provide immersive content, reducing the need for separate monitoring devices and simplifying the overall system architecture.

Inventive Principle:

Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent combines EEG signal processing, ocular camera data analysis, and content adaptation algorithms into a unified system that operates through the HMD. By merging these previously separate components into a single integrated system, the patent reduces complexity while maintaining comprehensive monitoring capabilities for attention, comprehension, and drowsiness detection.

Inventive Principle:

Principle #5Merging (Combining)

2Measurement precision

If multiple sensors (EEG interfaces and ocular cameras) are added to HMD for comprehensive monitoring, then monitoring accuracy is improved, but device weight increases

Engineering Contradiction:

Improvedrowsiness and attention monitoring accuracyVSAvoidHMD device weight

Core Design Contradiction:

Measurement precisionVSWeight of moving object

Solution Approach 1:

The EEG interfaces are implemented using thin, flexible electrode structures that can be integrated into the HMD headband or cap. These flexible EEG interfaces maintain contact with the scalp for accurate signal acquisition while adding minimal weight compared to traditional rigid sensor arrays. The thin-film construction allows the sensors to conform to the head shape without requiring heavy mounting structures.

Inventive Principle:

Principle #30Flexible shells and thin films

3Speed

If real-time EEG signal processing is performed to detect ERPs, then response time is improved, but energy consumption increases

Engineering Contradiction:

Improvereal-time feedback response timeVSAvoidHMD device energy consumption

Core Design Contradiction:

SpeedVSUse of energy by moving object

Solution Approach 1:

The system processes EEG signals by detecting specific event-related potential components (P300/P3b, N400) that occur at predictable time intervals following stimulus presentation. By focusing processing on these periodic, time-locked ERP components rather than continuously analyzing all EEG data, the system achieves real-time monitoring capability while significantly reducing computational energy requirements compared to continuous full-spectrum EEG analysis.

Inventive Principle:

Principle #19Periodic action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The system provides real-time feedback on user engagement, enabling adaptive adjustments to the content presentation and improving the overall user experience by ensuring attention and comprehension, while also monitoring drowsiness to prevent fatigue.

Implementation Method 1

Electroencephalography (EEG) refers to a technique for monitoring electrical activity of the brain of a living organism—typically the brain of a human subject. Fluctuations in electrical potential may be observed at various locations or regions of the brain via a set of EEG interfaces that are spatially distributed relative to the subject's head.

Methodology Applied

Scientific EffectElectroencephalography (EEG):

Implementation Method 2

An event-related potential (ERP) refers to a response of the brain to a stimulus event that has been perceived by the subject. ERPs may be detected via EEG as fluctuations in electrical potential observed during a period of time following the subject's perception of the stimulus event.

Methodology Applied

Scientific EffectEvent-related potential (ERP):

Data Source

PatentUS10660570B2Attention, comprehension, and drowsiness monitoring via head mounted device supporting augmented and mixed reality experiences

Publication Date: 2020.05.26 META PLATFORMS TECHNOLOGIES LLC

AI summary

A head mounted display (HMD) system includes an HMD device worn on a head of a user. The HMD device incorporates electroencephalography (EEG) interfaces for monitoring the brain of a human subject during interaction with the HMD device. Fluctuations in electrical potential that are observed via the EEG interfaces may be used to detect event-related potentials (ERPs). The HMD system may programmatically perform one or more operations in response to detecting ERPs. The HMD system may further include off-board devices that communicate with the HMD device over a wireless communications network.