VR Headset Biometric Feedback for Immersive Interaction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current virtual reality interfaces rely on traditional mechanisms and fail to effectively capture user biofeedback, such as concentration, which limits immersive interactions with virtual objects.

Innovation Solution

The system uses a combination of gaze tracking and electroencephalography (EEG) signals, processed by a trained machine learning model, to determine user concentration on virtual objects within a virtual environment, rendering graphical indicators and allowing for interactive actions through controller inputs and gestures.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If traditional interface mechanisms are used for VR interactions, then device complexity is reduced, but user immersion and interaction effectiveness deteriorate

Engineering Contradiction:
Improveinteraction effectivenessVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent combines multiple sensing modalities (gaze tracking, EEG signals, depth focus detection) into a unified interaction system. This merging of biometric feedback mechanisms enables more effective and immersive user interactions with virtual objects, resolving the contradiction by integrating complex sensors into a cohesive system that enhances adaptability without proportionally increasing overall system complexity

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent introduces biometric feedback signals as intermediaries between the user and the virtual environment. These signals (gaze direction, EEG concentration levels, focus depth) serve as mediators that translate user intent into virtual object interactions, enabling more effective communication between user and system while managing the complexity through standardized intermediary interfaces

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If biometric feedback detection is added to VR headset, then user concentration detection is improved, but device complexity increases

Engineering Contradiction:
Improveconcentration detection accuracyVSAvoidheadset complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The VR headset is designed with multi-functional sensors that serve multiple purposes. The same sensors detect gaze direction, focus depth, and EEG signals for concentration measurement. This universal approach allows the system to achieve precise concentration detection without proportionally increasing device complexity, as existing structural components are leveraged for multiple measurement functions

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent implements a nested sensor architecture where EEG electrodes and gaze tracking cameras are integrated within the existing VR headset structure. The biometric sensors are embedded within the headset's housing and optical paths, allowing concentration detection capabilities to be nested within the existing device framework rather than requiring separate external equipment

Inventive Principle:
Principle #7Nested doll (Nesting)

3Loss of information

If multiple sensors are integrated in VR headset, then biofeedback capture is improved, but ease of operation deteriorates

Engineering Contradiction:
Improvebiofeedback capture completenessVSAvoiduser comfort
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The system operates autonomously by continuously monitoring biometric signals without requiring user intervention. The gaze tracking, EEG detection, and focus measurement occur automatically, with the system processing signals and triggering virtual object interactions without the user needing to manually activate or adjust settings, thereby maintaining ease of operation despite multiple integrated sensors

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS11995233B2Biometric feedback captured during viewing of displayed content
Publication Date: 2024.05.28 SONY INTERACTIVE ENTERTAINMENT LLC
  • US11995233B2 patent drawing
  • US11995233B2 patent drawing
  • US11995233B2 patent drawing

AI summary

A method is provided, including: rendering a view of a virtual environment through a virtual reality (VR) headset; detecting a gaze direction of a user that wears the VR headset; detecting a gaze focus depth of the user that wears the VR headset; detecting an electroencephalography (EEG) signal of the user that wears the VR headset; using the gaze direction and gaze focus depth of the user to identify a virtual object in the virtual environment as being actively viewed by the user; using the EEG signal to determine a concentration of the user upon the identified virtual object; responsive to determining the concentration of the user upon the identified virtual object, then rendering a graphical indicator applied to the virtual object in the view of the virtual environment.