Virtual Environment Adjustment via User Emotional State Detection

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current virtual reality systems break immersion when users provide feedback or input, limiting the immersive experience to scripted scenarios without user input.

Innovation Solution

A method and system that sense a user's physical activity to determine their emotional state, using this data to non-intrusively adjust the virtual environment, thereby enhancing and maintaining the immersive experience without requiring explicit user input.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If user feedback or input is required to control the virtual environment, then the system can adapt to user preferences, but the immersive experience is reduced or broken

Engineering Contradiction:

Improveadaptation to user preferencesVSAvoidimmersive experience

Core Design Contradiction:

Adaptability or versatilityVSReliability

Solution Approach 1:

The system automatically adjusts the virtual environment by detecting physical activity and inferring emotional states without requiring explicit user input. The system serves itself by using sensor data to make adaptive changes, eliminating the need for users to break immersion through manual feedback while still achieving personalization

Inventive Principle:

Principle #25Self-service

Solution Approach 2:

The patent replaces traditional mechanical input methods (controllers, keyboards, buttons) with sensor-based detection systems that automatically capture physical activity data. This substitution allows the system to interpret user state passively through cameras, microphones, and other sensors, maintaining immersion while enabling adaptation

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

2Adaptability or versatility

If the virtual environment is adjusted based on user input, then the experience becomes personalized, but the scripted scenario structure is disrupted

Engineering Contradiction:

Improvepersonalization of experienceVSAvoidscripted scenario structure

Core Design Contradiction:

Adaptability or versatilityVSStability of the object's composition

Solution Approach 1:

The system dynamically adjusts the virtual environment within the bounds of pre-designed scenarios. Rather than allowing arbitrary changes that would disrupt the scripted structure, the system makes controlled, real-time modifications based on detected emotional states, maintaining both personalization and structural integrity

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The patent modifies specific parameters of the virtual environment (such as lighting, music, NPC behavior, or task difficulty) based on inferred emotional states, while keeping the overall scenario framework intact. This allows personalization through parameter adjustment without disrupting the fundamental scripted structure

Inventive Principle:

Principle #35Parameter changes

3Measurement precision

If traditional input methods are used, then user control is precise, but accessibility is limited for users with disabilities

Engineering Contradiction:

Improveuser control precisionVSAvoidaccessibility

Core Design Contradiction:

Measurement precisionVSEase of operation

Solution Approach 1:

The system automatically detects physical activity and infers emotional states without requiring users to operate traditional input devices. This self-service approach eliminates barriers for users with disabilities while maintaining sufficient control precision through passive sensor-based measurement of physical cues

Inventive Principle:

Principle #25Self-service

Data Source

PatentUS20230053767A1System, game console and method for adjusting a virtual environment

Publication Date: 2023.02.23 SONY GROUP CORP

AI summary

A method for non-intrusively adjusting a virtual environment. The method comprises sensing a physical activity of a user perceiving the virtual environment and determining an emotional state of the user based on the sensed physical activity. Further, the method provides for adjusting the virtual environment using the user's emotional state as non-intrusive in-put by the user to increase and/or not to break the user's immersive experience of the virtual environment.