Gaze-Adaptive Sensory Effect Mapping for Virtual Reality Scenes

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current 4D movie theaters provide preset sensory effects that do not adapt to a user's gaze in a virtual world, leading to reduced user immersion and satisfaction.

Innovation Solution

A sensory effect adaptation method using an adaptation engine that converts metadata associated with objects in a virtual world into actionable commands for sensory devices in the real world, based on the user's gaze, environment, preferences, and device performance, enabling dynamic and personalized sensory experiences.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If preset sensory effects are provided on a time-by-time basis, then sensory effects can be provided irrespective of user gaze, but user immersion and satisfaction are reduced

Engineering Contradiction:

Improvesensory effect adaptabilityVSAvoiduser immersion

Core Design Contradiction:

Adaptability or versatilityVSReliability

Solution Approach 1:

The patent implements dynamic sensory effect provision by continuously tracking user gaze direction and adjusting sensory effects in real-time based on the currently viewed scene, transforming the static preset approach into a dynamic adaptive system that responds to user behavior

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The system incorporates feedback mechanisms by monitoring user gaze direction and using this information to adjust sensory effects accordingly, creating a closed-loop control system where user behavior directly influences the sensory experience

Inventive Principle:

Principle #23Feedback

2Reliability

If sensory effects are provided based on user gaze and scene, then user immersion is improved, but system complexity increases

Engineering Contradiction:

Improveuser immersionVSAvoidsystem complexity

Core Design Contradiction:

ReliabilityVSDevice complexity

Solution Approach 1:

The patent introduces an adaptation engine as an intermediary component that bridges the virtual world rendering system and the physical sensory effect devices, managing the complexity of coordinating multiple systems while maintaining clear separation of concerns

Inventive Principle:

Principle #24Intermediary (Mediator)

Solution Approach 2:

The adaptation engine serves multiple functions including gaze tracking, scene identification, sensory effect selection, and device control, consolidating these capabilities into a single multi-functional system rather than separate specialized components

Inventive Principle:

Principle #6Universality (Multi-functionality)

Data Source

PatentUS20190019340A1Sensory effect adaptation method, and adaptation engine and sensory device to perform the same

Publication Date: 2019.01.17 ELECTRONICS & TELECOMM RES INST

AI summary

Provided is a sensory effect adaptation method performed by an adaptation engine, the method including identifying first metadata associated with an object in a virtual world and used to describe the object and converting the identified first metadata into second metadata to be applied to a sensory device in a real world, wherein the second metadata is obtained by converting the first metadata based on a scene determined by a gaze of a user in the virtual world.