3D Immersive Navigation via Gaze-Driven Metadata and Spatial Lighting

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current virtual reality technologies fail to effectively facilitate user navigation and enhance user experience in 3D scenes, as existing navigation methods are complex and not adaptable to new environments, lacking intuitive guidance and relighting capabilities.

Innovation Solution

A 3D immersive method that determines a user's position and orientation in a virtual scene, using metadata to execute actions such as guiding the user to specific locations and modifying lighting to direct attention, thereby enhancing navigation and relighting, allowing for dynamic and context-aware interaction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If traditional game-based navigation controls are used in virtual reality, then users can navigate through 3D scenes, but users spend significant time understanding and mastering these controls

Engineering Contradiction:
Improvenavigation control easeVSAvoidtime to master controls
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The system automatically detects user intent by analyzing gaze direction and scene metadata, then autonomously executes navigation actions without requiring users to learn or input complex control commands. The navigation system serves itself by interpreting user attention and context to determine appropriate actions.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces traditional mechanical control interfaces (buttons, joysticks, keyboard commands) with a cognitive-based interaction model that uses gaze tracking and contextual metadata to infer user intent and execute navigation automatically, substituting physical control mechanics with perceptual and contextual processing.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Adaptability or versatility

If existing VR navigation systems provide contextual guidance, then users can be directed to destinations, but the systems lack ability to read user intent and provide personalized guidance

Engineering Contradiction:
Improvenavigation adaptabilityVSAvoiduser intent information
Core Design Contradiction:
Adaptability or versatilityVSLoss of information

Solution Approach 1:

The system continuously monitors user gaze direction, head orientation, and scene context to gather feedback about user intent. This feedback loop allows the system to dynamically adjust navigation guidance based on real-time user behavior and preferences, creating adaptive personalized navigation experiences.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system pre-processes scene metadata and potential navigation targets before user interaction, organizing information about destinations, pathways, and contextual relevance. This preliminary preparation enables rapid response to user intent without requiring complex real-time computation during navigation.

Inventive Principle:
Principle #10Preliminary action

3Ease of operation

If visual navigation aids like arrows and icons are added to VR scenes, then users receive directional guidance, but the navigation complexity increases for 3D environments

Engineering Contradiction:
Improvenavigation guidanceVSAvoidnavigation system complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent transitions navigation guidance from traditional 2D UI overlays (arrows, icons, menus) to 3D spatial indicators integrated into the virtual environment. Navigation cues are positioned and oriented in 3D space relative to user gaze and scene geometry, providing intuitive directional guidance that leverages the natural spatial understanding of VR users.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The system provides navigation guidance selectively at specific locations and moments based on user gaze and contextual relevance, rather than displaying comprehensive navigation information throughout the entire scene. This localized approach reduces visual clutter and complexity while maintaining effective guidance where needed.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS11207592B23D immersive method and device for a user in a virtual 3D scene
Publication Date: 2021.12.28 INTERDIGITAL CE PATENT HOLDINGS SAS
  • US11207592B2 patent drawing
  • US11207592B2 patent drawing

AI summary

A position and an orientation of a user in a virtual 3D scene is determined (22), an action is executed (24) in the virtual 3D scene for the user in function of the position and orientation of the user with respect to a given place, and a result of the action is outputted (25). For at least one event in the scene consisting in a presence of at least one determined virtual content, metadata linking the event(s) and at least one place of the event(s) are obtained (21). A given event and the given place linked by those metadata are determined (241), in function of the above position and orientation and of a relationship between that event and a user profile of the user. The action regarding the determined given event and place is executed.