VR Object Presentation via User Gaze and Physiological Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current virtual reality (VR) environments lack dynamic and user-specific interaction methods to determine and present relevant objects based on user interactions, relying on fixed rules and requiring extensive user input for contextual information.

Innovation Solution

A method and system that detect user interactions such as movement, speech, and physiological traits to produce contextual information, determining and presenting relevant objects in the VR environment by tracking user gaze direction, movement, and physiological responses, allowing for dynamic and responsive object presentation without explicit user requests.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If fixed rules are used to determine object presentation in VR environments, then system complexity is reduced, but adaptability and user-specific relevance deteriorate

Engineering Contradiction:
Improveuser-specific interactionVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system automatically detects user interactions (gaze direction, movement, physiological traits) and autonomously determines which objects to present without requiring explicit user commands or complex configuration. The VR environment serves itself by adapting to user behavior patterns, eliminating the need for users to manually specify contextual information while maintaining high adaptability to individual users.

Inventive Principle:
Principle #25Self-service

2Productivity

If extensive user input is required for contextual information, then information accuracy is improved, but user interaction efficiency deteriorates

Engineering Contradiction:
Improveuser interaction efficiencyVSAvoidtime for user input
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The system continuously monitors and detects user interactions (gaze direction, movement, physiological traits) in advance to predict user intentions before explicit requests are made. By preparing contextual information proactively based on detected patterns, the system eliminates the need for users to provide extensive input, significantly improving interaction efficiency while reducing time loss.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system uses real-time detection of user interactions as feedback to dynamically adjust object presentation. By continuously monitoring user behavior and using this feedback to refine predictions about user intentions, the system automatically optimizes which objects are presented, eliminating the need for extensive user input while maintaining high information accuracy.

Inventive Principle:
Principle #23Feedback

3Ease of operation

If dynamic object presentation based on user interaction is implemented, then user engagement is improved, but measurement and detection complexity increases

Engineering Contradiction:
Improveuser engagementVSAvoidinteraction detection
Core Design Contradiction:
Ease of operationVSDifficulty of detecting and measuring

Solution Approach 1:

The system employs a multi-functional detection framework that simultaneously monitors various types of user interactions (gaze direction, movement, physiological traits) using integrated sensors. This universal approach allows the system to capture comprehensive user behavior data through a unified architecture, making the detection process more manageable while enabling rich dynamic object presentation that significantly improves user engagement.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS10514752B2Methods and apparatus to determine objects to present in virtual reality environments
Publication Date: 2019.12.24 GOOGLE LLC
  • US10514752B2 patent drawing
  • US10514752B2 patent drawing
  • US10514752B2 patent drawing

AI summary

In at least one general aspect, a method can include detecting an interaction with a first object in a virtual reality (VR) environment, producing first contextual information based on user interaction with the first object, determining a second object to display in the VR environment based on the first contextual information, and presenting the second object in the VR environment. The interaction of the user may include at least one of a movement, a speech, or a physiological trait of the user.