VR Follower Pose Refinement via Surface Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In virtual reality (VR) systems, users' motions interacting with obstructions in the simulated environment often result in unrealistic experiences, such as penetrating solid objects, which degrades the VR experience by causing disorientation or unrealistic movement handling.

Innovation Solution

A method is introduced to determine a follower pose in a VR simulator by computing candidate poses along a sweep direction towards a leader pose, selecting a target pose using physics-based constraints, and refining it to ensure the follower pose interacts realistically with obstructions by moving along their surface, employing a combination of blocking and stroking algorithms to maintain physical plausibility.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If direct motion tracking is used to replicate user movement in VR, then motion tracking accuracy is improved, but physical plausibility deteriorates as objects penetrate obstructions

Engineering Contradiction:
Improvemotion tracking accuracyVSAvoidphysical plausibility
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The system performs preliminary detection to identify obstructions in the path of movement before the follower pose reaches them. By detecting obstructions in advance and computing candidate poses that account for their presence, the system prevents penetration issues before they occur, maintaining both tracking accuracy and physical plausibility

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces an intermediary computation process that acts as a mediator between the leader pose (user input) and follower pose (rendered object). This intermediary process computes multiple candidate poses, evaluates them against obstruction constraints, and selects the most physically plausible pose, thereby resolving the conflict between direct tracking and physical realism

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If multiple candidate poses are computed and refined using physics-based constraints, then physical plausibility is improved, but computational complexity increases

Engineering Contradiction:
Improvephysical plausibilityVSAvoidcomputational complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent segments the pose computation process into distinct stages: generating multiple candidate poses, evaluating them against constraints, selecting the best candidate, and refining the selected pose. This segmentation allows the system to apply computational effort selectively rather than continuously, reducing overall complexity while maintaining physical plausibility

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system changes parameters dynamically based on the computation stage - using different evaluation criteria for candidate poses versus refined poses, and adjusting the level of constraint application. This parameter adaptation allows the system to maintain physical plausibility while managing computational resources efficiently

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11398047B2Virtual reality simulations using surface tracking
Publication Date: 2022.07.26 NVIDIA CORP
  • US11398047B2 patent drawing
  • US11398047B2 patent drawing
  • US11398047B2 patent drawing

AI summary

The disclosure provides a system to render a virtual reality (VR) scene, and a method and computer program product to determine a follower pose in a VR simulator during a simulation step. In one example, the method includes: (1) computing one or more current candidate poses utilizing input parameters, wherein each of the current candidate poses is a temporal projection of a follower pose along a respective sweep direction towards a leader pose, and wherein an obstruction is located between the follower pose and the leader pose, (2) selecting a target pose from the one or more current candidate poses, (3) refining the target pose utilizing physics-based constraints and the input parameters, wherein the physics-based constraints use a surface of the obstruction, and (4) rendering a new follower pose based on the refined target pose.