Perspective-Locked Virtual Object Rendering in Mixed Reality

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current mixed reality technologies do not effectively allow users to create and share perspective-locked virtual objects that can be consumed by others at specific locations, orientations, and positions, limiting the immersive and interactive experience in real-world environments.

Innovation Solution

The technology enables users to create and share virtual objects that lock consumers to specific perspectives, positions, and orientations, allowing for immersive interactions by using a see-through head-mounted display device that tracks user positions and orientations, and a central service that manages object definitions and rendering data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If virtual objects are rendered on a flat display without perspective locking, then users can view objects from any position, but the immersive experience and spatial accuracy are reduced

Engineering Contradiction:
Improveviewing flexibilityVSAvoidspatial accuracy
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The system dynamically adjusts the rendering of virtual objects based on the user's position and orientation. The virtual objects are locked to specific perspectives, and the system determines whether to render them based on the user's current location relative to the defined consumption positions. This dynamic approach maintains spatial accuracy while adapting to user movement.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system creates a copy of the creator's perspective by capturing position, orientation, and field of view data, then uses this copied perspective information to render virtual objects for consumers. This allows the consumer to experience the scene from the same perspective as the creator, maintaining spatial accuracy.

Inventive Principle:
Principle #26Copying

2Measurement precision

If virtual objects are made perspective-locked to specific locations and orientations, then spatial accuracy and immersion are improved, but the system complexity increases

Engineering Contradiction:
Improvespatial accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system segments the virtual object rendering into distinct components: object definitions with consumption position data, user position tracking, and rendering determination logic. This segmentation allows each component to be handled independently, managing complexity through modular organization of the perspective-locking functionality.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system introduces an intermediary layer that manages the complex perspective-locking logic. This intermediary processes the relationship between user position, object definitions, and rendering decisions, shielding the user from the underlying complexity while maintaining spatial accuracy.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Device complexity

If virtual objects are rendered without position and orientation tracking, then device complexity is reduced, but user engagement and interaction quality decrease

Engineering Contradiction:
Improvetracking system complexityVSAvoiduser engagement
Core Design Contradiction:
Device complexityVSEase of operation

Solution Approach 1:

The system employs self-service mechanisms where the mobile device automatically tracks its own position and orientation using built-in sensors, and the system automatically determines whether to render virtual objects based on this tracked data. This reduces the need for complex external tracking infrastructure while maintaining user engagement.

Inventive Principle:
Principle #25Self-service

Data Source

PatentEP3011418B1Virtual object orientation and visualization
Publication Date: 2019.11.06 MICROSOFT TECHNOLOGY LICENSING LLC
  • EP3011418B1 patent drawingFigure 1A
  • EP3011418B1 patent drawingFigure 1B~1D
  • EP3011418B1 patent drawingFigure 2

AI summary

A method and apparatus for the creation of a perspective-locked virtual object having in world space. The virtual object may be consumed) by another user with a consumption device at a location, position, and orientation which is the same as, or proximate to, the location, position, and orientation where the virtual object is created. Objects may have one, few or many allowable consumption locations, positions, and orientations defined by its creator.