Virtual Object Reorientation in Mixed Reality

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

In mixed reality environments, accurately determining and adjusting the object space orientation and pivot point of 3D virtual objects is challenging, especially when importing models from creator applications to MR applications, due to differences in export and import processes, and when dealing with complex objects composed of multiple virtual objects.

Innovation Solution

A system that allows users to interactively select and reorient virtual objects using hand pose tracking and object reorientation modes, where user inputs change the object space orientation based on reference virtual objects, facilitating intuitive manipulation and alignment within the MR environment.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual re-editing of object space orientation and pivot point is performed in the creator modeling application, then the model's orientation can be corrected, but this requires repeated export and import operations and action by the author

Engineering Contradiction:

Improveorientation accuracyVSAvoidtime for repeated export-import operations

Core Design Contradiction:

Measurement precisionVSLoss of time

Solution Approach 1:

The patent introduces an intermediary system that automatically adjusts object space orientation and pivot point during the import process from creator applications to MR applications. This intermediary automatically corrects orientation mismatches without requiring manual intervention in the creator application, thereby eliminating repeated export-import cycles while maintaining accurate orientation.

Inventive Principle:

Principle #24Intermediary (Mediator)

Solution Approach 2:

The system performs preliminary automatic orientation correction during the import process itself, before the user needs to use the model in the MR application. By pre-adjusting the object space orientation and pivot point during import, the system eliminates the need for subsequent manual re-editing and repeated export-import operations.

Inventive Principle:

Principle #10Preliminary action

2Ease of operation

If default values or arbitrary component object orientations are used for complex virtual objects, then setup is automatic, but the object space orientation and pivot point may be incorrect from a user perspective

Engineering Contradiction:

Improveautomatic orientation setupVSAvoidorientation accuracy

Core Design Contradiction:

Ease of operationVSMeasurement precision

Solution Approach 1:

The system enables complex virtual objects to self-correct their object space orientation and pivot point automatically during import. By analyzing the component objects and their transformations, the system autonomously determines the correct orientation without requiring manual configuration, thereby maintaining both ease of operation and orientation accuracy.

Inventive Principle:

Principle #25Self-service

Solution Approach 2:

The system implements feedback mechanisms that evaluate the orientations of component objects within complex virtual objects and automatically adjust the overall object space orientation based on this evaluation. This feedback loop ensures that the resulting orientation is correct from a user perspective while maintaining automatic setup.

Inventive Principle:

Principle #23Feedback

3Measurement precision

If traditional desktop 3D application interfaces with mouse, keyboard, and menu operations are used, then precise control is possible, but these operations are difficult and inconvenient in MR environments with hand-operated motion controllers

Engineering Contradiction:

Improvecontrol precisionVSAvoidoperational convenience in MR

Core Design Contradiction:

Measurement precisionVSEase of operation

Solution Approach 1:

The patent replaces traditional mechanical input methods (mouse, keyboard, menu operations) with voice-based and gesture-based interfaces suitable for MR environments. Users can issue voice commands or perform hand gestures to control object orientation adjustments, maintaining precision while greatly improving ease of operation in MR contexts where physical keyboards and mice are unavailable.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS10928975B2On-the-fly adjustment of orientation of virtual objects

Publication Date: 2021.02.23 MICROSOFT TECHNOLOGY LICENSING LLC

AI summary

Techniques for interacting with a three-dimensional (3D) virtual environment including receiving a first user input for selecting a first virtual object; identifying, in response to the first user input, the first virtual object as a currently selected virtual object; receiving a second user input for activating an object reorientation mode; activating, in response to the second user input, an object reorientation mode; receiving a third user input indicating changes in pose of a hand; receiving, while the first virtual object has remained a currently selected virtual object the object reorientation mode has remained active, a fourth user input; identifying a first orientation of a reference virtual object; and changing, in response to receiving the fourth user input, an object space orientation of the first virtual object to having the first orientation from a different second orientation.