3D Selection Space for VR Object Interaction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing object selection techniques in virtual and mixed reality environments are cumbersome and inefficient, requiring individual selection and interaction with multiple objects, which is time-consuming and burdensome.

Innovation Solution

A method using gaze tracking and movement tracking to create a 3D selection space by extending a shape defined by the user's input object movement and gaze, allowing multiple objects to be selected and interacted with within this space without individual processing, reducing processing power and time requirements.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If existing object selection techniques are used in virtual and mixed reality environments, then individual object selection and interaction can be achieved, but the process becomes time-consuming and computationally burdensome when multiple objects need to be selected

Engineering Contradiction:
Improveobject selection speedVSAvoidtime for selecting multiple objects
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The patent merges multiple individual object selection operations into a single batch selection operation. By detecting a starting action followed by movement of an input object through three-dimensional space to define a selection volume, the system simultaneously selects all objects within that volume, eliminating the need for sequential individual selections and dramatically improving selection efficiency

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent transitions from two-dimensional selection interfaces to three-dimensional spatial selection. By utilizing depth information and creating a volumetric selection space that extends through three-dimensional space, the system enables users to select multiple objects at once by moving the input object through space, adding a spatial dimension to the selection process that naturally groups multiple objects

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Ease of operation

If existing object selection techniques are used in virtual and mixed reality environments, then individual object interaction is possible, but processing requirements increase significantly when multiple objects must be processed individually

Engineering Contradiction:
Improveobject selection simplicityVSAvoidprocessing complexity for multiple objects
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent combines multiple individual object processing operations into a single batch processing operation. Once objects are selected within the defined volume, subsequent actions are applied to all selected objects simultaneously, reducing the computational complexity from processing each object individually to processing a grouped set of objects in one operation

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent creates a universal selection mechanism that can select any number of objects within the defined volume regardless of their individual properties or positions. This multi-functional selection approach simplifies the interface by providing a single method that works for selecting one object, multiple objects, or all objects in a region, eliminating the need for different selection methods for different scenarios

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS10268266B2Selection of objects in three-dimensional space
Publication Date: 2019.04.23 MICROSOFT TECHNOLOGY LICENSING LLC
  • US10268266B2 patent drawing
  • US10268266B2 patent drawing
  • US10268266B2 patent drawing

AI summary

A user may select or interact with objects in a scene using gaze tracking and movement tracking. In some examples, the scene may comprise a virtual reality scene or a mixed reality scene. A user may move an input object in an environment and be facing in a direction towards the movement of the input object. A computing device may use sensors to obtain movement data corresponding to the movement of the input object, and gaze tracking data including to a location of eyes of the user. One or more modules of the computing device may use the movement data and gaze tracking data to determine a three-dimensional selection space in the scene. In some examples, objects included in the three-dimensional selection space may be selected or otherwise interacted with.