Velocity-Based Virtual Control Triggering in Mixed Reality

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing mixed reality systems face inaccuracies in attaching virtual controls to physical surfaces due to errors in surface analysis, leading to incorrect collision detection and user expectation mismatches, particularly for controls displayed as attached to surfaces.

Innovation Solution

A velocity-based selection condition is introduced, where virtual controls are triggered based on the velocity of a user digit decreasing below a threshold relative to the physical surface, considering positional and directional aspects, to align with user perceptions and reduce uncertainty in control attachment.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If collision detection is used to trigger virtual controls, then the control can be activated when the hand reaches the control location, but the inaccurate attachment of virtual controls to physical surfaces causes incorrect collision detection and user expectation mismatches

Engineering Contradiction:

Improvecontrol triggering accuracyVSAvoiduser expectation alignment

Core Design Contradiction:

Measurement precisionVSReliability

Solution Approach 1:

The patent changes the triggering parameter from spatial position (collision detection) to temporal velocity (deceleration detection). By monitoring the velocity of the hand and detecting when it decelerates below a threshold, the system triggers controls based on user motion patterns rather than precise spatial attachment, resolving the contradiction between measurement precision and reliability

Inventive Principle:

Principle #35Parameter changes

Solution Approach 2:

The system performs preliminary velocity analysis and deceleration detection before the hand reaches the control location. By identifying the deceleration event in advance, the system can trigger the control at the appropriate moment even when the exact attachment position is uncertain, improving both accuracy and user expectation alignment

Inventive Principle:

Principle #10Preliminary action

2Stability of the object's composition

If virtual controls are attached to physical surfaces, then they appear anchored and stable, but surface analysis errors cause incorrect attachment locations

Engineering Contradiction:

Improvecontrol attachment stabilityVSAvoidattachment location accuracy

Core Design Contradiction:

Stability of the object's compositionVSManufacturing precision

Solution Approach 1:

The patent introduces velocity-based deceleration detection as an intermediary mechanism between the hand and the virtual control. Instead of directly relying on precise spatial attachment, the system uses motion pattern analysis as a mediator to trigger controls, allowing stable attachment appearance without requiring precise location accuracy

Inventive Principle:

Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces the mechanical collision detection system with a velocity-based temporal detection system. By substituting spatial mechanics with temporal motion analysis, the system maintains stable control attachment while eliminating the need for precise location accuracy

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS11423585B2Velocity-based controls

Publication Date: 2022.08.23 MICROSOFT TECHNOLOGY LICENSING LLC

AI summary

Examples that relate to virtual controls in a mixed reality experience are described. One example provides a method comprising, via a mixed reality display device, displaying mixed reality content including a representation of a virtual control, and receiving sensor data indicating motion of a user digit. The method further comprises, based at least in part on the sensor data, determining a velocity of the user digit, and responsive to determining that the velocity of the user digit relative to a surface corresponding to the virtual control satisfies a velocity-based selection condition, triggering the virtual control.