Mixed Reality Distance Thresholds for Precise Virtual Control Engagement

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing mixed reality (MR) and augmented reality (AR) systems face challenges in providing precise interactions with virtual media content items due to imprecise thresholds for determining when a control indicator, such as a finger or wand, engages with VR interactive controls, leading to user dissatisfaction.

Innovation Solution

The system reduces the threshold for determining engagement by using contact information with a real surface, updating distance equations with compensation variables to account for alignment errors, and accurately determining the position of the control extremity, thereby enhancing the precision of VR interactive control engagement.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a standard threshold distance is used to determine engagement between control indicator and VR interactive control, then the system is simple to operate, but the interaction precision is insufficient leading to user dissatisfaction

Engineering Contradiction:
Improveengagement detection precisionVSAvoiddistance determination complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent dynamically adjusts the threshold distance parameter based on the detected real surface position. By changing the engagement threshold from a fixed value to a variable that adapts to the actual surface location, the system achieves precise engagement detection without requiring complex additional hardware. The threshold is modified using compensation variables that account for alignment errors between the real and virtual surfaces.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent replaces complex mechanical alignment systems with computational methods. Instead of using precise mechanical positioning to ensure alignment between real and virtual surfaces, the system uses image processing, coordinate transformation, and mathematical compensation to achieve sub-pixel level alignment accuracy. This substitution of mechanical systems with computational approaches reduces physical complexity while improving precision.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If alignment errors between real and virtual surfaces are not compensated, then the system is simpler, but the interaction accuracy deteriorates

Engineering Contradiction:
Improvesurface alignment accuracyVSAvoidalignment compensation complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent implements a feedback mechanism where the system continuously detects the real surface position using image processing, calculates the alignment error between real and virtual surfaces, and adjusts the virtual surface position accordingly. This closed-loop feedback system uses compensation variables that are updated based on detected deviations, ensuring sustained alignment accuracy throughout interaction sessions.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent performs preliminary detection and compensation of surface alignment errors before the user interaction begins. By pre-calculating compensation variables based on initial surface detection and establishing the corrected coordinate transformation beforehand, the system eliminates alignment issues proactively rather than reactively during interaction.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If the threshold for control engagement is reduced, then the interaction precision is improved, but the system becomes more sensitive to alignment errors

Engineering Contradiction:
Improvecontrol engagement precisionVSAvoidalignment error sensitivity
Core Design Contradiction:
Measurement precisionVSObject-affected harmful factors

Solution Approach 1:

The patent applies preliminary anti-action by pre-compensating for alignment errors before they can affect the reduced threshold engagement detection. The system calculates compensation variables that counteract expected alignment deviations, and applies these corrections to the virtual surface position and engagement threshold calculations, thereby neutralizing the harmful effect of alignment errors on precision.

Inventive Principle:
Principle #9Preliminary anti-action

Data Source

PatentUS12443270B2Distance determination for mixed reality interaction
Publication Date: 2025.10.14 SNAP INC
  • US12443270B2 patent drawing
  • US12443270B2 patent drawing
  • US12443270B2 patent drawing

AI summary

Systems, methods, and computer readable media that determines distances for mixed reality interaction, where the methods include determining a first position of a point of a surface and rendering a virtual reality (VR) interactive item comprising a VR interactive control. The methods further include tracking a control indicator controlled by the user by determining a first plurality of positions of the control indicator and activating the VR interactive control in response to detecting the control indicator controlled by the user transgressing a first threshold distance from the VR interactive control. The methods further include determining a closest position of the first plurality of positions to the point based on the first position, determining the point of the surface to have a second position based on the determined closest position plus a constant for the control indicator, and associating a second threshold with the point of the surface.