XR Raycast Cursor Filtering for Pinch Jump Suppression
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Extended Reality (XR) systems face challenges in accurately determining user intent for precise targeting and selection in crowded virtual environments, particularly due to unintended jumps or jitter in raycast cursors caused by hand movement sensitivity and conflicting intentions between specifying a location and timing of selection.
Innovation Solution
Implementing a raycast and pinch user input modality with a filtering mechanism that separates the intentions of specifying an exact location and selecting an object, using a temporal filter to stabilize the raycast cursor position during a pinch gesture, and an asymmetric approach for entering and exiting the pinching state to avoid sudden jumps.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If hand tracking is used for raycast cursor control in XR environments, then user interaction capability is improved, but unintended jumps or jitter occur causing targeting precision to deteriorate
Solution Approach 1:
The system performs preliminary action by detecting the pinch gesture intent before it is fully executed. When the system detects that a user is performing a pinch gesture, it preemptively stabilizes the raycast cursor position to prevent unintended jumps or jitter, thereby maintaining targeting precision while preserving ease of operation
Solution Approach 2:
The system introduces an intermediary stabilization mechanism between hand tracking input and raycast cursor output. This intermediary detects pinch gestures and applies conditional stabilization to the cursor position, filtering out unwanted jitter while maintaining the user's intended interaction capability
2Measurement precision
If hand movement sensitivity is increased for precise location specification, then targeting accuracy is improved, but unintended cursor jumps increase causing selection reliability to worsen
Solution Approach 1:
The system changes the parameter of cursor stabilization dynamically based on detected hand gestures. When a pinch gesture is detected, the system applies a different stabilization parameter (enhanced stability) compared to normal hand movement, thereby maintaining location specification accuracy while preventing unintended cursor jumps that would compromise selection reliability
3Stability of the object's composition
If temporal filtering is applied to stabilize raycast cursor during pinch gesture, then cursor stability is improved, but response time to hand movement deteriorates
Solution Approach 1:
The system applies periodic action by implementing time-limited temporal filtering. The stabilization filter is activated only during the brief period when a pinch gesture is detected, rather than continuously. This periodic application of filtering maintains cursor stability during the critical selection moment while minimizing the loss of response time during normal interaction
Data Source
AI summary
An extended Reality (XR) system is provided that provides filtering for a raycast cursor. The XR system provides an XR user interface to a user, the XR user interface includes a raycast and pinch user input modality having a raycast cursor. While continuously capturing, using one or more sensors of the XR system, tracking data of a hand of a user, the XR system determines a pinch intention intensity using the tracking data, and in response to determining the pinch intention intensity meets or exceeds an enter pinching state value, activates a raycast cursor filter applied to a position of the raycast cursor of the raycast and pinch user input modality.