User-Centric Gesture Mapping for Accurate XR 2D Input
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing XR environments face challenges in accurately mapping user motions to user interfaces due to artifacts such as accidental inputs and unintentional directional movements, particularly when translating arc-based hand motions from a spherical coordinate system to a 2D coordinate system.
Innovation Solution
The technique involves tracking hand motion in a spherical coordinate system and translating it to a 2D user interface plane by determining an origin based on user joints, such as the shoulder, elbow, or wrist, and decomposing the biomechanical chain of arm movements to accurately reflect user intent through vector calculations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If hand motion is tracked in a spherical coordinate system and translated to a 2D user interface plane, then the mapping of user motions to intended inputs is improved, but artifacts such as accidental inputs and unintentional directional movements occur
Solution Approach 1:
The patent segments the continuous spherical coordinate system into discrete angular components (azimuth and elevation angles) that can be independently mapped to 2D plane coordinates. This segmentation allows for controlled transformation while maintaining accuracy and reducing artifacts by treating each angular dimension separately rather than as a continuous 3D vector.
Solution Approach 2:
The patent transforms the 3D spherical coordinate system into a 2D planar coordinate system by projecting angular measurements onto a flat interface. This dimensionality reduction is achieved through mathematical projection that preserves the essential directional information while eliminating the depth component, thereby resolving the contradiction between maintaining 3D motion accuracy and producing clean 2D interface input.
2Measurement precision
If the origin is determined based on user joints such as shoulder, elbow, or wrist, then the mapping accuracy is improved, but the system complexity increases due to biomechanical chain decomposition
Solution Approach 1:
The patent segments the arm's biomechanical chain into discrete joint components (shoulder, elbow, wrist) and assigns potential origin points at each segment. This segmentation allows the system to evaluate and select the most appropriate origin based on the specific gesture being performed, improving accuracy without requiring complex simultaneous analysis of all joints.
Solution Approach 2:
The patent implements a dynamic origin selection mechanism that adapts the coordinate system origin based on the user's current pose and gesture type. Rather than using a fixed origin, the system dynamically determines the optimal origin point among the joint locations, allowing the mapping accuracy to be optimized for each specific interaction context while keeping the overall system manageable through predefined joint candidates.
Data Source
AI summary
A movement of a user input component is presented in accordance with a mapping of a user input motion from a user-centric spherical coordinate system to a 2D plane. An input motion by a user is detected. An origin for the input motion is identified in a user-centric spherical coordinate system. An arc length for the input motion is determined based on the identified origin. The input motion is mapped from the user-centric spherical coordinate system to a 2D plane of a user input component, and a movement of the user input component is presented on the 2D plane in accordance with the mapping.