Hand Chirality Estimation Using Joint Angles for XR Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing XR devices face challenges in accurately and efficiently estimating hand chirality due to the variability in hand shapes, sizes, and movements, leading to potential errors and computational inefficiencies that disrupt immersive experiences.
Innovation Solution
XR devices process tracking data to determine multiple bending angles around a geometrically defined reference vector, without relying on machine learning models, to estimate hand chirality, combining this with a rules-based approach for enhanced accuracy and reduced computational load.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If machine learning models are used to estimate hand chirality, then adaptability to various hand shapes and movements is improved, but computational load and processing time increase
Solution Approach 1:
The patent replaces machine learning models (complex computational system) with a rules-based geometric analysis system. The system uses defined geometric relationships between hand landmarks and bending angle calculations to determine chirality, substituting the mechanical/algorithmic ML approach with a deterministic geometric method that maintains adaptability while reducing computational complexity.
Solution Approach 2:
The patent changes the approach from learning-based parameter adaptation to fixed geometric parameter relationships. By defining specific geometric relationships between hand landmarks and using predetermined bending angle calculations, the system maintains adaptability to different hand configurations without requiring complex model training and inference.
2Measurement precision
If complex tracking algorithms are used to improve hand chirality estimation accuracy, then measurement precision is improved, but processing speed decreases
Solution Approach 1:
The patent segments the hand tracking problem into distinct geometric components: identifying specific hand landmarks, calculating vectors between landmarks, determining bending angles relative to reference vectors, and applying chirality determination rules. This segmentation allows each component to be processed efficiently with simple geometric operations rather than complex unified algorithms.
Solution Approach 2:
The patent substitutes complex iterative optimization algorithms with direct geometric calculations. By using closed-form solutions for vector calculations and bending angle determinations based on predefined geometric relationships, the system achieves high measurement precision without the computational overhead of complex iterative processing.
3Reliability
If multiple hand landmarks are processed to improve chirality detection, then reliability is improved, but device complexity increases
Solution Approach 1:
The patent creates a universal geometric framework that processes multiple hand landmarks using the same bending angle calculation methodology. The reference vector and bending angle approach serves multiple functions: determining chirality, verifying hand configuration, and maintaining consistency across different hand poses, thereby improving reliability without proportionally increasing system complexity.
Data Source
AI summary
Examples in the present disclosure relate to hand chirality estimation. Tracking data captured by one or more sensors associated with an extended reality (XR) device is processed to determine positions of a plurality of joints of a hand of a person. A reference vector is generated based on a first subset of the positions. The first subset of the positions includes positions of at least two metacarpophalangeal joints. A plurality of bending angles is determined based on at least a second subset of the positions. Each bending angle represents an angle between a respective pair of articulating bones that is measured in relation to the reference vector. An estimated chirality of the hand is identified based on the plurality of bending angles. Operation of the XR device is controlled using the estimated chirality of the hand.