Hand Tracking Wrist Rotation Scroll Sensitivity

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing hand-based input systems for extended reality (XR) environments suffer from poor scroll sensitivity due to inadequate interpretation of wrist rotation versus arm movements.

Innovation Solution

The system tracks hand motion and interprets it as a scroll by determining scroll momentum, distinguishing between wrist rotation and arm movement, and adjusting sensitivity accordingly, using a device with sensors to obtain positional data for two points on the hand.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If hand-based input systems track hand motion relative to user's body for 3D object motion, then the system can provide three-dimensional interaction capability, but the scroll sensitivity deteriorates due to poor interpretation of wrist rotation versus arm movements

Engineering Contradiction:
Improve3D interaction capabilityVSAvoidscroll sensitivity
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The system segments hand motion into two distinct components: wrist rotation (local motion) and arm movement (global motion). By tracking two points on the hand (wrist joint and pinch centroid) and analyzing their relative movements, the system can differentiate between scrolling gestures (wrist rotation) and navigation gestures (arm movement), thereby improving scroll sensitivity while maintaining 3D interaction capability

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system introduces an intermediary analysis layer that processes the motion data between the sensors and the final gesture interpretation. This intermediary layer calculates the contribution of wrist rotation versus arm movement to the overall hand motion, enabling accurate differentiation of gesture types and improving scroll detection precision without sacrificing 3D interaction versatility

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS20250036206A1Hand tracking based on wrist rotation and arm movement
Publication Date: 2025.01.30 APPLE INC
  • US20250036206A1 patent drawing
  • US20250036206A1 patent drawing
  • US20250036206A1 patent drawing

AI summary

Various implementations track hand motion to interpret a scroll movement. For example, an example process may include obtaining sensor data associated with a hand via one or more sensors in a physical environment. The process may further include determining positional data corresponding to three-dimensional (3D) positions of two points on the hand based on the sensor data. The process may further include determining whether a movement of the hand includes a wrist rotation associated with the hand rotating about the wrist, an arm motion associated with movement of the arm, or a combination of the wrist rotation and the arm motion. The process may further include determining the movement of the hand as a user interaction event based on the positional data and whether the movement of the hand includes the wrist rotation, the arm motion, or a combination of the wrist rotation and the arm motion.