XR Hand Pose Gating for Peripheral Gesture Suppression

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing XR environments struggle with managing gesture recognition and input, particularly when peripheral devices are being used, leading to unintentional gesture inputs that can disrupt user interactions.

Innovation Solution

A system that determines whether a hand is in a peripheral use mode or gesture input mode by analyzing hand pose and gestures, suppressing unwanted inputs during peripheral use and confirming peripheral device presence using computer vision when necessary.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If continuous high-power object detection is used to confirm peripheral device presence, then measurement precision is improved, but use of energy increases

Engineering Contradiction:

Improveperipheral device presence detection accuracyVSAvoidcomputational power consumption

Core Design Contradiction:

Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The system implements periodic object detection only when hand pose analysis indicates potential peripheral interaction, rather than continuous detection. This conditional periodic activation reduces computational power consumption while maintaining accurate peripheral device presence detection when needed

Inventive Principle:

Principle #19Periodic action

Solution Approach 2:

The system performs preliminary low-power hand pose analysis to predict potential peripheral interactions before activating high-power object detection. This preliminary action filters cases where object detection is necessary, reducing overall energy consumption while maintaining measurement precision when actually needed

Inventive Principle:

Principle #10Preliminary action

2Ease of operation

If all hand movements are treated as gesture inputs, then ease of operation is improved, but object-generated harmful factors increase due to unintentional gestures

Engineering Contradiction:

Improvegesture input responsivenessVSAvoidunintentional gesture inputs

Core Design Contradiction:

Ease of operationVSObject-generated harmful factors

Solution Approach 1:

The system introduces hand pose analysis as an intermediary between raw hand movement detection and gesture recognition. This intermediary layer analyzes the nature of hand movements to distinguish between intentional gestures and peripheral device interactions, preventing unintentional gesture inputs while maintaining responsiveness to valid gestures

Inventive Principle:

Principle #24Intermediary (Mediator)

Solution Approach 2:

The system applies preliminary classification of hand movements to identify and suppress potential unintentional gestures before they are processed as valid input. This preliminary anti-action prevents harmful unintended gestures from disrupting user interactions

Inventive Principle:

Principle #9Preliminary anti-action

Data Source

PatentUS12481369B2Suppression of hand gestures upon detection of peripheral events on a peripheral device

Publication Date: 2025.11.25 APPLE INC

AI summary

Suppressing a hand gesture upon detecting peripheral events on a peripheral device includes determining a first hand pose for a first hand a second hand pose for a second hand in response to a detected peripheral device peripheral event, determining, based on the first hand pose and the second hand pose, at least one hand of the first hand and the second hand in a peripheral use mode, detecting an input gesture from a hand of the at least one hand determined to be in the peripheral use mode, and rejecting the input gesture by a user input pipeline in accordance with the determination that the hand is in the peripheral use mode. The presence of a peripheral device is confirmed by activating a computer vision system in response to determining that a peripheral use condition is satisfied.