Hand Gesture Navigation for Low-Complexity Virtual Object Interaction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for interacting with virtual objects in augmented reality environments are cumbersome, inefficient, and create a significant cognitive burden on users, often requiring complex inputs and leading to errors, thereby wasting energy in battery-operated devices.

Innovation Solution

Improved methods and interfaces for interacting with virtual objects using hand gestures, including hand-worn devices that detect hand inputs and navigate content based on hand clenched or rotated states, and virtual objects that respond to specific input types without requiring precise location activation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If conventional input devices (controllers, joysticks, touch-sensitive surfaces) are used to interact with virtual objects, then control capability is provided, but the interaction becomes complex and tedious

Engineering Contradiction:
Improveinteraction simplicityVSAvoidinput complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent replaces physical input devices (controllers, joysticks, touch surfaces) with hand gesture recognition. The hand-worn device detects gestures in three-dimensional space, substituting mechanical interaction with natural hand movements. This eliminates the need for complex physical interfaces while maintaining control capability over virtual objects.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces a hand-worn device as an intermediary between the user and the virtual environment. This device captures hand gestures and translates them into commands for virtual object manipulation, serving as a natural mediator that bridges physical hand movements and digital interactions without requiring complex input device operation.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If precise location activation is required for virtual object interaction, then control precision is improved, but input complexity and error rate increase

Engineering Contradiction:
Improveactivation precisionVSAvoidinput ease
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent moves interaction from two-dimensional screen space to three-dimensional physical space. Hand gestures are detected in 3D space around the user, allowing natural hand movements to directly correspond to virtual object manipulation without requiring precise positioning on a flat touch surface. This dimensional transition simplifies the interaction while maintaining precision.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Adaptability or versatility

If complex input sequences are required to achieve desired outcomes, then control capability is enhanced, but time consumption and energy usage increase

Engineering Contradiction:
Improvecontrol capabilityVSAvoidinteraction time
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The hand-worn device continuously tracks hand position and gesture state in real-time, preparing for potential interactions without requiring activation sequences. The system is ready to respond to gestures immediately, eliminating the need for preliminary input steps or activation sequences that would consume time and energy.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent enables continuous gesture recognition and response, where hand movements are constantly monitored and translated into virtual object manipulation. This continuous action eliminates interruptions and sequential input requirements, allowing smooth, uninterrupted interaction that reduces both time consumption and energy usage compared to discrete input sequences.

Inventive Principle:
Principle #20Continuity of useful action

Data Source

PatentUS12579758B2Devices, methods, and graphical user interfaces for interacting with virtual objects using hand gestures
Publication Date: 2026.03.17 APPLE INC
  • US12579758B2 patent drawing
  • US12579758B2 patent drawing
  • US12579758B2 patent drawing

AI summary

The present disclosure generally relates to interacting with virtual objects using hand gestures. In some embodiments, methods and user interfaces for navigating content using hand gestures are described. In some embodiments, methods and user interfaces for using hand gestures to perform various operations are described. In some embodiments, methods and user interfaces for activating virtual objects are described. In some embodiments, methods and user interfaces for displaying information is described. In some embodiments, methods and user interfaces for manipulating the display of virtual objects is described.