3D Volume Rotation with Hand-Tracked Pinch Gestures in XR
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing XR systems lack an optimal input modality for rotating virtual objects without diverting user attention or requiring additional hardware, as touch-based or haptic devices are disruptive and limited in XR systems designed for immersion.
Innovation Solution
Implementing a pinch gesture-based method for rotating virtual objects using hand-tracking, where a user makes a pinch gesture near the object and moves their hand to control the rotation, leveraging hand-tracking data to determine the gesture's locations and orientations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If touch-based or haptic devices are used for rotating virtual objects, then rotation functionality is achieved, but user immersion is disrupted and system complexity increases
Solution Approach 1:
The patent replaces mechanical input devices (touch screens, haptic controllers) with a gesture-based control system that uses hand tracking and spatial positioning. Users rotate virtual objects by making a pinch gesture and moving their hand through space, eliminating the need for physical input devices and maintaining immersion in the XR environment.
Solution Approach 2:
The system introduces an intermediary gesture recognition layer between the user's physical hand movements and the virtual object manipulation. Hand tracking data is processed to detect pinch gestures, determine their spatial locations, and translate these into rotation commands, serving as a mediator that converts natural gestures into precise control actions.
2Device complexity
If hand-tracking with pinch gesture is used for rotating virtual objects, then user immersion is maintained and system complexity is reduced, but input precision and control accuracy may be compromised
Solution Approach 1:
The system continuously tracks hand position and gesture state in real-time, providing immediate visual feedback as the virtual object rotates in response to hand movements. This closed-loop feedback mechanism allows users to adjust their gestures for precise control, compensating for any initial imprecision in gesture detection.
Solution Approach 2:
The patent utilizes three-dimensional spatial positioning of the pinch gesture in addition to gesture detection. By incorporating the spatial location and movement trajectory of the hand in 3D space, the system gains additional dimensions of control precision, allowing accurate rotation even with simple gesture recognition.
Data Source
AI summary
An eXtended Reality (XR) system provides methodologies for rotating a virtual object in an XR user interface of the XR system. The methodologies include providing to a user an XR user interface of an XR system, where the XR user interface includes a virtual object displayed to the user. The XR system determines a first and second selection location of a pinch gesture being made by the user and rotates the virtual object using the first and second selection locations and an angle offset of the first selection location. The XR system redisplays the rotated virtual object to the user in the XR user interface.