XR Virtual Trackpad for Controller-Free Hand Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current XR user interfaces, such as those in virtual reality, augmented reality, and mixed reality devices, often rely on hand tracking for control but lack physical feedback, leading to uncomfortable and ineffective user experiences.
Innovation Solution
Projecting a virtual trackpad on a user's hand using hand tracking position data from an XR device, allowing users to control the interface with finger movements and receive physical feedback.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If hand tracking is used to control XR interfaces, then the device can operate without physical controllers, but users lack physical feedback making the experience uncomfortable and ineffective
Solution Approach 1:
A virtual trackpad is projected onto the user's hand to serve as an intermediary interface. The trackpad provides a tactile reference surface that mediates between the user's finger movements and the virtual environment, enabling controller-free operation while maintaining ease of use through visual and spatial feedback on the hand surface.
Solution Approach 2:
The system creates a virtual copy of a physical trackpad surface that appears on the user's hand. This copied interface element provides familiar interaction patterns from physical devices, allowing users to perform scrolling, clicking, and navigation gestures with their fingers while receiving visual feedback from the projected interface elements.
2Extent of automation
If hand gestures are tracked for UI control, then the system can provide contactless interaction, but the lack of physical feedback reduces precision and user comfort
Solution Approach 1:
The virtual trackpad provides immediate visual feedback as users perform gestures. Cursor movement, selection highlights, and other interface responses are displayed directly on the hand surface, allowing users to precisely control their gestures and achieve desired outcomes with higher accuracy in a contactless manner.
Data Source
AI summary
A virtual trackpad and method for using the same are disclosed. In some embodiments, the method comprises: projecting a virtual trackpad on one hand of a user using hand tracking position data from an extend reality (XR) device; detecting, via hand tracking, movements of one or more fingers as the one or more fingers are being moved across the virtual trackpad projected on the one hand; and controlling a user interface (UI) being displayed on a display by the XR device based on the movements of the one or more fingers.