Hand-Located XR Interface for Touch-Precise Controller-Free Input
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional interaction methods in extended reality (XR) systems, such as physical controllers and imprecise gesture recognition, disrupt the seamless integration of real and virtual elements, leading to a less intuitive user experience, particularly in environments where users need to interact with digital content while being aware of their physical surroundings, and can increase cognitive load.
Innovation Solution
A hand-located user interface integrated onto the user's palm or back of the hand, leveraging natural proprioceptive abilities to facilitate intuitive interactions without visual confirmation, using sensors to track hand movements and detect touch inputs on predefined locations on the hand.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If traditional physical controllers are used in XR systems, then interaction control is provided, but device complexity increases and ease of operation decreases
Solution Approach 1:
The patent extracts the user interface from traditional physical controllers and relocates it directly onto the user's hand surface. By taking out the UI elements from separate devices and embedding them on the hand, the system eliminates the need for additional controllers while maintaining interaction capabilities, thus reducing device complexity and improving ease of operation.
Solution Approach 2:
The patent introduces the user's hand as an intermediary interface between the user and the XR system. Instead of requiring separate physical controllers, the hand itself becomes the mediator for interaction, with virtual UI elements projected onto the hand surface to capture touch inputs directly from the user's natural hand movements.
2Ease of operation
If gesture recognition is used for hand-located interfaces, then interaction capability is provided, but measurement precision decreases leading to accidental activations
Solution Approach 1:
The patent replaces traditional mechanical gesture recognition systems with a direct touch detection system. Instead of using complex algorithms to interpret hand gestures in 3D space, the system projects virtual UI elements onto the hand surface and directly detects touch inputs through sensors that sense contact on the hand, providing more precise and reliable interaction data.
Solution Approach 2:
The patent creates a virtual copy of the hand surface where UI elements are projected. This virtual hand surface serves as an accurate replica that mirrors the user's actual hand movements and touch inputs, allowing for precise measurement and control without the ambiguities of traditional gesture recognition.
3Measurement precision
If visual confirmation is required for interactions, then accuracy is improved, but cognitive load increases and productivity decreases
Solution Approach 1:
The patent enables the system to serve itself by automatically detecting and interpreting touch inputs on the virtual hand surface without requiring visual confirmation from the user. The system self-validates interactions through direct sensor feedback from the hand surface, eliminating the need for users to visually confirm actions and reducing cognitive load while maintaining accuracy.
Data Source
AI summary
An extended Reality (XR) system that provides a hand-located XR user interface to a user. The XR system captures tracking data of a user's hands using one or more sensors. The XR system uses the tracking data to generate the hand-located XR user interface that includes one or more interactive virtual objects associated with one or more locations on a surface of the first hand of the user which the user can interact with using a digit of a second hand. Upon detecting a hand touch of the surface of the first hand by a digit of the second hand, the XR system executes a function or process associated with an interactive virtual object associated with the location of the hand touch. The hand-located XR user interface can be provided within or outside of a field of view of an optical element that provides images of the interactive virtual objects.