Hand-Located XR Labels with Dynamic View-Oriented Alignment
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing XR systems face challenges in user interaction due to static interfaces that do not align with individual ergonomic needs and fail to dynamically adapt to user hand size and orientation, leading to a less intuitive and cumbersome experience.
Innovation Solution
A dynamic and user-responsive interface system that adjusts interface elements in real-time based on hand and head tracking, ensuring ergonomic optimization and alignment with the user's viewpoint, incorporating methods for resizing and orienting interface labels and icons.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If static interface elements are used in XR systems, then device complexity is reduced, but ease of operation deteriorates due to misalignment with user ergonomic needs
Solution Approach 1:
The patent implements dynamic interface elements that automatically adjust their size, position, and orientation based on real-time tracking of user hand pose and head viewpoint. This allows the interface to adapt to individual ergonomic needs without requiring manual configuration, resolving the contradiction between operational ease and system complexity by making the adaptation automatic rather than manual.
Solution Approach 2:
The system continuously monitors user hand pose and head orientation through tracking sensors and uses this feedback to dynamically adjust interface element properties. This closed-loop feedback mechanism enables the interface to maintain optimal alignment with user ergonomics in real-time, improving ease of operation while managing complexity through automated adjustment algorithms.
2Adaptability or versatility
If static interface elements are used, then device complexity is reduced, but adaptability deteriorates due to inability to adjust to individual user needs
Solution Approach 1:
The interface elements transition from static to dynamic, automatically adjusting their properties based on tracked user hand pose and head viewpoint. This enables the system to adapt to individual user ergonomics and viewing angles in real-time, achieving high adaptability through automated dynamic adjustment rather than complex manual configuration systems.
Solution Approach 2:
The system performs self-adjustment of interface elements based on automatic tracking of user pose and viewpoint, without requiring manual intervention or complex setup procedures. This self-service capability enables adaptability to individual users while managing system complexity through automated algorithms that continuously optimize interface presentation.
3Ease of operation
If dynamic adjustment of interface elements is implemented, then ease of operation is improved, but loss of time increases due to real-time processing requirements
Solution Approach 1:
The system performs continuous tracking of user hand pose and head viewpoint, maintaining constant updates to interface element positions and orientations. This continuous operation eliminates the need for periodic recalibration or manual adjustment, ensuring the interface remains optimally aligned throughout use while distributing processing load continuously rather than in intensive bursts.
Solution Approach 2:
The system proactively adjusts interface elements based on predicted user needs derived from current pose and viewpoint data, rather than waiting for explicit user requests or mismatches to occur. This preliminary adjustment keeps the interface continuously optimized, reducing the time users would otherwise spend correcting misalignment or searching for interface elements.
Data Source
AI summary
An extended Reality (XR) system is provided that enhances user interaction within XR environments. The XR system captures tracking data using one or more sensors, including hand tracking data of a user's hand and pose data of the XR system itself. By continuously capturing this data, the XR system dynamically generates a hand-located user interface that includes interactive virtual objects associated with specific locations on the surface of the user's hand. Additionally, the XR system generates labels for the interactive virtual objects that are dynamically oriented toward the user as the user moves their hands and head when interacting with an XR environment.