3D Virtual Object Selection With Head-and-Hand Input Switching
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing VR, AR, and MR technologies face challenges in providing a comfortable and precise interaction with virtual objects in three-dimensional space, often leading to user fatigue due to the difficulty in controlling head poses for selection and the need for precise movements.
Innovation Solution
A wearable system that switches between user input modes based on user pose and input device interactions, allowing preliminary object identification through head poses and precise selection using hand gestures, and adjusts input modes based on contextual information and object characteristics.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If head pose control is used for object selection in VR/AR/MR, then the system can identify target objects in three-dimensional space, but user fatigue increases due to the difficulty of controlling head poses for precise selection
Solution Approach 1:
The patent divides the object selection process into two distinct phases: a coarse selection phase using head pose to identify a target object group, and a fine selection phase using hand gestures to select the specific target object. This segmentation allows each input method to operate in its optimal range, reducing overall user fatigue while maintaining selection precision.
Solution Approach 2:
The system dynamically switches between different input modes (head pose control and hand gesture control) based on the selection stage. The wearable device detects whether the user is in the coarse or fine selection phase and automatically adjusts the accepted input type, optimizing the interaction flow and reducing the cognitive and physical burden on the user.
2Measurement precision
If precise hand gestures are required for object selection, then selection accuracy improves, but user fatigue increases due to the need for precise movements
Solution Approach 1:
The patent separates the selection task into coarse selection (head pose) and fine selection (hand gestures). By limiting the duration and precision requirements of hand gesture usage to only the final selection moment, the system maintains accuracy while minimizing the physical effort required compared to continuous precise hand control.
Solution Approach 2:
Head pose control acts as an intermediary that narrows down the selection scope before hand gestures are applied. This intermediary step reduces the search space for hand gestures, making the required precise movements less demanding since the user only needs to select from a pre-filtered group of objects rather than the entire scene.
3Adaptability or versatility
If the system supports multiple input modes for different contexts, then adaptability improves, but device complexity increases
Solution Approach 1:
The wearable device is designed with multi-functionality to support both head pose tracking and hand gesture recognition within a single unified system. By integrating multiple input modalities into one device rather than requiring separate systems, the patent achieves adaptability while managing complexity through consolidation.
Solution Approach 2:
The system implements dynamic mode switching that automatically adapts the accepted input type based on the current interaction context. This dynamic behavior allows the system to support multiple input modes without requiring complex manual configuration or mode selection interfaces, as the system autonomously determines the appropriate mode based on operational state.
Data Source
AI summary
Systems and methods for interacting with virtual objects in a three-dimensional space using a wearable system are disclosed. The wearable system can be programmed to permit user interaction with interactable objects in a field of regard (FOR) of a user. The FOR includes a portion of the environment around the user that is capable of being perceived by the user via the AR system. The system can determine a group of interactable objects in the FOR of the user and determine a pose of the user. The system can update, based on a change in the pose or a field of view (FOV) of the user, a subgroup of the interactable objects that are located in the FOV of the user and receive a selection of a target interactable object from the subgroup of interactable objects. The system can initiate a selection event on the target interactable object.