Pointing Device Gesture Selection for XR Virtual Objects
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing computer graphics editors lack intuitive methods for selecting and manipulating virtual objects in extended reality environments, particularly using pointing devices like styluses.
Innovation Solution
The system uses a pointing device to select virtual objects based on its orientation in physical space, allowing for different types of manipulations (e.g., movement, rotation) based on specific selection inputs, and visually indicates selection through changes in object characteristics.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If traditional input methods (keyboard, mouse) are used in graphics editors, then device complexity is low, but ease of operation for manipulating virtual objects in XR environments deteriorates
Solution Approach 1:
A pointing device serves as an intermediary between the user and virtual objects in the XR environment. The device translates physical gestures and orientations into digital commands, enabling intuitive manipulation of virtual objects without requiring complex keyboard shortcuts or mouse operations. This intermediary layer bridges the gap between physical intuition and digital interaction.
Solution Approach 2:
The patent replaces traditional mechanical input systems (keyboard, mouse) with a gesture-based pointing device that operates through natural physical movements. The mechanical system of pressing keys or moving a mouse cursor is substituted with spatial gestures, orientation changes, and pointing actions that more naturally map to three-dimensional virtual object manipulation.
2Adaptability or versatility
If multiple input methods are provided for selecting virtual objects, then adaptability is improved, but device complexity increases
Solution Approach 1:
The pointing device employs dynamic selection criteria that adapt based on the user's action state. When the user is merely pointing, one set of selection rules applies; when the user performs a tapping gesture, different selection rules activate. This dynamic adaptation allows the system to handle multiple interaction modes without requiring separate input devices for each mode.
Solution Approach 2:
The pointing device is designed to perform multiple functions through a single unified interface. It can select virtual objects, manipulate their properties, and trigger actions all through the same device using different gesture types. This multi-functionality eliminates the need for separate specialized input devices while maintaining adaptability across different interaction scenarios.
3Ease of operation
If visual feedback is provided for object selection, then ease of operation is improved, but use of energy increases
Solution Approach 1:
Visual feedback is provided periodically rather than continuously. The system updates the visual state of virtual objects at discrete intervals corresponding to user actions or system events, rather than maintaining constant visual rendering of selection states. This periodic update approach reduces energy consumption while still providing sufficient feedback for effective operation.
Data Source
AI summary
An extended reality environment includes one or more virtual objects. A virtual object can be selected for manipulation by orienting a pointing device towards the virtual object and performing a selection input. In some embodiments, if the selection input is a first type of selection gesture received at the pointing device, the virtual object is selected for movement operations. In some embodiments, if the selection input is a second type of selection gesture received at the pointing device, the virtual object is selected for rotation operations. While the virtual object is selected for movement or rotation operations, the virtual object moves or rotates in accordance with the movement or rotation of the user's hand, respectively. In some embodiments, the virtual object has a first visual characteristic when the pointing device is pointing towards the virtual object and has a second visual characteristic when the virtual object is selected.