Virtual Object Selection Gesture Grouping XR
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Selecting multiple virtual objects in an extended reality (XR) environment is tedious due to the effort required in manipulating virtual objects with gestures, leading to increased power consumption and heat generation in devices.
Innovation Solution
A method where a user can use a gesture to select a first virtual object, which is then used as a tool to select other virtual objects by moving them together within a threshold distance, reducing the need for separate gestures to create groups, thereby simplifying movements and reducing unnecessary user inputs.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If separate gestures are used to select each virtual object individually, then selection precision is maintained, but operational complexity increases and power consumption rises
Solution Approach 1:
The patent combines multiple selection operations into a single continuous gesture. When a user performs a drag gesture that passes near multiple virtual objects, the system automatically selects all objects within the threshold distance, merging what would traditionally require multiple separate selection gestures into one unified operation. This reduces the number of gesture recognition cycles and associated power consumption.
Solution Approach 2:
The drag gesture is given multi-functionality: it serves both as a selection tool and as a grouping mechanism. By moving a first virtual object near other objects, the system simultaneously selects the first object and automatically groups it with nearby objects, eliminating the need for separate selection and grouping operations.
2Productivity
If multiple separate gestures are performed to manipulate virtual objects, then precise control is achieved, but operational time increases
Solution Approach 1:
The system performs preliminary grouping actions automatically during the drag gesture execution. As the user drags the first virtual object, the system proactively identifies and groups nearby objects in real-time, rather than requiring the user to complete the gesture and then separately initiate grouping operations. This preliminary action reduces total operational time.
Solution Approach 2:
The selection and grouping operations occur continuously throughout the drag gesture duration. Instead of discrete separate operations, the system maintains continuous detection of nearby objects and continuously updates the selection group as the gesture progresses, maximizing the productivity of each moment of user interaction.
3Reliability
If traditional selection methods are used for multiple virtual objects, then selection accuracy is maintained, but device heat generation increases
Solution Approach 1:
The patent extracts the grouping function from the traditional separate selection process and integrates it into the primary drag gesture. By taking out the automatic grouping capability and embedding it within the gesture execution, the system maintains selection accuracy while reducing the computational overhead of multiple separate gesture processing cycles, thereby reducing heat generation.
Data Source
AI summary
Various implementations disclosed herein include devices, systems, and methods for selecting multiple virtual objects within an environment. In some implementations, a method includes receiving a first gesture associated with a first virtual object in an environment. A movement of the first virtual object in the environment within a threshold distance of a second virtual object in the environment is detected. In response to detecting the movement of the first virtual object in the environment within the threshold distance of the second virtual object in the environment, a concurrent movement of the first virtual object and the second virtual object is displayed in the environment based on the first gesture.