AR Virtual Object Manipulation Using Gesture-Locked Virtual Spheres
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In augmented reality environments, users face difficulties in selecting and interacting with virtual objects, particularly in re-positioning and rotating them, which hinders efficient and intuitive interaction.
Innovation Solution
An object interaction system that generates a virtual sphere within a virtual object to track user gestures, allowing the virtual object to be adjusted based on detected movement, enabling intuitive and efficient interaction by locking a pointer cursor or user extremity to the virtual sphere and updating its position and orientation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If traditional interaction methods are used in AR environments, then users can view virtual objects, but selecting and interacting with them (especially re-positioning and rotating) becomes difficult and non-intuitive
Solution Approach 1:
The patent introduces a virtual sphere as an intermediary object between the user and the virtual object. The virtual sphere acts as a mediator that translates user gestures into object manipulation commands, making the interaction more intuitive while managing system complexity through a standardized interaction framework
Solution Approach 2:
The patent replaces traditional mechanical or manual interaction methods with gesture-based recognition. By using image data and gesture detection algorithms, the system substitutes physical manipulation with visual-gestural commands, improving ease of operation in AR environments
2Ease of operation
If gesture recognition is implemented to improve interaction, then ease of operation improves, but system complexity and processing requirements increase
Solution Approach 1:
The virtual sphere serves multiple functions: it acts as a selection target, a gesture recognition reference frame, and a manipulation control interface. This multi-functionality reduces the need for separate systems for each interaction type, managing complexity while maintaining ease of operation
Data Source
AI summary
A method includes using at least one processor to receive image data including one or more virtual objects and determining a distance between a user extremity and the one or more virtual objects based on the image data. Further, the method includes detecting a first gesture of the user extremity based on the image data and generating a virtual sphere within a virtual object of the one or more virtual objects. The method also includes determining that the distance is less than a threshold, detecting movement of the user extremity based on the image data, and adjusting a position of the virtual object based on the movement of the user extremity.