Virtual Joystick Control for Distant AR/VR Object Manipulation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented and virtual reality systems lack effective interaction techniques for manipulating virtual objects beyond arm's reach without the need for physical controllers.
Innovation Solution
A virtual joystick system that utilizes hand gestures to create a vector-based control mechanism, allowing users to manipulate virtual objects over unlimited distances by translating hand movements into vectors.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If traditional input devices like mice and keyboards are used for AR/VR, then the system structure remains simple, but the ease of operation deteriorates because these devices are not well suited for AR/VR uses
Solution Approach 1:
The patent replaces physical input devices (mice, keyboards, controllers) with a virtual joystick implemented as software in the AR/VR environment. Users interact with virtual objects through hand gestures that are translated into virtual joystick movements, eliminating the need for external physical controllers and providing more natural interaction suited to AR/VR contexts.
2Ease of operation
If direct hand mapping to virtual hands is used, then the ease of operation improves for nearby objects, but the adaptability deteriorates because virtual objects are constrained to being within arm's reach
Solution Approach 1:
The patent introduces a virtual joystick as an intermediary tool between the user's hand and distant virtual objects. The virtual joystick acts as a mediator that translates hand gestures into scaled virtual movements, allowing users to manipulate objects beyond arm's reach while maintaining intuitive gesture-based control.
Solution Approach 2:
The patent extends the interaction space by creating a virtual dimension through the virtual joystick. Hand movements in the user's physical space are mapped to a virtual coordinate system that can reach objects at any distance, effectively adding a dimensional transformation that removes the arm's reach constraint.
3Adaptability or versatility
If a virtual joystick system is implemented, then the adaptability improves by enabling manipulation beyond arm's reach, but the device complexity worsens due to the need for gesture recognition and vector calculation systems
Solution Approach 1:
The patent makes the AR/VR system itself multi-functional by integrating gesture recognition, virtual joystick creation, and object manipulation capabilities into a single unified system. The system can switch between different interaction modes (direct manipulation, virtual joystick control) depending on the user's needs, reducing the requirement for separate specialized devices.
Data Source
AI summary
Systems and methods are provided. For example, a method includes determining a position of a user's hand and identifying a manipulation gesture performed by the user targeting a virtual object. The method also includes determining a three-dimensional (3D) origin point based on the position of the user's hand when the manipulation gesture is performed, and determining a 3D end point based on a movement of the user's hand from the origin point. The method additionally includes deriving a 3D vector based on the 3D origin point and the 3D end point, and applying an action to the targeted virtual object based on the 3D vector, wherein the targeted virtual object is at a distance greater than the user's arm reach.