Virtual Hand Controller for VR Avatar Locomotion Without Hardware
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing virtual reality systems require players to put down controllers for locomotion, leading to cumbersome experiences and impaired immersion due to the need to re-detect and re-map controllers, especially when transitioning from conversation to movement.
Innovation Solution
A mechanism allowing players to control avatar locomotion through hand and finger tracking, enabling the instantiation of virtual controllers using gestures without physical controllers, and maintaining controller position relative to the avatar through transforms.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If physical controllers are used for locomotion control, then precise control input is achieved, but player immersion is impaired and operation becomes cumbersome when transitioning from conversation to movement
Solution Approach 1:
The patent replaces physical mechanical controllers with optical tracking of hand and finger movements. The system uses cameras or sensors to detect hand gestures and translates them into locomotion commands, eliminating the need for physical controller manipulation while maintaining control precision through accurate gesture recognition and mapping to virtual controller positions.
Solution Approach 2:
The patent creates a virtual controller that is instantiated in the virtual world based on the player's hand position. This virtual controller copy mirrors the functionality of physical controllers but is controlled through natural hand gestures, allowing seamless transition between conversation and locomotion without physical manipulation.
2Measurement precision
If physical controllers are required for locomotion, then control accuracy is maintained, but immersion is reduced due to need to put down and re-detect controllers
Solution Approach 1:
The patent enables continuous locomotion control through sustained hand gesture recognition. The virtual controller remains instantiated and responsive as long as the player maintains the appropriate gesture, eliminating interruptions for controller pickup and detection. The system continuously tracks hand position and updates the virtual controller position accordingly, ensuring uninterrupted control.
Solution Approach 2:
The patent replaces the mechanical controller detection system with an optical gesture recognition system that continuously tracks hand position. This substitution eliminates the need for physical controller presence and re-detection, providing continuous and reliable control through natural hand movements throughout the locomotion process.
3Ease of operation
If hand tracking is used for locomotion control, then immersion and ease of operation are improved, but maintaining controller position relative to moving avatar becomes complex
Solution Approach 1:
The patent implements a dynamic virtual controller system that automatically adjusts its position in the virtual world based on the player's hand position and the avatar's movement. The virtual controller is instantiated at an offset from the character root and updates its position continuously to maintain the correct spatial relationship, allowing natural hand tracking while managing the complexity through automated transform calculations.
Solution Approach 2:
The patent creates a universal control system where the virtual controller serves multiple functions: it acts as both a visual indicator of hand position and the actual control interface for locomotion. This multi-functionality simplifies the system by combining controller instantiation, position tracking, and input processing into a single unified mechanism that adapts to avatar movement automatically.
Data Source
AI summary
The present technology provides a mechanism by which a player can make a gesture with their hands which can bring up a virtual controller, wherein hand movements and finger tracking can result in locomotion of an avatar through a virtual world without need for a hardware controller. Therefore, a player can have a natural conversion or otherwise control the hands of their avatar to interact with other objects in the virtual world, and then use the avatar's hands to bring up a virtual controller to control locomotive movements of their avatar without the player of a physical controller.