Virtual Cursor Positioning for Controller-Free VR Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current VR interaction methods rely heavily on handheld controllers, which are cumbersome and limit immersion when they run out of power, and biological hand interactions with virtual objects are not effectively addressed.
Innovation Solution
A method and apparatus for determining a virtual cursor in a VR scene using the position information of a user's virtual human body, such as wrist and waist positions, to construct a virtual ray and cursor, enabling bare-hand manipulation and interaction through virtual fingers and hand postures.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If handheld controllers are used for VR interaction, then interaction reliability is improved, but device complexity and weight increase
Solution Approach 1:
The patent extracts the interaction control function from the physical handheld controller and relocates it to the user's biological hand through gesture recognition. The system captures hand gestures via cameras and processes them to control virtual cursors and interact with 3D objects, eliminating the need for separate controller hardware and its associated complexity.
Solution Approach 2:
The patent replaces the mechanical controller system with a vision-based gesture recognition system. Instead of using physical buttons and joysticks, the system uses image processing to detect hand gestures, track finger movements, and interpret them as control commands, substituting mechanical input with optical sensing and computational analysis.
2Measurement precision
If handheld controllers are used for VR interaction, then interaction precision is improved, but ease of operation deteriorates due to weight and immersion limitation
Solution Approach 1:
The patent enables the user's own body (hand) to serve as the interaction device. By recognizing natural hand gestures and movements, the system allows users to control virtual objects directly through their own bodily actions, eliminating the need to hold and operate separate controllers, thereby improving ease of operation and immersion.
3Ease of operation
If biological hands are used to replace controllers, then ease of operation is improved, but measurement precision of hand gestures deteriorates
Solution Approach 1:
The patent implements a feedback mechanism where the system continuously captures hand gesture images, processes them to determine gesture intent, and provides real-time visual feedback through the virtual cursor following the hand movements. This feedback loop enables the system to adapt to varying hand positions and gestures, improving recognition precision while maintaining ease of operation.
Data Source
AI summary
The disclosure relates to a method, apparatus, device, storage medium and program product for determining a virtual cursor in a virtual reality scene, and the method includes: determining position information of a virtual human body of a user in the virtual reality scene, wherein the position information comprises a wrist position and a waist position; determining a virtual ray based on the position information, wherein a starting point of the virtual ray is determined based on the wrist position, and a direction of the virtual ray is determined based on the waist position and the wrist position; and determining the virtual cursor based on an intersection of the virtual ray and a virtual object in the virtual reality scene.