XR Bare-Hand 3D Cursor Control with Interactive Light Rays
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing XR glasses lack a method for users to control a three-dimensional cursor in a three-dimensional space using bare hands, relying instead on remote controllers or sensors for interaction.
Innovation Solution
A method for achieving virtual touch control using a three-dimensional cursor involves defining a control aiming point with a light ray passing through a joint or fingertip, projecting an interactive control line, and assigning trigger and click fingers to perform operations in a three-dimensional virtual space.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a conventional two-dimensional cursor is used in XR glasses, then the device can display images, but the user cannot move and click the cursor in three-dimensional space
Solution Approach 1:
The patent extends the conventional two-dimensional cursor concept to three-dimensional space by introducing a vertical dimension (Z-axis) to the cursor positioning system. The control method calculates three-dimensional coordinates (X, Y, Z) based on hand joint positions and light ray projections, enabling the cursor to move freely in 3D virtual space rather than being constrained to a flat 2D plane.
2Adaptability or versatility
If remote controllers or sensors are used for cursor control, then three-dimensional cursor movement is achieved, but the operation becomes more complex and less intuitive
Solution Approach 1:
The system uses the user's own hand as the control device, eliminating the need for external remote controllers or additional sensors. The hand tracking system detects natural hand gestures and joint positions, automatically calculating the three-dimensional cursor position based on the geometric relationship between the hand, light source, and display screen. This self-service approach simplifies the control system while maintaining 3D cursor functionality.
3Ease of operation
If hand gestures are used for direct virtual object manipulation, then proximity interaction is achieved, but distant object control is not possible
Solution Approach 1:
The patent introduces an interactive control line as a mediator between the user's hand and distant virtual objects. This control line, formed by projecting a light ray from the light source through the hand joint to the display screen, acts as a virtual pointer that extends the user's reach. The control line visually indicates the cursor position and maintains the directional relationship between the hand gesture and the target object, enabling intuitive control of distant objects without requiring physical proximity.
Data Source
AI summary
A method for achieving virtual touch control, a storage medium, and a chip; applicable to systems using XR wearable devices or headsets, where in a virtual space, a weighted mean position of a joint or fingertip or a plurality of joints of a human hand which a light ray projected from a preset light source passes through before projecting further to a distant position is a control aiming point; the light ray projected from the preset light source towards the distant position is an interactive control line, and the three-dimensional cursor or a pen tip is displayed at a distal end of the interactive control line. A fast spatial position calculation method and a fast touch determination method are used for the interactive control line with definite or indefinite length formed through a bare hand to achieve virtual touch control, writing or drawing in a 3D virtual space.