VR Region-of-Interest Interaction for Precise Small-Object Selection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing virtual reality interaction methods suffer from low accuracy and interaction fatigue due to reliance on single input modes like gestures, handles, or eye movements, making it difficult to select small objects and causing muscle fatigue, especially when interacting with objects far away or requiring prolonged interaction.
Innovation Solution
A method combining head control data to determine a region of interest and hand posture data to move a control point within that region, allowing for precise interaction by integrating head and hand movements to enhance accuracy and reduce fatigue.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If single input mode (gesture, handle, or eye movement) is used for interaction, then device complexity is reduced, but measurement precision and interaction accuracy deteriorate
Solution Approach 1:
The patent combines multiple input modes (head movement, eye movement, and hand gesture) into a unified interaction system. The head control module detects head movement to determine region of interest, the eye tracking module detects eye movement to identify target objects within that region, and the hand gesture module provides confirmation or refinement. This merging of multiple sensing modalities resolves the contradiction by maintaining system functionality while significantly improving object selection accuracy through multi-modal verification.
2Ease of operation
If single input mode (gesture, handle, or eye movement) is used for interaction, then ease of operation is improved, but measurement precision deteriorates
Solution Approach 1:
The interaction process is segmented into distinct stages, each handled by a specialized module: head movement detection for coarse positioning of region of interest, eye tracking for fine targeting within that region, and hand gesture for final confirmation. This segmentation allows each module to operate independently with optimized controls, maintaining ease of operation while achieving high precision through the cumulative effect of multiple specialized sensing stages.
3Duration of action of moving object
If prolonged interaction is required, then interaction completeness is improved, but object-generated harmful factors (muscle fatigue) increase
Solution Approach 1:
The patent introduces head movement and eye tracking as intermediary control mechanisms that reduce the burden on hand muscles during prolonged interactions. Instead of continuously moving hands or maintaining fixed hand positions, users can adjust the region of interest through head movement and select objects through eye tracking, with hand gestures used only for confirmation. This intermediary approach distributes the interaction workload across different muscle groups, reducing fatigue in the hands and arms during extended use.
Data Source
Figure 1~1a
Figure 1b~1c
Figure 1d~1f
AI summary
Provided in the embodiments of the present disclosure are a method and apparatus for interaction in a virtual reality scene, a device and a storage medium. The method comprises: receiving head control data acting in a virtual reality scene; determining a region of interest on the basis of the head control data and displaying the region of interest and a control point, the control point being initially located at the center point of the region of interest, and the region of interest comprising an object to be interacted with; receiving hand pose data generated in a hand operation area, a displacement mapping relationship being present between the hand operation area and the region of interest; moving the control point to a target display position, the target display position being a mapping position of the hand pose data in the region of interest; and responding to an interaction operation generated when the control point acts on said object.