Gaze-Based VR Interaction via Pupil Mapping
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current virtual reality interaction methods require frequent head movement to interact with virtual environments, leading to an unsatisfactory user experience due to the reliance on visual reticles that move with head movements, making natural and effective interaction difficult.
Innovation Solution
A virtual reality interaction method that acquires a reference pupil image, determines the pupil position, calculates a gaze point in a virtual image based on a mapping relationship between coordinate systems, and executes operations based on the gaze point's location within activatable regions and gaze state, allowing for more intuitive interaction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If visual reticles are used for interaction in virtual reality, then the interaction method is simple to implement, but frequent head movement is required leading to poor user experience
Solution Approach 1:
The patent replaces the mechanical head-movement-based reticle interaction system with an optical gaze-tracking system. Instead of requiring physical head movements to move visual reticles, the system uses eye-tracking technology to detect pupil position and map it to virtual image coordinates, enabling gaze-based interaction that is more natural and less physically demanding.
2Adaptability or versatility
If head movement is required to interact with virtual environments, then the interaction follows traditional UI patterns, but natural and effective interaction becomes difficult
Solution Approach 1:
The patent introduces an intermediary mapping relationship between pupil position in the reference pupil image and coordinates in the virtual image. This mapping layer translates natural eye gaze movements into meaningful interaction commands within the virtual environment, serving as a mediator between the user's natural physiological movements and the virtual interface requirements.
3Ease of operation
If gaze-based interaction is implemented, then natural and effective control is achieved, but complex coordinate system mapping and calibration are required
Solution Approach 1:
The patent performs preliminary calibration by establishing the mapping relationship between pupil position coordinates and virtual image coordinates before actual interaction begins. This preliminary action includes capturing reference pupil images, determining pupil positions, and creating the coordinate transformation mapping, which simplifies subsequent gaze-based interactions by pre-configuring the coordinate system relationship.
Data Source
AI summary
The present application provides a virtual reality interaction method. The virtual reality interaction method includes acquiring a reference pupil image of a user; determining a pupil position in the reference pupil image; determining a gaze point in a virtual image based on the pupil position in the reference pupil image and a mapping relationship between first coordinates in a first coordinate system of the reference pupil image and second coordinates in a second coordinate system of the virtual image; and executing an operation based on a determination that the gaze point is in an activatable region of the virtual image and a determination of a gaze state.