Gaze and Gesture Interaction in Virtual Spaces
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing human-computer interaction methods in virtual spaces are cumbersome and inflexible, relying on external apparatuses which detract from the natural interaction experience.
Innovation Solution
A method and apparatus that track a user's gaze point in a virtual space, adjust its display form based on interaction gestures to generate interaction points, and allow for direct interaction with virtual objects without external apparatuses.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If external apparatuses are used for interaction in virtual spaces, then interaction functionality is achieved, but device complexity increases and natural interaction experience deteriorates
Solution Approach 1:
The patent extracts the interaction function from external apparatuses and integrates it directly into the XR device. By using gaze tracking and gesture recognition built into the device, it eliminates the need for separate interaction controllers, thereby reducing device complexity while maintaining natural interaction experience.
Solution Approach 2:
The patent makes the XR device universal by enabling it to perform multiple interaction functions directly. The device can detect gaze points, recognize gestures, and execute interactions without requiring specialized external apparatuses, thus simplifying the overall system while enhancing operational ease.
2Adaptability or versatility
If traditional interaction methods are used in virtual spaces, then interaction control is achieved, but flexibility and adaptability are reduced
Solution Approach 1:
The patent implements dynamic interaction control by continuously adapting to user gaze movements and gestures in real-time. The system dynamically adjusts interaction parameters based on the detected gaze point and gesture type, providing flexible and adaptable control that responds to user intentions without rigid predefined actions.
Solution Approach 2:
The patent changes interaction parameters dynamically based on detected gaze positions and gesture characteristics. By varying interaction parameters such as selection targets, action types, and response timing according to real-time gaze and gesture data, the system achieves high flexibility and adaptability in virtual space interaction.
Data Source
AI summary
The present application provides a human-computer interaction method and apparatus, a device, and a medium. The method includes: determining a gaze point of a line of sight of a user on a target object, the target object being located in a virtual space; adjusting, in response to an interaction gesture for the gaze point, a display form of the gaze point to generate a first interaction point; and interacting with the target object based on the first interaction point.