Virtual Object Control via Gaze Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current virtual reality (VR) and augmented reality (AR) applications have limitations in controlling virtual objects, as they rely on simple and tedious methods, which are not flexible or convenient for users.
Innovation Solution
A method and apparatus for controlling virtual objects in applications by detecting user action sequences and presenting virtual objects based on predetermined action sequences, allowing users to interact with virtual objects using natural gestures and gaze direction without the need for dedicated input devices.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If simple and tedious control methods are used in VR/AR applications, then the device complexity is reduced, but the ease of operation deteriorates
Solution Approach 1:
The patent replaces traditional mechanical input devices (controllers, buttons, joysticks) with a gaze-based selection system. The user's gaze direction is detected to identify the target virtual object, and a selection menu is presented based on the detected gaze, eliminating the need for physical input devices and simplifying the interaction mechanism.
Solution Approach 2:
The patent introduces an intermediary selection menu that appears between the user's gaze detection and the final object selection. This menu acts as a mediator, presenting multiple candidate objects based on gaze direction and requiring a simple confirmation action, thereby simplifying the overall control process while maintaining precision.
2Measurement precision
If dedicated input devices are required for controlling virtual objects, then the measurement precision of user intent is improved, but the device complexity increases
Solution Approach 1:
The patent substitutes dedicated input devices with a gaze detection system. The user's gaze direction is tracked using sensors (such as eye-tracking cameras or infrared sensors), and the system determines the target virtual object based on where the user is looking. This eliminates the need for physical controllers while maintaining precise intent detection.
Solution Approach 2:
The system uses the user's natural gaze direction as the input signal, requiring no additional input devices. The user's eyes naturally indicate the target object, and the system automatically detects and processes this information, making the interaction self-service and eliminating the need for external control devices.
3Ease of operation
If natural gestures and gaze direction are used for control, then the ease of operation is improved, but the difficulty of detecting and measuring increases
Solution Approach 1:
The patent introduces an intermediary selection menu that simplifies the detection process. Instead of directly selecting from all virtual objects, the system first presents a limited set of candidate objects based on the user's gaze direction. This intermediary step reduces the complexity of detection by narrowing down the search space and providing clear visual feedback to the user.
Solution Approach 2:
The system provides continuous visual feedback by displaying the detected gaze direction and presenting a selection menu of candidate objects. This feedback loop helps the user verify that their gaze is being correctly interpreted and allows them to adjust their gaze if needed, making the detection process more reliable and easier to control.
Data Source
AI summary
A method, apparatus, device and medium for controlling a virtual object in an application are provided. In the method, in response to a determination that a first action sequence of a user of the application matches a first predetermined action sequence, a set of virtual objects is presented in a display area of the application with a first format. A target virtual object in the set of virtual objects is determined based on a user interaction of the user. In response to a determination that a second action sequence of the user matches a second predetermined action sequence, an operation corresponding to the target virtual object is performed. With example implementations of the disclosure, user interaction may be provided in a more flexible and efficient manner without interfering with the user's experience of using the application.