Gaze-Timed Handheld Controller Functions for MR Session Menus
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing MR and AR systems are limited by the number of user input buttons or actions on handheld controllers, restricting functionality and requiring users to return to a specific world location for session menus, which distracts from social activities.
Innovation Solution
A gaze timer feature that temporarily modifies the functionality of user input devices by gazing at a predefined region for a predetermined time, allowing access to session menus without disrupting ongoing interactions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If the number of user input buttons or actions on handheld controllers is increased to extend functionality, then controller functionality is improved, but device complexity and ease of operation deteriorate
Solution Approach 1:
The patent applies multi-functionality by enabling a single existing button to perform multiple functions through gaze-based activation. The button can access different functions or selections based on which virtual object the user is gazing at, allowing one physical input element to control multiple operations without adding more buttons.
Solution Approach 2:
The patent introduces gaze detection as an intermediary between the user and the controller button. The eye tracking system acts as a mediator that determines which function should be activated based on the user's line of sight, enabling contextual function selection without requiring additional physical inputs.
2Ease of operation
If session menus are made permanently accessible on the controller, then ease of operation is improved, but distraction from primary activities increases
Solution Approach 1:
The patent applies dynamics by making the menu accessibility conditional rather than static. The menu becomes accessible only when the user gazes at the controller for a predetermined time, allowing the system to dynamically adjust between being intrusive and being accessible based on real-time user behavior.
Solution Approach 2:
The patent uses preliminary action by requiring the user to gaze at the controller for a predetermined time before the menu function is activated. This preliminary gaze action serves as a deliberate trigger that distinguishes intentional menu access from casual glances, preventing accidental activation while maintaining ease of access when needed.
3Productivity
If gaze duration threshold is decreased to enable faster access to extended functions, then productivity is improved, but reliability deteriorates due to accidental activation
Solution Approach 1:
The patent applies parameter changes by using the gaze duration threshold as a configurable parameter that balances accessibility and reliability. By setting an optimal threshold value, the system achieves a balance where legitimate function access is sufficiently fast while accidental activations are prevented through the time requirement.
Data Source
Figure 1
Figure 2~3
Figure 4
AI summary
A wearable computing system (100) that includes a head-mounted display (110) implements a gaze timer feature for enabling the user to temporarily extend the functionality of a handheld controller or other user input device (104). In one embodiment, when the user gazes at, or in the vicinity of, a handheld controller (104) for a predetermined period of time, the functionality of one or more input elements (130) of the handheld controller (104) is temporarily modified. For example, the function associated with a particular controller button (130) may be modified to enable the user to open a particular menu (506) using the button. The gaze timer feature may, for example, be used to augment the functionality of a handheld controller or other user input device (104) during mixed reality and/or augmented reality sessions.