Gaze-Timed Controller Mapping for Expanded Mixed Reality Input
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing MR and AR systems are limited by the number of functions available via handheld controllers due to the restricted number of user input buttons or actions, necessitating a more intuitive way to extend functionality without distracting users from their primary activities.
Innovation Solution
Implementing a gaze timer feature that modifies the functionality of user input devices by a predefined gaze action, allowing temporary access to additional functions via a secondary mapping table when the user looks at the controller for a set period.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If the number of buttons or input actions on the controller is increased to provide more functions, then the functionality of the controller is improved, but the device complexity and ease of operation deteriorate
Solution Approach 1:
The controller's functionality is made dynamic through the gaze timer mechanism. The controller transitions between different functional states based on the user's gaze duration. When the user gazes at the controller for a predefined period, the controller dynamically switches to an extended functionality mode, allowing access to additional functions without permanently adding more physical buttons or input elements.
2Adaptability or versatility
If more functions are added to the controller to extend its capabilities, then the adaptability is improved, but the ease of operation worsens due to increased complexity
Solution Approach 1:
The gaze timer acts as an intermediary mechanism between the user and the controller's extended functions. Instead of requiring direct interaction with multiple buttons or complex input sequences, the user simply needs to gaze at the controller for a predefined period. This intermediary gaze-based activation simplifies the user interaction while still providing access to a wide range of functions through the secondary mapping table.
3Productivity
If additional functions are made accessible through the controller, then the productivity is improved, but the reliability worsens due to increased risk of accidental activation
Solution Approach 1:
The system performs a preliminary action by monitoring the user's gaze duration before activating additional functions. The gaze timer requires the user to maintain gaze for a predefined period before the secondary mapping table is activated. This preliminary time-based verification ensures that intentional activations are distinguished from accidental ones, thereby maintaining reliability while providing access to enhanced functionality.
Data Source
AI summary
A wearable computing system that includes a head-mounted display implements a gaze timer feature for enabling the user to temporarily extend the functionality of a handheld controller or other user input device. In one embodiment, when the user gazes at, or in the vicinity of, a handheld controller for a predetermined period of time, the functionality of one or more input elements (e.g., buttons) of the handheld controller is temporarily modified. For example, the function associated with a particular controller button may be modified to enable the user to open a particular menu using the button. The gaze timer feature may, for example, be used to augment the functionality of a handheld controller or other user input device during mixed reality and/or augmented reality sessions.