Display Device Input Modality Switching via Ray Intersection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
There is a need for efficient methods to switch between user input modalities, such as eye-tracking and pointing devices, in displaying devices that offer both modalities to enhance user experience and provide seamless transitions without requiring users to actively change settings.
Innovation Solution
A method and device that determine whether a pointing ray from a secondary input modality intersects with an interactable region, allowing the displaying device to switch from an eye-tracking modality to a pointing device modality and back, based on the intersection, ensuring the user can choose the most suitable input method for interaction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If eye-tracking is used as the input modality, then hands-free operation is enabled, but switching to another input modality requires manual setting changes
Solution Approach 1:
The system automatically detects when the user intends to switch input modalities by monitoring pointing device activity and gaze data, then performs the switching without requiring manual configuration changes by the user
Solution Approach 2:
The system dynamically changes the active input modality parameter based on detected user behavior patterns, transitioning from eye-tracking to pointing device or vice versa based on real-time interaction context
2Adaptability or versatility
If multiple input modalities are provided, then user choice and interaction accuracy are improved, but automatic switching between modalities is complex to implement
Solution Approach 1:
The system uses feedback from pointing device activity detection and eye-tracking gaze data to automatically determine when switching between input modalities is appropriate, creating a closed-loop control system that adapts to user needs
Solution Approach 2:
The displaying device integrates multiple input modalities (eye-tracking and pointing devices) into a single unified system that can automatically switch between them based on detected user intent, making the system versatile without requiring separate control mechanisms
Data Source
AI summary
Disclosed is a method for switching user input modality of a displaying device displaying an interactable region. The displaying device is in communication with a first input modality and a second input modality. The first input modality is an eye tracker configured to determine gaze data of a user and the second input modality is an input modality other than an eye tracker configured to determine a pointing ray. The first input modality is selected as the input modality of the displaying device. The method comprises determining whether the pointing ray of the second input modality is intersecting with the interactable region. The method further comprises, based on the determining switching the input modality of the displaying device to the second input modality when the pointing ray of the second input modality is intersecting with the interactable region.