XR Touch Input Routing by Orientation and User Gaze
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current input methodologies for extended reality (XR) devices are imprecise and inefficient, particularly when using companion devices like smartphones or smartwatches for interactions.
Innovation Solution
An application determines the orientation of a touch device relative to an XR device, directing touch inputs to either the touch device or the XR device based on user gaze and angular relationships, using sensors and cameras to ensure precise input assignment.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If touch input from a companion device is always directed to the XR device, then input efficiency for XR interactions is improved, but input accuracy deteriorates when the user is actually viewing the companion device
Solution Approach 1:
The patent dynamically redirects touch input based on real-time detection of user gaze direction. When the user is looking at the XR device, touch input from the companion device is directed to the XR device for efficient interaction. When the user is looking at the companion device, touch input is redirected to the companion device for accurate interaction. This dynamic adaptation resolves the contradiction between input efficiency and input accuracy.
2Measurement precision
If touch input is redirected based on device orientation, then input accuracy is improved, but system complexity increases due to orientation tracking and decision logic
Solution Approach 1:
The patent introduces an intermediary component that monitors device orientation and gaze direction, and automatically makes decisions about input routing. This intermediary layer handles the complexity of orientation tracking and decision logic, isolating it from both the XR device and companion device systems. The intermediary uses sensors to detect orientation and applies predefined rules to determine input destination, improving accuracy while containing system complexity in a dedicated module.
3Adaptability or versatility
If a single touch device provides input to both the touch device and XR device, then versatility is improved, but input ambiguity increases
Solution Approach 1:
The patent implements a feedback mechanism that continuously monitors user gaze direction and device orientation to determine the intended target of touch input. The system uses this feedback to dynamically resolve input ambiguity by routing touch input to the correct device. This feedback loop maintains versatility by allowing the same touch device to interact with both the XR device and companion device, while eliminating ambiguity through real-time context-aware routing decisions.
Data Source
AI summary
According to at least one implementation, a method includes identifying an orientation of a first device relative to a second device and determining whether the orientation satisfies at least one criterion. In response to the orientation satisfying the at least one criterion, the method further includes receiving touch input for the second device from the first device. In response to the orientation failing to satisfy the at least one criterion, the method also includes receiving touch input for the first device from the first device.