XR Controller Input Conversion for Cross-Platform Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing XR and non-XR devices face challenges in seamless interaction due to differences in input methods, requiring users to switch between various input methods for different devices.
Innovation Solution
The implementation of techniques that allow XR devices to detect and process gestures and inputs from XR controllers, enabling seamless interaction with non-XR devices by projecting non-XR device screens into XR space and converting non-XR inputs into executable XR inputs.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If XR devices use gesture-based input methods while non-XR devices use traditional input methods (keyboard, mouse, touch), then each device can be optimized for its specific interaction paradigm, but users must switch between different input methods when interacting across devices, reducing operational efficiency
Solution Approach 1:
The patent makes XR controllers universal by enabling them to perform multiple functions: they can detect both traditional input types (keyboard strokes, mouse movements, touch gestures) and XR-specific gestures. This allows a single input device to interface with both XR and non-XR platforms, eliminating the need for users to switch between different input methods and reducing operational complexity while maintaining adaptability across device types
2Reliability
If XR devices operate independently from non-XR devices, then each device can maintain its own optimized performance and input methods, but seamless interaction and content sharing between devices becomes difficult
Solution Approach 1:
The patent introduces an intermediary layer in the form of a non-XR device that acts as a bridge between XR and non-XR platforms. The non-XR device receives traditional inputs (keyboard, mouse, touch), processes them, and transmits the corresponding XR inputs to the XR device. This intermediary enables seamless interaction and content sharing across platforms while allowing each device to maintain its optimized performance and input methods independently
3Adaptability or versatility
If the system supports multiple input methods for different devices, then it can accommodate diverse user preferences and device types, but the system complexity increases requiring more conversion and coordination mechanisms
Solution Approach 1:
The patent merges the functionality of multiple input devices into a single XR controller that can detect various input types (keyboard strokes, mouse movements, touch gestures, and XR gestures). By combining these detection capabilities into one device, the system reduces architectural complexity while maintaining support for diverse input methods and device types, eliminating the need for separate conversion mechanisms for each input type
Data Source
AI summary
A connection may be established between an extended reality (XR) platform and a non-XR platform. User input may be received via one of XR and non-XR devices comprised in the XR and non-XR platforms. Position information associated with the user input may be converted to be executable by an other one of the XR and non-XR devices. Controls may be implemented across the XR and non-XR platforms without switching the input mechanism associated with the one of the XR and non-XR devices to an input mechanism associated with the other one of the XR and non-XR devices.