Artificial Reality Execution With Synthetic Input for Headset-Free Testing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Developing and testing artificial reality applications often requires users to don and remove headsets, which can detract from usability and accuracy, especially when using native input channels.
Innovation Solution
An interface manager on an external device provides synthetic input to an artificial reality system, allowing users to interact with applications without needing native input channels, and the system executes the application using this input, generating visual information that is streamed back for real-time interaction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If users use native input channels (headset and controllers) to interact with artificial reality applications, then the system can execute applications with full functionality, but users must don and remove headsets which detracts from usability and efficiency
Solution Approach 1:
An external device serves as an intermediary between the user and the artificial reality system. This external device provides synthetic input that simulates native input channel interactions, allowing users to control applications without physically donning the headset. The intermediary translates user interactions into synthetic input signals that the XR system can process natively.
Solution Approach 2:
The system creates a synthetic copy of native input channel interactions. Instead of requiring actual headset and controller physical interaction, the external device generates synthetic input signals that replicate the functionality of native input channels. This copying approach maintains full application functionality while eliminating the need to physically wear the headset.
2Ease of operation
If users interact with artificial reality applications using synthetic input from external devices, then usability is improved without requiring headset donning, but the system must maintain accurate native execution feedback
Solution Approach 1:
The system implements a feedback loop where the artificial reality system executes applications and streams output data back to the external device. This feedback mechanism ensures that users receive accurate native execution feedback while using synthetic input. The external device displays application output and can present synthetic input based on the actual system state, maintaining measurement precision through continuous feedback.
Solution Approach 2:
The patent replaces mechanical input channel interactions with synthetic input signals. Instead of physical headset and controller interactions, the system uses software-based synthetic input that can accurately represent native input channel behavior. This substitution maintains measurement precision by ensuring synthetic input accurately reflects the intended native interaction model.
3Measurement precision
If the artificial reality system executes applications natively to provide accurate feedback, then execution accuracy is maintained, but the system requires specific input channels that may not be available to all users
Solution Approach 1:
The external device provides universal access to artificial reality applications through multiple input methods. It can receive input from various sources (touchscreen, keyboard, mouse, voice) and translate them into synthetic input compatible with the XR system's native input channels. This multi-functionality approach maintains execution accuracy while significantly improving accessibility for users without native input channels.
Solution Approach 2:
The system dynamically adjusts input parameters to maintain compatibility between synthetic input and native execution expectations. The external device monitors the XR system's execution state and adjusts synthetic input parameters accordingly, ensuring that applications execute accurately while remaining accessible to diverse user configurations.
Data Source
AI summary
Aspects of the present disclosure are directed to native artificial reality system execution of an application using synthetic input from an external device. In traditional use cases, artificial reality system input is provided by input channels native to the system, However, utilizing native input channels can detract from usability in some scenarios, such as during application development and/or testing. Implementations include an interface manager, executing at external device(s), that provides synthetic input to an artificial reality system. The artificial reality system can execute an application using the synthetic input, generate application data via the execution, such as visual information, and stream the application data back to the interface manager at the external device(s). In some implementations, a user defines the synthetic input via interactions with the interface manager, and the interface manager displays, to the user, the application data generated via the synthetic input.