AR/VR Companion Interface Sync for Efficient Text Input
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional augmented or virtual reality (AR/VR) devices face inefficiencies and limitations in user interaction, particularly when interacting with service provider systems that require significant text entry, leading to frustration and computational inefficiencies.
Innovation Solution
The use of companion devices paired with AR/VR devices to facilitate user interaction through a companion user interface, leveraging platform-independent markup files and secure communication channels to enhance interaction efficiency and protect sensitive data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If natural user interfaces are used in AR/VR environments, then user immersion is enhanced, but interaction efficiency deteriorates
Solution Approach 1:
The system segments the interaction interface into two distinct parts: a natural interface component for navigation and selection within the AR/VR environment, and a text-based interface component for efficient text input. This segmentation allows each interface type to operate in its optimal domain, with the text-based interface handling text entry tasks that would be inefficient through natural interfaces alone.
Solution Approach 2:
The patent introduces an intermediary mechanism that bridges the natural interface and text-based interface. When a user selects a text input option through the natural interface, the system activates a text-based input method as an intermediary to handle the actual text entry, then returns control to the AR/VR environment. This intermediary resolves the contradiction by providing efficient text input without breaking the immersive experience.
2Adaptability or versatility
If text-based search strings and user identification are required for service interaction, then interaction capability is improved, but device complexity increases
Solution Approach 1:
The patent implements a universal interface framework that can handle multiple interaction types through a single integrated system. The framework supports both natural interface interactions for navigation and text-based interface interactions for text input, allowing the same device to adapt to different interaction requirements without requiring separate specialized interfaces for each function.
Solution Approach 2:
The interface system is made dynamic by allowing it to switch between different interaction modes based on the task requirements. The system can dynamically activate text-based input methods when text entry is needed, and naturally transition back to immersive AR/VR navigation, creating a flexible interface that adapts to varying interaction capabilities and environmental contexts.
3Ease of operation
If users exit AR/VR environment for text entry, then text input capability is improved, but user experience quality deteriorates
Solution Approach 1:
The patent embeds the text-based input interface within the AR/VR environment rather than requiring users to exit. The text input interface is nested as a contextual overlay or virtual keyboard that appears within the immersive environment, allowing users to input text without leaving the AR/VR experience. This nesting approach maintains the outer AR/VR environment while incorporating the necessary text input functionality as an inner layer.
Solution Approach 2:
The system performs preliminary actions by pre-positioning text input interfaces and service interaction options within the AR/VR environment before users need to perform text entry. Service provider information, search fields, and input options are prepared and displayed in advance within the immersive environment, allowing users to interact with text-based functions without exiting the AR/VR experience, thus preventing disruption to their workflow.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A computer-implemented method comprises receiving inputs as part of creating an augmented or virtual reality, AR/VR, application executable by an augmented reality device, the AR/VR application having a plurality of scenes and corresponding actions as part of user interaction with respective scenes of the plurality of scenes. The method further comprises generating a markup file that specifies linkages between controls usable as part of user interaction with a companion device and the corresponding actions within the respective scenes of the AR/VR application as executed by the AR/VR device. The method further comprises storing the markup file as associated with the AR/VR application, wherein the markup file is configured to support communication, to the companion device, of respective linkages between the controls as executed by the companion device, and corresponding actions for the respective scenes output by the AR/VR device.