AR/VR Companion Interface for Secure Text Input
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional augmented or virtual reality (AR/VR) devices face inefficiencies in user interaction, particularly when engaging with service provider systems requiring text entry, leading to frustration and computational inefficiencies due to limitations in natural user interfaces.
Innovation Solution
A companion device is paired with the AR/VR device to provide alternative input mechanisms, leveraging a companion user interface synchronized with the AR/VR environment through a markup file and secure communication channels, ensuring compatibility and protecting sensitive data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If natural user interfaces are used in AR/VR devices for text entry, then user immersion is maintained, but text input efficiency deteriorates significantly
Solution Approach 1:
The patent introduces a service provider system as an intermediary that bridges the AR/VR device and external services. This mediator handles text input processing, allowing users to interact with services like search and purchases without directly typing text within the immersive AR/VR environment, thus maintaining immersion while improving input efficiency through alternative interfaces
2Ease of operation
If modal interaction is used to interface with text entry fields, then text input capability is achieved, but user experience continuity deteriorates
Solution Approach 1:
The service provider system performs preliminary actions by pre-processing and understanding user intent before full text input is required. The system prepares interaction states and anticipates user needs, allowing seamless transitions between AR/VR environment and text input modes without requiring users to fully exit the immersive experience, thus maintaining continuity
3Ease of operation
If conventional text entry methods are used in AR/VR, then text input function is achieved, but computational efficiency deteriorates
Solution Approach 1:
The patent extracts the computationally intensive text processing functions from the AR/VR device itself and relocates them to the service provider system. By taking out these heavy computational tasks from the resource-constrained AR/VR device, the system achieves text input functionality while significantly improving computational efficiency and reducing energy consumption on the AR/VR device
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A method as implemented by at least one computing device of a service provider system is provided. The method comprises: executing, locally by the at least one computing device, an augmented or virtual reality (AR/VR) environment; communicating, by the at least one computing device, augmented or virtual reality (AR/VR) data via a network to an AR/VR device to cause rendering of the AR/VR environment by the AR/VR device for viewing by a user; communicating, by the at least one computing device, companion data via the network to a companion device, the companion data configured to cause the companion device to generate a companion user interface that is displayable by a display device of the companion device and user selectable to initiate an action within the AR/VR environment; receiving, by the at least one computing device, protected data from the companion device generated via user interaction with the companion user interface via the user interface; and executing, by the at least one computing device, the action as part of the AR/VR environment without exposing the protected data to the AR/VR device.