See-Through AR Virtual Windows for Out-of-View Assistants
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Displaying a virtual assistant in an augmented reality environment poses challenges, such as the assistant disappearing from view when a user moves, disrupting interaction and detracting from the immersive experience, and presenting the assistant persistently may limit user connection.
Innovation Solution
The virtual assistant is displayed as an animated character that transitions into a virtual window when out of view, maintaining interaction through spatial audio and adapting its behavior based on user and environmental characteristics.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the virtual assistant is displayed at a fixed location in the real-world environment, then the assistant remains associated with that location, but the assistant disappears from view when the user moves, disrupting interaction
Solution Approach 1:
The virtual assistant's display position is made dynamic rather than fixed. The system continuously monitors the assistant's position relative to the user's field of view and automatically transitions the display mode between world-locked (when visible) and display-locked in a virtual window (when out of view), ensuring continuous accessibility.
Solution Approach 2:
A virtual window is introduced as an intermediary element on the see-through display. When the virtual assistant moves out of the user's field of view, the system creates a virtual window containing the assistant's representation, allowing the user to continue interacting with the assistant without the assistant disappearing completely.
2Ease of operation
If the virtual assistant is persistently displayed in the field of view, then interaction is maintained, but user connection and immersion are limited
Solution Approach 1:
The display behavior adapts dynamically based on the user's movement and the assistant's position in the environment. The system adjusts between full visibility (when the assistant is in view) and virtual window mode (when out of view), creating a more natural and adaptable interaction experience that enhances user connection.
3Ease of operation
If the virtual assistant transitions to a virtual window when out of view, then interaction is maintained, but the display system complexity increases
Solution Approach 1:
The see-through display performs multiple functions: it can display the virtual assistant directly in the field of view when visible, and it can create and manage virtual windows when the assistant moves out of view. This multi-functionality is built into the display system's existing capabilities, minimizing additional complexity.
Data Source
Figure 1
Figure 2~3
Figure 4
AI summary
Examples are disclosed herein relating to displaying a virtual assistant. One example provides an augmented reality display device comprising a see-through display, a logic subsystem, and a storage subsystem storing instructions executable by the logic subsystem to display via the see-through display a virtual assistant associated with a location in a real-world environment, detect a change in a field of view of the see-through display, and when the virtual assistant is out of the field of view of the see-through display after the change in the field of view, display the virtual assistant in a virtual window on the see-through display.