AR Shared Screen Space Using Avatar Head Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
AR wearable devices have limited physical user interface items, battery power, and processing capability, making it difficult for users to collaborate effectively on projects, especially when sharing screens and providing limited feedback.
Innovation Solution
A 'Host' AR wearable device provides a shared screen with size and location information, along with user avatars and head orientations, which is displayed on 'Guest' devices, allowing for real-time interaction and augmentation sharing, including emoji, images, and video feeds.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If AR wearable devices are used for collaboration, then real-time interaction and shared screen viewing is enabled, but the devices have limited physical user interface items, battery power, and processing capability
Solution Approach 1:
The patent introduces a cloud-based server system as an intermediary that handles complex processing tasks, screen sharing, and coordination between multiple AR devices. This allows the wearable devices themselves to remain simple while still enabling sophisticated collaborative functionality through remote server assistance
Solution Approach 2:
The AR wearable devices are designed to perform multiple functions including screen sharing, avatar display, spatial tracking, and real-time communication through a unified platform, reducing the need for separate dedicated devices for each function
2Adaptability or versatility
If AR wearable devices provide more functions, then collaboration effectiveness improves, but battery power is limited
Solution Approach 1:
The cloud server acts as an energy-offloading intermediary, performing computationally intensive tasks such as video encoding, spatial mapping, and real-time rendering remotely. This significantly reduces the energy burden on the wearable devices while maintaining advanced functionality
Solution Approach 2:
The system uses periodic updates and asynchronous communication to share screen content and avatar positions, rather than continuous high-bandwidth transmission. This reduces energy consumption while maintaining real-time collaboration effectiveness
3Ease of operation
If AR wearable devices share screen space with avatars and real-time feedback, then collaboration immersion improves, but processing capability is limited
Solution Approach 1:
The cloud-based processing system handles the computationally intensive tasks of real-time video processing, avatar generation, and spatial coordinate transformation, allowing the wearable devices to focus on display and user interaction with minimal local processing requirements
Solution Approach 2:
Instead of requiring each device to process and display the complete shared screen content independently, the system transmits compressed video streams and rendered avatars to each device, reducing the processing burden on individual wearables while maintaining immersive collaboration
Data Source
AI summary
Systems, methods, and computer readable media for an augmented reality (AR) shared screen space. Examples relate to a host augmented realty (AR) device sharing a screen and a relative location of the AR device to the screen with guest AR devices where the guest AR devices share a relative location of the guest AR devices to a copy of the screen displayed on the display of the guest AR devices and where the users of the AR devices may see each other's location with the use of avatars around the shared screen and add augmentations to the shared screen. The yaw, roll, and pitch of the head of the avatars tracks the movement of the head of the user of the AR wearable device.