Third-Person AR Spectator Views With Synchronized Virtual Compositing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality (AR) systems limit spectators to viewing only the user's physical interactions, preventing them from fully engaging with the user's AR session, as they cannot see the virtual environment.
Innovation Solution
Implementing one or more cameras to capture the user's AR session and composite virtual elements onto the video feed, providing a synchronized third-person view that includes both physical and virtual objects, allowing spectators to see the AR session from various perspectives.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If spectators view only the user's physical interactions through existing AR systems, then the system complexity remains low, but the spectator engagement and understanding of the virtual environment is insufficient
Solution Approach 1:
The patent merges the real-world video feed captured by cameras with the virtual environment rendering into a single composite spectator view. This combining of physical and virtual elements allows spectators to simultaneously observe both the user's physical actions and the corresponding virtual interactions, resolving the information loss without requiring separate viewing systems.
Solution Approach 2:
The system introduces a remote computing system as an intermediary that receives data from both the AR head-mounted display system and camera systems, processes this information, and generates the composite spectator view. This intermediary handles the complex integration tasks, keeping the user's AR experience simple while enabling comprehensive spectator viewing.
2Adaptability or versatility
If cameras and composite rendering are added to provide third-person view, then spectator engagement improves, but system complexity and processing requirements increase
Solution Approach 1:
The remote computing system serves multiple functions: it receives and processes data from the AR head-mounted display system, receives video feeds from multiple camera systems, renders the virtual environment, and composites these elements into the spectator view. This multi-functional approach provides versatile spectator perspectives while consolidating complexity into a single remote system rather than distributing it across multiple devices.
3Manufacturing precision
If virtual elements are composited onto video feed in real-time, then spectator view quality improves, but processing power and energy consumption increase
Solution Approach 1:
The system performs preliminary actions by receiving and processing the virtual environment data from the AR head-mounted display system before compositing it with the video feed. The remote computing system prepares the virtual element positioning information in advance, allowing for accurate real-time compositing without requiring excessive processing power during the actual rendering phase.
Data Source
AI summary
A user may interact and view virtual elements such as avatars and objects and/or real world elements in three-dimensional space in an augmented reality (AR) session. The system may allow one or more spectators to view from a stationary or dynamic camera a third person view of the users AR session. The third person view may be synchronized with the user view and the virtual elements of the user view may be composited onto the third person view.