XR Observation Video Viewport Stabilization for Shared VR Viewing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing VR systems face challenges in sharing immersive experiences with observers without the need for multiple HMDs, which are costly and can cause nausea and disorientation, and existing software modifications are impractical.
Innovation Solution
Generate an observation video based on the position and orientation of an XR display, incorporating viewport elements that mimic the user's motion within the XR environment, using available data without modifying XR software.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If multiple HMDs are used to share VR content with observers, then observers can view the VR experience, but the cost increases and observers may experience nausea and disorientation
Solution Approach 1:
The patent creates a video copy of the VR content being displayed in the HMD and outputs it to a separate display device. This allows observers to view the VR experience without wearing an HMD, eliminating the harmful effects of motion sickness while maintaining observation quality. The video feed is generated by capturing the display output and processing it into a viewable format for external observers.
2Object-affected harmful factors
If VR content is output to a separate display without HMD, then cost is reduced, but the video appears unstable and unpleasant to observers
Solution Approach 1:
The patent dynamically adjusts the video output based on the HMD wearer's head movements and orientation. The system processes the raw VR feed to stabilize the image, compensating for head movements to create a stable, pleasant viewing experience for observers. This dynamic processing maintains video quality while eliminating the instability that would otherwise make the content unpleasant to watch.
3Stability of the object's composition
If secondary view is generated within VR environment, then stable observation is achieved, but access to XR software is required
Solution Approach 1:
The patent introduces an intermediary processing system that sits between the HMD display and the external observer's display device. This intermediary captures the display output, processes it to add stability and context, and outputs the stabilized video feed. This approach achieves stable observation without requiring access to or modification of the XR software itself, making the solution more universally applicable and easier to implement.
Data Source
AI summary
Systems, methods, apparatuses, and computer-readable media for creating an observation video are described. The observation video may comprise a viewport that moves in coordination with motion of an HMD user's head and that shows portions of VR content being output to the HMD user at different times. For each of those times, motion data from the HMD may be used to determine a position, orientation, and/or shape of the viewport. The observation video may also include an element that represents the HMD user, which element may comprise a video element video isolated from video of the user captured by a camera, and/or which may comprise an animated avatar.