HMD Content Sharing via Pass-Through Video Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current head-mounted display (HMD) technologies limit social interaction as they provide an immersive experience that cannot be shared with others, preventing spectators from viewing or participating in the gameplay or content experienced by the user.
Innovation Solution
A system and method for sharing HMD content with a second screen, allowing video frames generated during interactive gameplay to be processed and displayed on both the HMD and a second screen, enabling real-time mirroring of the HMD content, including in-band and out-of-band regions, to facilitate social interaction and viewing by others.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If HMD content is displayed only on the HMD to maintain immersive experience, then immersion quality is improved, but social shareability deteriorates
Solution Approach 1:
The patent creates a visual copy of the HMD content by capturing the display through a camera or extracting the video signal, then transmits this copy to a second screen device. This allows the original HMD content to remain unchanged and immersive while creating a shareable replica for others to view, resolving the contradiction between maintaining immersion quality and enabling social shareability.
2Adaptability or versatility
If video processing is performed to enable second screen display, then social shareability is improved, but processing complexity worsens
Solution Approach 1:
The patent introduces a processing device as an intermediary between the HMD and the second screen. This intermediary handles the video signal processing, format conversion, and transmission tasks, isolating the complexity from both the HMD and the second screen devices. The intermediary performs necessary video processing operations while managing the overall system complexity in a centralized manner.
3Ease of operation
If real-time video processing is performed for second screen mirroring, then social interaction responsiveness is improved, but processing time and resource consumption worsen
Solution Approach 1:
The patent performs preliminary actions by pre-processing video frames and preparing them for transmission before they are needed on the second screen. The processing device anticipates the timing requirements by continuously processing video frames in advance, ensuring that processed content is ready for immediate display when needed, thus reducing actual processing delays during social interaction.
Solution Approach 2:
The patent implements periodic video frame processing at standardized intervals (e.g., 60 frames per second or other refresh rates). By processing video content in regular periodic cycles rather than on-demand, the system maintains consistent real-time performance and predictable timing, ensuring smooth social interaction responsiveness while optimizing resource utilization through rhythmic processing patterns.
Data Source
AI summary
A media streaming device is provided. In one configuration, the media streaming device includes an interface for connecting the media streaming device to a display screen. A head mounted display (HMD) output for connecting to an HMD over a wireless connection provide by wireless communication circuitry. A processor for processing received video of interactive content. The processor is configured to format the video of interactive content for rendering on the display screen. A pass-through connection that is configured to interface the video of interactive content to the HMD via the HMD output over the wireless connection. The pass-through connection maintains a left-eye and right-eye format for rendering the video of interactive content in a three-dimensional format in the HMD.