Video Sub-stream Segmentation for XR Headset Bandwidth Optimization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Streaming volumetric video in real-time requires significant bandwidth and can be challenging due to limited or inconsistent network speeds, especially when delivering video content to extended-reality headsets.
Innovation Solution
The system assigns source sub-locations at a source location to target sub-locations at a target location, transmitting video sub-streams from video cameras capturing specific points-of-view within source sub-locations to target content delivery servers, which then transmit these sub-streams to extended-reality headsets, optimizing bandwidth usage and reducing latency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If volumetric video is streamed in real-time to extended-reality headsets, then viewers can experience immersive 3D content from multiple angles, but network bandwidth consumption increases significantly and latency worsens due to limited or inconsistent network speeds
Solution Approach 1:
The patent divides the source location into multiple source sub-locations and assigns video cameras to specific sub-locations. Each camera captures video from a specific viewpoint, and only the relevant video sub-streams are transmitted to corresponding target sub-locations. This segmentation reduces the total volume of video data that needs to be streamed while maintaining immersive viewing experience.
Solution Approach 2:
The patent transmits different video sub-streams to different target sub-locations based on the viewer's specific location. Each target sub-location receives video content optimized for that specific viewpoint, ensuring high-quality relevant content is delivered while avoiding transmission of unnecessary video data to other locations.
2Reliability
If all video streams from all source sub-locations are transmitted to all target locations, then complete coverage is achieved, but network bandwidth usage increases and latency worsens
Solution Approach 1:
The patent extracts and transmits only the necessary video sub-streams from the source location to the target location. By identifying and transmitting only the video content relevant to each specific target sub-location, the system eliminates unnecessary data transmission, reducing bandwidth consumption and latency while maintaining complete coverage of all required viewpoints.
3Adaptability or versatility
If video sub-streams are transmitted from all source sub-locations to all target sub-locations, then all viewers receive all possible viewpoints, but network bandwidth consumption increases significantly
Solution Approach 1:
The patent segments both the source location into source sub-locations and the target location into target sub-locations, with specific video cameras assigned to specific source sub-locations. This segmentation enables selective transmission of video sub-streams, where each target sub-location receives only the video content from source sub-locations relevant to its viewpoint, reducing total data transmission volume while maintaining multiple viewpoint options.
Data Source
AI summary
Provided are a computer program product, system, and method for transmitting video sub-streams captured from source sub-locations to extended-reality headsets worn by viewers at a target location. Video cameras, positioned to capture video at a source location, are assigned to source sub-locations of the source location. The video cameras assigned to a source sub-location capture video of the event from points-of-view of viewers within the source sub-location. The source sub-locations of the source location are associated with target sub-locations of a target location in which the viewer is located. The source location and the target location are in different geographical locations. A video sub-stream from video cameras assigned to a source sub-location is transmitted to be rendered in the extended-reality headset worn by a viewer located in a target sub-location associated with the source sub-location to which the video cameras that captured the video sub-stream are assigned.