Immersive Video Streaming Region Prediction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current systems for delivering immersive video, such as 360-degree video, face challenges in efficiently managing bandwidth and processing resources due to the need to transmit and display the entire video frame, even though only a subset of the frame is within the user's field of view, leading to potential lag and resource wastage.
Innovation Solution
The method involves determining and transmitting only the transmission regions of immersive video frames based on the user's field of view, using predictive algorithms to include surrounding portions that are likely to be viewed, thereby reducing the amount of data transmitted and processed.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If the entire video frame is transmitted and processed, then the complete video content is available for display, but bandwidth and processing resources are wasted
Solution Approach 1:
The patent divides the immersive video frame into multiple transmission regions based on the user's field of view. Only the portions of the video frame that correspond to the user's current and predicted field of view are transmitted, rather than transmitting the entire frame. This segmentation approach reduces the quantity of video data transmitted and processed, directly addressing the contradiction between transmitting complete content and conserving bandwidth resources.
2Loss of energy
If only the current field of view is transmitted, then bandwidth is conserved, but the viewing experience may lag when the user changes their view
Solution Approach 1:
The patent transmits surrounding portions of the video frame that are outside the current field of view but are predicted to be viewed soon. This preliminary transmission of anticipatory content ensures that when the user changes their field of view, the required video data is already available at the display device, preventing lag and maintaining smooth viewing experience while still conserving bandwidth compared to transmitting the entire frame.
3Reliability
If the surrounding portions outside the FOV are included in transmission, then the viewing experience remains smooth during FOV changes, but more data is transmitted and processed
Solution Approach 1:
The patent transmits a partial amount of surrounding video content beyond the current field of view - specifically, only the portions that are predicted to be viewed based on user behavior patterns. This is neither the minimal approach (transmitting only current FOV) nor the maximal approach (transmitting entire frame), but an optimized partial transmission that balances smooth viewing experience with bandwidth conservation.
Data Source
AI summary
Methods, systems, and apparatuses for predicting a user field-of-view change and determining transmission regions of immersive video (IV) content for an IV device are presented. A field-of-view change of a user device may be predicted. A transmission region in one or more video frames of the IV content may be determined based on the predicted change.