Adaptive VR Video Transmission with Field of View Error Prioritization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The challenge in streaming virtual reality (VR) video is the inefficiency in bandwidth usage due to inaccurate field of view (FoV) prediction, leading to wasted bandwidth and degraded user experience, especially in networks with limited bandwidth and high latency.
Innovation Solution
Implementing a method that predicts the user's FoV and sends video bytes accordingly, using a hybrid time and layer differentiation scheme to categorize video bytes into critical and less critical categories, prioritizing the transmission of actual FoV bytes over higher QoS profiles, thereby minimizing bandwidth waste and maintaining video quality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If panoramic or 360 degree video is streamed to provide immersive viewing experience, then user engagement and entertainment value are improved, but bandwidth consumption increases significantly
Solution Approach 1:
The patent divides the 360-degree video into multiple field-of-view (FoV) segments or tiles, where only the currently relevant FoV segments are transmitted based on predicted user viewing direction. This segmentation allows the system to send only necessary portions of the video, reducing overall bandwidth consumption while maintaining immersive viewing experience.
Solution Approach 2:
The patent extracts and transmits only the essential FoV segments that match the predicted user viewing direction, excluding unnecessary segments. By taking out only the necessary content based on prediction accuracy, the system reduces bandwidth waste while preserving the core viewing experience.
2Quantity of substance
If FoV prediction accuracy is increased to reduce bandwidth waste, then bandwidth efficiency is improved, but system complexity increases
Solution Approach 1:
The patent applies partial action by transmitting only the predicted FoV segments rather than the complete 360-degree video. It uses excessive action by sending slightly more FoV segments than strictly necessary (to account for prediction errors), ensuring that even if prediction is imperfect, the user still receives sufficient content, thus balancing complexity and efficiency.
Solution Approach 2:
The system dynamically adjusts transmission parameters based on predicted FoV accuracy, changing the number and quality of transmitted segments according to prediction confidence levels. This allows the system to optimize bandwidth usage while managing complexity through adaptive parameter modification.
3Reliability
If all FoV segments are transmitted to ensure complete content availability, then content completeness is improved, but network resources are wasted
Solution Approach 1:
The patent performs preliminary action by predicting the user's FoV in advance and pre-transmitting only the relevant segments before the user actually views them. This proactive approach ensures content availability for the predicted viewing direction while avoiding the waste of transmitting all possible segments.
Solution Approach 2:
The system uses feedback mechanisms to monitor actual user viewing behavior and adjust future predictions accordingly. By continuously refining FoV predictions based on user feedback, the system improves content availability accuracy while reducing network resource waste from transmitting unnecessary segments.
Data Source
AI summary
Aspects of the subject disclosure may include, for example, a method comprising: obtaining media content, such as video; receiving a request from a user and/or user equipment (UE) to view the media content; identifying a predicted field of view of the user; sending the predicted field of view to the equipment of the user at a normal priority; monitoring a line of sight (or actual field of view) of the user; determining a field of view error as a difference between the line of sight and the predicted field of view; and sending the field of view error to the equipment of the user at a higher priority. Other embodiments are disclosed.