FOV Streaming Server Tile Selection via UE Feedback
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current MPEG media transport (MMT) technologies face challenges in efficiently delivering Field of View (FOV) streaming for 360° video content, which requires high bandwidth and lacks optimization for rendering only the relevant video tiles based on the user's viewing direction.
Innovation Solution
The solution involves a server-client communication system that uses feedback from user equipment (UE) to determine the user's field of view, allowing the server to send only the necessary video tiles, optimizing bandwidth usage by employing a signaling method to manage and render tiles efficiently within the MMT framework.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If 360° video content is streamed to provide immersive user experience, then the user experience quality is improved, but the bandwidth consumption increases significantly
Solution Approach 1:
The 360° video content is divided into multiple video tiles, allowing the system to transmit only the specific tiles corresponding to the user's current field of view rather than the entire 360° content, thereby reducing bandwidth consumption while maintaining immersive experience quality
Solution Approach 2:
The system transmits high-quality video data only for the specific region of interest (the user's field of view) while reducing or eliminating transmission of other regions, optimizing the allocation of bandwidth resources to where they are most needed
2Area of stationary object
If all video tiles are transmitted to ensure complete scene coverage, then the scene coverage is improved, but the bandwidth efficiency deteriorates
Solution Approach 1:
The system extracts and transmits only the necessary portion of video tiles that correspond to the user's field of view, separating the essential data from the redundant data, thereby improving bandwidth efficiency while maintaining adequate scene coverage
Solution Approach 2:
The system dynamically adjusts which video tiles are transmitted based on the user's real-time viewing direction, allowing the scene coverage to adapt to user behavior while optimizing bandwidth efficiency
3Loss of energy
If field of view tracking and tile selection is implemented, then the bandwidth efficiency is improved, but the system complexity increases
Solution Approach 1:
The system uses feedback from the user's viewing direction (obtained through head tracking or device orientation sensors) to dynamically determine which video tiles to transmit, creating a closed-loop system that improves bandwidth efficiency through adaptive content delivery
Solution Approach 2:
The patent introduces signaling mechanisms as intermediaries between the user equipment and the server, enabling the transmission of field of view information and tile selection instructions without requiring complex direct communication protocols
Data Source
Figure 1~2
Figure 3
Figure 4~5
AI summary
A server for streaming content includes a communication interface and a processor. The communication interface is configured to communicate with a user equipment (UE). The processor is configured to determine whether the UE supports viewing direction feedback. When the UE supports viewing direction feedback, the processor generates a first portion of the content corresponding to a first field of view of the UE and transmits the first portion of the content to the UE.