Wide-Angle Video Tile Caching for Viewport-Predicted Streaming
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional wide-angle video communication systems waste network bandwidth and computational resources by transmitting and encoding all tiles of a wide-angle video, even though a viewer can only view a portion of the video at any given time, leading to inefficient use of resources and degraded performance.
Innovation Solution
Implementing viewport prediction at the receiver to identify tiles likely to be viewed in the near future, transmitting requests for cached tile bitstreams through an edge node, and optimizing encoding and re-transmission processes to ensure tiles are decoded and displayed efficiently.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If all tiles of wide-angle video are transmitted and encoded, then complete video coverage is provided, but network bandwidth and computational resources are wasted
Solution Approach 1:
The wide-angle video is divided into multiple tiles, allowing selective transmission and decoding of only those tiles that are currently or predicted to be within the user's viewport, rather than transmitting the entire video content
Solution Approach 2:
The system performs preliminary viewport prediction to identify tiles that will be viewed in the near future, allowing these tiles to be pre-loaded and cached at edge nodes before actual viewing occurs, reducing latency and improving streaming efficiency
2Reliability
If all tiles are transmitted and encoded, then no viewing gaps occur, but processing power and encoding resources are depleted
Solution Approach 1:
The system transmits slightly more tiles than currently visible by predicting future viewport positions, ensuring viewing continuity without processing all possible tiles. This partial action approach balances resource consumption with maintaining uninterrupted viewing experience
3Loss of energy
If viewport prediction is implemented, then bandwidth efficiency improves, but system complexity increases
Solution Approach 1:
Edge nodes are introduced as intermediary components between the content delivery network and end users. These edge nodes perform viewport prediction, tile caching, and intelligent routing, offloading complexity from both the core network and user devices while improving overall system efficiency
Data Source
AI summary
A device for real-time wide-angle video communication in a network including the device, a sending device and a receiving device, the device including a processor configured to receive, from the receiving device, a request for a list of bitstreams, wherein each bitstream is associated with a respective tile of a wide-angle image of a compressed wide-angle video; transmit, by the device to the sending device, a request to obtain first bitstreams of the list of bitstreams, wherein the first bitstreams are not cached at the device; and transmit, by the device to the receiving device, second bitstreams of the list of bitstreams, wherein the second bitstreams are cached at the device; maintain, by the device, an edge list of tiles corresponding to cached bitstreams, wherein the edge list of tiles includes tiles currently used and tiles predicted to be used by the receiving device.