HEVC Tile Segmentation for Low-Traffic Panorama Streaming
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current HEVC-tiled video streaming methods face challenges in reducing network traffic and processor load while maintaining high compression efficiency, often requiring numerous HTTP requests and compromising video quality due to the absence of spatial and temporal decoding dependencies between tiles.
Innovation Solution
The solution involves grouping HEVC tiles into spatial segments, allowing for independent decoding and reduced network traffic by using a spatial manifest file to request and deliver video data as a single HEVC-tiled stream, which can be directly processed by a single HEVC decoder, thereby minimizing processor resources and network traffic.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If HEVC tiles are independently encoded to enable selective decoding of subsets, then decoder flexibility and bandwidth efficiency are improved, but compression efficiency deteriorates due to loss of spatial and temporal predictions between tiles
Solution Approach 1:
The video stream is segmented into multiple spatial segments, each comprising one or more HEVC tiles. This segmentation enables the decoder to selectively decode only the spatial segments containing tiles of interest, improving adaptability and bandwidth efficiency while maintaining compression efficiency within each segment through preserved spatial and temporal predictions.
Solution Approach 2:
Spatial segments are configured with local decoding independence, where prediction is maintained within each segment but not across segment boundaries. This local quality approach allows flexible selective decoding of specific regions while preserving compression efficiency locally, resolving the contradiction between decoder flexibility and overall compression efficiency.
2Loss of energy
If multiple independent tile streams are streamed to enable ROI selection, then bandwidth usage is reduced, but network traffic complexity increases due to numerous HTTP requests
Solution Approach 1:
Multiple HEVC tiles are merged into spatial segments that are transmitted as unified video streams. This merging reduces network traffic complexity by eliminating the need for numerous separate HTTP requests for individual tiles, while still enabling selective decoding of specific tiles within the received segments, thus maintaining bandwidth efficiency.
3Productivity
If HEVC tiles are processed in parallel using multi-core processors, then decoding speed is improved, but device complexity and processor resource management become more challenging
Solution Approach 1:
The video data is segmented into spatial segments that can be independently decoded. This segmentation enables parallel processing of multiple spatial segments using multi-core processors, improving decoding speed while simplifying resource management compared to fine-grained tile-level parallelism, as the system only needs to manage a smaller number of independent decoding tasks.
Data Source
Figure 1A~1B
Figure 2
Figure 3
AI summary
A method is described of streaming HEVC-tiled video data to a client device comprising: providing said client device with a spatial manifest file comprising one or more spatial segments identifiers for locating one or more delivery nodes configured for delivering video data associated with a spatial segment identified by at least one of said one or more spatial segments identifiers, preferably (part of) one or more URLs, to said client device, a spatial segment being associated with HEVC-tiled video data comprising a subset of HEVC tiles of a HEVC-tiled (panorama) video stream; and, selecting a spatial segment identifier in said spatial manifest file for requesting a delivery node to deliver at least part of the video data of a spatial segment as a HEVC-tiled video stream to the client device.