Tile-Based 360-Degree Video Streaming Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current 360-degree video streaming technologies are inefficient due to the practice of fetching entire video frames, leading to high bandwidth usage and resource consumption on cellular networks, as they include both visible and invisible portions, which is not optimized for limited bandwidth and fluctuating throughput.
Innovation Solution
The system determines an optimal segment size for tile-based 360-degree video streaming by identifying the field of view and segmenting the video into tiles that only overlap with the viewer's field of view, allowing for efficient delivery of only the visible portions and reducing unnecessary data transfer.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If entire video frames are fetched for 360-degree video streaming, then complete video content is delivered, but bandwidth usage increases and resource consumption rises on cellular networks
Solution Approach 1:
The video frame is divided into multiple tiles, and only the tiles that overlap with the viewer's field of view are selected for delivery. This segmentation allows the system to transmit a subset of the complete video content, reducing bandwidth usage while maintaining the reliability of delivering all visible content within the user's viewing area.
2Ease of manufacture
If traditional video delivery schemes are used for 360 videos, then deployment is simplified, but cellular network efficiency deteriorates due to limited bandwidth and high energy consumption
Solution Approach 1:
The system dynamically determines the viewer's field of view and adapts the video delivery by selecting only the relevant tiles that overlap with the current viewing area. This dynamic adaptation optimizes cellular network efficiency by reducing the amount of data transmitted, while the underlying tile-based structure maintains deployment simplicity through compatibility with existing video coding standards.
3Reliability
If visible and invisible video portions are both transmitted, then no viewing area is missed, but data transfer volume increases unnecessarily
Solution Approach 1:
The system extracts only the necessary portion of the video content by identifying and selecting tiles that overlap with the viewer's field of view. This extraction process eliminates the transmission of invisible portions while ensuring that all visible content within the viewing area is delivered, thereby reducing data transfer volume without compromising viewing area coverage.
Data Source
AI summary
Aspects of the subject disclosure may include, for example, identifying a field of view (FoV) within a first frame of a video that occupies a sub-portion of the frame. A size is determined by subdividing a portion of the video according to a tiling scenario. Tiles overlapping the FoV are detected, and an updated size is determined based on an encoded version of the tiles and compared to a reference size. Responsive to the updated size being less than the reference size, the reference size is adjusted to the updated size, the tiling scenario is adjusted according to an adjusted tiling scenario, and the determining of the size is repeated based on the adjusted tiling scenario. Responsive to the updated size not being less than the reference size, a preferred tiling scenario is identified based on the adjusted tiling scenario for tiling the video. Other embodiments are disclosed.