Spherical Video Tile Encoding for Bandwidth Optimization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Streaming spherical video consumes significant system resources due to the large number of bits required for transmission, processing, and memory usage in existing encoding and decoding technologies.
Innovation Solution
The method involves determining a tile position in a spherical video frame based on a viewer's perspective, selecting and encoding a two-dimensional tile at a higher quality, mapping the frame to a two-dimensional representation using a projection algorithm, and encoding this representation at a lower quality, allowing for efficient transmission of only visible portions of the video.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If spherical video is encoded and transmitted in full quality, then video quality is maintained, but bandwidth consumption and processing resources increase significantly
Solution Approach 1:
The spherical video frame is divided into multiple two-dimensional tiles, each representing a specific portion of the spherical video. Only the tile corresponding to the viewer's current perspective is encoded and transmitted at high quality, while other tiles are either not transmitted or transmitted at lower quality, thereby reducing overall bandwidth consumption while maintaining video quality for the visible portion
Solution Approach 2:
Different quality levels are applied to different regions of the spherical video. The tile corresponding to the viewer's perspective is encoded at high quality to ensure visual fidelity, while other tiles are encoded at lower quality or omitted entirely, optimizing the trade-off between video quality and bandwidth usage based on the actual viewing area
2Measurement precision
If spherical video is encoded with high quality, then video quality is improved, but processing power and memory usage increase
Solution Approach 1:
The method extracts only the necessary portion of the spherical video (the tile corresponding to the viewer's perspective) for high-quality encoding and transmission. By isolating and processing only this relevant portion, the computational complexity and memory requirements are significantly reduced compared to encoding the entire spherical video frame at high quality
Solution Approach 2:
By segmenting the spherical video into multiple tiles and processing only the relevant tile, the overall processing workload is divided and reduced. The encoder and decoder only need to handle a small fraction of the total data at high quality, thereby reducing processing power and memory usage while maintaining video quality for the visible area
3Quantity of substance
If only visible portions are transmitted, then bandwidth is reduced, but video completeness is compromised
Solution Approach 1:
The system dynamically adapts to the viewer's changing perspective by receiving updates about the view perspective during playback and adjusting which tile is transmitted. This dynamic approach ensures that the most relevant portion of the spherical video is always transmitted at high quality, maintaining both bandwidth efficiency and video completeness for the actual viewing area
Solution Approach 2:
The method prepares multiple two-dimensional tiles in advance, each corresponding to different portions of the spherical video. When the viewer's perspective changes, the system can quickly switch to transmitting the appropriate pre-prepared tile, ensuring continuous high-quality transmission without needing to re-encode the entire video, thus balancing bandwidth usage with video completeness
Data Source
AI summary
A method includes determining a tile position in a frame of a spherical video based on a view perspective, selecting a portion of the frame of the spherical video as a two dimensional tile based on the tile position, encoding the two dimensional tile at a first quality, mapping the frame of the spherical video to a two dimensional representation of the spherical video based on a two dimensional projection algorithm, and encoding the two dimensional representation of the spherical video at a second quality.