Rank Information Encoding for Panoramic Media Bandwidth Optimization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Immersive media content, such as 360-degree panoramic videos, requires high bandwidth for uniform visual quality, which is inefficient and exceeds current mobile network capabilities, necessitating a method to reduce bandwidth consumption while maintaining a high-quality user experience.
Innovation Solution
The technique involves determining and encoding rank information for different segments of panoramic media content, allowing for prioritization of processing based on user preferences and scene characteristics, thereby optimizing bandwidth usage by adjusting visual quality according to user focus and content importance.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If uniform visual quality is maintained across all segments of panoramic media content, then user viewing experience is improved, but bandwidth consumption increases significantly
Solution Approach 1:
The patent applies local quality by assigning different rank values to different segments of the panoramic image based on their importance. The center region (fovea) where users typically focus receives higher rank and thus higher quality encoding, while peripheral regions receive lower rank and lower quality encoding. This resolves the contradiction by maintaining high visual quality only where needed rather than uniformly across the entire image.
Solution Approach 2:
The patent divides the panoramic image into multiple segments or regions with different rank values. By segmenting the image and applying different quality levels to different segments, the system maintains high quality for important regions while reducing quality (and bandwidth) for less important regions, thus resolving the bandwidth-quality tradeoff.
2Manufacturing precision
If high bandwidth is allocated for immersive media content, then visual quality is improved, but network efficiency deteriorates given current mobile network capabilities
Solution Approach 1:
The patent changes the quality parameter dynamically based on segment importance and user focus. By using rank information to modulate the quality parameter for different regions, the system achieves high visual quality where needed while reducing overall bandwidth consumption, thereby improving network efficiency without sacrificing essential visual quality.
3Quantity of substance
If rank information is used to prioritize processing of certain segments, then bandwidth usage is optimized, but system complexity increases
Solution Approach 1:
The patent applies preliminary action by pre-calculating and embedding rank information into the bitstream during encoding. This rank information indicates the importance of different segments before transmission. The decoder can then use this pre-provided rank information to prioritize processing without requiring complex real-time analysis, thus optimizing bandwidth usage while limiting the increase in system complexity to manageable levels.
Data Source
AI summary
Methods, apparatus, and systems for providing consistent immersive media viewing experiences to user while reducing bandwidth consumption are disclosed. In one example aspect, a method for processing multimedia content includes determining, for a conversion between a frame of panoramic media content comprising multiple segments and a bitstream representation of the frame of panoramic media content, multiple sets of rank information associated with the frame. Each set of the rank information indicates a priority level for processing a segment of the frame of panoramic media content. The method also includes performing the conversion based on the multiple sets of rank information.