Region-wise Packing for VR Video Bandwidth Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current technologies for storing and transmitting encoded video data, particularly in virtual reality applications, face inefficiencies due to the need to send redundant data across overlapping regions, leading to increased bandwidth consumption and processing requirements.
Innovation Solution
The implementation of region-wise packing techniques that allow for overlapping packed regions in both container files and video bitstreams, enabling the avoidance of redundant data transmission by signaling content coverage and frame packing information in Dynamic Adaptive Streaming over HTTP (DASH) Media Presentation Descriptions, allowing receivers to properly de-frame-pack and render video content.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of energy
If region-wise packing is implemented to prevent sending redundant picture areas, then bandwidth consumption is reduced, but device complexity increases due to the need for unpacking and projected region formation processing
Solution Approach 1:
The video content is divided into multiple packed regions, each representing a specific field of view or view direction. By segmenting the overall video content into manageable regional components, the system can efficiently pack only the necessary regions for each viewpoint, reducing redundant data transmission while maintaining organized structure for streamlined processing.
Solution Approach 2:
The patent introduces a new dimension of spatial organization by mapping three-dimensional video content from multiple viewpoints into a two-dimensional packed region structure. This dimensional transformation enables efficient representation of multi-view content in a compact format, reducing bandwidth requirements while preserving the ability to reconstruct specific views through selective unpacking of relevant regions.
2Productivity
If overlapping packed regions are processed to avoid redundant data transmission, then data efficiency is improved, but processing cycles increase due to unpacking and projected region formation
Solution Approach 1:
The video content is pre-processed and organized into packed regions during encoding, with metadata about region boundaries and overlaps prepared in advance. This preliminary organization allows the receiving device to efficiently process only the necessary regions without redundant operations, reducing processing cycles while maintaining data transmission efficiency.
Solution Approach 2:
Different packed regions are processed with different levels of detail and processing intensity based on their specific characteristics and importance. Critical regions receive more processing attention while less important regions use simplified processing, optimizing the balance between processing speed and data efficiency without uniformly increasing processing cycles across all regions.
Data Source
AI summary
In one example, a device for processing media content includes a memory configured to store media content; and one or more processors implemented in circuitry and configured to process a first packed region of the media content, wherein to process the first packed region, the one or more processors are configured to unpack the first packed region to produce a first unpacked region, and form a first projected region from the first unpacked region; and process a second packed region of the media content, the second packed region overlapping the first packed region at least in part, wherein to process the second packed region, the one or more processors are configured to unpack the second packed region to produce a second unpacked region, and form a second projected region from the second unpacked region.