Viewport-Based Spatial Region Encoding for VR Bandwidth Optimization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Virtual reality content requires high bandwidth for high spatial and temporal resolution, leading to increased data transmission rates that are challenging for current low-latency high-bandwidth channels, especially with the need for high frame rates and resolutions like 8K for head-mounted displays.
Innovation Solution
The method involves transmitting only a portion of the virtual reality content at the highest picture rate, dividing it into regions based on viewport information, with the current and expected viewports transmitted at different picture rates, and using multiple transmission channels to efficiently process and render the content, allowing for scalable layers and adaptive encoding.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If virtual reality content is transmitted at high spatial and temporal resolution to maintain picture quality, then the data transmission rate increases, but the bandwidth requirements become challenging for current low-latency high-bandwidth channels
Solution Approach 1:
The spatial content is divided into multiple regions (first spatial region and second spatial region) that are transmitted at different picture rates. The first spatial region corresponding to the viewport is transmitted at a higher picture rate to maintain picture quality, while the second spatial region is transmitted at a lower picture rate, thereby reducing the overall data transmission rate while maintaining acceptable picture quality in the important viewport region.
2Speed
If the entire picture sequence is transmitted at the highest picture rate to maintain temporal resolution, then the data transmission rate increases, but the bandwidth consumption becomes excessive
Solution Approach 1:
Different picture rates are applied to different spatial regions based on their importance. The first spatial region (viewport) receives higher picture rate to maintain temporal resolution where it matters most, while the second spatial region receives lower picture rate, thereby optimizing bandwidth consumption while maintaining acceptable temporal resolution in the critical viewport area.
3Ease of operation
If all spatial regions are transmitted with equal quality and rate, then the system is simple to implement, but the bandwidth efficiency is suboptimal
Solution Approach 1:
The system dynamically adapts the picture rate for different spatial regions based on viewport information. The encoder determines which spatial region corresponds to the viewport and assigns different picture rates accordingly, allowing the system to optimize bandwidth efficiency while maintaining simplicity in implementation through automated region identification and differential encoding.
Data Source
AI summary
The invention relates to a method and technical equipment, wherein the method comprises obtaining a picture sequence; selecting a first spatial region and a second spatial region within a picture area of pictures of the picture sequence, the second spatial region differing from the first spatial region; obtaining a first spatial region sequence, the first spatial region sequence comprising the first spatial region of the pictures of the picture sequence; obtaining a second spatial region sequence, the second spatial region sequence comprising the second spatial region of the pictures of the picture sequence; transmitting the first spatial region sequence at a first picture rate; and transmitting the second spatial region sequence at a second picture rate, the first picture rate being different from the second picture rate.