VR Video Viewport Pixel Reassignment for Bandwidth Optimization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current technologies face challenges in providing high-quality 360-degree video experiences for virtual reality (VR) due to high bandwidth and resolution requirements, which can be unmanageable for existing networks and user devices, and also struggle with real-time processing and transmission of high-quality VR video content.
Innovation Solution
The solution involves a method that processes VR video into multiple viewport segments, allocating more pixels to specific regions, and using signaling information to optimize bitrates and improve encoding efficiency, while maintaining compatibility with existing hardware and streaming protocols.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If high resolution (above 4k) and high bitrate (above 60 Mbps) are used to transmit high quality VR video signals, then video quality is improved, but network bandwidth requirements become unmanageable for existing networks and user devices
Solution Approach 1:
The patent segments the VR video stream into multiple independent streams corresponding to different regions of interest (ROI). Each segmented stream is encoded at a lower resolution and bitrate suitable for the specific ROI, rather than encoding the entire high-resolution 360-degree video. This segmentation allows the system to deliver high perceived quality in important regions while reducing overall bandwidth consumption.
Solution Approach 2:
The patent applies different quality levels to different regions of the video based on their importance. High-resolution encoding is applied only to identified regions of interest (such as where speakers or important actions are located), while less important regions are encoded at lower resolutions. This local quality differentiation maintains overall video quality perception while significantly reducing total bandwidth requirements.
2Manufacturing precision
If existing transcoding methods are used to process high resolution VR video, then video quality is maintained, but computational power requirements become very high and stream preparation time increases exponentially
Solution Approach 1:
The patent performs preliminary identification and segmentation of regions of interest during the video encoding process itself, rather than requiring extensive post-processing or real-time transcoding. By pre-identifying ROIs and creating segmented streams in advance, the system reduces the computational burden during live streaming and eliminates the need for exponential-time transcoding operations.
3Adaptability or versatility
If high resolution VR video is transmitted to support interactive pan/tilt/zoom functionality, then user interaction quality is improved, but transmission reliability and latency constraints become difficult to meet with current technology
Solution Approach 1:
The patent segments the video content into multiple resolution layers and regions of interest, allowing the client to selectively request and receive only the necessary segments for current interaction needs. This segmentation enables fast switching between different viewports and resolution levels, meeting latency constraints while maintaining transmission reliability through selective data transmission.
Data Source
Figure 1
Figure 2
Figure 3~4
AI summary
The disclosure relates to optimizing and improving VR video resolution and bandwidth usage for VR videos. The processes and systems include receiving a video input and reassigning pixels within a viewport to maximize resolution around the center of the viewport. The process can include video frame stamping to provide a mechanism for a client-side player to determine characteristics of an optimized video frame display.