Viewport Indication in Volumetric Point Cloud Streaming
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current multimedia telephony services (MTSI) lack effective mechanisms for dynamically indicating a user-selected region of interest (ROI) during video streaming, leading to suboptimal bandwidth utilization and user experience in immersive 6DoF experiences, as they do not enable dynamic switching to a user-selected area within the video frame.
Innovation Solution
The implementation of new RTP/RTCP-based procedures for viewport indication, where a receiving device transmits RTCP feedback messages with viewport information to a transmitting device, allowing for optimized encoding and transmission of point cloud video content based on the user's selected region of interest, using spherical coordinate systems and specific angle parameters.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If viewport indication mechanisms are not implemented in MTSI, then the system maintains simplicity and interoperability, but bandwidth utilization and user experience in immersive 6DoF applications deteriorate
Solution Approach 1:
The patent extends the existing RTCP feedback mechanism, originally designed for general quality-of-service feedback, to carry viewport indication information. By making RTCP multi-functional (handling both traditional feedback and new viewport signaling), the system gains adaptability for 6DoF applications without adding separate dedicated signaling protocols, thus limiting complexity increase.
Solution Approach 2:
The patent introduces new parameters within existing RTCP message structures to convey viewport information. Instead of creating entirely new message types or protocols, the invention modifies parameter fields in existing messages to encode region-of-interest data, enabling adaptability while maintaining compatibility with current MTSI infrastructure.
2Loss of energy
If encoding resources are distributed uniformly across the entire video frame, then encoding is simpler, but bandwidth utilization deteriorates when a specific ROI is selected
Solution Approach 1:
The patent enables the transmitting device to apply different encoding qualities to different regions of the video frame based on viewport information received via RTCP. The selected ROI receives higher encoding quality and more bandwidth resources, while non-ROI regions use lower quality encoding, optimizing bandwidth utilization according to user interest without requiring complex manual encoding adjustments.
Solution Approach 2:
The patent makes the encoding resource allocation dynamic by continuously receiving updated viewport indications through RTCP feedback messages. The transmitting device adapts its encoding strategy in real-time based on the user's current region of interest, allowing flexible resource distribution that responds to changing viewing requirements rather than using static uniform encoding.
3Productivity
If dynamic viewport indication is implemented, then user experience in 6DoF applications improves, but the complexity of real-time feedback mechanisms increases
Solution Approach 1:
The patent leverages the existing RTCP protocol's multi-functional capability to handle both traditional quality feedback and new viewport indication tasks. By reusing an established real-time feedback infrastructure for dual purposes, the system improves 6DoF user experience without building a completely new complex feedback protocol from scratch.
Solution Approach 2:
The patent implements a feedback loop where the receiving device sends RTCP messages containing viewport information back to the transmitting device in real-time. This feedback mechanism enables dynamic adaptation of the video stream to user preferences, enhancing user experience while utilizing an already-standardized feedback protocol to limit complexity increases.
Data Source
AI summary
Embodiments herein provide mechanisms for a receiving device to indicate to a transmitting device viewport information to indicate a region of interest for point cloud video content. For example, the receiving device may transmit a real-time transport control protocol (RTCP) feedback message that includes the viewport information. The viewport information includes an indication of a reference point for the region of interest. The receiving device may receive, from the transmitting device, the point cloud video for the region of interest based on the viewport information. Other embodiments may be described and claimed.