Immersive Media PDU Set Importance Adaptation for Viewport Delivery
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding technologies for immersive media, such as 360-degree and volumetric video, lack efficient methods for spatially adapting protocol data unit (PDU) set importance values, leading to suboptimal transmission and decoding efficiency, especially in viewport-dependent delivery scenarios.
Innovation Solution
The method involves defining PDU sets comprising spatial regions of a frame and performing spatial adaptation of PDU set importance values based on adaptation criteria, assigning different importance values at different time points, and signaling these adaptations in the coded video bitstream for efficient transmission and decoding.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If spatial adaptation of PDU set importance values is not performed, then transmission and decoding efficiency is maintained with uniform importance values, but transmission efficiency and decoding performance are suboptimal in viewport-dependent delivery scenarios
Solution Approach 1:
The patent applies local quality by assigning different importance values to different spatial regions (PDU sets) within the same video frame. Specifically, PDU sets corresponding to the viewport region are assigned higher importance values while non-viewport regions receive lower importance values, allowing differential treatment of different spatial locations to optimize transmission efficiency
Solution Approach 2:
The patent implements dynamics by enabling temporal variation of PDU set importance values. The importance values can be adapted at different time points based on changing viewport information, allowing the system to dynamically respond to user viewing behavior and optimize delivery performance over time
2Loss of energy
If all regions are transmitted with equal importance, then transmission is simplified, but bandwidth is wasted on non-essential regions
Solution Approach 1:
The patent changes the importance parameter of PDU sets based on their spatial location relative to the viewport. By modifying the importance value parameter differentially across PDU sets, the system enables optimized bandwidth utilization where higher importance regions receive prioritized transmission and lower importance regions can be transmitted at reduced quality or skipped entirely
3Measurement precision
If spatial adaptation of PDU set importance values is implemented, then decoding performance is optimized for viewport regions, but signaling overhead increases
Solution Approach 1:
The patent segments the video frame into multiple PDU sets that can be independently assigned importance values. This segmentation allows the signaling mechanism to efficiently represent spatial variations by assigning importance values to discrete PDU set units, reducing the overall signaling overhead compared to per-pixel or per-block approaches
Data Source
AI summary
A sender, of a bitstream of coded video formed from volumetric video, defines PDU sets including spatial region(s) of a frame of the coded video. The sender performs spatial adaptation of PDU set importance values based on adaptation criteria. The spatial adaptation is signaled in the coded video of the bitstream. The PDU sets are assigned, via the spatial adaptation, different PDU set importance values at different time points. The sender sends, toward a receiver, the bitstream including the coded video. A receiver receives the bitstream including the coded video, parses information, and outputs at least part of a decoded volumetric video based on the parsed information.