Dynamic Adaptation of Volumetric Content Sub-bitstreams in Streaming
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding systems struggle with efficiently adapting to changes in visual volumetric content, such as point cloud component sub-bitstreams, in point cloud streaming services, particularly in terms of bitrate adaptation and codec changes.
Innovation Solution
The system employs dynamic adaptation of visual volumetric content by using messages and parameter sets to indicate changes in active attributes and codecs. This includes using messages like the Component Codec Change (CCC) SEI message, Active Attributes (AA) SEI message, Component Change Parameter Set (CCPS), and Parameter Set Activation (PSA) SEI message to inform the decoder about these changes, allowing it to adjust the decoding process accordingly.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If all attribute sub-bitstreams are transmitted and decoded, then visual volumetric content quality is improved, but bandwidth usage and processing complexity increase
Solution Approach 1:
The patent implements dynamic adaptation of attribute sub-bitstreams by introducing SEI messages (AA message and PSA message) that enable the decoder to adaptively select which attribute sub-bitstreams to decode based on current operating conditions such as bandwidth availability, device capabilities, and content importance. This dynamic selection mechanism allows the system to transmit all attribute sub-bitstreams but decode only the necessary subset, resolving the contradiction between maintaining high visual quality and reducing bandwidth consumption.
2Adaptability or versatility
If multiple codecs are supported for different visual volumetric content components, then adaptability is improved, but device complexity increases
Solution Approach 1:
The patent introduces SEI messages as intermediary signaling mechanisms that carry codec identification and selection information. The CCC (Component Codec Change) SEI message specifically informs the decoder about codec changes for different visual volumetric content components without requiring the decoder to implement all possible codecs simultaneously. This intermediary signaling layer enables multi-codec adaptability while maintaining manageable decoder complexity by allowing selective codec implementation based on actual content requirements.
3Productivity
If attribute changes are signaled frequently, then streaming quality adaptation is improved, but message overhead increases
Solution Approach 1:
The patent employs preliminary action by using PSA (Parameter Set Activation) SEI messages to pre-signal which attribute sub-bitstreams will be active in upcoming content segments. This allows the decoder to prepare appropriate decoding configurations in advance, enabling rapid quality adaptation when attribute changes occur without requiring excessive signaling overhead during actual content transmission. The preliminary signaling reduces the need for frequent change notifications by establishing expectations beforehand.
Data Source
AI summary
A media content processing device may decode visual volumetric content based on one or more messages, which may indicate which attribute sub-bitstream of one or more attribute sub-bitstreams indicated in a parameter set is active. The parameter set may include a visual volumetric video-based parameter set. The message indicating one or more active attribute sub-bitstreams may be received by the decoder. A decoder may perform decoding, such as determining which attribute sub-bitstream to use for decoding visual media content, based on the one or more messages. The one or more messages may be generated and sent to a decoder, for example, to indicate the deactivation of the one or more attribute sub-bitstreams. The decoder may determine an inactive attribute sub-bitstream and skip the inactive attribute sub-bitstream for decoding the visual media content based on the one or more messages.