Layered Volumetric Video Bitstream Signaling and Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current volumetric video coding technologies, such as V3C, fail to effectively identify and manage layered video components within bitstreams, leading to inefficiencies in decoding and rendering, particularly when redundant source representations are involved, as they lack signaling information about layer relationships and constraints.
Innovation Solution
The method involves encoding volumetric video components using a layered video encoder, maintaining information about layer relationships, and encapsulating these components into V3C units with signaling information that allows for decoding and rendering of complete or partial bitstreams, ubiquitously, by providing signaling elements that indicate layer relationships and constraints.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If V3C video components are encoded by a layered video codec and then split into V3C unit payloads, then the components can be stored in independent payloads for flexible processing, but it becomes impossible to reconstruct the original layered video coded bitstream and lose the benefits of layered video coding
Solution Approach 1:
The patent segments the layered video bitstream into independent V3C unit payloads, each containing specific video components (texture, geometry, occupancy) at different layers. This segmentation allows flexible processing and storage while maintaining the ability to reconstruct the original bitstream through proper reassembly of the segmented units.
Solution Approach 2:
The patent introduces an intermediary data structure that preserves the layered video coding information during the transition from layered video codec output to independent V3C unit payloads. This intermediary structure maintains the relationships between layers and components, enabling reconstruction of the original bitstream while allowing independent processing of each payload.
2Ease of operation
If V3C bitstream stores video components within independent V3C unit payloads, then processing and transmission become more flexible, but the decoding and rendering efficiency decreases due to lack of layer relationship information
Solution Approach 1:
The patent performs preliminary organization of video components into properly structured V3C unit payloads that include all necessary layer relationship information. By pre-organizing the data with embedded metadata about layer dependencies and component relationships, the decoding and rendering processes can proceed efficiently without needing to perform complex analysis during playback.
3Adaptability or versatility
If multiple redundant source representations are captured from different viewing angles, then the volumetric video content becomes more comprehensive, but the data redundancy increases significantly
Solution Approach 1:
The patent merges multiple redundant source representations from different viewing angles into a unified layered video structure. By combining the redundant information into a single organized bitstream with proper layer relationships, the system maintains comprehensive volumetric content while reducing the effective data quantity through efficient representation and elimination of true redundancy.
Data Source
Figure 1a
Figure 1b
Figure 2a
AI summary
There is disclosed a method comprising: obtaining bitstreams of video components of a layered volumetric video; analyzing the video components to determine a relationship between the video components and corresponding layers; providing signaling elements to indicate if the volumetric video comprises video components at different layers; providing in the signaling elements information of the relationship between the video components and corresponding layers; encapsulating the layered video coded bitstreams to visual volumetric video-based coding units; and constructing a bitstream according to specified constraints. There is also disclosed a method comprising: receiving a bitstream comprising video components of a layered volumetric video; demultiplexing video components of the volumetric video; receiving signaling elements; examining the signaling elements to determine if the volumetric video comprises video components at different layers; extracting from the one or more signaling elements information of relationship between the video components and corresponding layers; and re-multiplexing the layered video components into one layered video bitstream for video decoding.