3D Video Sub-Picture Signaling for Complete Composition Rendering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In 3D image encoding, region-wise packing may lead to holes in the rendered image due to the need for providing information about a minimum sub-picture set required for rendering, which is not adequately addressed by existing technologies.
Innovation Solution
A method and device for transmitting and receiving 3D data that includes generating sub-picture asset information to ensure that sub-pictures are rendered together, using asset descriptors to indicate whether content is a sub-picture and providing information about other sub-pictures constituting a composition picture.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If region-wise packing is performed to increase compression efficiency, then compression efficiency is improved, but holes may be generated in the rendered 3D image due to incomplete sub-picture set transmission
Solution Approach 1:
The transmitting device performs preliminary action by generating asset descriptor information that identifies the complete set of sub-pictures required for rendering before transmission. This allows the receiving device to pre-fetch or request all necessary sub-picture data, ensuring complete rendering without holes while maintaining region-wise packing compression efficiency.
Solution Approach 2:
The asset descriptor acts as an intermediary between the transmitted sub-picture data and the rendering process. It carries metadata that describes the spatial relationships and completeness requirements of the sub-picture set, enabling the receiving device to correctly assemble the packed regions into a complete 3D image without missing components.
2Quantity of substance
If only selected sub-picture data is transmitted to reduce transmission amount, then transmission data amount is reduced, but information about minimum sub-picture set required for rendering is lost
Solution Approach 1:
The invention extracts and separates the rendering configuration information into a distinct asset descriptor structure that accompanies the transmitted sub-picture data. This extracted metadata contains the minimum sub-picture set information required for rendering, allowing it to be transmitted efficiently alongside the compressed video data without bloating the primary content stream.
Solution Approach 2:
The asset descriptor uses parameter-based signaling to concisely encode the minimum sub-picture set requirements. By changing the representation from transmitting complete configuration data to transmitting compact parameter sets that define the required sub-picture combinations, the information loss is prevented while transmission amount is minimized.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
The present disclosure relates to a method and device for transmitting and receiving video content including three-dimensional (3D) data. The method of transmitting video content through a plurality of assets includes identifying whether content transmitted through an asset is a sub-picture; when the content transmitted through the asset is the sub-picture, generating sub-picture asset information comprising information about other sub-pictures constituting a composition picture together with the sub-picture; and transmitting the sub-picture asset information and the content.