Packed Video Frame Layout for Single-Decoder Volumetric Video
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Mobile electronic devices struggle to provide a quality immersive video experience due to the large number of decoder instantiations required for volumetric video data, which is typically handled by high-end devices like personal computers.
Innovation Solution
A frame packing technique is employed to consolidate video components into fewer bitstreams, allowing for fewer decoder instantiations by packaging multiple types of video data into a single packed video frame, which can be decoded with a single decoder.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If volumetric video data is processed using traditional methods with multiple separate bitstreams, then decoding accuracy and video quality are maintained, but the number of decoder instantiations increases significantly, making it unsuitable for mobile devices
Solution Approach 1:
The patent combines multiple separate video component bitstreams (geometry, texture, occupancy, attribute) into a single packed video frame bitstream. This merging reduces the number of decoder instantiations from multiple separate decoders to a single decoder, directly addressing the technical contradiction by lowering the operational complexity for mobile devices while maintaining all necessary video components in one unified structure
Solution Approach 2:
The packed video frame structure serves multiple functions simultaneously: it contains geometry data, texture data, occupancy data, and attribute data all in one bitstream. This multi-functional design allows a single decoder to handle what previously required multiple specialized decoders, resolving the contradiction between ease of operation and device complexity
2Productivity
If multiple separate bitstreams are used for different video components, then each component can be decoded with high precision, but mobile devices cannot handle the computational load of multiple decoder instantiations
Solution Approach 1:
The patent merges multiple video component streams into a single packed video frame bitstream that can be processed by one decoder. This consolidation improves processing efficiency on mobile devices by reducing the computational overhead of multiple decoder instantiations, directly resolving the contradiction between productivity and quantity of decoders
Solution Approach 2:
Within the single packed video frame, the patent maintains segmented regions for different video components (geometry, texture, occupancy, attribute). This segmentation allows the single decoder to efficiently process different components in an organized manner, achieving high processing efficiency without requiring multiple separate decoders
Data Source
AI summary
Methods, apparatus, systems and articles of manufacture to generate packed video frames are disclosed. A video encoding system disclosed herein includes a configuration determiner to create a packed video frame layout that includes regions into which video components are to be placed. The system also includes a frame generator to form packed video frames that include the video components placed into different regions. The encoding system further includes a frame information generator that generates packed video frame information that identifies characteristics of the packed video frame including (i) the identities of regions included in the packed video frame layout, (ii) types of video components included in the regions, or iii) information identifying the locations and dimensions of the regions. A video encoder of the encoding system encodes the frames and includes the packed video frame information to signal the inclusion of the packed video frames in the encoded bitstream.