Hierarchical Track Structure for 3D Media Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current network-based media processing frameworks are limited by their reliance on flat file formats, which do not support hierarchical track structures or track derivation operations, leading to inefficient processing of 3D content and high bandwidth consumption, especially in viewport-dependent applications like VR and 360-degree video.
Innovation Solution
Implementing a hierarchical track structure within network-based media processing frameworks to enable track derivation techniques, allowing media processing entities to receive input tracks and associated task instruction data to generate new output tracks through specified transform properties such as stitching, projection, and transcoding, thereby distributing processing tasks across multiple entities.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If all spherical content is processed and delivered, then complete viewport coverage is achieved, but bandwidth consumption and compute resources increase significantly
Solution Approach 1:
The patent extracts and processes only the necessary viewport-specific portions of spherical content rather than the entire content. By identifying and isolating the relevant spherical regions corresponding to user viewports, the system delivers only the extracted portions, reducing bandwidth consumption while maintaining complete viewport coverage.
Solution Approach 2:
The patent applies local quality by processing and delivering content with different qualities based on viewport requirements. Instead of uniformly processing all spherical content, the system selectively processes only the local regions that correspond to actual user viewports, optimizing resource allocation and reducing overall processing and bandwidth requirements.
2Loss of energy
If viewport-dependent processing is implemented, then bandwidth consumption is reduced, but processing complexity and device requirements increase
Solution Approach 1:
The patent segments spherical content into distinct viewport-specific portions based on user viewing angles and device capabilities. By dividing the content delivery task into segmented viewport regions, the system reduces bandwidth consumption while managing processing complexity through structured segmentation rather than monolithic processing.
Solution Approach 2:
The patent performs preliminary actions by pre-identifying and pre-processing viewport parameters and spherical content mappings before actual content delivery. This preliminary setup enables efficient viewport-dependent processing during content delivery, reducing both bandwidth consumption and real-time processing complexity.
3Productivity
If hierarchical track structure with track derivation is used, then processing efficiency improves, but file format complexity increases
Solution Approach 1:
The patent implements a hierarchical track structure where tracks are nested within files and can contain derived tracks. This nesting approach enables processing efficiency by allowing derived tracks to reference and build upon parent tracks, avoiding redundant processing while organizing complex content relationships in a structured, manageable hierarchy.
Solution Approach 2:
The patent applies universality by designing the hierarchical track structure to serve multiple functions: organizing spherical content, defining derivation relationships, specifying processing operations, and enabling viewport-dependent delivery. This multi-functional design improves processing efficiency without requiring separate systems for each function, though it does increase file format complexity.
Data Source
AI summary
The techniques described herein relate to methods, apparatus, and computer readable media configured to perform media processing tasks. A media processing entity includes a processor in communication with a memory, wherein the memory stores computer-readable instructions that, when executed by the processor, cause the processor to perform receiving, from a remote computing device, multi-view multimedia data comprising a hierarchical track structure comprising at least a first track comprising first media data at a first level of the hierarchical track structure, and a second track comprising task instruction data at a second level in the hierarchical track structure that is different than the first level of the first track. The instructions further cause the processor to perform processing the first media data of the first track based on the task instruction data of the second track to generate modified media data and an output track that includes the modified media data.