Track Derivation for 3D Video Sample Selection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional approaches for selecting and switching between video tracks in the ISO Base Media File Format (ISOBMFF) are inadequate, as they cannot perform track selection using a derivation operation, fail to select content at the sample level, and do not allow for the generation of a new track with a different ID, leading to inefficient processing and bandwidth usage in 3D content delivery.
Innovation Solution
The implementation of track derivation operations that enable selecting and switching between input video tracks at the sample level, allowing for the generation of a derived track with specified transformation operations, which can encapsulate samples from multiple input tracks and associate metadata, thereby optimizing 3D content delivery by processing only the viewed content.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If all spherical content is encoded and delivered, then the user can view content at any viewport, but bandwidth and computational resources are consumed excessively
Solution Approach 1:
The spherical video content is segmented into multiple discrete tracks, each representing a specific camera viewpoint or region. The system then selects and transmits only the relevant tracks based on the user's viewport, rather than transmitting all possible content. This segmentation allows viewport flexibility while reducing bandwidth consumption by excluding unnecessary content.
2Reliability
If all spherical content is processed and delivered, then complete content availability is ensured, but computational resources and processing time are excessive
Solution Approach 1:
The system extracts and processes only the specific content needed for the current viewport rather than processing the entire spherical video. By identifying which camera tracks correspond to the user's viewing angle and extracting only those for processing, the system maintains content availability for the viewed region while significantly improving processing efficiency.
3Ease of operation
If conventional track selection methods are used, then track switching is possible, but sample-level selection and new track generation are not achieved
Solution Approach 1:
The track selection system is made dynamic by enabling sample-level selection rather than fixed track-level selection. The derivation operation allows flexible combination of samples from multiple input tracks to generate new derived tracks, providing adaptability at the sample level while maintaining ease of operation through automated selection processes.
4Quantity of substance
If viewport-dependent content delivery is implemented, then bandwidth efficiency is improved, but system complexity increases
Solution Approach 1:
A track derivation operation serves as an intermediary mechanism that handles the complexity of viewport-dependent selection. This derivation operation automatically determines which tracks and samples to select based on viewport information, shielding the client from direct complexity while achieving bandwidth efficiency through automated track selection and combination.
Data Source
AI summary
The techniques described herein relate to methods, apparatus, and computer readable media configured to accessing multimedia data that includes a plurality of media tracks that each include an associated series of samples of media data, and a derived track comprising a set of derivation operations to perform to generate a series of samples of media data for the derived track. A derivation operation of the set is performed to generate a portion of media data for the derived track, which includes: determining, based on the derivation operation, a group of media tracks from the plurality by determining each media track in the group meets a grouping criteria, selecting one media track from the group of media tracks, and adding a sample from the one media track to the derived track to generate the portion of the derived track.