HEVC File Format STSA Sample Grouping and Up-Switching
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The existing designs for storage of High Efficiency Video Coding (HEVC) content lack a compact way to signal samples containing Step-Wise Temporal Sub-Layer Access (STSA) pictures and do not efficiently indicate whether temporal sub-layer up-switching to any higher temporal layer can be performed at any sample.
Innovation Solution
A file format is developed that includes a SampleToGroupBox identifying a sample group with STSA samples and an HEVC decoder configuration record indicating whether all Sequence Parameter Sets (SPSs) allow temporal sub-layer up-switching, enabling efficient identification and decoding of STSA samples and determining up-switching capabilities.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If existing HEVC content storage designs are used, then the file format can store video content, but it lacks a compact way to signal STSA samples and indicate up-switching capabilities
Solution Approach 1:
The patent segments the file format into distinct functional components: SampleToGroupBox for identifying STSA samples, HEVCDecoderConfigurationRecord for indicating up-switching capabilities, and separate sample data structures. This segmentation allows each component to handle specific information efficiently, reducing overall information loss while maintaining manageable complexity.
Solution Approach 2:
The patent introduces intermediary data structures (SampleToGroupBox, HEVCDecoderConfigurationRecord) that act as mediators between the raw video samples and the decoding process. These intermediaries compactly signal STSA sample identification and up-switching capabilities without requiring complex direct encoding in the base file format.
2Measurement precision
If detailed sample information is stored for each sample, then STSA samples can be identified, but the file format becomes less efficient
Solution Approach 1:
The patent merges sample identification information into group-level structures (SampleToGroupBox) rather than individual sample metadata. By combining multiple sample identifiers into a single group entry with a group_description_index, the system achieves precise STSA sample identification while significantly improving storage efficiency through data consolidation.
Solution Approach 2:
The HEVCDecoderConfigurationRecord serves multiple functions: it indicates up-switching capabilities, provides decoder configuration information, and enables efficient sample identification. This multi-functional approach reduces the need for separate dedicated structures, thereby improving storage efficiency without sacrificing identification precision.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A device generates a file that comprises a plurality of samples that contain coded pictures. In addition, the file contains a box that identifies a sample group that contains one or more samples from among the plurality of samples, wherein the box further indicates that each sample in the sample group is a step-wise temporal sub-layer access (STSA) sample. The same or different device identifies, based on data in the box that identifies the sample group, STSA samples from among the samples in the file that contains the box.