Scalable Video Stream Packets for Simpler Operation Point Parsing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding standards like H.264/AVC and HEVC face challenges in efficiently handling scalable data streams due to complex syntax extensions and high overhead in signaling operation points, leading to increased parsing effort and resource consumption in network entities.
Innovation Solution
A data stream structure where packets carry operation point identifiers and scalability descriptors, with optional profile and level descriptors signaled separately, reducing overhead and simplifying parsing for network entities.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If complex syntax extensions are used to handle scalable data streams, then adaptability is improved, but device complexity increases
Solution Approach 1:
The patent segments the scalability information by introducing separate NAL unit types: one for base layer video data and another for scalability information. This segmentation allows the decoder to process base layer data independently while optionally processing scalability information, reducing the complexity burden on the device while maintaining adaptability.
Solution Approach 2:
The patent extracts scalability information from the complex syntax extensions and places it into separate NAL units. This extraction allows the scalability information to be handled independently from the base video decoding process, reducing the immediate processing complexity while preserving the ability to adapt to different scalability requirements.
2Adaptability or versatility
If multiple different NAL unit header structures are used to signal operation points, then adaptability is improved, but ease of operation deteriorates
Solution Approach 1:
The patent creates a universal NAL unit header structure that can accommodate both base layer video data and scalability information through a single standardized format. This universal structure eliminates the need for multiple different header formats, simplifying the parsing process while maintaining the ability to signal various operation points and scalability configurations.
3Adaptability or versatility
If prefix NAL units are used to signal base layer, then adaptability is improved, but data consumption increases
Solution Approach 1:
The patent merges the base layer signaling and scalability information signaling into a unified NAL unit structure. Instead of requiring separate prefix NAL units for base layer indication, the standardized NAL unit header combines both functions, reducing redundant data transmission while maintaining full adaptability for different base layer configurations.
Data Source
AI summary
The handling of scalable data streams by network entities is rendered less complex by, in the data stream, accompanying packets which actually carry data by packets of a different packet type which have a scalability axes descriptor defining the number of scalability axes and a semantic meaning thereof. In another aspect, the handling of scalable data streams by network entities is rendered more efficient by conveying level and/or profile descriptors using packets other than the data carrying packets, with profile and/or level descriptors being divided up into a first set explicitly signaling the definition of the available coding option set and/or available syntax element value range for a respective operation point, and a second set of profile and/or level descriptors which signal the definition of the available coding option set and/or available syntax element value range for their respective operation points by reference another profile and/or level descriptor.