Scalable Video Coding Base Layer Compatibility with Non-Scalable Decoders
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Scalable video coding/multiplexing schemes face challenges in compatibility with non-scalable video coding standards, as existing technologies fail to ensure that non-scalable decoders can ignore scalable layers and only decode the base layer effectively.
Innovation Solution
Assigning default values for scalability parameters to the base layer and using special NALUs to identify and route compatible layers, allowing non-scalable decoders to decode only the base layer by discarding or ignoring scalability data, and utilizing network gateways to manage packet routing based on decoder capabilities.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If scalable video coding parameters are transmitted in the base layer, then scalable decoders can utilize additional layers, but non-scalable decoders cannot ignore scalability data and only decode the base layer
Solution Approach 1:
The patent extracts scalability parameters from the base layer bitstream by placing them in a separate supplemental enhancement information (SEI) message or network abstraction layer (NAL) unit. This allows non-scalable decoders to ignore the scalability data while scalable decoders can access it, resolving the contradiction between compatibility and scalability functionality.
Solution Approach 2:
The patent introduces an intermediary structure (SEI message or NAL unit with specific syntax elements) that carries scalability parameters separately from the base layer video data. This intermediary allows the base layer to remain compatible with non-scalable decoders while providing an interface for scalable decoders to access additional layer information.
2Adaptability or versatility
If scalability data is included in the base layer stream, then scalable decoders can access additional layers, but bandwidth is wasted for non-scalable decoders that cannot utilize this data
Solution Approach 1:
The patent extracts scalability parameters from the base layer and places them in separate NAL units or SEI messages that can be selectively transmitted. This allows the network to optimize bandwidth by sending scalability data only to scalable decoders while keeping the base layer stream compact for non-scalable decoders.
Solution Approach 2:
The patent applies local quality by providing different data representations to different decoder types: a compact base layer stream for non-scalable decoders and an enhanced stream with attached scalability parameters for scalable decoders. This localized optimization reduces overall bandwidth waste.
3Ease of operation
If default scalability parameter values are assigned to the base layer, then non-scalable decoders can decode the base layer effectively, but scalable decoders cannot access transmitted scalability parameters
Solution Approach 1:
The patent performs preliminary action by assigning default scalability parameter values in the base layer that ensure correct decoding for non-scalable decoders. Meanwhile, transmitted scalability parameters in separate structures provide overridden or enhanced values for scalable decoders, resolving the contradiction between ease of base layer decoding and preservation of scalability information.
Data Source
AI summary
Scalable video coding and multiplexing compatible with non-scalable decoders is disclosed. In some embodiments, video data is received and encoded in a manner that renders at least a base layer to be compatible with a non-scalable video encoding standard, including by assigning for at least the base layer default values to one or more scalability parameters. In some embodiments, video data is received and encoded to produce an encoded video data that includes a base layer that conforms to a non-scalable video encoding standard and one or more subordinate non-scalable layers, which subordinate non-scalable layers do not by themselves conform to the non-scalable video encoding standard but which can he combined with the base layer to produce a result that does conform to the non-scalable video encoding standard, such that the result can be decoded by a non-scalable decoder. An identification data identifying those portions of the encoded video data that are associated with a subordinate non-scalable layer is included in the encoded video data.