Output Layer Set Scalability for Multiview Video
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding systems fail to support scalability, particularly in multiview applications, as they require decoders to always handle the highest encoded layer, leading to errors when intermediate layers are needed based on hardware and network requirements.
Innovation Solution
Incorporating output layer sets (OLSs) that allow decoders to select and render desired output layers by setting the ols_mode_idc syntax element to indicate that all layers in an OLS are output layers, enabling multiview scalability and reducing bitstream size.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If the video coding system requires decoders to always handle the highest encoded layer, then the system can maintain simple decoding logic, but scalability is lost and errors occur when intermediate layers are needed
Solution Approach 1:
The patent segments the video bitstream into multiple Output Layer Sets (OLSs), where each OLS contains a specific subset of layers. This allows decoders to selectively process only the layers needed for their capability level, rather than requiring handling of all layers up to the highest encoded layer. The segmentation enables independent processing of different layer sets, resolving the contradiction between simple decoding logic and scalability.
Solution Approach 2:
The patent introduces dynamic selection mechanisms where decoders can dynamically choose which OLS to process based on their capabilities and requirements. The system allows flexible configuration of which layers are processed and in what order, enabling adaptability to different hardware capabilities and network conditions while maintaining relatively simple decoding logic through standardized selection procedures.
2Manufacturing precision
If all layers are encoded and transmitted, then complete video quality is achieved, but network bandwidth and processing resources are wasted when intermediate layers are sufficient
Solution Approach 1:
The patent extracts and separates necessary layer information into distinct OLSs, allowing only the required layers to be transmitted and processed. By taking out only the essential layers needed for a given quality level rather than transmitting all layers, the system reduces data volume and network bandwidth requirements while maintaining the ability to achieve complete video quality when needed.
Solution Approach 2:
The patent enables partial processing by allowing decoders to process only the necessary portions (layers) of the video data rather than all layers. This partial action approach optimizes resource utilization by avoiding excessive processing of layers that are not needed, while still providing the option to process all layers for maximum quality when necessary.
3Productivity
If decoders process only the highest layer, then processing speed is maximized, but multiview scalability and intermediate layer support are lost
Solution Approach 1:
The patent segments layers into OLSs that can be processed independently, allowing decoders to process only the highest relevant layer for maximum speed while maintaining the ability to access and process intermediate layers when needed for multiview scalability. The segmentation enables selective processing that preserves both speed and adaptability.
Solution Approach 2:
The patent adds a dimensional organization to layer processing by grouping layers into hierarchical OLS structures. This dimensional change allows decoders to navigate and process layers in a structured manner, enabling them to achieve high processing speed by focusing on the highest layer while maintaining scalability through the hierarchical structure that provides access to intermediate layers.
Data Source
AI summary
A video coding mechanism is disclosed. The mechanism includes receiving a bitstream comprising an output layer set (OLS) and a video parameter set (VPS). The OLS includes one or more layers of coded pictures and the VPS includes an OLS mode identification code (ols_mode_idc) specifying that for each OLS, all layers in the each OLS are output layers. The output layers are determined based on the ols_mode_idc in the VPS. A coded picture from the output layers is decoded to produce a decoded picture. The decoded picture is forwarded for display as part of a decoded video sequence.