Post-Processing Unit for Scalable Video Decoding Complexity
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional video encoding and decoding systems face challenges in providing scalable decoding complexity, as encoded video bitstreams are often either too complex for feature-poor decoders or lack necessary data for feature-rich decoders, leading to inefficient processing and potential errors due to all-or-nothing dependency on embedded stages.
Innovation Solution
The implementation of a post-processing unit that can selectively apply additional stages such as deblocking, dithering, sharpening/edge-enhancement, spatial scalability, and temporal scalability, controlled by resource processor to adjust decoding complexity based on decoder capabilities and display characteristics, allowing for scalable decoding complexity and improved video quality without propagating errors.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If encoded video bitstreams are designed for feature-rich decoders, then video quality can be enhanced, but decoding complexity increases making it unsuitable for feature-poor decoders
Solution Approach 1:
The decoding process is segmented into mandatory base decoding stages and optional post-processing stages. The base decoder produces a preliminary decoded signal that can be independently decoded by feature-poor decoders, while feature-rich decoders can additionally apply optional post-processing stages (deblocking, dithering, sharpening, spatial scalability, temporal scalability) to enhance video quality. This segmentation allows the same bitstream to be efficiently decoded across decoder complexity levels.
2Device complexity
If encoded video bitstreams are simplified for feature-poor decoders, then decoding complexity is reduced, but video quality deteriorates for feature-rich decoders
Solution Approach 1:
The system dynamically adapts the decoding process to decoder capabilities through control information in the bitstream. Feature-poor decoders process only mandatory stages with lower complexity, while feature-rich decoders dynamically activate optional post-processing stages based on their capabilities and the characteristics of the displayed video content, optimizing both decoding complexity and video quality for each decoder type.
3Manufacturing precision
If all post-processing stages are mandatorily applied, then video quality is maximized, but error propagation occurs and processing efficiency decreases
Solution Approach 1:
Instead of mandatorially applying all post-processing stages, the system applies only the necessary subset of stages based on decoder capabilities and content requirements. The base decoding provides sufficient quality for feature-poor decoders without optional stages, while feature-rich decoders selectively apply only those post-processing stages that benefit the specific video content being displayed, avoiding unnecessary processing and potential error propagation.
Data Source
AI summary
Systems, apparatuses and methods whereby a base coded video signal is provided to a decoder having a set of post-processing stages. The base coded video signal can be decoded to produce a base decoded video signal. Post-processing of the base decoded video signal can be used to produce an enhanced quality video output signal. Application of a post-processing stage can be implemented according to the capabilities of the decoder and/or the instantaneous operating parameters of the decoder and/or characteristics of a display. A control signal, communicated over a dedicated channel separate from the base coded video signal, can be used initiate and/or aid implementation of a post-processing stage. The control signal can also provide information to assist/manage the decoding of the base coded video signal. The use of additional post-processing stages increases the complexity of an overall decoding process while improving the quality of a resulting reproduced video sequence.