Encoder SAO Filtering Conditions for Video Encoding Efficiency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The H.265/HEVC standard provides limited guidance on when and how to enable Sample Adaptive Offset (SAO) filtering, which can adversely affect computational efficiency and processing time, making it desirable to determine optimal conditions for enabling SAO operations.
Innovation Solution
Implementing a multi-stage filtering process that includes a deblocking filter followed by SAO, where SAO parameters are specified using pre-deblocking pixels, and determining the application of SAO based on residual data, encoding efficiency, or periodic application, to optimize filtering operations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If SAO filtering is applied to all reconstructed pictures, then reconstruction quality is improved, but computational complexity and processing time increase
Solution Approach 1:
The patent changes the parameter of SAO filtering application from universal (all pictures) to conditional (based on picture type, scene complexity, and residual energy metrics). The encoder calculates activity metrics and residual energy for each picture, then adjusts the application of SAO filtering parameters dynamically, applying filtering only when conditions indicate it will benefit reconstruction quality without unnecessarily increasing computational complexity.
Solution Approach 2:
Instead of applying SAO filtering to all reconstructed pictures (excessive action), the patent applies filtering selectively to only those pictures that meet specific criteria such as having sufficient residual energy or belonging to certain picture types (partial action). This reduces computational complexity while maintaining reconstruction quality for the most beneficial cases.
2Manufacturing precision
If SAO filtering is applied to all reconstructed pictures, then reconstruction quality is improved, but processing time increases
Solution Approach 1:
The patent dynamically changes the processing parameter by adjusting SAO filtering application based on calculated activity metrics and residual energy for each picture. Pictures with low activity or low residual energy skip SAO filtering, while pictures with high activity or high residual energy receive filtering, thereby optimizing processing time while maintaining reconstruction quality where needed.
Solution Approach 2:
The patent implements periodic evaluation of activity metrics and residual energy at encoder intervals to determine SAO filtering application. This periodic assessment allows the system to adapt to changing content characteristics and apply filtering only when beneficial, reducing overall processing time compared to continuous universal application.
3Measurement precision
If SAO parameters are specified using post-deblocking pixels, then filtering accuracy is improved, but processing dependency increases
Solution Approach 1:
The patent performs preliminary calculation of activity metrics and residual energy using pre-deblocking pixels before the deblocking filter is applied. This preliminary action allows SAO parameter specification to be based on original picture characteristics without waiting for deblocking to complete, reducing processing dependency while maintaining the ability to specify accurate filtering parameters.
Data Source
AI summary
Disclosed herein are exemplary embodiments of innovations in the area of encoding pictures or portions of pictures (e.g., slices, coding tree units, or coding units) and determining whether and how certain filtering operation should be performed and flagged for performance by the decoder in the bitstream. In particular examples, various implementations for setting the sample adaptive offset (SAO) syntax elements in the H.265/HEVC standard are disclosed. Although these examples concern the H.265/HEVC standard and its SAO filter, the disclosed technology is more widely applicable to other video codecs that involve filtering operations (particularly multi-stage filtering operations) as part of their encoding and decoding processes.


