Encoder SAO Filtering Conditions for Video Encoding Efficiency

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The H.265/HEVC standard provides limited guidance on when and how to enable Sample Adaptive Offset (SAO) filtering, which can adversely affect computational efficiency and processing time, making it desirable to determine optimal conditions for enabling SAO operations.

Innovation Solution

Implementing a multi-stage filtering process that includes a deblocking filter followed by SAO, where SAO parameters are specified using pre-deblocking pixels, and determining the application of SAO based on residual data, encoding efficiency, or periodic application, to optimize filtering operations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If SAO filtering is applied to all reconstructed pictures, then reconstruction quality is improved, but computational complexity and processing time increase

Engineering Contradiction:
Improvereconstruction qualityVSAvoidcomputational complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent changes the parameter of SAO filtering application from universal (all pictures) to conditional (based on picture type, scene complexity, and residual energy metrics). The encoder calculates activity metrics and residual energy for each picture, then adjusts the application of SAO filtering parameters dynamically, applying filtering only when conditions indicate it will benefit reconstruction quality without unnecessarily increasing computational complexity.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

Instead of applying SAO filtering to all reconstructed pictures (excessive action), the patent applies filtering selectively to only those pictures that meet specific criteria such as having sufficient residual energy or belonging to certain picture types (partial action). This reduces computational complexity while maintaining reconstruction quality for the most beneficial cases.

Inventive Principle:
Principle #16Partial or excessive action

2Manufacturing precision

If SAO filtering is applied to all reconstructed pictures, then reconstruction quality is improved, but processing time increases

Engineering Contradiction:
Improvereconstruction qualityVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent dynamically changes the processing parameter by adjusting SAO filtering application based on calculated activity metrics and residual energy for each picture. Pictures with low activity or low residual energy skip SAO filtering, while pictures with high activity or high residual energy receive filtering, thereby optimizing processing time while maintaining reconstruction quality where needed.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent implements periodic evaluation of activity metrics and residual energy at encoder intervals to determine SAO filtering application. This periodic assessment allows the system to adapt to changing content characteristics and apply filtering only when beneficial, reducing overall processing time compared to continuous universal application.

Inventive Principle:
Principle #19Periodic action

3Measurement precision

If SAO parameters are specified using post-deblocking pixels, then filtering accuracy is improved, but processing dependency increases

Engineering Contradiction:
Improvefiltering accuracyVSAvoidprocessing dependency
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent performs preliminary calculation of activity metrics and residual energy using pre-deblocking pixels before the deblocking filter is applied. This preliminary action allows SAO parameter specification to be based on original picture characteristics without waiting for deblocking to complete, reducing processing dependency while maintaining the ability to specify accurate filtering parameters.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11895295B2Encoder-side decisions for sample adaptive offset filtering
Publication Date: 2024.02.06 MICROSOFT TECHNOLOGY LICENSING LLC
  • US11895295B2 patent drawing
  • US11895295B2 patent drawing
  • US11895295B2 patent drawing

AI summary

Disclosed herein are exemplary embodiments of innovations in the area of encoding pictures or portions of pictures (e.g., slices, coding tree units, or coding units) and determining whether and how certain filtering operation should be performed and flagged for performance by the decoder in the bitstream. In particular examples, various implementations for setting the sample adaptive offset (SAO) syntax elements in the H.265/HEVC standard are disclosed. Although these examples concern the H.265/HEVC standard and its SAO filter, the disclosed technology is more widely applicable to other video codecs that involve filtering operations (particularly multi-stage filtering operations) as part of their encoding and decoding processes.