Sample Adaptive Offset Control for HEVC Video Coding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The existing HEVC standard for video coding has limitations in the Sample Adaptive Offset (SAO) process, particularly in classification precision and dynamic range, which affects image quality, especially at higher bit depths, due to noise sensitivity and restricted bitdepth, precision, and color limitations.

Innovation Solution

The proposed solution involves additional quantization steps, conversion to alternative color spaces for improved offset application, interpolation of offset values, and dynamic range signaling to enhance precision and reduce noise sensitivity, allowing for more flexible and precise offset application while minimizing overhead.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the maximum value of offset values is limited for bit depths above 10 bits, then the dynamic range covered by SAO values is increased, but the precision of SAO values is reduced

Engineering Contradiction:
Improvedynamic range coverageVSAvoidprecision of SAO values
Core Design Contradiction:
ReliabilityVSMeasurement precision

Solution Approach 1:

The patent applies dynamics by making the offset value range adaptive rather than fixed. The maximum offset value is dynamically adjusted based on the actual noise characteristics and bit depth of the input signal. This allows the system to expand the offset range when high dynamic range coverage is needed while maintaining precision when the signal characteristics warrant it, resolving the contradiction between dynamic range coverage and precision.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes the parameter of offset value range from a fixed limit to an adaptive parameter that varies based on signal characteristics. By modifying the maximum offset value parameter according to bit depth and noise levels, the system can optimize both dynamic range coverage and precision for different operating conditions, rather than being constrained by a universal limit.

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If the number of bands for SAO classification is increased, then the precision of sample classification is improved, but the overhead needed to signal offset values is increased

Engineering Contradiction:
Improveclassification precisionVSAvoidoverhead for signaling offset values
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The patent applies segmentation by dividing the offset signaling into multiple stages or groups. Instead of signaling all offset values for all bands, the system segments the bands into groups and signals offset values selectively. This reduces the total number of offset parameters that need to be transmitted while maintaining classification precision through intelligent selection of which bands receive explicit offset signaling versus which use default or interpolated values.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements partial action by applying SAO offset signaling to only the most critical or beneficial bands rather than all bands. The system identifies which bands benefit most from explicit offset signaling and applies the signaling overhead selectively to those bands, while other bands use default offset values or are handled through interpolation, thus reducing overall overhead while maintaining necessary classification precision.

Inventive Principle:
Principle #16Partial or excessive action

3Reliability

If quantization is applied during categorization, then noise sensitivity is reduced, but the precision of sample values is reduced

Engineering Contradiction:
Improvenoise sensitivityVSAvoidprecision of sample values
Core Design Contradiction:
ReliabilityVSMeasurement precision

Solution Approach 1:

The patent applies preliminary action by performing quantization during the categorization phase before the actual offset application. This preliminary quantization reduces noise sensitivity by grouping similar sample values together, and the system compensates for the precision loss by applying more precise offset values in subsequent processing stages, ensuring that the initial quantization serves as a noise-reduction preprocessing step rather than a final precision-determining step.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS9300967B2Sample adaptive offset control
Publication Date: 2016.03.29 APPLE INC
  • US9300967B2 patent drawing
  • US9300967B2 patent drawing
  • US9300967B2 patent drawing

AI summary

Offset values, such as Sample Adaptive Offset (SAO) values in video coding standards such as the High Efficiency Video Coding standard (HEVC), may be improved by performing calculations and operations that improve the preciseness of these values without materially affecting the signal overhead needed to transmit the more precise values. Such calculations and operations may include applying a quantization factor to a video sample and at least some of its neighbors, comparing the quantized values, and classifying the video sample as a minimum, maximum, or one of various types of edges based on the comparison. Other sample range, offset mode, and/or offset precision parameters may be calculated and transmitted with metadata to improve the precision of offset values.