Merging SAO and ALF Filters in Video Coding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video coding techniques face inefficiencies due to redundant DC coefficient offsets in adaptive loop filters (ALF) when combined with sample adaptive offset (SAO) processes, leading to additional encoder frame delays and reduced coding efficiency.

Innovation Solution

The proposed solution merges SAO filtering techniques with ALF filtering techniques, utilizing AC coefficients to determine offset values, thereby eliminating redundant DC offsets and optimizing the filtering process.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If SAO and ALF processes are applied separately in video coding, then filtering effectiveness is improved, but encoder complexity and processing time increase

Engineering Contradiction:
Improvefiltering effectivenessVSAvoidencoder complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent combines SAO and ALF processes into a unified filtering operation where offset values from SAO are integrated with the ALF filtering stage. This merging eliminates redundant processing steps while maintaining the complementary strengths of both filtering techniques, thereby improving filtering effectiveness without proportionally increasing encoder complexity.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The unified filtering structure serves multiple functions simultaneously: it performs both SAO offset compensation and ALF adaptive filtering in a single pass. This multi-functionality allows the system to achieve the benefits of both separate processes while reducing the overall processing burden and complexity of the encoder architecture.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Manufacturing precision

If SAO and ALF processes are applied separately in video coding, then filtering effectiveness is improved, but encoder processing time increases

Engineering Contradiction:
Improvefiltering effectivenessVSAvoidencoder processing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

By merging SAO and ALF into a single integrated filtering process, the patent eliminates the sequential execution overhead of two separate processes. The unified structure processes video blocks in one pass rather than requiring two distinct processing stages, thereby maintaining filtering effectiveness while significantly reducing encoder processing time.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The integrated filtering approach performs offset determination and filtering operations in a preliminary unified stage, avoiding redundant computations that would occur if SAO and ALF were executed separately. This preliminary action consolidates processing steps and reduces the total time required for encoder operations.

Inventive Principle:
Principle #10Preliminary action

3Manufacturing precision

If redundant DC offsets are applied in ALF when combined with SAO, then filtering completeness is improved, but coding efficiency decreases

Engineering Contradiction:
Improvefiltering completenessVSAvoidcoding efficiency
Core Design Contradiction:
Manufacturing precisionVSProductivity

Solution Approach 1:

The patent extracts and eliminates redundant DC offset operations from the ALF process when SAO is already applied. By identifying and removing these redundant computations, the system maintains filtering completeness (since SAO already provides the necessary offset compensation) while improving coding efficiency by reducing unnecessary processing operations.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The unified filtering approach discards redundant DC offset calculations in ALF that are already covered by SAO, thereby eliminating wasted computational resources. This selective discarding of redundant operations maintains the completeness of filtering while recovering processing efficiency by focusing computational effort only on necessary operations.

Inventive Principle:
Principle #34Discarding and recovering

Data Source

PatentUS9357235B2Sample adaptive offset merged with adaptive loop filter in video coding
Publication Date: 2016.05.31 QUALCOMM INC
  • US9357235B2 patent drawing
  • US9357235B2 patent drawing
  • US9357235B2 patent drawing

AI summary

Techniques for performing sample adaptive offset (SAO) and adaptive loop filter (ALF) processes in a video coding process are described. The SAO and ALF processes may be combined. In one example, the determination of offset values for a SAO filter process may be based on classifications used in an ALF process. In one example, an ALF classification that indicates a particular directional characteristic of a video block may be used to determine how and whether an SAO filter process is applied to each sample within the video block.