Combined SAO and Bilateral Filter for Video Coding Efficiency

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video coding technologies face inefficiencies due to the independent application of multiple in-loop filters, which consume excessive processor cycles, memory, and memory bandwidth, leading to potential degradation in video quality.

Innovation Solution

The harmonization of a sample adaptive offset filter with a bilateral filter to create a combined filter, reducing the need for separate buffers and reads, thereby improving coding efficiency by consolidating processing and memory utilization.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If multiple in-loop filters are applied independently, then video quality is maintained or improved, but processor cycles and memory usage increase

Engineering Contradiction:
Improvevideo qualityVSAvoidprocessor cycles
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent combines the SAO filter and bilateral filter into a single unified filter that performs both sample adaptive offset correction and bilateral filtering operations in one processing pass, rather than applying them as separate independent filters. This merging reduces the number of processing operations and improves processor cycle efficiency while maintaining the video quality benefits of both filtering techniques.

Inventive Principle:
Principle #5Merging (Combining)

2Reliability

If multiple in-loop filters are applied independently, then video quality is maintained or improved, but memory and memory bandwidth utilization increase

Engineering Contradiction:
Improvevideo qualityVSAvoidmemory usage
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The unified filter consolidates the memory structures required for SAO filtering and bilateral filtering into a single buffer system. By merging the filter operations, the patent eliminates the need for separate buffers for each filter stage, thereby reducing overall memory usage and memory bandwidth consumption while preserving video quality.

Inventive Principle:
Principle #5Merging (Combining)

3Adaptability or versatility

If separate filters are used for SAO and bilateral filtering, then filtering functionality is comprehensive, but device complexity increases

Engineering Contradiction:
Improvefiltering functionalityVSAvoidfilter structure
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent creates a universal filter structure that performs multiple filtering functions (SAO offset correction and bilateral filtering) within a single device. This multi-functional unified filter maintains the comprehensive filtering capabilities of separate filters while reducing structural complexity by eliminating redundant components and processing stages.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11153563B2Combined in-loop filters for video coding
Publication Date: 2021.10.19 QUALCOMM INC
  • US11153563B2 patent drawing
  • US11153563B2 patent drawing
  • US11153563B2 patent drawing

AI summary

In general, techniques are described by which to obtain combined in-loop filters for video coding. A device for coding video data comprising a memory and one or more processors may be configured to perform the techniques. The memory may store the video data. The one or more processors, which may be implemented in circuitry, are configured to implement a combined sample adaptive offset and bilateral filter. The combined sample adaptive offset and bilateral filter may be configured to obtain reconstructed samples of a current block of the video data, and perform filtering with respect to the reconstructed samples of the current block of the video data to obtain filtered reconstructed samples of the current block of the video data.