Edge Enhancement Filter for AV1 Video Coding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

AOMedia Video 1 (AV1) experiences information loss during video compression, particularly in edge detection, which affects coding efficiency and visual quality due to lossy coding modules and the limitations of current high-pass filters like CCALF, which can only be applied to chroma components without signaling filter coefficients.

Innovation Solution

The method involves detecting edges within video data, calculating gradient values for edge directions, and using these gradients to decode and encode video data, allowing filtering to be applied across all color components without needing to signal filter coefficients, thereby enhancing edge detection and preservation across all color components.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If CCALF filter is used for chroma components, then edge detection is improved, but filter coefficients need to be signaled increasing bitstream overhead

Engineering Contradiction:
Improveedge detection accuracyVSAvoidbitstream overhead
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The system uses the video data itself to determine filtering parameters. Gradient calculations are performed on the decoded video samples to automatically identify edge directions and strengths, eliminating the need for external signaling of filter coefficients. The filter adapts to local content characteristics without requiring additional bitstream information.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The filtering parameters (coefficients, edge directions, strengths) are dynamically changed based on local gradient calculations rather than being fixed or pre-specified. The system computes gradients in multiple directions (horizontal, vertical, diagonal) and adjusts filter application accordingly, allowing parameters to adapt to local image characteristics without signaling overhead.

Inventive Principle:
Principle #35Parameter changes

2Manufacturing precision

If filtering is applied to all color components, then visual quality is improved, but device complexity increases

Engineering Contradiction:
Improvevisual qualityVSAvoidfiltering complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The filtering process is segmented by color component (luma and chroma) and by directional gradients. Each component can be processed independently with appropriate gradient calculations, allowing selective application of filtering where needed without uniformly processing all data through complex filters.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The same gradient-based filtering mechanism is applied universally across all color components (Y, Cb, Cr or R, G, B). The filter serves multiple functions: edge detection, artifact reduction, and quality enhancement, all through a single unified process that works across different color spaces and components.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Measurement precision

If gradient calculations are performed for all directions, then edge detection accuracy is improved, but processing time increases

Engineering Contradiction:
Improveedge detection accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system calculates gradients in multiple directions (horizontal, vertical, and diagonal) but applies filtering only where gradients exceed certain thresholds or where edges are actually detected. Not all gradient calculations lead to filter application, avoiding unnecessary processing while maintaining accuracy where needed.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

Gradient calculations and filtering are applied locally based on detected edge characteristics rather than uniformly across the entire frame. The filter strength, direction, and application are customized for each local region based on its specific gradient profile, improving accuracy while reducing overall processing time by focusing computation on relevant areas.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS12112509B2Edge enhancement filter
Publication Date: 2024.10.08 TENCENT AMERICA LLC
  • US12112509B2 patent drawing
  • US12112509B2 patent drawing
  • US12112509B2 patent drawing

AI summary

A method, computer program, and computer system is provided for coding video data. Video data is received, and an edge present within a sample of the received video data is detected. A gradient value corresponding to a direction associated with the detected edge is calculated. The video data is decoded based on the calculated gradient.