Nonlinear Adaptive Loop Filtering Clipping Parameters

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video coding methods face challenges in efficiently managing bandwidth demand due to the increasing demand for higher resolution video, particularly in existing standards like HEVC and future standards like VVC, where non-linear adaptive loop filtering (NLALF) designs have limitations such as being tailored for specific color formats and bit-depths, and interactions with in-loop reshaping methods are not fully understood.

Innovation Solution

The proposed solution involves enhancing video coding by using non-linear adaptive loop filtering (NLALF) with clipping parameters that depend on coded information, bit-depth, color representation formats, and in-loop reshaping, allowing for adaptive filtering and improved coding efficiency across various video standards.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If non-linear adaptive loop filtering is tailored for specific color formats and bit-depths, then filtering performance for those specific formats is improved, but adaptability to other formats and bit-depths deteriorates

Engineering Contradiction:
Improvefiltering performanceVSAvoidformat compatibility
Core Design Contradiction:
Manufacturing precisionVSAdaptability or versatility

Solution Approach 1:

The patent applies parameter changes by making clipping parameters dynamic and adaptive based on video characteristics. Instead of fixed parameters for specific formats, the system adjusts clipping parameters according to actual video content properties, allowing the same filtering mechanism to work effectively across different color formats and bit-depths while maintaining optimal performance

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent achieves universality by designing a clipping parameter determination mechanism that works across multiple color formats (YUV, RGB) and bit-depths (8-bit, 10-bit, 12-bit). The system uses coded information and video characteristics as inputs to generate appropriate clipping parameters, making the filtering system universally applicable rather than format-specific

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Ease of manufacture

If clipping parameters are fixed for specific bit-depths, then processing simplicity is improved, but coding efficiency across varying bit-depths deteriorates

Engineering Contradiction:
Improveprocessing simplicityVSAvoidcoding efficiency
Core Design Contradiction:
Ease of manufactureVSProductivity

Solution Approach 1:

The patent applies dynamics by transitioning from static, fixed clipping parameters to dynamic parameters that adapt based on video characteristics and coded information. The system determines clipping parameters on-the-fly using functions of coded information, allowing optimal performance across varying bit-depths without requiring multiple pre-configured parameter sets

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes parameters by making clipping values dependent on actual video content properties rather than fixed bit-depth specifications. This allows the system to maintain processing simplicity through a unified determination mechanism while achieving high coding efficiency by adapting parameters to match the actual video characteristics

Inventive Principle:
Principle #35Parameter changes

3Device complexity

If non-linear adaptive loop filtering is designed without considering in-loop reshaping interactions, then design complexity is reduced, but overall video quality deteriorates

Engineering Contradiction:
Improvedesign complexityVSAvoidvideo quality
Core Design Contradiction:
Device complexityVSManufacturing precision

Solution Approach 1:

The patent applies feedback by incorporating in-loop reshaping information into the clipping parameter determination process. The system uses coded information about reshaping operations to adjust clipping parameters, creating a feedback loop that ensures optimal filtering performance when in-loop reshaping is applied, thereby improving video quality without significantly increasing design complexity

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS12047610B2Nonlinear adaptive loop filtering in video processing
Publication Date: 2024.07.23 DOUYIN VISION CO LTD
  • US12047610B2 patent drawing
  • US12047610B2 patent drawing
  • US12047610B2 patent drawing

AI summary

A method of processing video data includes determining that a non-linear adaptive loop filtering operation is applied for a current video region of a video; deriving a first filtering index for the current video region and deriving a first filtering parameter based on the first filtering index; deriving a first clipping parameter from a clipping parameter set based on the first filtering index; performing a clipping operation that is part of the non-linear adaptive loop filtering operation based on the first clipping parameter, where the first clipping parameter is used to clip differences between reference sample values of a current sample value of the current video region and the current sample value before applying the first filtering parameter; and performing a conversion between the current video region and a bitstream of the video based on the non-linear adaptive loop filtering operation.