AV1 Interframe Mode Pruning for Reduced Computational Complexity

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

AV1 video encoding requires significant computational complexity due to the diverse set of coding tools and syntax elements, leading to inefficient video compression and increased processing demands.

Innovation Solution

The method involves pruning interframe candidate modes based on specific criteria, reducing the set of candidate modes by excluding certain interframe mode types, determining the rate distortion cost for the remaining modes, and selecting the mode with the lowest cost for encoding, thereby reducing computational complexity.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If a diverse set of candidate modes is searched to achieve high compression efficiency, then coding efficiency is improved, but computational complexity increases

Engineering Contradiction:
Improvecompression efficiencyVSAvoidcomputational complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent extracts and removes certain candidate modes from the full set of interframe modes, keeping only a subset that is most likely to be optimal. This is done by excluding mode types that are less useful based on criteria such as block size, motion characteristics, and reference frame availability, thereby reducing computational complexity while maintaining compression efficiency.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

Instead of exhaustively searching all possible candidate modes, the patent performs a partial search by evaluating only a selected subset of modes. This partial action approach avoids the excessive computation required for complete mode search while still achieving good compression results by focusing on the most promising candidates.

Inventive Principle:
Principle #16Partial or excessive action

2Manufacturing precision

If exhaustive mode search is performed to find the optimal encoding mode, then encoding quality is improved, but processing time increases

Engineering Contradiction:
Improveencoding qualityVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent performs preliminary actions by pre-determining which candidate modes are worth evaluating based on criteria such as block size, motion characteristics, and reference frame availability. This preliminary selection is done before the actual mode evaluation, allowing the encoder to skip unnecessary modes and reduce processing time while maintaining encoding quality.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent extracts the essential candidate modes needed for good encoding quality and removes redundant modes from consideration. By taking out only the necessary modes for evaluation, the processing time is significantly reduced while the encoding quality is preserved through selective mode assessment.

Inventive Principle:
Principle #2Taking out (Extraction)

3Productivity

If all interframe mode types are evaluated to ensure optimal compression, then coding performance is improved, but device complexity increases

Engineering Contradiction:
Improvecoding performanceVSAvoidmode search complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent applies local quality by treating different video blocks differently based on their specific characteristics. For each block, the set of candidate modes is locally optimized by including or excluding mode types based on block size, motion characteristics, and reference frame availability, rather than using a uniform approach for all blocks. This reduces overall complexity while maintaining coding performance.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent changes parameters such as the set of candidate modes based on block characteristics including block size, motion characteristics, and reference frame availability. By dynamically adjusting which mode types are evaluated based on these parameters, the system achieves good coding performance without the complexity of evaluating all mode types uniformly across all blocks.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS20250097410A1Efficient interframe mode search for AV1 encoding
Publication Date: 2025.03.20 META PLATFORMS INC
  • US20250097410A1 patent drawing
  • US20250097410A1 patent drawing
  • US20250097410A1 patent drawing

AI summary

Technology herein provides a method, apparatus and computer readable storage medium for use in video encoding. The technology performs operations including pruning interframe candidate modes, based on one or more criteria, to provide a reduced set of candidate modes for encoding a video block, wherein a candidate mode includes an interframe mode type, a set of reference frame types, and one or more dynamic reference list (DRL) candidates, and wherein pruning interframe candidate modes comprises excluding one or more interframe mode types, determining a rate distortion (RD) cost for each of the candidate modes in the reduced set of candidate modes, selecting a candidate mode from the reduced set of candidate modes, based on the lowest RD cost, as a selected interframe mode, and encoding the video block using the selected interframe mode.