Texture-Based Video Partitioning via CNN for RDO Efficiency

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The existing Quad-Tree plus Binary-Tree (QTBT) video compression technology requires further improvement in compression efficiency, particularly in the Rate Distortion Optimization (RDO) process, which is complex and time-consuming.

Innovation Solution

A texture-based technique is employed to generate a set of split partition probabilities, using a Convolutional Neural Network (CNN) to analyze the image data and predict optimal block partitions, thereby accelerating the RDO process.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If Rate Distortion Optimization (RDO) is used to determine optimal block partitions, then coding efficiency is improved, but computational complexity and processing time increase significantly

Engineering Contradiction:
Improvecoding efficiencyVSAvoidcomputational complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent applies preliminary action by using a Convolutional Neural Network to pre-analyze image data and generate partition probability maps before the actual encoding process. The CNN predicts likely partition boundaries and regions of interest in advance, allowing the RDO process to focus computational resources only on high-probability partition locations rather than evaluating all possible partitions exhaustively.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent replaces the traditional mechanical RDO optimization process with a neural network-based probabilistic model. Instead of computationally evaluating rate-distortion costs for numerous partition configurations, the system uses the CNN's learned probability distributions to directly guide partition decisions, substituting iterative optimization with a single-pass probabilistic assessment.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Reliability

If exhaustive Rate Distortion Optimization is performed to find optimal partitions, then compression performance is improved, but processing time increases

Engineering Contradiction:
Improvecompression performanceVSAvoidprocessing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The CNN performs preliminary analysis of the image content to identify probable partition structures before encoding begins. By pre-computing partition probability maps that highlight likely boundaries and uniform regions, the system eliminates the need for time-consuming exhaustive RDO searches during the actual encoding phase.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent applies skipping by allowing the encoder to bypass exhaustive RDO evaluation for regions where the CNN predicts low partition probability or uniform characteristics. The system rushes through these low-complexity regions using the pre-computed probability guidance, reserving full RDO processing only for complex, high-uncertainty regions that truly benefit from optimization.

Inventive Principle:
Principle #21Skipping (Rushing through)

Data Source

PatentUS20250039372A1Texture-based partitioning decisions for video compression
Publication Date: 2025.01.30 INTERDIGITAL VC HOLDINGS INC
  • US20250039372A1 patent drawing
  • US20250039372A1 patent drawing
  • US20250039372A1 patent drawing

AI summary

A block of video data is split using one or more of several possible partition operations by using the partitioning choices obtained through use of a texture-based image partitioning. In at least one embodiment, the block is split in one or more splitting operations using a convolutional neural network. In another embodiment, inputs to the convolutional neural network come from pixels along the block's causal borders. In another embodiment, boundary information, such as the location of partitions in spatially neighboring blocks, is used by the texture analysis. Methods, apparatus, and signal embodiments are provided for encoding.