Texture-Based Video Partitioning via CNN for RDO Efficiency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The existing Quad-Tree plus Binary-Tree (QTBT) video compression technology requires further improvement in compression efficiency, particularly in the Rate Distortion Optimization (RDO) process, which is complex and time-consuming.
Innovation Solution
A texture-based technique is employed to generate a set of split partition probabilities, using a Convolutional Neural Network (CNN) to analyze the image data and predict optimal block partitions, thereby accelerating the RDO process.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If Rate Distortion Optimization (RDO) is used to determine optimal block partitions, then coding efficiency is improved, but computational complexity and processing time increase significantly
Solution Approach 1:
The patent applies preliminary action by using a Convolutional Neural Network to pre-analyze image data and generate partition probability maps before the actual encoding process. The CNN predicts likely partition boundaries and regions of interest in advance, allowing the RDO process to focus computational resources only on high-probability partition locations rather than evaluating all possible partitions exhaustively.
Solution Approach 2:
The patent replaces the traditional mechanical RDO optimization process with a neural network-based probabilistic model. Instead of computationally evaluating rate-distortion costs for numerous partition configurations, the system uses the CNN's learned probability distributions to directly guide partition decisions, substituting iterative optimization with a single-pass probabilistic assessment.
2Reliability
If exhaustive Rate Distortion Optimization is performed to find optimal partitions, then compression performance is improved, but processing time increases
Solution Approach 1:
The CNN performs preliminary analysis of the image content to identify probable partition structures before encoding begins. By pre-computing partition probability maps that highlight likely boundaries and uniform regions, the system eliminates the need for time-consuming exhaustive RDO searches during the actual encoding phase.
Solution Approach 2:
The patent applies skipping by allowing the encoder to bypass exhaustive RDO evaluation for regions where the CNN predicts low partition probability or uniform characteristics. The system rushes through these low-complexity regions using the pre-computed probability guidance, reserving full RDO processing only for complex, high-uncertainty regions that truly benefit from optimization.
Data Source
AI summary
A block of video data is split using one or more of several possible partition operations by using the partitioning choices obtained through use of a texture-based image partitioning. In at least one embodiment, the block is split in one or more splitting operations using a convolutional neural network. In another embodiment, inputs to the convolutional neural network come from pixels along the block's causal borders. In another embodiment, boundary information, such as the location of partitions in spatially neighboring blocks, is used by the texture analysis. Methods, apparatus, and signal embodiments are provided for encoding.


