Video Block Partitioning via Motion and Depth Variance
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Video encoding and decoding processes face challenges in efficiently determining the optimal partitioning type for video blocks, leading to increased complexity and costs due to the need for substantial coding gains without significant increases in coding complexity.
Innovation Solution
A system and method that determine the partitioning type for video blocks based on motion information and depth information, using motion variance and depth variance to decide whether to split the blocks and determine the split direction, enabling faster encoding and decoding operations without increased complexity.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of energy
If partitioning operations are performed to provide coding gains, then compression efficiency is improved, but coding complexity increases
Solution Approach 1:
The patent changes the parameters used for partitioning decision from traditional texture-based metrics to motion-based metrics (motion variance, motion gradient) and depth-based metrics (depth variance). This parameter substitution enables the system to achieve better partitioning decisions with lower computational complexity, as motion and depth information are already available from previous processing stages.
Solution Approach 2:
The patent introduces motion information and depth information as intermediary elements that mediate the partitioning decision process. These intermediaries provide additional contextual information about the video content, enabling more accurate partitioning decisions without requiring complex analysis of the video data itself, thus improving compression efficiency while maintaining manageable complexity.
2Loss of energy
If partitioning operations are performed to achieve coding gains, then compression efficiency is improved, but processing speed decreases
Solution Approach 1:
The patent performs preliminary actions by utilizing motion information and depth information that have already been computed in earlier encoding/decoding stages. By reusing these pre-computed intermediaries for partitioning decisions, the system avoids redundant computations and accelerates the partitioning process while maintaining high compression efficiency.
Solution Approach 2:
The patent changes the computational parameters from analyzing raw video pixel data to analyzing motion vectors and depth maps, which are already in a processed format. This parameter transformation significantly reduces the computational burden and increases processing speed while still achieving accurate partitioning for optimal compression.
3Measurement precision
If motion variance is calculated to determine partitioning type, then partitioning accuracy is improved, but computational cost increases
Solution Approach 1:
The patent applies motion information and depth information for multiple purposes: they are used both for motion compensation/depth reconstruction and for partitioning decisions. This multi-functionality eliminates the need for separate computational processes, reducing overall computational cost while improving partitioning accuracy through the use of these versatile intermediaries.
4Measurement precision
If depth variance is calculated to determine partitioning type, then partitioning accuracy is improved, but computational cost increases
Solution Approach 1:
The patent changes the basis for partitioning decisions from texture-based parameters to depth-based parameters (depth variance). This parameter substitution improves partitioning accuracy for depth-related content while reducing computational cost because depth maps are already available and can be processed efficiently using simple variance calculations.
Data Source
AI summary
Systems, methods, and instrumentalities are disclosed herein for determining the partitioning type of a video block based on depth and/or motion information associated with the video block. The depth and/or motion information may be obtained by a coding device such as an encoder in addition to the video block. Utilizing the depth and/or motion information, the coding device may be able to accelerate the partitioning determination process and obtain coding gains without incurring a significant increase in coding complexity.