Intra-Subpartitioning Mode for Video Coding Block Splitting

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video coding techniques face challenges in efficiently compressing video data while maintaining high quality, as they struggle with managing large data volumes and adhering to size constraints, particularly when splitting coding blocks across Virtual Pipeline Data Units (VPDUs) boundaries.

Innovation Solution

The implementation of an intra-subpartitioning (ISP) mode that splits coding blocks into sub-blocks based on size thresholds, ensuring that the dimensions of sub-blocks comply with maximum transform block size requirements, and using a recursive tree structure to determine optimal horizontal or vertical splits, preventing processing across VPDU boundaries.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If coding blocks are split across VPDU boundaries to improve compression efficiency, then coding flexibility increases, but processing complexity and computational burden increase

Engineering Contradiction:
Improvecoding flexibilityVSAvoidprocessing complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent applies segmentation by dividing the coding block processing into separate segments based on VPDU boundaries. Each VPDU processes only the coding blocks that fall within its boundary, creating independent processing segments. This resolves the contradiction by maintaining coding flexibility through proper block segmentation while reducing processing complexity by eliminating cross-boundary operations.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediary mechanism in the form of boundary detection and constraint enforcement logic that mediates between the desire for flexible coding block splitting and the need for simplified processing. This intermediary layer ensures that coding blocks are properly constrained to VPDU boundaries, allowing coding flexibility within boundaries while preventing the processing complexity that would arise from cross-boundary operations.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Manufacturing precision

If intra-subpartitioning mode is enabled for all coding blocks to improve compression efficiency, then video quality improves, but processing time and computational load increase

Engineering Contradiction:
Improvevideo qualityVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent applies local quality by enabling intra-subpartitioning mode selectively based on local characteristics of coding blocks, such as their size and position relative to VPDU boundaries. Rather than uniformly applying the mode to all blocks, the system evaluates each block's specific properties and enables the mode only where it provides beneficial compression without violating boundary constraints, thus improving video quality while minimizing processing time.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent implements partial action by applying intra-subpartitioning mode to only a subset of coding blocks that meet specific criteria (size thresholds, boundary constraints) rather than to all blocks. This selective application provides sufficient compression improvement for the most beneficial blocks while avoiding the excessive processing time that would result from uniformly applying the mode to every coding block in the video stream.

Inventive Principle:
Principle #16Partial or excessive action

3Productivity

If size constraints are enforced to prevent cross-VPDU processing to improve processing efficiency, then processing speed improves, but coding flexibility decreases

Engineering Contradiction:
Improveprocessing speedVSAvoidcoding flexibility
Core Design Contradiction:
ProductivityVSAdaptability or versatility

Solution Approach 1:

The patent applies preliminary action by establishing size constraints and boundary rules before the actual coding and processing operations begin. By pre-defining which coding blocks can be processed by which VPDUs based on their dimensions and positions, the system enables fast processing during execution without sacrificing coding flexibility, as all necessary decisions about block-VPDU assignments are made in advance.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent uses parameter changes by adjusting the intra-subpartitioning mode flag and split type parameters based on the coding block's size parameters and position relative to VPDU boundaries. This dynamic parameter adjustment allows the system to maintain coding flexibility by adapting to different block characteristics while simultaneously improving processing speed by enforcing size constraints that prevent cross-VPDU operations.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS20230232000A1Sub-partition intra prediction
Publication Date: 2023.07.20 QUALCOMM INC
  • US20230232000A1 patent drawing
  • US20230232000A1 patent drawing
  • US20230232000A1 patent drawing

AI summary

Techniques are described for improving intra-subpartitioning (ISP) mode for splitting coding blocks into sub-blocks. In some cases, whether ISP mode is enabled for a coding block is based on size constraints pertaining to data units (e.g., VPDUs, transform blocks, among others). For instance, based on a size constraint related to a VPDU, the ISP mode can be disabled for coding blocks crossing VPDU boundaries. In some cases, whether to enable ISP mode may be based on comparison of the width and/or height of the coding block to size thresholds corresponding to one or more maximum transform block sizes. In some cases, where the ISP mode is enabled for a coding block, a value of a flag used for defining a type of split, horizontal or vertical, for the coding block, can be inferred based on the width and/or height of the coding block relative to one or more thresholds.