Inter Frame Segment Coding for Parallel Decoding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image/video coding methods restrict dependencies between tiles, leading to increased bit requirements and visual artifacts at tile boundaries, limiting merge modes and context adaptability.

Innovation Solution

A method for coding a segment of an inter frame by deriving new temporal motion information predictor candidates from a reference frame and updating CABAC contexts, allowing for context adaptive binary arithmetic coding across segment boundaries.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If dependencies between tiles are disabled to enable parallel decoding, then decoding parallelism is improved, but coding efficiency deteriorates due to increased bit requirements and visual artifacts at tile boundaries

Engineering Contradiction:
Improvedecoding parallelismVSAvoidcoding efficiency
Core Design Contradiction:
ProductivityVSLoss of information

Solution Approach 1:

The frame is divided into multiple tiles that can be decoded in parallel, while within each tile, slice boundaries are carefully managed to allow controlled dependencies. This segmentation enables parallel processing at the tile level while maintaining coding efficiency through intra-tile dependencies.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different dependency rules are applied to different regions: at tile boundaries, dependencies are restricted to enable parallel decoding, while within tiles and across slices, dependencies are maintained to preserve coding efficiency. The solution applies local quality by allowing merge modes and motion prediction within slices even when tile boundaries exist.

Inventive Principle:
Principle #3Local quality

2Productivity

If merge spatial candidates are restricted at tile boundaries to enable parallel decoding, then decoding parallelism is improved, but motion prediction accuracy deteriorates

Engineering Contradiction:
Improvedecoding parallelismVSAvoidmotion prediction accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

When spatial merge candidates are unavailable at tile boundaries, the solution transitions to temporal dimension by using motion information from reference frames. This dimensional change allows motion prediction to continue effectively even when spatial dependencies are restricted at tile boundaries.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Productivity

If CABAC context is reset at the start of each tile to break dependencies, then decoding parallelism is improved, but coding precision deteriorates due to loss of context adaptability

Engineering Contradiction:
Improvedecoding parallelismVSAvoidcoding precision
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The CABAC context is segmented such that it is reset at tile boundaries to enable parallel decoding, but within each tile, context is maintained across slice boundaries to preserve coding precision. This selective segmentation allows parallelism while minimizing context loss.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different context handling strategies are applied to different regions: at tile boundaries, context is reset to enable parallelism, while within tiles, context is preserved to maintain coding precision. The solution applies local quality by allowing context propagation within tiles even when tile-level parallelism is required.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS11178398B2Method and electronic device for coding a segment of an inter frame
Publication Date: 2021.11.16 SAMSUNG ELECTRONICS CO LTD
  • US11178398B2 patent drawing
  • US11178398B2 patent drawing
  • US11178398B2 patent drawing

AI summary

Example embodiments herein provide a method for coding a segment of an inter frame. The method includes partitioning, by a partitioning unit, a current frame into a plurality of segments. Further, the method includes coding, by a coding unit, a current spatial block at a boundary of a segment included among the plurality of segments by deriving at least one new temporal motion information predictor candidate from a reference frame. Further, the method includes cabac context initialization at the start of each non-first segment from the plurality of segments by deriving temporal stored cabac context from the reference frame.