Intra Block Copy Video Coding Pipeline Data Dependency

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The existing video coding systems using pipeline architecture face data dependency issues due to the use of Intra-block copy (IntraBC) mode, which affects the efficiency of the encoding process as reconstructed data from neighboring blocks is not always available when needed, leading to delays in processing.

Innovation Solution

The solution involves using a constrained previous reconstructed region for IntraBC estimation by excluding unavailable data and employing source pixel data to replace unavailable reconstructed data, allowing for concurrent processing across multiple stages of the pipeline architecture.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If IntraBC mode is used in pipeline architecture, then coding efficiency is improved, but data dependency issues arise causing processing delays

Engineering Contradiction:
Improvecoding efficiencyVSAvoidprocessing delays
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The patent segments the reconstructed region into two distinct parts: available reconstructed data from completed pipeline stages and unavailable reconstructed data from ongoing pipeline stages. This segmentation allows the system to selectively use only the available data for IntraBC estimation, eliminating data dependency delays while maintaining coding efficiency benefits where possible.

Inventive Principle:
Principle #1Segmentation

2Measurement precision

If reconstructed data from neighboring blocks is used for IntraBC estimation, then prediction accuracy is improved, but data availability becomes a constraint in pipeline processing

Engineering Contradiction:
Improveprediction accuracyVSAvoiddata availability
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent applies preliminary action by completing the reconstruction of certain blocks through the pipeline before they are needed as reference data for IntraBC estimation. By carefully ordering the processing sequence and using available reconstructed data from previously completed stages, the system ensures that reference data is ready when needed, eliminating waiting delays while maintaining prediction accuracy.

Inventive Principle:
Principle #10Preliminary action

3Productivity

If concurrent processing is implemented across multiple pipeline stages, then overall throughput is improved, but data dependency between stages increases complexity

Engineering Contradiction:
ImprovethroughputVSAvoiddata dependency management
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent extracts and removes the data dependency constraint from the pipeline processing by excluding unavailable reconstructed data from the IntraBC estimation process. This allows each pipeline stage to operate independently using only the data that is actually available, simplifying the control logic while maintaining high throughput through concurrent processing.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS10165292B2Method and apparatus for intra block copy mode in video coding system with pipeline architecture
Publication Date: 2018.12.25 MEDIATEK INC
  • US10165292B2 patent drawing
  • US10165292B2 patent drawing
  • US10165292B2 patent drawing

AI summary

Method and apparatus of video coding using coding modes including Intra Block Copy (IntraBC) for a video coding system incorporating multi-stage pipeline processing is disclosed. In order to overcome data dependency issue due to the use of pipeline architecture, a first embodiment uses constrained previous reconstructed region for IntraBC estimation by excluding unavailable reconstructed previous reconstructed data due to the multi-stage pipeline processing. In the second embodiment, the unavailable reconstructed data is replaced by source pixel data.