Video Prediction Processing Using Reference Data Buffer for Parallel Execution

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Conventional video coding standards face challenges in performing parallel non-inter and inter prediction efficiently, leading to suboptimal system performance due to data dependency between intra and inter prediction blocks.

Innovation Solution

A prediction processing system and method utilizing a reference data buffer to buffer and reuse inter prediction results for non-inter prediction operations, allowing for overlapping processing periods and enabling parallel execution of inter and non-inter prediction tasks.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If conventional sequential prediction processing is used, then data dependency between intra and inter prediction blocks is maintained, but system performance is suboptimal due to inability to perform parallel processing

Engineering Contradiction:

Improveprediction processing throughputVSAvoidprediction processing architecture

Core Design Contradiction:

ProductivityVSDevice complexity

Solution Approach 1:

The prediction processing system is divided into separate inter prediction processing circuits and non-inter prediction processing circuits that operate independently and in parallel, eliminating the sequential dependency while maintaining functional completeness through dedicated processing paths for each prediction type

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

A reference data buffer is introduced as an intermediary component to store reference data generated by inter prediction operations, enabling non-inter prediction circuits to access required reference data without blocking inter prediction processing, thus facilitating parallel operation while managing data dependencies

Inventive Principle:

Principle #24Intermediary (Mediator)

2Productivity

If parallel non-inter and inter prediction is implemented, then system performance is enhanced, but data dependency management becomes more complex

Engineering Contradiction:

Improvedecoding performanceVSAvoidreference data buffer management

Core Design Contradiction:

ProductivityVSDevice complexity

Solution Approach 1:

Reference data from inter prediction operations is buffered in advance in the reference data buffer, making it available before non-inter prediction operations require it, thus enabling parallel processing without waiting for inter prediction to complete while managing data availability proactively

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

Reference data is copied from inter prediction results into the reference data buffer, creating an independent copy that can be accessed by non-inter prediction circuits without affecting the original inter prediction data flow, enabling parallel access and processing

Inventive Principle:

Principle #26Copying

Data Source

PatentUS12063360B2Prediction processing system using reference data buffer to achieve parallel non-inter and inter prediction and associated prediction processing method

Publication Date: 2024.08.13 MEDIATEK INC

AI summary

A prediction processing system includes a processing circuit and a reference data buffer. The processing circuit performs a first inter prediction operation upon a first prediction block in a frame to generate a first inter prediction result, and further performs a second inter prediction operation upon a second prediction block during a first period. The reference data buffer buffers a reference data derived from the first inter prediction result. The processing circuit further fetches the reference data from the reference data buffer, and performs a non-inter prediction operation according to at least the reference data during a second period, wherein the second period overlaps the first period.