Neighbor Block Pattern Formula for Video Coding Memory Reduction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video coding standards, such as VP9, face inefficiencies in motion estimation due to large memory requirements and complex hardware logic, resulting from fixed neighbor block patterns and extensive data storage, which hinder performance and increase costs.

Innovation Solution

A flexible neighbor block pattern formula is introduced to determine spatial neighbor motion vector locations for various block sizes, reducing memory capacity and bandwidth needs by eliminating the need for a look-up table and using only 8×8 motion vectors, with neighbor blocks stored in a reduced memory buffer.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If fixed neighbor block patterns with look-up tables are used for motion estimation, then motion estimation accuracy is maintained, but memory capacity and bandwidth requirements increase significantly

Engineering Contradiction:
Improvemotion estimation accuracyVSAvoidmemory capacity
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent extracts only the essential neighbor block information (motion vectors from immediate spatial neighbors) needed for accurate motion estimation, removing unnecessary look-up tables and pre-stored neighbor block data. This selective extraction maintains prediction accuracy while significantly reducing memory capacity requirements.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent creates a universal motion vector prediction mechanism that works across all block sizes and coding configurations without requiring size-specific look-up tables. The same neighbor block pattern and prediction logic apply universally, eliminating the need for multiple pre-stored patterns in memory.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Measurement precision

If extensive neighbor block data is stored in memory, then motion vector prediction accuracy is improved, but hardware logic complexity and chip area increase

Engineering Contradiction:
Improvemotion vector prediction accuracyVSAvoidhardware logic complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the motion estimation process into simple, modular steps: identifying immediate spatial neighbors, retrieving their motion vectors, and applying prediction logic. This segmentation avoids complex hardware logic by breaking down the process into manageable operations that can be executed with minimal circuitry.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent enables the decoding process to be self-sufficient by computing motion vector predictions on-the-fly using only the immediately available neighbor block data from the current frame buffer. This eliminates the need for complex pre-computed look-up tables and reduces hardware logic complexity while maintaining prediction accuracy.

Inventive Principle:
Principle #25Self-service

3Measurement precision

If traditional block-matching with exhaustive search is used, then motion estimation accuracy is maximized, but computational performance and processing speed decrease

Engineering Contradiction:
Improvemotion estimation accuracyVSAvoidprocessing speed
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent performs preliminary action by utilizing motion vectors from already-decoded spatial neighbor blocks to predict the current block's motion vector. This preliminary prediction provides a strong initial estimate that avoids the need for exhaustive block-matching searches, significantly improving processing speed while maintaining acceptable accuracy.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements feedback by using the motion vectors of previously decoded neighbor blocks as input to predict the current block's motion vector. This feedback mechanism leverages the temporal and spatial correlation in video data, providing accurate predictions without requiring computationally intensive exhaustive searches.

Inventive Principle:
Principle #23Feedback

4Adaptability or versatility

If neighbor blocks from wide areas are considered, then motion vector prediction coverage is improved, but memory bandwidth and data transfer requirements increase

Engineering Contradiction:
Improveprediction coverageVSAvoidmemory bandwidth
Core Design Contradiction:
Adaptability or versatilityVSQuantity of substance

Solution Approach 1:

The patent applies local quality by focusing motion vector prediction on immediate spatial neighbors (blocks directly above and to the left of the current block) rather than considering blocks across the entire frame. This localized approach provides sufficient prediction coverage for most cases while minimizing memory bandwidth requirements by accessing only nearby data.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS11616968B2Method and system of motion estimation with neighbor block pattern for video coding
Publication Date: 2023.03.28 INTEL CORP
  • US11616968B2 patent drawing
  • US11616968B2 patent drawing
  • US11616968B2 patent drawing

AI summary

Techniques related to motion estimation with neighbor block pattern for video coding.