Programmable Spatial Prediction for Video Encoding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional video encoding systems lack flexibility in utilizing spatial prediction modes, leading to suboptimal bit rate reduction and perceptual quality in video compression, especially in real-time video streaming applications.

Innovation Solution

A programmable spatial prediction system that dynamically loads and optimizes prediction modes and coefficients, enabling high-speed and flexible spatial prediction by using a loadable microcoded engine, which computes sample values based on weighted averages of neighboring samples across 4×4 partitions, allowing for parallel processing and efficient reduction of spatial redundancies.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of energy

If conventional fixed spatial prediction modes are used, then device complexity is reduced, but bit rate reduction efficiency deteriorates

Engineering Contradiction:
Improvebit rateVSAvoidencoder complexity
Core Design Contradiction:
Loss of energyVSDevice complexity

Solution Approach 1:

The patent implements dynamic spatial prediction by allowing the encoder to select from multiple prediction modes (planar, differential, gradient) and adjust prediction parameters based on the actual video content characteristics. The encoder dynamically determines the optimal prediction mode for each block by evaluating gradient calculations and comparing prediction errors, rather than using a fixed prediction approach. This dynamic adaptation enables better bit rate reduction efficiency while managing complexity through standardized algorithms.

Inventive Principle:
Principle #15Dynamics

2Measurement precision

If fixed prediction modes are used, then ease of operation is improved, but perceptual quality deteriorates

Engineering Contradiction:
Improveprediction accuracyVSAvoidencoding simplicity
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent changes prediction parameters dynamically by calculating gradients in multiple directions (horizontal, vertical, diagonal) and selecting the prediction mode that provides the best match for each video block. The encoder computes gradient values, determines optimal prediction directions, and adjusts prediction parameters based on content characteristics such as edge orientations and texture patterns. This parameter adaptation significantly improves prediction accuracy and perceptual quality while maintaining encoding simplicity through standardized decision algorithms.

Inventive Principle:
Principle #35Parameter changes

3Productivity

If simple prediction methods are used, then processing speed is improved, but bit rate reduction deteriorates

Engineering Contradiction:
Improveencoding speedVSAvoidbit rate
Core Design Contradiction:
ProductivityVSLoss of energy

Solution Approach 1:

The patent segments the video content into discrete blocks and applies appropriate prediction modes to each block independently. By dividing the video stream into manageable units (macroblocks and sub-blocks), the encoder can efficiently process each segment using optimized algorithms for that specific region. This segmentation enables parallel processing capabilities and allows the use of computationally intensive gradient calculations only where necessary, rather than uniformly across the entire video stream, thus maintaining high encoding speed while achieving effective bit rate reduction.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS8948246B2Method and system for spatial prediction in a video encoder
Publication Date: 2015.02.03 AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE LTD
  • US8948246B2 patent drawing
  • US8948246B2 patent drawing
  • US8948246B2 patent drawing

AI summary

Described herein is a method and system for spatial prediction in a video encoder. The method and system can operate on a set of video elements in parallel. Multiple modes can also be executed for each set of video elements. Modes correspond to a weighted combination of neighboring video elements. The weighted combination can be changed and loaded into a spatial predictor instruction table.