Alternate Reference Frame Temporal Filter for Video Encoding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video encoding technologies face challenges in achieving high-quality video transmission while minimizing bandwidth consumption, particularly in scenarios with limited bandwidth, as they struggle to effectively utilize reference frames for predictive encoding.

Innovation Solution

The method involves selecting a filter set of frames, including an anchor frame, to generate an alternate reference frame by determining weighting factors for temporal and spatial correlations, which is then used to encode and transmit video blocks, allowing for more efficient compression and decoding.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If conventional reference frames are used for predictive encoding, then encoding simplicity is maintained, but video quality and compression efficiency deteriorate under limited bandwidth conditions

Engineering Contradiction:
Improvevideo qualityVSAvoidencoding complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent applies preliminary action by pre-filtering reference frames before they are used for encoding. A temporal filter is applied to generate a filtered reference frame that enhances predictive coding efficiency. This preliminary processing of reference frames allows the encoder to achieve better compression ratios and video quality without increasing the complexity of the core encoding operation itself.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces an intermediary by creating a filtered reference frame that serves as a mediator between the original reference frame and the current frame being encoded. This intermediate filtered reference frame acts as a bridge that improves prediction accuracy while keeping the overall system architecture relatively simple.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Manufacturing precision

If more reference frames are used to improve predictive encoding, then video quality improves, but bandwidth consumption increases

Engineering Contradiction:
Improvevideo qualityVSAvoidbandwidth consumption
Core Design Contradiction:
Manufacturing precisionVSLoss of substance

Solution Approach 1:

The patent applies parameter changes by dynamically adjusting the filtering parameters based on the characteristics of the video data. The temporal filter uses configurable parameters such as filter strength and reference frame selection that can be optimized to achieve the best compression efficiency at minimal bandwidth cost, rather than using a fixed approach.

Inventive Principle:
Principle #35Parameter changes

3Productivity

If complex filtering algorithms are applied to reference frames, then predictive encoding efficiency improves, but computational load on decoders increases

Engineering Contradiction:
Improveencoding efficiencyVSAvoidcomputational load
Core Design Contradiction:
ProductivityVSUse of energy by moving object

Solution Approach 1:

The patent applies segmentation by dividing the filtering operation into discrete, manageable steps that can be efficiently implemented. The temporal filter processes reference frames in segments, applying filtering operations only where needed and using computationally efficient algorithms that balance encoding efficiency with decoder computational requirements.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS9172957B2Coding video data with an alternate reference frame generated using a temporal filter
Publication Date: 2015.10.27 GOOGLE LLC
  • US9172957B2 patent drawing
  • US9172957B2 patent drawing
  • US9172957B2 patent drawing

AI summary

Implementations of the teachings herein include coding video data with an alternate reference frame generated using a temporal filter. The alternate reference frame is generated by determining a first weighting factor, for each corresponding block of a respective frame of a filter set, that represents a temporal correlation of the block with the corresponding block, determining a second weighting factor, for each pixel for each corresponding block of the respective frame of the filter set, that represents a temporal correlation of the pixel to a spatially-correspondent pixel in the block, determining a filter weight for each pixel in the block and for each spatially-correspondent pixel is each corresponding block based on the first weighting factor and the second weighting factor, and generating a weighted average pixel value for each pixel position in the block to form a block of the alternate reference frame based on the filter weights.