Alternate Reference Frame Video Decoding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video compression schemes, such as H.264, face challenges in achieving high-quality video transmission over limited bandwidth channels, as they rely on prediction techniques that may not always select the best reference frames for optimal data compression.

Innovation Solution

The method involves selecting a target block in a video frame and determining if a secondary alternate reference block should be created based on differences with existing predictor blocks, using blocks from a sequence of frames that are more different to enhance prediction accuracy and reduce data requirements.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of energy

If standard prediction techniques are used to compress video, then bandwidth consumption is reduced, but video quality deteriorates

Engineering Contradiction:
Improvebandwidth consumptionVSAvoidvideo quality
Core Design Contradiction:
Loss of energyVSManufacturing precision

Solution Approach 1:

The patent segments the reference frame selection process by creating multiple alternate reference blocks from different frames in the sequence. Instead of using a single reference block, the system divides the reference selection into multiple candidates (first alternate reference block, second alternate reference block) derived from different temporal positions, allowing the decoder to choose the best match for each target block, thereby maintaining quality while managing bandwidth.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent extends the reference frame selection from a single temporal dimension to multiple temporal dimensions by utilizing frames from both past and future in the video sequence. The alternate reference blocks are constructed by combining information from multiple frames at different temporal positions, creating a multi-dimensional reference structure that improves prediction accuracy without proportionally increasing bandwidth.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Manufacturing precision

If multiple reference frames are used for prediction, then video quality improves, but device complexity increases

Engineering Contradiction:
Improvevideo qualityVSAvoiddevice complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent performs preliminary construction of alternate reference blocks during the encoding phase by combining frames from the sequence according to motion vector information. These pre-computed alternate reference blocks are then transmitted to the decoder, which simply needs to perform comparison and selection without complex reconstruction operations, thus improving quality while limiting decoder complexity.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent creates copied versions of reference blocks from different frames in the sequence (first alternate reference block from one frame, second alternate reference block from another frame) and transmits these copies to the decoder. The decoder then selects the best matching copy for each target block, achieving improved quality through multiple references while keeping the decoder operation simple (comparative selection rather than complex synthesis).

Inventive Principle:
Principle #26Copying

Data Source

PatentUS9392280B1Apparatus and method for using an alternate reference frame to decode a video frame
Publication Date: 2016.07.12 GOOGLE LLC
  • US9392280B1 patent drawing
  • US9392280B1 patent drawing
  • US9392280B1 patent drawing

AI summary

A current block and a reference frame used to compress the current block are selected from a bitstream. The reference frame has an alternate reference block created by obtaining a preliminary alternate reference block for the current block, obtaining a predictor block that is generated based on a frame other than the current frame, and creating the alternate reference block when the difference between the two predictors is less than a threshold. The alternate reference block is created by using certain blocks from the sequence of frames that are more different from the preliminary alternate reference block than other non-selected blocks. The current block is decoded using the alternate reference block. In this way, a predictor block that is different from a golden frame predictor is made available when an existing alternate reference block is too similar to the golden frame predictor to be useful.