Interpolated Reference Pictures for Video Coding Bit Rate Reduction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional video compression systems face inefficiencies in reducing bit rate for video transmission, as they rely solely on previously encoded pictures for encoding current pictures, limiting compression efficiency.

Innovation Solution

The use of interpolated reference pictures (IRPs) generated through interpolation methods like weighted picture averages and motion compensated interpolation, which are stored in a decoded picture buffer and used to encode or decode current pictures, optimizing the reference picture list arrangement and management.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If conventional video compression systems rely solely on previously encoded pictures for encoding current pictures, then the system complexity remains low, but the compression efficiency is limited

Engineering Contradiction:
Improvecompression efficiencyVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent applies preliminary action by generating interpolated reference pictures in advance before encoding the current picture. The interpolation process creates additional reference pictures from previously decoded pictures, which are then stored in the decoded picture buffer for subsequent encoding operations. This advance preparation of reference materials improves compression efficiency without significantly increasing real-time encoding complexity.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces interpolated reference pictures as intermediary elements between previously encoded pictures and the current picture being encoded. These IRPs serve as mediators that provide additional reference information, enabling more accurate motion compensation and prediction. The interpolation circuit acts as an intermediary component that generates these intermediate reference pictures, thereby improving compression efficiency while managing system complexity.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If interpolated reference pictures are generated and stored in the decoded picture buffer, then compression efficiency improves, but the buffer management complexity increases

Engineering Contradiction:
Improvecompression efficiencyVSAvoidbuffer management complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent applies dynamics by implementing dynamic buffer management for interpolated reference pictures. The decoded picture buffer dynamically adjusts its contents based on the availability and quality of reference pictures, the interpolation parameters, and the encoding requirements. Reference pictures are added to or removed from the buffer according to their utility, allowing the system to optimize compression efficiency while adapting buffer management to changing conditions rather than following rigid rules.

Inventive Principle:
Principle #15Dynamics

3Loss of energy

If more reference pictures are used for encoding current pictures, then the bit rate for video transmission is reduced, but the device complexity increases

Engineering Contradiction:
Improvebit rateVSAvoiddevice complexity
Core Design Contradiction:
Loss of energyVSDevice complexity

Solution Approach 1:

The patent applies parameter changes by modifying the interpolation parameters to control the generation of interpolated reference pictures. Parameters such as the interpolation method (e.g., linear interpolation, motion-compensated interpolation), the temporal distance between reference pictures, and the spatial resolution are adjusted to optimize the balance between bit rate reduction and device complexity. By changing these parameters, the system can generate sufficient reference pictures to reduce bit rate while avoiding excessive complexity in the interpolation and buffer management processes.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS10404979B2Video coding with interpolated reference pictures
Publication Date: 2019.09.03 MEDIATEK INC
  • US10404979B2 patent drawing
  • US10404979B2 patent drawing
  • US10404979B2 patent drawing

AI summary

Aspects of the disclosure provide an apparatus for encoding a sequence of pictures into a coded bit stream. The apparatus can include a decoded picture buffer (DPB) configured to store reference pictures, at least one of the reference pictures being an interpolated reference picture (IRP), an interpolation circuit configured to generate the IRP based on the reference pictures stored in the DPB, an encoding circuit configured to encode a current picture in the sequence of pictures based on a value of a variable indicating whether the current picture is to be encoded using the IRP, and an encoding controller configured to determine the value of the variable according to a size of DPB and the reference pictures stored in the DPB.