Reference Picture List Encoding for Video Synchronization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video encoding and decoding systems face challenges in efficiently managing reference frames to reduce bandwidth consumption while maintaining video quality, particularly in scenarios with packet loss conditions.

Innovation Solution

The system assigns unique picture numbers to reference frames, constructs and signals a ranked reference picture list using differential coding, and reorders picture numbers for efficient encoding and decoding, ensuring synchronization of encoder and decoder buffers.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of energy

If reference frames are used to encode video frames, then bandwidth consumption is reduced, but overhead bits increase due to reference picture list management

Engineering Contradiction:
Improvebandwidth consumptionVSAvoidoverhead bits
Core Design Contradiction:
Loss of energyVSLoss of information

Solution Approach 1:

The patent changes the parameter of reference picture list encoding by using differential coding instead of direct encoding. This differential coding approach encodes only the changes in picture numbers rather than the full picture numbers themselves, significantly reducing the overhead bits while maintaining the ability to manage multiple reference frames for bandwidth efficiency

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent extracts and separately manages the reference picture list information from the main video data stream. By identifying and separately encoding only the picture numbers in the reference picture list using differential coding, it isolates the overhead information management from the main compression process, reducing the impact on overall bandwidth consumption

Inventive Principle:
Principle #2Taking out (Extraction)

2Measurement precision

If reference picture lists are encoded with detailed picture numbers, then decoding accuracy is improved, but bandwidth consumption increases

Engineering Contradiction:
Improvedecoding accuracyVSAvoidbandwidth consumption
Core Design Contradiction:
Measurement precisionVSLoss of energy

Solution Approach 1:

The patent transforms the encoding parameter from absolute picture numbers to differential picture numbers. This parameter change maintains decoding accuracy because the differential values can be easily reconstructed into the original picture numbers at the decoder, while significantly reducing the number of bits required to represent the same information

Inventive Principle:
Principle #35Parameter changes

3Reliability

If multiple reference frames are managed in buffers, then video quality is maintained, but system complexity increases

Engineering Contradiction:
Improvevideo qualityVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent segments the reference frame management into distinct components: reference picture buffers for storage and a reference picture list for active reference selection. This segmentation allows the system to maintain multiple reference frames for video quality while managing complexity through structured organization and separate handling of storage versus active reference management

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The reference picture list acts as an intermediary between the reference picture buffers and the video encoding/decoding process. It mediates which reference frames are actively used without requiring the entire buffer management system to be directly involved in each encoding operation, thereby reducing system complexity while maintaining video quality

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS10382773B1Video data encoding using reference picture lists
Publication Date: 2019.08.13 GOOGLE LLC
  • US10382773B1 patent drawing
  • US10382773B1 patent drawing
  • US10382773B1 patent drawing

AI summary

Encoding is accomplished using a reference picture list. Reference frames are identified with picture numbers and are assigned to reference picture buffers when used for encoding. The picture numbers associated the reference frames in the reference picture buffers are ranked. Reordering can occur to assign short word lengths to those reference frames used frequently for prediction. The resulting encoded reference picture list is sent to a decoder. The decoder decodes the reference picture list. By comparing picture numbers in the reference picture list with picture numbers of reference picture buffers of the decoder, the encoder and decoder buffers can remain in sync even under packet loss conditions. For example, the decoder can use the decoded reference picture list to determine missing and unused reference frames.