Video Decoder Reference Picture Buffer Management

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video coding methods are inefficient for encoding and decoding image sequences, particularly in high resolution formats, and lack random access and editability functionalities, leading to large file sizes and playback restrictions.

Innovation Solution

The method involves signaling that a predefined set of reference pictures can be stored in the reference picture buffer and used consistently throughout decoding, allowing all output pictures in the sequence to be decoded without changing the reference picture set, and indicating whether inter coded pictures use only intra coded pictures as references, enabling efficient encoding and decoding with improved random access and editability.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If temporal prediction is used to compress video sequences, then coding efficiency is improved, but random access and editability functionalities are lost

Engineering Contradiction:
Improvecoding efficiencyVSAvoidrandom access and editability
Core Design Contradiction:
ProductivityVSAdaptability or versatility

Solution Approach 1:

The video sequence is segmented into independent picture units (tiles or slices) that can be decoded independently. Each picture is coded with both intra and inter prediction capabilities, allowing the sequence to be divided into self-contained segments that maintain temporal compression while enabling random access to any segment without requiring decoding of previous segments.

Inventive Principle:
Principle #1Segmentation

2Adaptability or versatility

If intra pictures are used to enable random access, then adaptability is improved, but coding efficiency deteriorates

Engineering Contradiction:
Improverandom accessVSAvoidcoding efficiency
Core Design Contradiction:
Adaptability or versatilityVSProductivity

Solution Approach 1:

Different prediction methods are applied locally to different regions within pictures. Some regions use intra prediction for random access capability, while other regions use inter prediction for better compression efficiency. This local differentiation allows the system to achieve both random access and coding efficiency simultaneously by optimizing each region's prediction method based on its specific requirements.

Inventive Principle:
Principle #3Local quality

3Manufacturing precision

If reference picture lists are constructed for each slice, then decoding accuracy is improved, but device complexity increases

Engineering Contradiction:
Improvedecoding accuracyVSAvoidreference picture list construction
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

Reference picture lists are merged across slice boundaries, allowing the same reference picture list to be used for multiple slices. This reduces the complexity of constructing and managing separate reference picture lists for each slice while maintaining decoding accuracy, as the shared reference lists still provide the necessary temporal prediction capability across different slices.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentEP2987326B1An apparatus, a method and a computer program for video coding and decoding
Publication Date: 2020.09.02 NOKIA TECHNOLOGIES OY
  • EP2987326B1 patent drawingFigure 1~2
  • EP2987326B1 patent drawingFigure 3
  • EP2987326B1 patent drawingFigure 4

AI summary

A method and related apparatus for decoding an image sequence from a bitstream, wherein an identifier indicating if all output pictures are decodable with a predefined set of reference pictures is decoded;an indication of required reference pictures for a given output picture is decoded; the indicated at least one reference picture for the given output picture is decoded; and the at least one output picture is decoded.