Video Coding Reference Picture Selection Using POC and Temporal Layers

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video coding techniques face challenges in efficiently managing motion vectors (MVs) for inter-picture prediction, particularly in reducing redundancy and improving compression ratios, especially when dealing with high-resolution and high-frame-rate video streams.

Innovation Solution

The proposed method involves processing circuitry that decodes video data by selecting a collocated reference picture based on Picture Order Count (POC) numbers and selection indices, allocating memory spaces for temporal layers, and storing decoded data to optimize MV prediction and storage efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of substance

If motion compensation with inter-picture prediction is used, then compression ratio is improved, but memory requirements and bandwidth increase

Engineering Contradiction:
Improvecompression ratioVSAvoidmemory requirements
Core Design Contradiction:
Loss of substanceVSQuantity of substance

Solution Approach 1:

The patent extracts and stores only the essential motion vector information in a compact format (one-dimensional array) rather than storing complete picture data, significantly reducing memory requirements while maintaining compression effectiveness

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent segments the video data processing into separate temporal layers, allowing selective storage and retrieval of motion information from different time points, optimizing the balance between compression ratio and memory usage

Inventive Principle:
Principle #1Segmentation

2Loss of substance

If motion vectors are predicted from surrounding MVs, then data redundancy is reduced, but coding complexity increases

Engineering Contradiction:
Improvedata redundancyVSAvoidcoding complexity
Core Design Contradiction:
Loss of substanceVSDevice complexity

Solution Approach 1:

The patent implements dynamic motion vector prediction where the prediction process adapts based on the temporal layer and POC relationships, using different reference pictures and prediction strategies for different temporal levels, reducing redundancy while managing complexity through structured adaptation

Inventive Principle:
Principle #15Dynamics

3Measurement precision

If multiple reference pictures from different temporal layers are used, then decoding accuracy is improved, but selection complexity increases

Engineering Contradiction:
Improvedecoding accuracyVSAvoidselection complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent performs preliminary organization of reference pictures into temporal layers with assigned POC values before the actual decoding process, enabling efficient selection based on pre-established temporal relationships and reducing real-time selection complexity

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent uses POC (Picture Order Count) as a key parameter to systematically identify and select appropriate reference pictures from different temporal layers, transforming the complex selection problem into a parameter-based lookup process that improves decoding accuracy while managing complexity

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS10645380B2Method and apparatus for video coding
Publication Date: 2020.05.05 TENCENT AMERICA LLC
  • US10645380B2 patent drawing
  • US10645380B2 patent drawing
  • US10645380B2 patent drawing

AI summary

Aspects of the disclosure provide method and apparatus for video coding. In some examples, an apparatus includes processing circuitry. The processing circuitry decodes a first portion of video data to obtain first decoded data corresponding to at least two pictures of a plurality of pictures. The processing circuitry identifies one or more pictures of the at least two pictures for decoding a second portion of the video data corresponding to a current picture. In a case that the one or more identified pictures includes two or more identified pictures, the processing circuitry selects a collocated reference picture based on one of (i) the POC numbers of the two or more identified pictures and the current picture, and (ii) a selection index provided in the video data. The processing circuitry also decodes the second portion of the video data using the collocated reference picture.