Video Decoder Reference Picture Selection for Decoding Complexity

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video coding technologies face challenges in accurately predicting motion information of picture blocks, leading to suboptimal coding performance due to inefficiencies in referencing library pictures during decoding.

Innovation Solution

A method and apparatus for improving motion information prediction by determining candidate reference pictures based on the minimum decoding time interval between library pictures, allowing for efficient decoding and encoding by selecting appropriate library pictures that maximize content similarity or encoding efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If library pictures are referenced during decoding, then coding performance can be improved, but decoding complexity and peak decoding demands increase

Engineering Contradiction:
Improvecoding performanceVSAvoiddecoding complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent pre-determines the quantity of candidate reference pictures to be used during decoding based on the minimum decoding time interval k. By establishing this quantity in advance (rather than dynamically selecting during decoding), the system prepares the decoding process ahead of time, reducing peak decoding complexity while maintaining coding performance benefits from reference picture usage.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If more library pictures are used as reference pictures, then motion prediction accuracy improves, but decoding time and processing load increase

Engineering Contradiction:
Improvemotion prediction accuracyVSAvoiddecoding time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent changes the parameter of reference picture quantity from a dynamic or fixed large number to a specifically determined quantity based on the minimum decoding time interval k. This parameter adjustment optimizes the balance between motion prediction accuracy (benefiting from more references) and decoding time (increasing with more references), achieving the best compromise for the given decoding constraints.

Inventive Principle:
Principle #35Parameter changes

3Reliability

If library pictures with small time intervals are referenced, then content similarity and prediction accuracy improve, but decoding resource requirements increase

Engineering Contradiction:
Improveprediction accuracyVSAvoiddecoding resource requirements
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The system pre-determines the appropriate quantity of candidate reference pictures based on the minimum decoding time interval k before the actual decoding process. This preliminary determination allows the system to select an optimal number of reference pictures that balances prediction accuracy (from using recent, similar content) against decoding resource requirements, avoiding the need to process excessive reference pictures during peak decoding moments.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11496754B2Video encoder, video decoder, and corresponding method of predicting random access pictures
Publication Date: 2022.11.08 HUAWEI TECH CO LTD
  • US11496754B2 patent drawing
  • US11496754B2 patent drawing
  • US11496754B2 patent drawing

AI summary

A decoding method includes obtaining an identifier from a bitstream, where the identifier indicates a minimum decoding time interval k between library pictures that is allowed in the bitstream, obtaining, when parsing the bitstream, a decoding moment ti of a current decoded picture and a decoding moment tj of a first decoded picture that is closest to the current decoded picture and that references a new library picture when the current decoded picture is decoded by referencing a library picture, where the new library picture is a library picture that is not decoded or needs to be re-decoded when the first decoded picture is decoded, and determining a preset quantity of library pictures as candidate reference pictures of the current decoded picture based on a relationship between k and a difference between ti and tj.