R Picture Type for Random Access Video Encoding Efficiency

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The H.264/AVC standard's use of IDR pictures for random access reduces encoding efficiency by limiting bidirectional motion estimation for B pictures before IDR and restricting P pictures to single IDR reference, leading to decreased encoding performance.

Innovation Solution

Introducing a new picture type, R picture, which supports random access and allows for inter-prediction using multiple reference pictures, including past and future frames, to enhance encoding efficiency and maintain reference picture lists effectively.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If IDR picture is used for random access in H.264/AVC, then random decoding capability is enabled, but encoding efficiency is reduced due to limited reference picture usage

Engineering Contradiction:
Improverandom access capabilityVSAvoidencoding efficiency
Core Design Contradiction:
Adaptability or versatilityVSProductivity

Solution Approach 1:

The patent segments the reference picture management into two distinct modes: traditional IDR mode for random access and new R picture mode for enhanced compression. This segmentation allows the system to choose the appropriate mode based on whether random access is required, thereby resolving the contradiction between random access capability and encoding efficiency.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces dynamic reference picture list management where the decoder can adaptively maintain reference pictures from both before and after the R picture in the reference picture list. This dynamic adaptation allows bidirectional prediction to function effectively, improving encoding efficiency while preserving random access capability through the R picture structure.

Inventive Principle:
Principle #15Dynamics

2Adaptability or versatility

If DPB is cleared before IDR picture encoding, then random access is supported, but bidirectional motion estimation cannot be performed for B pictures before IDR

Engineering Contradiction:
Improverandom access supportVSAvoidmotion estimation capability
Core Design Contradiction:
Adaptability or versatilityVSProductivity

Solution Approach 1:

Instead of clearing the DPB before encoding the random access picture (as in traditional IDR), the patent inverts the approach by maintaining reference pictures in the DPB and using a new R picture type that explicitly manages reference picture lists. This inversion allows bidirectional motion estimation to function while still supporting random access through the R picture's reference picture list management.

Inventive Principle:
Principle #13The other way round (Inversion)

3Adaptability or versatility

If P pictures after IDR can use only one IDR picture as reference, then random access structure is maintained, but encoding efficiency of P pictures is reduced

Engineering Contradiction:
Improvereference picture structureVSAvoidP picture encoding efficiency
Core Design Contradiction:
Adaptability or versatilityVSProductivity

Solution Approach 1:

The patent makes the reference picture list management universal by allowing P pictures to access multiple reference pictures (both before and after the R picture) regardless of the random access structure. This multi-functionality enables P pictures to use bidirectional prediction when beneficial, improving encoding efficiency while the R picture structure maintains random access capability.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS9491483B2Inter-prediction method and video encoding/decoding method using the inter-prediction method
Publication Date: 2016.11.08 SK TELECOM CO LTD
  • US9491483B2 patent drawing
  • US9491483B2 patent drawing
  • US9491483B2 patent drawing

AI summary

A video encoding method using inter-prediction, includes: encoding information indicating whether a first picture is a picture which allows a second picture preceding the first picture in a display order to refer to at least one picture encoded before the first picture, wherein the first picture serves as a random access picture; encoding the first picture without referring to a reference picture which has already encoded; and when the first picture is a picture which allows the second picture to refer to the at least one picture encoded before the first picture, inter-prediction encoding, after encoding the first picture, the second picture by using at least one reference picture encoded before the first picture, and encoding reference picture information used for encoding the second picture, wherein the at least one reference picture encoded before the first picture is not deleted from a memory until the second picture are encoded.