Decoded Picture Buffer Overflow Prevention via Dynamic Bumping

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video coding standards face challenges in managing the decoded picture buffer (DPB) size, leading to errors and failures due to the DPB becoming full before all pictures of an access unit (AU) are processed, especially when additional bumping is only invoked after the last decoding unit (DU) of an AU is removed from the coded picture buffer (CPB.

Innovation Solution

Implementing a method to invoke additional bumping after every picture or the last DU of each picture in an AU, marking and removing pictures from the DPB to free up space and prevent the DPB from overflowing, ensuring it can store current and reference pictures efficiently.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If additional bumping is only invoked after the last DU of an AU is removed from the CPB, then the DPB management follows existing video coding standards, but the DPB becomes full before all pictures of an AU are processed causing errors and failures

Engineering Contradiction:
ImproveDPB overflow preventionVSAvoidPicture processing completion
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent applies preliminary action by invoking additional bumping operations before the DPB becomes full, specifically after each picture is removed from the CPB rather than waiting until the last DU is removed. This proactive approach frees up DPB space in advance, preventing overflow errors and ensuring the DPB can accommodate all pictures of the current AU without failure.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If the DPB size is increased to store all pictures of an AU, then all pictures can be stored without overflow, but the memory consumption and device complexity increase

Engineering Contradiction:
ImprovePicture storage completenessVSAvoidDPB memory size
Core Design Contradiction:
ReliabilityVSVolume of stationary object

Solution Approach 1:

The patent applies dynamics by making the DPB management adaptive and flexible through dynamic bumping operations. Instead of statically increasing the DPB size, the system dynamically adjusts picture retention based on processing progress, removing pictures from the DPB at appropriate intervals (after each picture removal from CPB) to maintain sufficient space while minimizing memory consumption.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent applies discarding and recovering by selectively removing pictures from the DPB at intermediate points during AU processing. After each picture is removed from the CPB, the corresponding picture is also removed from the DPB, freeing up space for subsequent pictures while ensuring previously processed pictures are no longer needed. This maintains storage completeness without requiring excessive memory capacity.

Inventive Principle:
Principle #34Discarding and recovering

3Reliability

If pictures are removed from the DPB more frequently, then the DPB has sufficient space for current and reference pictures, but the overhead of managing bumping operations increases

Engineering Contradiction:
ImproveDPB space managementVSAvoidBumping operation management
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent applies self-service by tying the additional bumping operations to existing picture processing events. The bumping operation is automatically triggered after each picture is removed from the CPB, leveraging the natural processing flow rather than requiring separate, independent management decisions. This integrates space management into the existing processing pipeline, reducing overhead while maintaining reliability.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS11917174B2Decoded picture buffer (DPB) operations and access unit delimiter (AUD)
Publication Date: 2024.02.27 QUALCOMM INC
  • US11917174B2 patent drawing
  • US11917174B2 patent drawing
  • US11917174B2 patent drawing

AI summary

Systems, methods, and computer-readable storage media are provided for decoded picture buffer (DPB) operations and rewriting access unit delimiters (AUDs) after bitstream extractions. An example method can include storing one or more pictures associated with an access unit (AU) in a decoded picture buffer (DPB), the AU including a first plurality of pictures, the first plurality of pictures corresponding to a plurality of video coding layers; after each picture of a second plurality of pictures associated with the AU is removed from a coded picture buffer (CPB), removing at least one picture of the one or more pictures from the DPB; and storing, in the DPB, each picture of the second plurality of pictures removed from the CPB.