Video Decoder Buffer Management for Variable Picture Sizes

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The existing video decoding methods in Reference Picture Resampling (RPR) mode require an additional RPR frame buffer to scale frames, increasing costs due to the need for extra storage space for scaled frames.

Innovation Solution

A video decoding method that determines whether the size of a current picture matches the next picture, and if not, scales the corresponding reference frame to generate a scaled frame, storing it in a first frame buffer after ensuring sufficient space by displaying a portion of the originally stored frame, thereby eliminating the need for a conventional RPR frame buffer.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If an additional RPR frame buffer is used to store scaled frames, then the decoding function is achieved, but the storage cost increases

Engineering Contradiction:
Improvedecoding functionVSAvoidstorage space
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The patent merges the function of storing scaled frames with existing frame buffers (L0 buffer, L1 buffer, or Bp buffer) that would otherwise be used for their original purposes. By combining these storage functions, the system achieves the required decoding functionality without adding extra buffer memory, thus resolving the contradiction between achieving decoding function and minimizing storage space.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The existing frame buffers are made multi-functional by allowing them to store both their original frames and scaled reference pictures. The buffers serve dual purposes: maintaining original frame sequences for display and storing scaled frames for reference during decoding, thereby eliminating the need for dedicated RPR frame buffer space.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Quantity of substance

If existing frame buffers are used to store scaled frames, then storage space is reduced, but buffer management complexity increases

Engineering Contradiction:
Improvestorage spaceVSAvoidbuffer management
Core Design Contradiction:
Quantity of substanceVSDevice complexity

Solution Approach 1:

The patent changes the state parameters of existing buffers by dynamically adjusting their content based on buffer type and display status. Full buffers are emptied and refilled with scaled frames, partially displayed buffers have their undisplayed portions replaced, and this parameter-based management approach provides a systematic way to handle buffer complexity without requiring additional hardware buffers.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS9319677B2Video decoding method and system thereof
Publication Date: 2016.04.19 MEDIATEK INC
  • US9319677B2 patent drawing
  • US9319677B2 patent drawing
  • US9319677B2 patent drawing

AI summary

A video decoding method for decoding a bit stream to a plurality of frames, applied in a video decoding system, includes: determining whether a size of a current picture is equal to that of a next picture according to the bit stream; scaling a corresponding reference frame for the next picture to generate a scaled frame when the size of the current picture is not equal to that of the next picture; and storing the scaled frame in a first buffer of a storage unit, wherein at least a portion of a first frame originally stored in the first buffer is used; wherein when it is determined that the size of the current picture is not equal to that of the next picture, the next picture is encoded in the bit stream in a mode that the scaled corresponding reference frame is required for decoding the next picture.