Semiconductor Video Frame Decoding with Layered DPB Buffering

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing methods for decoding and reverse playback of video streams encoded in a hierarchical manner are inefficient, leading to longer display delays and larger memory requirements due to sequential access taking longer than random access.

Innovation Solution

A semiconductor system and method that decodes video frames by classifying them into layers and storing them in a decoded picture buffer (DPB), allowing for efficient decoding and display of frames in chronological and reverse chronological order, reducing the size of the DPB and display delay by optimizing the number of buffer blocks and decoding order.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If video frames are decoded sequentially in chronological order, then decoding simplicity is maintained, but display delay increases and playback efficiency deteriorates

Engineering Contradiction:

Improvedecoding simplicityVSAvoiddisplay delay

Core Design Contradiction:

Ease of operationVSLoss of time

Solution Approach 1:

The patent segments video frames into multiple layers (first layer, second layer, third layer) based on their importance and decoding requirements. This segmentation allows the system to decode and display critical frames (second layer) immediately while continuing to decode less critical frames (third layer) in the background, thereby reducing display delay without compromising decoding simplicity

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent implements preliminary action by pre-decoding and storing first layer frames in the decoded picture buffer (DPB) before displaying second layer frames. This ensures that when reverse playback is needed, the DPB already contains the necessary base frames, eliminating the need to wait for sequential decoding completion and significantly reducing display delay

Inventive Principle:

Principle #10Preliminary action

2Reliability

If all frames are decoded before display, then decoding completeness is ensured, but memory requirements increase and playback efficiency decreases

Engineering Contradiction:

Improvedecoding completenessVSAvoidmemory requirements

Core Design Contradiction:

ReliabilityVSQuantity of substance

Solution Approach 1:

The patent divides frames into hierarchical layers where first layer frames serve as foundational references and second layer frames contain enhanced information. By maintaining only the necessary first layer frames in the DPB and decoding second layer frames on-demand, the system ensures decoding completeness for critical frames while significantly reducing memory requirements compared to storing all decoded frames

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent applies partial action by decoding and storing only the essential first layer frames in the DPB rather than all frames. Second layer frames are decoded selectively based on playback requirements. This partial decoding approach ensures decoding completeness for critical frames while reducing memory usage and improving playback efficiency

Inventive Principle:

Principle #16Partial or excessive action

3Ease of operation

If sequential access is used for frame retrieval, then access simplicity is maintained, but access speed decreases and playback efficiency deteriorates

Engineering Contradiction:

Improveaccess simplicityVSAvoidaccess speed

Core Design Contradiction:

Ease of operationVSSpeed

Solution Approach 1:

The patent implements preliminary action by pre-decoding and storing first layer frames in the DPB before they are needed for display. This allows the system to perform random access to previously decoded frames instantly without sequential retrieval, significantly improving access speed while maintaining access simplicity through the standardized DPB access mechanism

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The decoded picture buffer (DPB) serves as an intermediary storage mechanism that bridges the gap between decoding operations and display requirements. By storing first layer frames in the DPB, the system enables fast random access to critical frames without sequential retrieval, improving access speed while maintaining simplicity through the standardized buffer access interface

Inventive Principle:

Principle #24Intermediary (Mediator)

Data Source

PatentUS11659190B2Method of operating semiconductor device and semiconductor system

Publication Date: 2023.05.23 SAMSUNG ELECTRONICS CO LTD

AI summary

A method of operating a semiconductor device includes receiving a video stream including a plurality of frames encoded in a hierarchical manner. Each frame is classified as one of a plurality of layers, and the plurality of layers includes a first layer and a second layer. The method further includes decoding the frames classified as the first layer in a chronological order, storing the decoded frames classified as the first layer in a decoded picture buffer (DPB), decoding a latest one of the frames classified as the second layer, storing the decoded latest one of the frames classified as the second layer in the DPB, reading the DPB to display the latest one of the frames classified as the second layer, and decoding and displaying the frames classified as the second layer other than the latest one of the frames classified as the second layer in a reverse chronological order.