Video Processing Reference Picture List Management

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

High-resolution and high-quality video images increase data throughput, leading to higher transmission and storage costs, and existing image compression techniques do not adequately address the need for efficient processing and storage solutions.

Innovation Solution

An image processing method and video device that parallelize hardware and firmware operations to improve image processing speed by storing and parsing header information, managing reference picture lists, and encoding or decoding images using methods like HEVC, VP8, VP9, MPEG-2, MPEG-4, H.263, and H.264, while allowing for error recovery and efficient reference picture ordering.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If high-resolution and high-quality video images are processed using conventional methods, then image quality is improved, but data throughput and processing time increase leading to higher transmission and storage costs

Engineering Contradiction:
Improveimage qualityVSAvoidprocessing speed
Core Design Contradiction:
Manufacturing precisionVSProductivity

Solution Approach 1:

The patent applies preliminary action by parsing header information and managing reference picture lists in advance during buffer storage, before the actual video engine processing. This preparation work is performed while pictures are being stored in the buffer, allowing the video engine to immediately process pictures without waiting for reference picture list management, thereby improving processing speed while maintaining high image quality

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements continuity of useful action by overlapping multiple operations: the video engine processes current pictures while simultaneously, the firmware parses header information of next pictures and manages reference picture lists. This parallel processing ensures that no component remains idle, maximizing productivity while preserving image quality through proper reference picture management

Inventive Principle:
Principle #20Continuity of useful action

2Device complexity

If conventional sequential processing is used for header parsing and reference picture list management, then device complexity is reduced, but processing time increases

Engineering Contradiction:
Improveprocessing architectureVSAvoidprocessing time
Core Design Contradiction:
Device complexityVSLoss of time

Solution Approach 1:

Header information parsing is performed in advance while pictures are being stored in the buffer, before the video engine needs to process the pictures. This preliminary parsing action allows the video engine to immediately access parsed header information without waiting, reducing processing time while maintaining a relatively simple device architecture

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces a temporal dimension to the processing architecture by performing operations in overlapping time periods: buffer storage occurs while header parsing is performed, and video engine processing occurs while reference picture list management is performed. This temporal parallelism reduces processing time without significantly increasing spatial complexity

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Ease of operation

If reference picture list management is performed after video engine processing completes, then ease of operation is improved, but productivity decreases

Engineering Contradiction:
Improveoperation simplicityVSAvoidimage processing speed
Core Design Contradiction:
Ease of operationVSProductivity

Solution Approach 1:

Reference picture list management is performed in advance during the video engine's processing of current pictures. The firmware generates and updates reference picture lists while the video engine is occupied with decoding or encoding, so that when the video engine completes processing, the reference picture lists are already prepared for next picture processing, eliminating waiting time and improving productivity

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent ensures continuous useful action by having the firmware manage reference picture lists in parallel with the video engine's picture processing. This overlap eliminates idle time in the system, maintaining high productivity while keeping the operation simple through automated firmware management without requiring complex user intervention

Inventive Principle:
Principle #20Continuity of useful action

Data Source

PatentUS9812095B2Video processing method including managing a reference picture list and video system therefore
Publication Date: 2017.11.07 SAMSUNG ELECTRONICS CO LTD
  • US9812095B2 patent drawing
  • US9812095B2 patent drawing
  • US9812095B2 patent drawing

AI summary

An image processing method of a video device includes storing a plurality of pictures into a buffer, parsing header information of a current image of the plurality of pictures and managing a reference picture list of the current image while the current image is processed by a video engine based on the parsed header information.