Video Central Processing Unit Prescan for Parallel Decoding Balance

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video processing technologies, such as HEVC, face challenges in efficiently decoding UHD videos due to unbalanced processing among multiple units, leading to inefficiencies in bandwidth usage and increased latency, especially when dealing with varying resolutions and frame rates.

Innovation Solution

A method and apparatus utilizing a video central processing unit that communicates with a host to parse bitstream header information, generate tasks for parallel processing, and employ a prescan module to extract essential information for seamless processing across multiple video processing units, ensuring balanced performance and efficient bandwidth usage.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If a simple parallel processing method is employed using multiple processing units, then processing capacity is improved, but processing balance and bandwidth efficiency deteriorate

Engineering Contradiction:
Improveprocessing capacityVSAvoidprocessing balance
Core Design Contradiction:
ProductivityVSEase of operation

Solution Approach 1:

The patent applies preliminary action by performing a prescan of the bitstream before actual decoding to obtain prescan information about coding unit sizes and positions. This advance information allows the controller to pre-calculate and optimize the division of labor among processing units, ensuring balanced workloads before processing begins. The prescan phase prepares data structures that guide the subsequent parallel decoding to achieve processing balance.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements feedback by using the prescan information to continuously monitor and adjust the task allocation among processing units. The controller receives feedback about the actual processing progress and compares it with the predicted balance, then dynamically adjusts the distribution of coding units to maintain optimal processing balance. This feedback mechanism ensures that bandwidth efficiency is maintained even when processing conditions change.

Inventive Principle:
Principle #23Feedback

2Productivity

If coding units of different sizes are processed in parallel, then processing capacity is improved, but decoding time synchronization deteriorates

Engineering Contradiction:
Improveprocessing capacityVSAvoiddecoding time synchronization
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The patent performs preliminary calculation of decoding times for different coding units during the prescan phase. By knowing the sizes and positions of all coding units in advance, the system can predict which units will take longer to decode and pre-arrange their distribution across processing units. This allows the controller to balance the total decoding time across all units, achieving synchronization without sacrificing the benefits of parallel processing different-sized units.

Inventive Principle:
Principle #10Preliminary action

3Productivity

If WPP format information is written in header during coding, then parallel decoding capability is improved, but adaptability to different formats deteriorates

Engineering Contradiction:
Improveparallel decoding capabilityVSAvoidformat adaptability
Core Design Contradiction:
ProductivityVSAdaptability or versatility

Solution Approach 1:

The patent creates a universal decoding architecture that can handle both WPP-encoded streams and conventional encoded streams. The prescan mechanism and controller are designed to work with any bitstream format by extracting relevant information during the prescan phase. The system can detect whether WPP format information is present and adapt its processing accordingly, making the decoder universally compatible with multiple encoding formats while maintaining parallel decoding capability when WPP is used.

Inventive Principle:
Principle #6Universality (Multi-functionality)

4Speed

If processing units operate independently, then processing speed is improved, but synchronization and latency deteriorate

Engineering Contradiction:
Improveprocessing speedVSAvoidlatency
Core Design Contradiction:
SpeedVSLoss of time

Solution Approach 1:

The patent implements a feedback-based synchronization mechanism where the controller monitors the processing status of all independent processing units in real-time. Based on this feedback, the controller can dynamically adjust task allocation to ensure that all units complete their work at approximately the same time. This feedback loop minimizes idle waiting time and reduces overall latency while preserving the speed benefits of independent parallel processing.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS10212441B2Method and apparatus for processing video
Publication Date: 2019.02.19 CHIPS&MEDIA
  • US10212441B2 patent drawing
  • US10212441B2 patent drawing
  • US10212441B2 patent drawing

AI summary

The present invention relates to a method for processing a video, comprising: a step in which a video central processing unit communicates with a host, receives a bitstream, parses header information, and generates a plurality of tasks for parallel processing; a step in which free scan information is generated by a free scan of a video bitstream inputted from the host according to the control of the video central processing unit; and a step in which a plurality of video processing units process the plurality of tasks on the basis of the free scan information and the parsed header information by receiving the control of the video central processing unit.