Parallel Video Parsing for Decoder Bottleneck
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The increasing resolution and dynamic range of images and videos lead to larger encoded bitstreams, causing a bottleneck effect in image decoding circuitry, resulting in inefficiencies and latency in video decoding processes.
Innovation Solution
Implementing multiple video parsers corresponding to different compression schemes such as HEVC and AVC, which operate in parallel to decode bitstreams independently, reducing dependencies on decoder cores and enhancing decoding performance by up to four times while maintaining minimal hardware footprint.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If multiple parsers operate in parallel to process bitstreams, then decoding performance and throughput are improved, but device complexity and hardware resources increase
Solution Approach 1:
The patent divides the bitstream processing task into multiple independent segments by implementing multiple parsers (first parser, second parser, third parser, fourth parser) that operate in parallel. Each parser handles a portion of the bitstream independently, allowing simultaneous processing of multiple compression schemes (HEVC, AVC, VP9) without requiring a single complex sequential processor. This segmentation increases throughput while keeping individual parser units relatively simple.
Solution Approach 2:
The patent implements a universal decoding architecture that can handle multiple video compression standards (HEVC, AVC, VP9) through a single multi-functional decoder system. The same hardware platform can dynamically switch between different compression schemes by activating the appropriate parser, eliminating the need for separate dedicated hardware for each standard and improving resource utilization.
2Loss of time
If multiple parsers process bitstreams independently, then latency is reduced and bottleneck effects are mitigated, but the number of computing blocks increases
Solution Approach 1:
The patent segments the bitstream processing workflow into independent parallel tasks by creating multiple parser instances (first through fourth parsers) that can simultaneously process different portions of the encoded data. This eliminates the sequential bottleneck where a single parser would process all bitstreams one after another, significantly reducing overall latency despite increasing the number of computing blocks.
Solution Approach 2:
The patent performs preliminary parsing actions by having multiple parsers ready to process bitstreams as soon as they become available, rather than waiting for a single parser to finish previous tasks. The first and second parsers can begin processing HEVC bitstreams while the third and fourth parsers simultaneously handle AVC and VP9 bitstreams, eliminating idle time and reducing overall processing latency.
Data Source
AI summary
Systems and methods of parallel image parsing and processing for video decoding are provided. Video decoder circuitry may enable an incoming encoded bitstream to be split into multiple bitstreams corresponding to the bitstream compression scheme and processed by multiple parsers corresponding to the bitstream compression scheme in parallel. This enables parallel decoding of the incoming bitstream and, thus, more efficient decoder processing.