Video Central Processing Unit Prescan for Parallel Decoding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video processing technologies face challenges in efficiently decoding UHD videos due to unbalanced processing among multiple video processing units, leading to inefficiencies in bandwidth usage and increased decoding time, particularly with the HEVC standard, where synchronization and latency issues arise from differing tile and slice sizes.
Innovation Solution
A method and apparatus that utilize a video central processing unit to parse and realign bitstreams, generating prescan information to enable seamless parallel processing across multiple video processing units, ensuring balanced workload and efficient task scheduling, even in non-WPP encoded streams.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If a parallel processing method using multiple video processing parts is employed, then the decoding capability for UHD videos is improved, but unbalancing occurs between processing parts leading to degraded bandwidth efficiency
Solution Approach 1:
The patent applies preliminary action by performing prescan of the bitstream before actual decoding to generate prescan information. This prescan process prepares and organizes the bitstream data in advance, allowing the video processing parts to receive pre-organized data that balances their workloads. The prescan information includes reorganized bitstream segments and timing data that enable synchronized decoding across multiple parts, preventing bandwidth inefficiency by ensuring each part receives appropriately sized and timed data portions.
2Adaptability or versatility
If coding parts with different sizes exist in one pixel, then the decoding flexibility is improved, but the processing time of each processing part differs causing synchronization issues
Solution Approach 1:
The patent uses prescan as a preliminary action that processes the bitstream before decoding to generate prescan information containing timing and synchronization data. This prescan information includes start positions, lengths, and synchronization markers for each coding part, enabling the video processing parts to align their processing times. By preparing this synchronization data in advance during prescan, the system maintains decoding flexibility with variable-sized coding parts while ensuring all parts complete their processing simultaneously.
Solution Approach 2:
The patent implements feedback mechanisms where the video central processing unit monitors the decoding progress of each video processing part and uses prescan information to adjust task allocation. The system receives feedback about processing status and dynamically reallocates bitstream segments to maintain balance. This feedback loop ensures that even when coding parts have different sizes, the processing time is synchronized by continuously monitoring and adjusting the workload distribution based on actual processing speed variations.
3Extent of automation
If WPP format information is written in header information during coding, then parallel decoding is enabled, but the applicable range is limited to HEVC standardization method
Solution Approach 1:
The patent applies universality by creating a prescan mechanism that can process various bitstream formats without requiring WPP-specific header information. The prescan function is designed to be format-agnostic, capable of handling different video coding standards and bitstream structures. This universal prescan approach enables parallel decoding capability across multiple video formats and standards, not just HEVC, by extracting and organizing synchronization information through the prescan process rather than relying on format-specific header markers.
4Stability of the object's composition
If processing parts standby for synchronization, then the output synchronization is improved, but latency increases during decoding process
Solution Approach 1:
The patent eliminates standby time by using prescan as a preliminary action that prepares and synchronizes all processing parts before actual decoding begins. The prescan process generates synchronization information and distributes it to all video processing parts in advance, so that when decoding starts, all parts are already synchronized and ready to process simultaneously. This eliminates the need for parts to standby during decoding, as synchronization is established beforehand through the prescan operation.
Solution Approach 2:
The patent ensures continuity of useful action by making the prescan process run in parallel with the decoding process rather than having parts standby. The prescan information is generated continuously and distributed to processing parts as they become ready, maintaining continuous productive work. This continuous operation eliminates idle standby time while preserving output synchronization, as the prescan information continuously updates the synchronization state of all parts without interrupting the overall decoding flow.
Data Source
AI summary
The present invention relates to an apparatus for processing a video, comprising: a video central processing unit which communicates with a host, receives a bitstream and parses header information; and a free scan module which generates free scan information by a free scan of a video bitstream inputted from the host according to the control of the video central processing unit, wherein the video central processing unit rearranges the bitstream on the basis of the header information and the free scan information and performs task scheduling so as to perform parallel decoding of the rearranged bitstream by a predetermined unit.