Layered Video Decoding for Parallel Graphics Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Most personal computers lack the computational capability to decode high-density video data compressed using high compression ratio schemes like H.264, such as those found on Blu-ray discs, due to inefficient use of graphics processing units and increased computational complexity, leading to difficulties in playback without additional hardware.
Innovation Solution
A layered decoding method that processes entire frames or multiple frames in parallel, optimizing the use of graphics processing hardware by pre-processing encoded data to allow parallel processing across multiple pipelines, minimizing CPU usage and leveraging SIMD architecture for efficient video decoding.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If sequential macro block decoding is used to ensure proper dependency handling, then decoding accuracy is maintained, but processing speed deteriorates due to inability to exploit parallelism
Solution Approach 1:
The video frame is divided into multiple tiles, and each tile is further divided into macro blocks. This segmentation allows independent parallel processing of different tiles while maintaining intra-tile sequential dependencies, thus enabling partial parallelism without sacrificing decoding accuracy.
Solution Approach 2:
The patent introduces a spatial dimension for parallelism by processing multiple tiles simultaneously, while maintaining the temporal/sequential dimension for dependency-critical operations within each tile. This multi-dimensional approach allows both parallelism and accuracy to coexist.
2Loss of substance
If high compression ratio schemes like H.264 are used to reduce data storage and transmission requirements, then data efficiency is improved, but computational complexity increases making playback difficult on standard PCs
Solution Approach 1:
By dividing the decoding work into independent tile segments, the patent reduces the computational burden on any single processing unit. Each GPU thread can handle a specific tile independently, making the overall complex H.264 decoding process manageable through distributed parallel computation.
Solution Approach 2:
The patent replaces traditional CPU-based sequential decoding with GPU-based parallel processing. The GPU's architecture with thousands of cores substitutes the mechanical sequential execution model, enabling efficient handling of H.264's computational complexity through massive parallelism.
3Adaptability or versatility
If dedicated decoding hardware is added to enable high-density media playback, then playback capability is improved, but device cost and complexity increase
Solution Approach 1:
The patent makes the GPU serve dual purposes: traditional graphics rendering and video decoding. By programming the GPU to handle both functions, the system eliminates the need for separate dedicated decoding hardware, reducing overall device complexity while maintaining playback capability.
Solution Approach 2:
The existing GPU hardware serves itself by being programmed to perform decoding tasks in addition to its primary graphics function. This self-service approach allows the GPU to handle video decoding without requiring external dedicated decoding components.
Data Source
AI summary
Embodiments of a method and system for inter-prediction in decoding video data are described herein. In various embodiments, a high-compression-ratio codec (such as H.264) is part of the encoding scheme for the video data. Embodiments pre-process control maps that were generated from encoded video data, and generating intermediate control maps comprising information regarding decoding the video data. The control maps indicate which units of video data in a frame are to be processed using an inter-prediction operation. In an embodiment, inter-prediction is performed on a frame basis such that inter-prediction is performed on an entire frame at one time. In other embodiments, processing of different frames is interleaved. Embodiments increase the efficiency of the inter-prediction such as to allow decoding of high-compression-ratio encoded video data on personal computers or comparable equipment without special, additional decoding hardware.