Scalable Video Coding via Coefficient Sampling
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The existing Scalable Video Coding (SVC) extension for High Efficiency Video Coding (HEVC) requires significant bandwidth and processing power for encoding, transmission, and storage due to the multiple layers of video data representing different resolutions, frame rates, and quality levels, which is inefficient.
Innovation Solution
The method involves transforming residue from predictive video compression into frequency domain coefficients, sampling these coefficients to create multiple layers, and multiplexing them for scalable encoding and decoding, allowing users to select specific layers based on desired attributes like resolution, frame rate, or bit depth, thereby reducing unnecessary data transmission and processing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If multiple layers of video data are transmitted to provide scalability across different resolutions, frame rates, and quality levels, then adaptability and versatility are improved, but the quantity of data and bandwidth consumption increase significantly
Solution Approach 1:
The video data is segmented into multiple layers representing different resolutions, frame rates, and quality levels. Each layer contains a subset of the video coefficients, allowing the decoder to select and combine appropriate layers based on available bandwidth and device capabilities, thereby providing scalability without transmitting all possible data variants
Solution Approach 2:
The patent extracts only the necessary video coefficients required to achieve the desired scalability. By identifying and transmitting only the essential coefficients for each layer rather than complete video data, the system reduces the quantity of transmitted data while maintaining the ability to provide multiple quality levels
2Adaptability or versatility
If multiple layers of video data are encoded and transmitted for scalable decoding, then adaptability is improved, but processing power consumption increases
Solution Approach 1:
The video coefficients are pre-organized into multiple layers during encoding, with each layer containing coefficients appropriate for specific resolution, frame rate, and quality requirements. This preliminary structuring allows the decoder to quickly select and process only the necessary layers based on available resources, avoiding the need to process all video data at full complexity
Solution Approach 2:
The system enables dynamic selection of video layers based on real-time bandwidth availability and device capabilities. The decoder can adaptively choose which layers to process and combine, optimizing processing power consumption by avoiding unnecessary decoding operations while maintaining scalability across different playback scenarios
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Methods, systems, and computer program products for the generation of multiple layers of scaled encoded video data compatible with the HEVC standard. Residue from prediction processing may be transformed into coefficients in the frequency domain. The coefficients may then be sampled to create a layer of encoded data. The coefficients may be sampled in different ways to create multiple respective layers. The layers may then be multiplexed and sent to a decoder. There, one or more of the layers may be chosen. The choice of certain layer(s) may be dependent on the desired attributes of the resulting video. A certain level of video quality, frame rate, resolution, and/or bit depth may be desired, for example. The coefficients in the chosen layers may then be assembled to create a version of the residue to be used in video decoding.