Extended Transform Selection in Video Coding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video coding techniques, such as those in the High Efficiency Video Coding (HEVC) standard, limit the number of transforms to DCT-2, DST-7, and DCT-8, excluding other transforms that could provide more flexibility with competitive computation complexity and memory usage, thereby potentially reducing coding efficiency.
Innovation Solution
Incorporating additional transforms like DCT-3, DST-2, DST-3, DCT-4, DST-4, DST-5, DST-6, and an identity transform into the transform coding scheme, allowing for more flexible transform selection without increasing computation complexity or memory usage, by using a set of inverse and discrete cosine transforms and discrete sine transforms.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If additional transforms (DCT-3, DST-2, DST-3, DCT-4, DST-4, DST-5, DST-6) are included in the transform coding scheme, then coding flexibility and efficiency are improved, but device complexity increases
Solution Approach 1:
The transform selection process is segmented into two stages: first selecting between DST and DCT based on prediction mode, then selecting specific transform types based on block size. This segmentation reduces the overall complexity by breaking down the transform selection into manageable decision trees rather than evaluating all transform options simultaneously.
Solution Approach 2:
The transform selection is made dynamic and adaptive based on coding conditions. The encoder dynamically selects transforms from the extended set based on prediction mode and block size, allowing the system to adapt to different coding scenarios while maintaining manageable complexity through conditional selection rules.
2Productivity
If a larger set of transforms is used for transform coding, then compression performance is improved, but computation complexity increases
Solution Approach 1:
Different transforms are assigned to different local coding conditions (prediction modes and block sizes). Specifically, DST transforms are used for certain prediction modes while DCT transforms are used for others, and specific transform types are selected based on block dimensions. This local optimization allows the system to achieve better compression performance by matching transforms to local characteristics without requiring all transforms to be evaluated everywhere.
Solution Approach 2:
Instead of using all available transforms for all blocks, the system applies transforms selectively based on coding conditions. The extended transform set provides more options, but only the appropriate transforms are applied to each block based on prediction mode and size, avoiding unnecessary computation while maintaining the ability to achieve superior compression when needed.
Data Source
AI summary
This disclosure describes examples of extending the number of available discrete cosine transform (DCT) and discrete sine transform (DST) for encoding and decoding. A video coder may determine one or more transforms or inverse transforms to apply from a set of transforms or inverse transforms that includes DCT-2 or inverse DCT-2, DST-7 or inverse DST-7, DST-8 or inverse DST-8, DCT-3 or inverse DCT-3, DST-2 or inverse DST-2, DST-3 or inverse DST-3, DCT-4 or inverse DCT-4, DST-4 or inverse DST-4, DST-5 or inverse DST-5, DST-6 or inverse DST-6, and identity transform an inverse identity transform (IDT).


