Video Transform Block Processing With Size-Based Secondary Transform
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video signal processing technologies face high computational complexity and memory requirements due to the need for efficient transform technologies, particularly in handling high spatial resolution and high frame rate video content.
Innovation Solution
A method and apparatus for encoding and decoding video signals that selectively apply a non-separable secondary transform based on the size of the transform block, omitting it for blocks smaller than or equal to 4×4 and applying it to larger blocks, using transforms like DCT-2, DST-7, or DCT-8, and Givens rotation-based transforms.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If a non-separable secondary transform is applied to all transform blocks, then transform efficiency is improved, but computational complexity increases
Solution Approach 1:
The patent applies the non-separable secondary transform selectively based on local block size characteristics. Specifically, it is applied only to transform blocks larger than 4×4, while blocks of 4×4 or smaller use only the primary separable transform. This local differentiation optimizes transform efficiency for larger blocks without unnecessarily increasing complexity for smaller blocks.
Solution Approach 2:
The patent changes the parameter of transform block size as the decision criterion. By using the block size parameter (comparing against the 4×4 threshold), the system dynamically selects whether to apply the computationally intensive non-separable secondary transform, thus adapting computational complexity to the actual processing needs of each block.
2Manufacturing precision
If transform technologies are applied to high spatial resolution video content, then processing quality is improved, but memory requirements increase
Solution Approach 1:
The patent applies different transform strategies to different regions of the video data based on block size. Smaller blocks (4×4 or less) use the simpler primary transform, while only larger blocks receive the more sophisticated non-separable secondary transform. This local quality approach ensures high processing quality where needed while reducing overall memory consumption.
Solution Approach 2:
Instead of applying the computationally intensive non-separable secondary transform to all blocks, the patent applies it partially only to blocks that benefit from it (those larger than 4×4). This partial action approach maintains processing quality for complex regions while avoiding unnecessary memory usage and computation for simpler regions.
Data Source
AI summary
A video signal encoding method according to an embodiment of the present invention comprises checking a transform block including residual samples except a prediction sample from a picture of the video signal, generating transform coefficients through a transform for the residual samples of the transform block based on a size of the transform block, and performing quantization and entropy coding the transform coefficients, wherein generating the transform coefficients includes, applying a forward primary transform to each of a horizontal direction and vertical direction of the transform block including the residual samples, and not applying a forward non-separable secondary transform to the transform block to which the primary transform has been applied when the size of the transform block is smaller than or equal to 4×4, and applying the forward non-separable secondary transform to the transform block when the size of the transform block is greater than 4×4.