Inter-Coded Block Transform Using Directional LFNST
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding techniques lack non-separable transforms for inter-coded blocks, limiting compression efficiency in video data processing.
Innovation Solution
Implementing a non-separable transform, such as a low frequency non-separable transform (LFNST), for inter-coded blocks, which is dependent on the direction of the block, using pixel gradients or geometric partitioning modes to enhance compression efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If non-separable transform is applied to inter-coded blocks, then compression efficiency is improved, but computational complexity increases
Solution Approach 1:
The non-separable transform is selectively applied only to specific inter-coded blocks that meet certain criteria (e.g., block size, prediction mode, gradient characteristics), rather than universally to all blocks. This segmentation approach captures directional information where beneficial while avoiding unnecessary computation in other cases, thus improving compression efficiency without proportionally increasing overall computational complexity.
Solution Approach 2:
The transform application is adapted locally based on block-specific characteristics such as gradient direction, block size, and prediction mode. By analyzing local features and applying the non-separable transform only where directional information is significant, the patent achieves improved compression for relevant blocks while maintaining lower complexity for blocks where simple transforms suffice.
2Measurement precision
If non-separable transform is applied to capture directionality, then coding accuracy is improved, but processing time increases
Solution Approach 1:
Gradient calculations and directional analysis are performed preliminarily during the prediction stage, before the transform is applied. This preliminary assessment of block characteristics allows the system to quickly determine whether a non-separable transform is warranted, reducing the processing time overhead by avoiding unnecessary transform computations on blocks that don't benefit from directional modeling.
Solution Approach 2:
The patent applies the non-separable transform partially, only to the extent necessary for blocks with significant directional content. By using simple transforms or no transform for blocks without strong directional characteristics, the system achieves adequate coding accuracy for most blocks while reserving the computationally intensive non-separable transform only for cases where it provides meaningful improvement.
Data Source
AI summary
Systems and techniques are described for processing video data. For example, an apparatus can obtain a block of video data encoded using inter-prediction. In some examples, the apparatus can determine a direction associated with the block of video data, for instance based on pixels of the block of video data, based on pixels of at least one neighboring block of the block of video data, or based on information associated with a geometric partitioning mode (GPM) associated with the block of video data. The apparatus can apply a non-separable transform to the block of video data, for instance to decode or encode the video data. In some examples, the apparatus can apply the non-separable transform to the block according to the direction associated with the block of video data.


