Video Coding Transform Adjustments for Complexity Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video encoding and decoding technologies face challenges in reducing memory usage and computational complexity while maintaining video quality, particularly when dealing with large blocks and multiple transform processes.
Innovation Solution
The proposed solution involves approximating complex transform processes by adding pre- or post-adjustment operations to a less complex transform process, allowing for efficient processing and memory reduction without significant loss in video quality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If multiple different transform processes are applied to different blocks of video data, then coding gain is improved, but device complexity and memory usage increase
Solution Approach 1:
The patent applies a universal base transform process (e.g., DCT-2) that can be adjusted through pre- and post-adjustment operations to approximate multiple different transform processes. This allows a single transform engine to perform the function of multiple specialized transforms, reducing device complexity while maintaining the ability to achieve coding gains similar to using multiple different transforms.
Solution Approach 2:
The patent changes parameters of a base transform process by applying pre-adjustment operations (modifying input data before transformation) and post-adjustment operations (modifying output data after transformation). By adjusting these parameters, the same base transform can approximate different transform processes, reducing the need for multiple complex transform implementations.
2Reliability
If multiple different transform processes are applied to different blocks of video data, then coding gain is improved, but memory usage increases
Solution Approach 1:
The patent uses a single base transform process that can be universally applied to all blocks with adjustments, eliminating the need to store multiple different transform process definitions in memory. This reduces memory usage while still enabling differentiated transform behavior across blocks through adjustment parameters.
3Productivity
If a less complex transform process is used, then computational complexity is reduced, but video quality deteriorates
Solution Approach 1:
The patent introduces pre-adjustment and post-adjustment operations as intermediary steps around a simple base transform process. These adjustments act as mediators that compensate for the simplicity of the base transform, allowing the system to achieve video quality comparable to complex transforms while maintaining computational efficiency of the simpler base transform.
Solution Approach 2:
By changing parameters through pre- and post-adjustment operations, the patent enhances the performance of a simple base transform process, allowing it to achieve video quality comparable to complex transforms while maintaining computational efficiency.
Data Source
AI summary
A device may perform a first prediction process for a first block of video data to produce a first residual. The device may apply a first transform process to the first residual to generate first transform coefficients for the first block of video data and encode the first transform coefficients. The device may perform a second prediction process for a second block of video data to produce a second residual. The device may determine that a second transform process, which includes the first transform process and at least one of a pre-adjustment operation or a post-adjustment operation, is to be applied to the second residual. The device may apply the first transform process and the pre-or post-adjustment operation to the second residual to generate second transform coefficients for the second block. The coding device may code the first and second transform coefficients.