Non-Separable Primary Transform for High-Efficiency Video Coding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The increasing demand for high-resolution, high-quality images and videos, particularly in virtual reality and augmented reality, necessitates a more efficient compression technique to reduce transmission and storage costs, as existing methods struggle with the increased data volume.
Innovation Solution
A method and apparatus for video/image coding that incorporates a non-separable primary transform and effectively signals transform index information, including both separable and non-separable transforms, along with the application of a primary and secondary transform, enhancing coding efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If conventional separable transforms are used for video/image coding, then the coding process is simple and computationally efficient, but the compression efficiency is insufficient for high-resolution content
Solution Approach 1:
The patent implements dynamic transform selection by allowing the transform type (separable or non-separable) to be adaptively chosen based on block characteristics, prediction mode, and other contextual factors. This enables the coding system to switch between simple separable transforms for regular blocks and more complex non-separable transforms for blocks requiring higher compression efficiency, thus resolving the contradiction between compression efficiency and computational complexity
Solution Approach 2:
The patent divides the video/image data into different blocks and applies different transform types to different blocks based on their characteristics. By segmenting the processing approach, the system can use simple separable transforms for blocks where they suffice while applying complex non-separable transforms only where needed, thereby improving overall compression efficiency without uniformly increasing complexity across all blocks
2Manufacturing precision
If non-separable primary transforms are applied to improve compression efficiency, then higher quality compression is achieved, but the signaling overhead and processing complexity increase
Solution Approach 1:
The patent applies non-separable primary transforms selectively rather than universally, using them only for blocks where they provide significant coding precision improvement. This partial application approach ensures that the increased signaling complexity is justified only where it yields measurable precision gains, avoiding unnecessary complexity for blocks where simpler transforms suffice
Solution Approach 2:
The patent changes the transform parameter (separable vs. non-separable) based on block characteristics and coding conditions. By dynamically adjusting this parameter, the system achieves higher coding precision when needed while maintaining lower complexity for standard blocks, thus resolving the contradiction between precision and signaling complexity
3Reliability
If high-resolution video/image data is transmitted without advanced compression, then image quality is preserved, but transmission and storage costs increase significantly
Solution Approach 1:
The patent changes the transform domain parameters to better represent high-resolution content characteristics. By using non-separable transforms that can capture directional correlations more effectively, the system achieves better energy compaction in the transform domain, leading to more efficient compression while preserving image quality and reducing transmission costs
Solution Approach 2:
The patent combines multiple transform techniques (separable and non-separable transforms, primary and secondary transforms) in a composite processing pipeline. This composite approach leverages the strengths of different transform methods to achieve superior compression efficiency for high-resolution content while maintaining image quality, thereby reducing transmission and storage costs
Data Source
AI summary
According to the disclosure of the present document, by configuring a primary transform to include a non-separable transform, higher encoding efficiency may be expected compared to the existing primary transform including only a separable transform. Also, by efficiently signaling information related to a primary transform including a separable transform and a non-separable transform, the effect of reducing the number of bits and improving coding performance may be expected. In addition, by efficiently applying a primary transform and a secondary transform, computational complexity and power consumption may be reduced, and latency required for additionally generated transform coefficient processing may be minimized.