Image Processing Using CU-Level I_PCM Mode Selection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In HEVC coding formats, the use of CUs for encoding operations increases unnecessary processing and can decrease encoding efficiency, particularly in real-time operations, as I_PCM mode is limited to LCUs of 128x128 pixels, and existing methods like NPL 2 and NPL 3 are not compatible with AVC coding formats.
Innovation Solution
An image processing apparatus and method that allows selection of a non-compression mode for encoding in units of coding units with a hierarchical structure, skipping shift and filter processing where necessary, and using adaptive loop filtering to enhance encoding efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If I_PCM mode is limited to LCUs of 128x128 pixels in HEVC coding formats, then encoding operations can be performed using CUs, but unnecessary processing increases and encoding efficiency decreases
Solution Approach 1:
The patent divides the LCU (128x128 pixels) into smaller CUs (coding units) for independent processing. By allowing I_PCM mode selection at the CU level rather than the entire LCU level, the patent enables finer-grained control over encoding operations, reducing unnecessary processing in regions where non-compression mode is beneficial while maintaining compression in other regions.
Solution Approach 2:
The patent applies different encoding modes (compression vs. non-compression) to different local regions (CUs) within an LCU based on local image characteristics. This allows the encoding strategy to be optimized for each specific region, improving overall encoding efficiency by avoiding uniform processing across the entire LCU.
2Reliability
If shift processing and filter processing are applied to all coding units, then encoding completeness is maintained, but processing time increases and real-time operation becomes difficult
Solution Approach 1:
The patent applies shift processing and filter processing selectively rather than universally. By identifying CUs that benefit from non-compression mode (I_PCM), the patent performs compression processing only on the remaining CUs, reducing total processing time while maintaining sufficient encoding quality for the overall image.
Solution Approach 2:
The patent allows skipping of shift and filter processing steps for CUs designated for I_PCM mode. This selective skipping eliminates unnecessary processing operations in regions where they would not provide benefit, enabling real-time operation while maintaining encoding completeness for regions where processing is applied.
3Manufacturing precision
If adaptive loop filtering is applied to enhance encoding efficiency, then image quality improves, but device complexity increases
Solution Approach 1:
The patent applies adaptive loop filtering selectively to specific CUs rather than uniformly to the entire image or LCU. By segmenting the filtering operation to target only regions that benefit from it, the patent reduces the overall computational complexity and device resources required while maintaining image quality in critical regions.
Data Source
AI summary
The present technology relates to an image processing apparatus and method that are capable of enhancing encoding efficiency while suppressing a decrease in the efficiency of encoding processing. The image processing apparatus includes an encoding mode setter that sets, in units of coding units having a hierarchical structure, whether a non-compression mode is to be selected as an encoding mode for encoding image data, the non-compression mode being an encoding mode in which the image data is output as encoded data, and an encoder that encodes the image data in units of the coding units in accordance with a mode set by the encoding mode setter. The present disclosure can be applied to, for example, an image processing apparatus.