Feature Information Encoding with Transform, Quantization, and Rearrangement
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding methods for machines (VCM) face inefficiencies in encoding and decoding image and feature information, particularly in preprocessing and rearrangement processes, which affect the performance of machine-learning tasks.
Innovation Solution
The proposed solution involves preprocessing original images and feature information through techniques like color format transformation, sub-sampling, domain transformation, quantization, and rearrangement, followed by encoding and decoding processes that include inverse transformations and dequantization to optimize the encoding procedure for machine-learning tasks.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If domain transformation and quantization are performed on feature map information and image information, then encoding efficiency is improved, but processing complexity increases
Solution Approach 1:
The patent applies domain transformation (e.g., DCT, DST, or learned transforms) and quantization as preprocessing steps before encoding. By performing these transformations in advance, the encoder works with transformed and quantized coefficients that are more amenable to compression, thereby improving encoding efficiency while managing complexity through standardized transform operations.
Solution Approach 2:
The patent changes the domain representation of the data by applying linear transforms (such as discrete cosine transform or discrete sine transform) and quantization operations. These parameter changes convert the original image and feature map data into a different domain where the encoding can be performed more efficiently, trading off some processing complexity for improved compression performance.
2Reliability
If feature information is extracted and preprocessed through multiple transformations, then machine-learning task performance is improved, but encoding time increases
Solution Approach 1:
The patent extracts feature information from intermediate layers of a neural network and performs preprocessing (domain transformation, quantization, rearrangement) before the final encoding stage. By preparing the feature information in advance, the system improves the quality of data available for machine-learning tasks while managing encoding time through efficient transform and quantization operations.
Solution Approach 2:
The patent processes different components (image information and feature map information) separately through the transformation and quantization pipeline, then combines them for final encoding. This segmentation allows for optimized processing of each component type, improving overall task performance while managing encoding time through parallel or sequential processing of distinct data streams.
3Adaptability or versatility
If 3D feature map information is rearranged into 2D form, then encoding flexibility is improved, but data structure complexity increases
Solution Approach 1:
The patent rearranges 3D feature map information (with dimensions corresponding to height, width, and channel) into 2D form by flattening or reshaping the data structure. This dimensionality change provides encoding flexibility by allowing the use of 2D encoding techniques on feature map data, while the transformation is performed through systematic indexing and reorganization operations that manage the underlying data structure complexity.
Data Source
AI summary
There are provided a method, apparatus, system, and computer-readable recording medium for image compression. An encoding apparatus performs domain transformation and quantization on feature map information and image information. The encoding apparatus rearranges the result of domain transformation and quantization so as to have a form advantageous to the encoding procedure and encodes the result of rearrangement, thereby generating a bitstream. A decoding apparatus receives the bitstream, decodes the received bitstream, and performs inverse transformation, dequantization, and inverse rearrangement using information transmitted through the bitstream. The result of inverse transformation, dequantization, and inverse rearrangement is used for the machine-learning task of a neural network.


