Feature Information Encoding with Transform, Quantization, and Rearrangement

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video coding methods for machines (VCM) face inefficiencies in encoding and decoding image and feature information, particularly in preprocessing and rearrangement processes, which affect the performance of machine-learning tasks.

Innovation Solution

The proposed solution involves preprocessing original images and feature information through techniques like color format transformation, sub-sampling, domain transformation, quantization, and rearrangement, followed by encoding and decoding processes that include inverse transformations and dequantization to optimize the encoding procedure for machine-learning tasks.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If domain transformation and quantization are performed on feature map information and image information, then encoding efficiency is improved, but processing complexity increases

Engineering Contradiction:
Improveencoding efficiencyVSAvoidprocessing complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent applies domain transformation (e.g., DCT, DST, or learned transforms) and quantization as preprocessing steps before encoding. By performing these transformations in advance, the encoder works with transformed and quantized coefficients that are more amenable to compression, thereby improving encoding efficiency while managing complexity through standardized transform operations.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent changes the domain representation of the data by applying linear transforms (such as discrete cosine transform or discrete sine transform) and quantization operations. These parameter changes convert the original image and feature map data into a different domain where the encoding can be performed more efficiently, trading off some processing complexity for improved compression performance.

Inventive Principle:
Principle #35Parameter changes

2Reliability

If feature information is extracted and preprocessed through multiple transformations, then machine-learning task performance is improved, but encoding time increases

Engineering Contradiction:
Improvemachine-learning task performanceVSAvoidencoding time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent extracts feature information from intermediate layers of a neural network and performs preprocessing (domain transformation, quantization, rearrangement) before the final encoding stage. By preparing the feature information in advance, the system improves the quality of data available for machine-learning tasks while managing encoding time through efficient transform and quantization operations.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent processes different components (image information and feature map information) separately through the transformation and quantization pipeline, then combines them for final encoding. This segmentation allows for optimized processing of each component type, improving overall task performance while managing encoding time through parallel or sequential processing of distinct data streams.

Inventive Principle:
Principle #1Segmentation

3Adaptability or versatility

If 3D feature map information is rearranged into 2D form, then encoding flexibility is improved, but data structure complexity increases

Engineering Contradiction:
Improveencoding flexibilityVSAvoiddata structure complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent rearranges 3D feature map information (with dimensions corresponding to height, width, and channel) into 2D form by flattening or reshaping the data structure. This dimensionality change provides encoding flexibility by allowing the use of 2D encoding techniques on feature map data, while the transformation is performed through systematic indexing and reorganization operations that manage the underlying data structure complexity.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS12373991B2Method, apparatus, system and computer-readable recording medium for feature information
Publication Date: 2025.07.29 ELECTRONICS & TELECOMM RES INST
  • US12373991B2 patent drawing
  • US12373991B2 patent drawing
  • US12373991B2 patent drawing

AI summary

There are provided a method, apparatus, system, and computer-readable recording medium for image compression. An encoding apparatus performs domain transformation and quantization on feature map information and image information. The encoding apparatus rearranges the result of domain transformation and quantization so as to have a form advantageous to the encoding procedure and encodes the result of rearrangement, thereby generating a bitstream. A decoding apparatus receives the bitstream, decodes the received bitstream, and performs inverse transformation, dequantization, and inverse rearrangement using information transmitted through the bitstream. The result of inverse transformation, dequantization, and inverse rearrangement is used for the machine-learning task of a neural network.