Entropy Estimation Network With Local Attention for Image Compression

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing entropy estimation networks in image/video compression are inefficient, affecting the accuracy of probability distribution estimation and overall compression performance.

Innovation Solution

An entropy estimation method and apparatus that combines convolution operations with pointwise operations to implement a local attention mechanism, utilizing group convolution to expand the receptive field while reducing computational load, and incorporates upsampling processes to enhance feature matrix dimensions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional convolution operations are used in entropy estimation networks, then the network can process feature matrices, but the computational load is high and the receptive field is limited

Engineering Contradiction:
Improveprobability distribution estimation accuracyVSAvoidcomputational load
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies segmentation by dividing the convolution operation into two distinct types: group convolution and pointwise convolution. Group convolution segments the feature map processing into multiple independent groups, reducing computational complexity. Pointwise convolution then processes each group independently with 1x1 kernels. This segmentation allows the network to maintain high probability distribution estimation accuracy while significantly reducing the computational load compared to conventional full convolution operations.

Inventive Principle:
Principle #1Segmentation

2Measurement precision

If the receptive field is expanded to improve probability estimation accuracy, then more contextual information is captured, but the computational complexity increases

Engineering Contradiction:
Improveprobability estimation accuracyVSAvoidcomputational complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent uses segmentation through group convolution where the feature map is divided into G independent groups. Each group is processed separately, allowing the network to capture broader contextual information (expanded receptive field) while maintaining manageable computational complexity. The segmentation enables parallel processing of different feature groups, effectively expanding the receptive field without linearly increasing computational burden.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies dimensionality change by using pointwise convolution with 1x1 kernels that operate in the channel dimension rather than spatial dimensions. This allows the network to process and integrate information across channels effectively, expanding the functional receptive field in the channel dimension while keeping spatial computational complexity controlled. This dimensional approach enables capturing more contextual information without proportionally increasing computational load.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Measurement precision

If deeper convolutional layers are added to improve feature extraction, then probability distribution estimation improves, but the network complexity and training difficulty increase

Engineering Contradiction:
Improvefeature extraction accuracyVSAvoidnetwork complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies segmentation by implementing a two-stage convolution process where group convolution extracts features in a computationally efficient manner, followed by pointwise convolution that refines features with minimal computational overhead. This segmented approach allows the network to achieve deep feature extraction capabilities without proportionally increasing overall network complexity, making training more manageable while improving probability distribution estimation accuracy.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent uses parameter changes by adjusting the group number G in group convolution and the kernel sizes in different stages. By optimizing these parameters, the network achieves effective feature extraction with controlled complexity. The ability to independently tune group numbers and kernel sizes allows flexible adjustment of the trade-off between feature extraction capability and network complexity, facilitating easier training compared to fixed-structure deep networks.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS20260065028A1Entropy estimation method and apparatus for image compression
Publication Date: 2026.03.05 HUAWEI TECH CO LTD
  • US20260065028A1 patent drawing
  • US20260065028A1 patent drawing
  • US20260065028A1 patent drawing

AI summary

This disclosure provides an entropy estimation method and apparatus for image compression. The method includes: obtaining a to-be-processed first feature matrix, where a shape of the first feature matrix is [Cin, hin, win], Cin indicates a quantity of channels of the first feature matrix, hin indicates a height of the first feature matrix, and win indicates a width of the first feature matrix; and inputting the first feature matrix to an entropy estimation network to obtain a second feature matrix, where a shape of the second feature matrix is [Cout, hout, wout], Cout indicates a quantity of channels of the second feature matrix, hout indicates a height of the second feature matrix, and wout indicates a width of the second feature matrix. The second feature matrix and the first feature matrix meet the following conditions: Cout=Cin, hout=s·hin, and wout=s·win, where s is an integer greater than 1.