Entropy Estimation Network With Local Attention for Image Compression
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing entropy estimation networks in image/video compression are inefficient, affecting the accuracy of probability distribution estimation and overall compression performance.
Innovation Solution
An entropy estimation method and apparatus that combines convolution operations with pointwise operations to implement a local attention mechanism, utilizing group convolution to expand the receptive field while reducing computational load, and incorporates upsampling processes to enhance feature matrix dimensions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If conventional convolution operations are used in entropy estimation networks, then the network can process feature matrices, but the computational load is high and the receptive field is limited
Solution Approach 1:
The patent applies segmentation by dividing the convolution operation into two distinct types: group convolution and pointwise convolution. Group convolution segments the feature map processing into multiple independent groups, reducing computational complexity. Pointwise convolution then processes each group independently with 1x1 kernels. This segmentation allows the network to maintain high probability distribution estimation accuracy while significantly reducing the computational load compared to conventional full convolution operations.
2Measurement precision
If the receptive field is expanded to improve probability estimation accuracy, then more contextual information is captured, but the computational complexity increases
Solution Approach 1:
The patent uses segmentation through group convolution where the feature map is divided into G independent groups. Each group is processed separately, allowing the network to capture broader contextual information (expanded receptive field) while maintaining manageable computational complexity. The segmentation enables parallel processing of different feature groups, effectively expanding the receptive field without linearly increasing computational burden.
Solution Approach 2:
The patent applies dimensionality change by using pointwise convolution with 1x1 kernels that operate in the channel dimension rather than spatial dimensions. This allows the network to process and integrate information across channels effectively, expanding the functional receptive field in the channel dimension while keeping spatial computational complexity controlled. This dimensional approach enables capturing more contextual information without proportionally increasing computational load.
3Measurement precision
If deeper convolutional layers are added to improve feature extraction, then probability distribution estimation improves, but the network complexity and training difficulty increase
Solution Approach 1:
The patent applies segmentation by implementing a two-stage convolution process where group convolution extracts features in a computationally efficient manner, followed by pointwise convolution that refines features with minimal computational overhead. This segmented approach allows the network to achieve deep feature extraction capabilities without proportionally increasing overall network complexity, making training more manageable while improving probability distribution estimation accuracy.
Solution Approach 2:
The patent uses parameter changes by adjusting the group number G in group convolution and the kernel sizes in different stages. By optimizing these parameters, the network achieves effective feature extraction with controlled complexity. The ability to independently tune group numbers and kernel sizes allows flexible adjustment of the trade-off between feature extraction capability and network complexity, facilitating easier training compared to fixed-structure deep networks.
Data Source
AI summary
This disclosure provides an entropy estimation method and apparatus for image compression. The method includes: obtaining a to-be-processed first feature matrix, where a shape of the first feature matrix is [Cin, hin, win], Cin indicates a quantity of channels of the first feature matrix, hin indicates a height of the first feature matrix, and win indicates a width of the first feature matrix; and inputting the first feature matrix to an entropy estimation network to obtain a second feature matrix, where a shape of the second feature matrix is [Cout, hout, wout], Cout indicates a quantity of channels of the second feature matrix, hout indicates a height of the second feature matrix, and wout indicates a width of the second feature matrix. The second feature matrix and the first feature matrix meet the following conditions: Cout=Cin, hout=s·hin, and wout=s·win, where s is an integer greater than 1.


