Image compression method and system based on octave convolution and semantic segmentation

Abstract

The invention provides an image compression method and system based on octave convolution and semantic segmentation. The scheme comprises the following steps: generating a semantic segmentation map of an original image by using a pre-trained semantic segmentation network; taking the semantic segmentation map and the original image as input of a first group of octave convolution networks, and generating a compressed representation of the image; performing up-sampling on the compressed representation, and taking the compressed representation and the semantic segmentation map as input of a second group of octave convolution networks to obtain an original image estimation value; and calculating a residual error between an original image and the original image estimation value, carrying out lossy coding on the residual error, and adding the original image estimation value and a decoded residual error image to obtain a final reconstructed image. According to the method, the distribution of bit streams in the image space can be guided by inputting the semantic segmentation map, high-frequency information and low-frequency information in the image space are independently optimized by using the octave convolution network, and a high-quality and high-detail image can be effectively synthesized while the compression ratio is ensured.

Description

technical field [0001] The present disclosure relates to the technical field of computer vision, in particular to an image compression method and system based on octave convolution and semantic segmentation. Background technique [0002] The statements in this section merely mention background art related to the present disclosure and do not necessarily constitute prior art. [0003] With the rapid development of information technology, more and more multimedia data appear on the Internet, and high-quality multimedia content begins to be widely popularized. How to process these data to improve transmission efficiency and reduce storage cost has become an extremely important issue. For images, a large number of images generate a huge amount of data, which brings great challenges to storage and transmission. Reasonable image compression is conducive to reducing storage pressure and improving transmission capabilities. Image compression technology has received more and more at...

AI Technical Summary

Problems solved by technology

BPG uses HEVC as the encoding core. Under the same resolution, the BPG file size is half that of JPEG. Although BPG is very good, the high patent fee prevents it from being widely used.

These traditional image compression schemes rely on the individual optimization of the encoder, the processing flow is relatively complex, sometimes unsatisfactory in terms of detail restoration, usually accompanied by artifacts, blurring and other shortcomings, and the performance of low data rate image compression is also poor. poor

Images