The invention discloses a semantic communication method based on a semantic
perception mask and a
vector quantization codebook, and belongs to the technical field of
wireless communication. Specifically, the invention provides a semantic
perception compression strategy, semantic
perception masking is performed on an input image according to the semantic importance size represented by the attention vector of the last self-attention layer of an image
encoder of a CLIP model, image blocks with relatively low semantic importance can be selectively masked instead of random masking, and therefore, the semantic perception compression strategy can be applied to
image processing. Therefore, the
semantic information learning capability of the model is enhanced, and the training efficiency is improved. In addition, an improved robust
vector quantization codebook shared at a transmitting end and a receiving end is designed. According to the
codebook, coding features are represented by orthogonal and trainable base vector indexes in transmission, so that the robustness of a
system is enhanced, and the transmission data volume is reduced. According to the method provided by the invention, the
semantic information processing efficiency can be remarkably improved, and better performance is shown under the challenging low
signal-to-
noise ratio condition.