The invention discloses a multi-mode joint information source channel coding
system for
satellite-ground semantic communication. The multi-mode joint information source channel coding
system comprises a joint information source channel coder and a decoder, the
encoder is used for sequentially performing
feature extraction,
feature fusion, data
cutting and
phase modulation operation on input multi-
modal data to generate a transmitting
signal, and transmitting the transmitting
signal to a ground
base station through a channel; and the decoder is used for sequentially performing real and virtual part separation,
data expansion,
feature extraction and
modal data recovery operation on the received
signal so as to reconstruct multi-
modal data. According to the
system, public
semantic information among multi-
modal data can be mined, the time-varying low-signal-to-
noise-ratio channel characteristics of a
satellite downlink are combined, the information
bottleneck theory highly related to
data reconstruction quality is used as guidance to optimize a coding space,
complex field transmission signals with the high
compression ratio are generated in a self-adaptive mode, and the multi-modal multi-domain transmission signals are obtained. The reconstruction quality of the multi-
modal data can be ensured, and the bandwidth and the
energy consumption overhead of
satellite communication can be remarkably reduced.