Video processing method based on neural network coding and decoding

Abstract

The embodiment of the invention provides a video processing method based on neural network coding and decoding, and the method comprises the steps: carrying out the video coding of a video frame through a transmitting end, and obtaining a coded bit sequence; performing video decoding processing on the bit sequence to obtain an intermediate symbol in a video decoding process; recoding the intermediate symbol by using a semantic encoder to obtain a recoding sequence; performing channel coding and modulation processing on the recoding sequence to obtain a to-be-sent symbol, and sending the to-be-sent symbol through a channel; a receiving end receives a symbol sequence through a channel; performing demodulation and channel decoding processing on the symbol sequence to obtain a sequence to be subjected to video decoding; decoding the to-be-decoded video sequence by using a semantic decoder to obtain a to-be-decoded intermediate symbol; performing video decoding processing on the to-be-decoded intermediate symbol to obtain a recovered image after video decoding; and reconstructing a video frame based on the recovered image after video decoding. According to the invention, the overall performance of video processing can be improved.

Images