The invention provides an immersive video coding method and
system based on 3DGS, and the method comprises the steps: carrying out the sparse reconstruction of each frame of multi-view video data, and obtaining an
initial point cloud; determining anchor points of three-dimensional
Gaussian distribution in each frame; extracting spatial context information of the anchor points through multi-resolution
hash coding, and splicing the spatial context information with the features of the anchor points to form fusion features; predicting parameters of three-dimensional
Gaussian distribution corresponding to each
anchor point through a neural network by using the fusion features and camera parameters, and obtaining a rendered image; calculating the
color loss between the rendered image and the original video frame, and optimizing the parameters of the anchor points; performing quantization and entropy coding on the optimized parameters of the anchor points; in combination with the
color loss and the coding rate, performing
rate distortion optimization on the quantization parameter to generate compressed three-dimensional scene representation; and repeating the steps for each frame of the multi-view video, and finally outputting a compressed immersive video code
stream. According to the invention, high-quality representation and efficient compression of the immersive video are realized, and the rate-
distortion performance is improved.