An error control method for multi-view video transmission based on joint source channel rate-distortion optimization

Abstract

The invention discloses a rate-distortion-optimized multi-view video transmission error control method based on a joint source channel, comprising: multi-view video coding, first performing motion parallax compensation prediction on a video sequence, and then performing coding mode selection; establishing an end-to-end video Distortion model, after the multi-view video sequence is predicted by motion parallax compensation, a virtual channel encoder is used to establish an end-to-end distortion model; the rate-distortion optimization coding of the joint source channel is based on the distortion model and virtual channel encoder. The generated channel parameter set and the error-corrected channel packet loss rate are used for rate-distortion optimization of the joint source channel. The obtained optimal source parameters are used for the selection of coding modes, and the obtained optimal channel parameters are used for channel coding. the encoding of the device. The method of the invention can effectively correct channel errors, reduce the spread of transmission errors among viewpoints, improve the transmission robustness of multi-view video streams, and make it better suited for video transmission in a lossy network environment.

Description

technical field [0001] The invention belongs to the field of video coding and processing, and in particular relates to a multi-viewpoint video transmission error control method based on rate-distortion optimization of joint source channels. Background technique [0002] Multi-viewpoint / multi-viewpoint video compression has a wide range of applications in fields such as 3DTV, Free Viewpoint TV (Free Viewpoint TV), virtual reality and augmented reality. A multi-viewpoint video sequence is a group of video signals obtained by shooting the same scene from different angles with multiple cameras. Compared with single-view video sequences, multi-view video sequences require greater compression efficiency and more efficient transmission performance due to the increase in the number of viewpoints. The existing multi-view video coding standards include Multiview video coding (MVC) and Multiview High Efficiency Video Coding (MV-HEVC), which are extensions of the H.264 / AVC and HEVC sta...

AI Technical Summary

Problems solved by technology

Although this method can improve the self-error tolerance of the code stream of each viewpoint to a certain extent, due to the lack of comprehensive consideration of the characteristics of multi-viewpoint video coding and multi-directional error diffusion in the design of the scheme, this method is often not good enough. Preservation and improvement of the overall reconstruction quality of multi-view 3D video images

Images