Multi-view video transmission error control method based on rate distortion optimization of joint information source channel

Abstract

The invention discloses a multi-view video transmission error control method based on rate distortion optimization of a joint information source channel, which comprises the following steps: multi-viewpoint video coding: firstly performing motion parallax compensation prediction on a video sequence, and then performing coding mode selection; establishing an end-to-end distortion degree model, andestablishing the end-to-end distortion degree model by adopting a virtual channel encoder after motion parallax compensation prediction is carried out on the multi-viewpoint video sequence; and rate distortion optimization coding of the joint information source channel: carrying out rate distortion optimization of the joint information source channel according to the distortion model, the channelparameter set generated by the virtual channel coder and the corrected channel packet loss rate, wherein the obtained optimal information source parameter is used for selection of a coding mode, and the obtained optimal channel parameter is used for coding of the channel coder. According to the method, channel errors can be effectively corrected, diffusion of transmission errors among viewpoints is reduced, the transmission robustness of multi-view video streams is improved, and the multi-view video streams can better adapt to video transmission in a lossy network environment.

Description

technical field [0001] The invention belongs to the field of video coding and processing, and in particular relates to a multi-viewpoint video transmission error control method based on rate-distortion optimization of joint source channels. Background technique [0002] Multi-viewpoint / multi-viewpoint video compression has a wide range of applications in fields such as 3DTV, Free Viewpoint TV (Free Viewpoint TV), virtual reality and augmented reality. A multi-viewpoint video sequence is a group of video signals obtained by shooting the same scene from different angles with multiple cameras. Compared with single-view video sequences, multi-view video sequences require greater compression efficiency and more efficient transmission performance due to the increase in the number of viewpoints. The existing multi-view video coding standards include Multiview video coding (MVC) and Multiview High Efficiency Video Coding (MV-HEVC), which are extensions of the H.264 / AVC and HEVC sta...

AI Technical Summary

Problems solved by technology

Although this method can improve the self-error tolerance of the code stream of each viewpoint to a certain extent, due to the lack of comprehensive consideration of the characteristics of multi-viewpoint video coding and multi-directional error diffusion in the design of the scheme, this method is often not good enough. Preservation and improvement of the overall reconstruction quality of multi-view 3D video images

Images