A method and decoding and encoding method for capturing the video difference vector in the multi-video coding process

Abstract

The invention relates to a disparity vector acquiring method during a multi-view encoding process, and an encoding and a decoding method thereof. The invention comprises confirming a disparity vector between two views during the multi-view image encoding process, calculating to obtain a disparity vector between other two views according to the preceding disparity vector between two views and known relative position information of views, then performing multi-view encoding and decoding operations by means of the disparity vectors. The method of the invention, on one hand, primely utilizes the correlation between the disparity vector and the space object deep information, and on the other hand, primely utilizes the direct relation between the disparity vector and the position of each camera. Experiments show that the disparity vector between views can be precisely calculated during the multi-view encoding process, thereby effectively improving the multi-view encoding performance.

Description

technical field [0001] The invention relates to image coding technology in the field of multimedia, in particular to a technology for determining disparity vectors. Background technique [0002] In the field of multi-view image coding technology, the industry has always hoped to effectively use the correlation between different-view images to encode images. For this reason, the concept of disparity is proposed, which refers to the displacement between two projection points of the same spatial point on different image planes. [0003] In order to obtain accurate disparity, a corresponding disparity estimation operation is required. The disparity estimation (Disparity estimation) is the process of finding the disparity vector of the pixel or block corresponding to the current frame in the reference frame under certain criteria. The disparity vector is the disparity value to be determined. [0004] At present, since the process of determining the disparity vector is similar t...

AI Technical Summary

Problems solved by technology

[0005] However, since the motion vector is caused by the movement of the object and the camera, and the disparity vector is caused by the offset of the camera position, there are many differences between the disparity vector and the motion vector, so that the determination method of the motion vector Unable to determine exact disparity vector

[0006] First of all, if the camera used to obtain the image satisfies the parallel setting and correction, the disparity vector is a scalar, and the motion vector obtained by motion estimation is a two-dimensional vector; moreover, for the single-view motion sequence, the motion vector domain has time Domain correlation, while the predicted value of the disparity vector has nothing to do with the time domain; therefore, due to the difference between the motion vector and the disparity vector, if the disparity vector is determined by the motion vector, it will not be possible to obtain a satisfactory disparity vector value

[0007] Moreover, usually the dynamic range of the disparity vector is relatively large. Taking an image with a size of 640×480 pixels as an example, in a stereo pair, the horizontal displacement of 30-50 pixels may often appear, sometimes even up to 100 pixels, and the motion vector will not have such a large dynamic range; therefore, due to the relatively large dynamic range of the disparity vector, if the motion estimation method in the traditional single-view video coding is used, the search range needs to be set very large. Large, and there is no guarantee that great results will be obtained

Images