Block matching parallax estimation-based middle view synthesizing method

Abstract

The invention provides a self-adapting parallax estimation-based virtual viewpoint drawing method, which is used for carrying out parallax estimation on two images simultaneously shot by a horizontal camera set and obtaining a virtual view at a random position among input viewpoints through interpolation and inverse mapping according to solved parallax views. The method comprises the steps of: firstly, respectively taking a left image and a right image as target images, carrying out self-adapting parallax estimation on a searching window so as to solve two parallax views which take the left image and the right image as the target images and adjusting a size of the window according to texture similarity of the two views; and then, carrying out virtual view drawing on appointed viewpoints according to solved parallax to obtain a final result. In the parallax estimation process of the block matching parallax estimation-based middle view synthesizing method, only horizontal searching is carried out, the amount of calculation is greatly reduced; and a method for self-adapting the searching window is provided, thus the accuracy for the parallax estimation is enhanced. The block matching parallax estimation-based middle view synthesizing method provided by the invention can obtain an excellent synthesizing result under the condition that the camera set is horizontally arranged and the distance from a foreground of a view to cameras is farther.

Description

technical field [0001] The invention relates to a multi-objective digital image processing method, in particular to an image-based virtual viewpoint rendering method. Background technique [0002] Video processing, transmission and display technologies have undergone multiple changes from black and white to color, from analog to digital, from standard definition to high definition, and the goal of the next generation of change will be a 3D stereoscopic video display system. The two-dimensional video flat display system that has been popularized at present cannot express the depth information of objects in natural scenes, so that users lack a sense of three-dimensionality when watching, and what they watch is inconsistent with natural scenes, and there is distortion caused by the loss of third-dimensional information. Therefore, obtaining the free viewpoint display structure of the viewpoint view required by the user becomes an important basis for the transformation from 2D t...

AI Technical Summary

Problems solved by technology

[0006] Among many image-based rendering methods, although the method that does not use geometric information at all can reconstruct the viewpoint quickly, it has a poor sense of reality and a large amount of data; the virtual viewpoint view obtained by the method based on the depth map is better, but the depth map The acquisition itself is a difficult task; the algorithm based on texture mapping is too difficult and not suitable for real scenes

It can be seen that in the current field of virtual viewpoint rendering, there is no rendering method that can take into account speed, accuracy and universal adaptability.

Images