A Depth Extraction Method of Three-View Stereo Video Based on Joint Constraints of Space-Time Domain

Abstract

The invention discloses an in-depth extracting method of a three-viewpoint stereoscopic video restrained by time-space domain. The method comprises the steps of searching an optimal matching point from left and right viewpoint images by aiming at a center viewpoint image, optimizing a parallax error estimation process based on an energy function by adopting a BP algorithm and a plane fusion method, adopting three-view parallax error and shielding information iterative optimization, establishing a time domain parallax error constraint relation between adjacent frames through an optical flow method, defining the confidence coefficient of the optical flow method, so as to restrain parallax error sequence time domain hopping, eliminating errors caused by parallax error value quantification by utilizing binomial sub pixel estimation and bilateral filters, obtaining the parallax error of sub pixel accuracy, quantizing the obtained parallax error, and then obtaining a final in-depth sequence. Compared with the prior art in which constraint is performed by adopting a single frame only, the method has the advantages that the method searches multi-reference frame optical flow, and can better avoid the propagation of space domain error on time domain, thereby being capable of obtaining a continuous and accurate in-depth image sequence on time-space domain through a three-viewpoint image.

Description

technical field [0001] The present invention relates to a method in the technical field of depth extraction of stereoscopic video, in particular to a method for extracting depth information of three-viewpoint stereoscopic video by utilizing joint constraints of time and space domains. Background technique [0002] Because the depth image contains the three-dimensional structure information of the scene, it is widely used in the field of computer vision for 3D modeling (3DModeling), image layer segmentation (Layer Separation), depth image-based rendering (DepthImageBasedRendering) and video editing (VideoEditing). For stereoscopic images, the disparity information of stereoscopic images can be obtained by applying techniques such as corresponding point matching, and the corresponding depth information of stereoscopic images can be obtained by quantifying the extracted disparity. Therefore, depth information extraction, as an important foundation and basic topic of computer vi...

AI Technical Summary

Problems solved by technology

Therefore, the method is limited to depth estimation of stationary scenes and requires sufficient motion of the camera

Images