In-depth extracting method of three-viewpoint stereoscopic video restrained by time-space domain

A technology for stereoscopic video and depth extraction, applied in stereoscopic systems, image data processing, instruments, etc.

Active Publication Date: 2014-04-02
SHANGHAI JIAO TONG UNIV
View PDF4 Cites 28 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Therefore, the method is limited to depth estimation of sta

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • In-depth extracting method of three-viewpoint stereoscopic video restrained by time-space domain
  • In-depth extracting method of three-viewpoint stereoscopic video restrained by time-space domain
  • In-depth extracting method of three-viewpoint stereoscopic video restrained by time-space domain

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0115] The present invention will be described in detail below in conjunction with specific embodiments. The following examples will help those skilled in the art to further understand the present invention, but do not limit the present invention in any form. It should be pointed out that for those of ordinary skill in the art, a number of modifications and improvements can be made without departing from the concept of the present invention. These all belong to the protection scope of the present invention.

[0116] Such as figure 1 As shown, the three-view depth sequence estimation method of the present invention includes the initialization of the middle-view disparity map, the iterative update of the disparity map and the occlusion image, the initialization of the left and right disparity images, the spatio-temporal constraints, and the sub-pixel estimation.

[0117] In the first step, for the intermediate viewpoint image I t,L , Calculate the initial matching energy distribut...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an in-depth extracting method of a three-viewpoint stereoscopic video restrained by time-space domain. The method comprises the steps of searching an optimal matching point from left and right viewpoint images by aiming at a center viewpoint image, optimizing a parallax error estimation process based on an energy function by adopting a BP algorithm and a plane fusion method, adopting three-view parallax error and shielding information iterative optimization, establishing a time domain parallax error constraint relation between adjacent frames through an optical flow method, defining the confidence coefficient of the optical flow method, so as to restrain parallax error sequence time domain hopping, eliminating errors caused by parallax error value quantification by utilizing binomial sub pixel estimation and bilateral filters, obtaining the parallax error of sub pixel accuracy, quantizing the obtained parallax error, and then obtaining a final in-depth sequence. Compared with the prior art in which constraint is performed by adopting a single frame only, the method has the advantages that the method searches multi-reference frame optical flow, and can better avoid the propagation of space domain error on time domain, thereby being capable of obtaining a continuous and accurate in-depth image sequence on time-space domain through a three-viewpoint image.

Description

technical field [0001] The present invention relates to a method in the technical field of depth extraction of stereoscopic video, in particular to a method for extracting depth information of three-viewpoint stereoscopic video by utilizing joint constraints of time and space domains. Background technique [0002] Because the depth image contains the three-dimensional structure information of the scene, it is widely used in 3D modeling (3D Modeling), image layer segmentation (Layer Separation), depth image based rendering (Depth Image Based Rendering) and video editing in the field of computer vision. (Video Editing), etc. For stereoscopic images, the disparity information of stereoscopic images can be obtained by applying techniques such as corresponding point matching, and the corresponding depth information of stereoscopic images can be obtained by quantifying the extracted disparity. Therefore, depth information extraction, as an important foundation and basic topic of ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04N13/00G06T7/00
Inventor 周军徐抗孙军冯可
Owner SHANGHAI JIAO TONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap