Method for improving frame rate of stereoscopic video depth map sequence

A stereoscopic video and depth map technology, applied in the field of computer vision, can solve problems such as unreliable depth map sequences, and achieve the effect of ensuring computational complexity, accurate and reliable depth information, and optimizing motion estimation results.

Active Publication Date: 2013-08-21
SHENZHEN GRADUATE SCHOOL TSINGHUA UNIV
View PDF4 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The purpose of the present invention is to provide a method for increasing the frame rate of a stereoscopic video depth map sequence, so a

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for improving frame rate of stereoscopic video depth map sequence
  • Method for improving frame rate of stereoscopic video depth map sequence
  • Method for improving frame rate of stereoscopic video depth map sequence

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0032] The present invention will be further described below in conjunction with the accompanying drawings and examples.

[0033] figure 1 The first and third columns represent the texture map sequences of View 1 (View1) and View 2 (View2) respectively, the second column represents the texture map sequence of the synthesized virtual viewpoint (View12), and the fourth column represents the depth map (Depth Map) sequence, where the solid line box represents the existing one, and the dotted line box represents the synthetic (virtual) one. For the convenience of description, use P 1，n Indicates the nth frame image of viewpoint 1, P 2,n Indicates the nth frame image of viewpoint 2, P 12,n Represents the nth frame image of the synthesized virtual viewpoint, D n Indicates the nth frame depth map. It can be seen that the frame rate of the existing texture image sequence is relatively high, and the frame rate of the existing depth image sequence is relatively low. The method for i...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

According to a method for improving the frame rate of a stereoscopic video depth map sequence, two adjacent frames of depth maps serve as two reference frames, and a middle depth map is constructed to be inserted between the adjacent frames of depth maps. The depth information of a macro block of the middle depth map is obtained according to the following steps: bi-directional motion estimation is carried out to obtain a matching cost and an initial motion vector of the current macro block; bi-directional motion compensation is carried out to obtain the initial depth information of the current macro block; if the smallest matching cost is smaller than a preset threshold value, the initial depth information serves as the depth information of the current macro block, otherwise the initial depth information is utilized to form a texture block, corresponding to a virtual viewpoint, of the current macro block; the matching cost of the texture block is calculated; the combined matching cost of the current macro block and the texture block is calculated to obtain the final motion vector; and the final motion vector is used for carrying out the bi-directional motion compensation to obtain the depth information of the current macro block. The method for improving the frame rate of the stereoscopic video depth map sequence is more accurate and reliable in the depth information, and can guarantee algorithm complexity.

Description

technical field [0001] The invention relates to a method for increasing the frame rate of a stereoscopic video depth map sequence, belonging to the field of computer vision. Background technique [0002] In recent years, with the rapid development of the economy, people's demand for video viewing has been increasing. Ordinary 2D video has been difficult to meet people's needs. Stereoscopic video has gained more and more people's favor for its close to real 3D experience. At the same time, the rapid development of computer applications has also made the application of stereoscopic video possible. [0003] Stereoscopic video includes binocular or multi-eye video sequences, which greatly increases the amount of video data and brings great difficulties to stereoscopic video storage and transmission. The video format of depth plus texture information can greatly reduce the data volume of stereoscopic video, and synthesize virtual viewpoints on the display side through depth info...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04N7/26H04N13/00H04N19/176H04N19/513
Inventor 张永兵王好谦杜成立戴琼海
Owner SHENZHEN GRADUATE SCHOOL TSINGHUA UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap