Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A depth map fusion method suitable for dibr preprocessing

A fusion method and depth map technology, applied in the field of 3D video, can solve the problems of geometric deformation, affecting the actual conversion effect of 3D video, and unable to effectively ensure the transformation and synthesis of virtual images without distortion, so as to overcome the problems of depth map distortion and over-smoothing. , the effect of cavity repair improvement

Inactive Publication Date: 2018-08-10
NANYANG NORMAL UNIV
View PDF14 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This type of method has high operating efficiency and obvious effect, but the smoothing filter may cause geometric deformation in the edge area of ​​the object in the virtual image (especially the edge in the vertical direction)
Therefore, in the 2D / 3D video conversion, the depth map preprocessing link in the existing DIBR technology cannot effectively guarantee the conversion and synthesis of the virtual image without distortion, thus affecting the actual conversion effect of the 3D video

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A depth map fusion method suitable for dibr preprocessing
  • A depth map fusion method suitable for dibr preprocessing
  • A depth map fusion method suitable for dibr preprocessing

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0035] The present invention will be further described below in conjunction with accompanying drawing and embodiment:

[0036] figure 1 It shows the processing flow of the existing DIBR system. For the input original depth map, the depth map is firstly smoothed and filtered in the preprocessing link, so as to reduce the occurrence of most holes during rendering by optimizing the partial structure of the depth map; then, Using the DIBR rendering processing method, using the depth image and the calibrated camera parameters, the pixels in the reference image are mapped to the target image; finally, using the hole filling method to repair a small amount of holes left in the rendering process, and output the converted left and right eye virtual image.

[0037] Among them, DIBR rendering processing is an important step in the 2D / 3D conversion method. It describes an accurate point-to-point mapping relationship, and can use the depth information to render a virtual stereoscopic vide...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a depth map fusion method used in the DIBR preprocessing process, which includes the following steps: conducting gradient analysis on the original depth map to estimate the hole area in the new viewpoint image; and generating an initial impact based on the estimated hole area distribution. degree distribution map; use texture images to diffuse the initial influence degree distribution map in the dimensional transformation space; fuse the original depth map and the pre-smoothed depth map based on the diffused influence degree distribution map to generate an optimized depth map. The method of the present invention fuses the original depth map and the pre-smoothed depth map through the influence distribution map based on texture feature diffusion in an efficient dimensional transformation space, thereby realizing the smoothing intensity of the optimized depth map in different areas. Adaptive adjustment not only effectively retains the smoothing effect of hole areas to eliminate the effects of holes, but also effectively avoids additional distortion caused by over-smoothing areas without holes.

Description

technical field [0001] The invention belongs to the technical field of three-dimensional video, and specifically relates to a 2D / 3D video conversion technology, in particular to a depth image fusion method suitable for a DIBR preprocessing process. Background technique [0002] At present, three-dimensional (3D) video is gradually popularized, and China Central Television (CCTV) also tried to broadcast a 3D channel on the occasion of New Year's Day in 2012. 3D video has gradually become a current development trend. However, insufficient video sources have become the main bottleneck restricting the rise of this industry. In this case, converting 2D video to 3D video is an effective way to solve this problem. [0003] There are generally two rendering methods for converting 2D video to 3D video: one is to directly reconstruct the left and right eye image pairs with parallax from a single video frame by using a certain method; the other is based on the depth map The rendering...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): H04N13/00G06T5/00G06T5/50G06T15/20
CPCH04N13/106G06T5/50G06T15/205G06T2207/10021G06T2207/20221G06T5/70
Inventor 刘伟郑扬冰刘红钊崔明月张新刚马世榜叶铁
Owner NANYANG NORMAL UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products