Depth-based cavity repairing method in viewpoint synthesis

A repair method and viewpoint synthesis technology, which are applied in image communication, electrical components, stereo systems, etc., can solve the problems of unsatisfactory repair effect of large holes, excessive data volume, and complex sampling, so as to eliminate foreground pixel penetration and maintain Good effect, keep the effect of continuity
CN104780355AInactive Publication Date: 2015-07-15ZHEJIANG UNIV
7 Cites 31 Cited by

Patent Information

Authority / Receiving Office
CN Β· China
Current Assignee / Owner
ZHEJIANG UNIV
Publication Date
2015-07-15
Estimated Expiration
Not applicable Β· inactive patent

Smart Images

  • Figure 1
    Figure 1
  • Figure 2
    Figure 2
  • Figure 3
    Figure 3
Patent Text Reader

Abstract

The invention discloses a depth-based cavity repairing method in viewpoint synthesis. The method comprises steps as follows: (1) performing depth edge one-way expansion preprocessing on an input reference depth map to eliminate inter-infiltration of a foreground pixel and a background pixel in a synthesized virtual viewpoint view; (2) performing pixel mapping transformation by using the preprocessed reference depth map and an original reference view to obtain a virtual viewpoint view with a cavity and a virtual viewpoint depth map; (3) repairing the cavity in the virtual depth map with a pixel-based image repairing method in combination with the relative position relation between the foreground and the background around the cavity in the virtual viewpoint depth map; (4) repairing the cavity in the virtual viewpoint view with an improved sample-based image repairing method in combination with the repaired virtual viewpoint depth map. With the adoption of the method, the virtual viewpoint view with better quality can be obtained, the continuity of image edges can be better kept, and the inter-infiltration of the foreground and background pixels can be eliminated.
Need to check novelty before this filing date? Find Prior Art

Description

technical field

[0001] The present invention relates to a method for repairing a hole area in viewpoint synthesis, specifically, it relates to a method for effectively utilizing depth information and considering the relative positional relationship between the foreground and the background around the hole in the synthesized virtual viewpoint view, through depth map preprocessing, Image mapping transformation, depth map inpainting, and sample-based color image inpainting combined with depth information are used to effectively fill the hole area and finally obtain a better quality virtual viewpoint view. Background technique

[0002] Viewpoint synthesis refers to the process of using a real image of a certain viewpoint to generate a virtual viewpoint image through corresponding parameters. Virtual view synthesis has a wide range of applications in related fields such as virtual reality, 3D free-viewpoint television, human-computer interaction, and 2D to 3D video conversion. ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More