Depth-based cavity repairing method in viewpoint synthesis

A repair method and viewpoint synthesis technology, which are applied in image communication, electrical components, stereo systems, etc., can solve the problems of unsatisfactory repair effect of large holes, excessive data volume, and complex sampling, so as to eliminate foreground pixel penetration and maintain Good effect, keep the effect of continuity

Inactive Publication Date: 2015-07-15
ZHEJIANG UNIV
View PDF7 Cites 31 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Due to the need to collect color information of multiple layers of depth, the problem of this method is that the sampl

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Depth-based cavity repairing method in viewpoint synthesis
  • Depth-based cavity repairing method in viewpoint synthesis
  • Depth-based cavity repairing method in viewpoint synthesis

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0014] The present invention will be described in further detail below in conjunction with the accompanying drawings and specific embodiments, and the purpose and effects of the present invention will become more apparent.

[0015] figure 1 A flowchart of a method for repairing holes in view synthesis results according to the present invention is given.

[0016] Viewpoint synthesis in the present invention refers to the process of inputting a reference view of a certain viewpoint and a corresponding reference depth map, and generating a view under a virtual viewpoint through a given pixel mapping transformation.

[0017] Holes inevitably appear in the synthesized virtual viewpoint views due to occlusions between different viewpoints and errors in the depth map. Filling these hollow areas is a necessary step in view synthesis, and the quality of the filling effect directly affects the result of view synthesis.

[0018] Such as figure 1 As shown, in step 101, the input refere...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a depth-based cavity repairing method in viewpoint synthesis. The method comprises steps as follows: (1) performing depth edge one-way expansion preprocessing on an input reference depth map to eliminate inter-infiltration of a foreground pixel and a background pixel in a synthesized virtual viewpoint view; (2) performing pixel mapping transformation by using the preprocessed reference depth map and an original reference view to obtain a virtual viewpoint view with a cavity and a virtual viewpoint depth map; (3) repairing the cavity in the virtual depth map with a pixel-based image repairing method in combination with the relative position relation between the foreground and the background around the cavity in the virtual viewpoint depth map; (4) repairing the cavity in the virtual viewpoint view with an improved sample-based image repairing method in combination with the repaired virtual viewpoint depth map. With the adoption of the method, the virtual viewpoint view with better quality can be obtained, the continuity of image edges can be better kept, and the inter-infiltration of the foreground and background pixels can be eliminated.

Description

technical field [0001] The present invention relates to a method for repairing a hole area in viewpoint synthesis, specifically, it relates to a method for effectively utilizing depth information and considering the relative positional relationship between the foreground and the background around the hole in the synthesized virtual viewpoint view, through depth map preprocessing, Image mapping transformation, depth map inpainting, and sample-based color image inpainting combined with depth information are used to effectively fill the hole area and finally obtain a better quality virtual viewpoint view. Background technique [0002] Viewpoint synthesis refers to the process of using a real image of a certain viewpoint to generate a virtual viewpoint image through corresponding parameters. Virtual view synthesis has a wide range of applications in related fields such as virtual reality, 3D free-viewpoint television, human-computer interaction, and 2D to 3D video conversion. ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04N13/00
Inventor 杜歆邹泷朱云芳
Owner ZHEJIANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap