Virtual viewpoint image generation process on basis of depth map segmentation and rendering

A virtual viewpoint and depth map technology, applied in the field of virtual viewpoint image generation, can solve problems such as holes in virtual viewpoint images, achieve obvious three-dimensional effects, high computing efficiency, and eliminate holes

Inactive Publication Date: 2012-07-25
四川和鼎昇泰信息技术有限公司
View PDF4 Cites 17 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The virtual viewpoint image generated by this method still has holes, so how to effect

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Virtual viewpoint image generation process on basis of depth map segmentation and rendering
  • Virtual viewpoint image generation process on basis of depth map segmentation and rendering
  • Virtual viewpoint image generation process on basis of depth map segmentation and rendering

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0045] In order to describe the present invention in more detail, the method for generating a virtual viewpoint image of the present invention will be described in detail below with reference to the drawings and specific embodiments.

[0046] Such as figure 1 As shown, a method for generating virtual viewpoint images based on depth map segmentation rendering includes the following steps:

[0047] (1) Obtain a two-dimensional image and its depth map.

[0048] The depth corresponding to the original two-dimensional image Figure one In general, it is a grayscale image with the same resolution as the two-dimensional image, and each sampling point is 8-bit quantized. If the resolution of the depth map is different from that of the two-dimensional image, the depth map must first be scaled to make the resolution the same as the resolution of the two-dimensional image, and each sampling point corresponds to each pixel of the two-dimensional image one-to-one ; If the depth value of each sa...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a virtual viewpoint image generation process on the basis of depth map segmentation and rendering, which includes: (1) acquiring two-dimensional images and a depth map thereof; (2), segmenting the depth map; (3), recovering the two-dimensional images; and (4), rendering the recovered images. By the generation process on the basis of depth map segmentation and rendering, virtual viewpoint images can be synthesized according to the original two-dimensional images and the corresponding depth map, and holes in the synthesized virtual viewpoint images can be eliminated thoroughly. Meanwhile, the virtual viewpoint image generation process can be implemented on hardware systems such as general PC (personal computers) or work stations and the like, higher computation efficiency can be achieved, and the virtual viewpoint images generated are obvious in stereoscopic effect.

Description

technical field [0001] The invention belongs to the technical field of video image processing, and in particular relates to a method for generating virtual viewpoint images based on depth map segmentation and rendering. Background technique [0002] The generation of virtual viewpoint images is one of the most critical steps in the process of converting 2D images into 3D images. The virtual viewpoint image can be used for roaming between different viewpoints in the free viewpoint image, thereby improving the interactive image viewing experience; it can also be used for multi-viewpoint image coding, and the generated virtual viewpoint image can perform parallax compensation prediction on the actual viewpoint image to play a role The purpose of improving the efficiency of multi-viewpoint image coding. At present, there are mainly two methods for generating virtual viewpoint images: three-dimensional model-based rendering MBR (3D Model Based Rendering) and image-based renderin...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T15/20H04N13/00H04N13/02
Inventor 冯杰黄海曹丽胡洁
Owner 四川和鼎昇泰信息技术有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap