Virtual viewpoint rendering method

A virtual viewpoint and virtual view technology, applied in the field of depth-based virtual viewpoint rendering, can solve problems such as blurred depth maps and affecting the quality of virtual view rendering, and achieve the effect of improving quality

Active Publication Date: 2012-07-18
TIANJIN UNIV
View PDF1 Cites 53 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Mori solves the hole problem by using 3D warping for virtual viewpoint rendering and by projecting the depth map onto the virtual image plane and post-filtering the mapped depth map, but post-filtering the resulting depth map blurs the depth Figure, which affects the drawing quality of the virtual view

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Virtual viewpoint rendering method
  • Virtual viewpoint rendering method
  • Virtual viewpoint rendering method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0039] The purpose of the present invention is to overcome the deficiencies of the prior art, and propose a new method for virtual viewpoint rendering. The present invention first uses the boundary reconstruction algorithm based on edge detection to preprocess the depth map to improve the quality of the depth map; then uses the left and right reference views and the preprocessed depth map to map to obtain the image of the virtual viewpoint position, and uses image fusion to Two virtual images are synthesized into one view; finally, the hole filling algorithm based on background separation is used to deal with the holes in the virtual view to achieve high-quality virtual viewpoint rendering.

[0040] A virtual view point drawing method, said method comprising the following steps:

[0041] (1) Preprocess the depth map by using the boundary reconstruction algorithm based on edge detection;

[0042] First, edge detection is performed on the depth map using the canny operator, and...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a virtual viewpoint rendering method, which belongs to the field of image processing and stereo imaging and can achieve high-quality virtual viewpoint rendering. The technical scheme adopted by the virtual viewpoint rendering method comprises the following steps: (1) preprocessing depth maps; (3) performing image fusion on the two virtual viewpoint images by using distance weighted values, eliminating most of hollows and producing a fusional initial virtual view; and (4) filling the hollows of the initial virtual view by a method on the basis of figure-ground segregation and obtaining a final virtual viewpoint image. The virtual viewpoint rendering method is mainly applicable to image processing and stereo imaging.

Description

technical field [0001] The invention belongs to the field of image processing and stereoscopic imaging, and relates to a depth-based virtual viewpoint rendering method. Background technique [0002] The traditional planar video uses planar images to describe three-dimensional scenes, which can no longer meet people's requirements for three-dimensionality. Compared with traditional flat video, stereoscopic video has a more intuitive visual expression effect, which can make people feel a real sense of depth and immersion. Virtual viewpoint rendering technology refers to the process of generating video images of the same scene obtained from two or more camera viewpoints, and generating video images of the scene from other camera viewpoints. It is the key technology to realize stereoscopic video applications such as free stereoscopic TV and free viewpoint TV. one. [0003] The virtual viewpoint rendering technology mainly includes Model Based Rendering (MBR) and Image Based Re...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/00
Inventor 雷建军王来花侯春萍范科峰吴冬燕张海龙
Owner TIANJIN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products