Virtual viewpoint drawing method based on depth value non-linear transformation

A technology of nonlinear transformation and virtual viewpoint, which is applied in the field of video image processing, can solve the problems of high time complexity and large amount of calculation, and achieve the effect of simple implementation process and low computational complexity

Active Publication Date: 2012-05-02
SHANGHAI JIAO TONG UNIV
View PDF2 Cites 19 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, since both filters require multiple iterative processing of the depth map, the amount of calculation is large and the time complexity is high.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Virtual viewpoint drawing method based on depth value non-linear transformation
  • Virtual viewpoint drawing method based on depth value non-linear transformation
  • Virtual viewpoint drawing method based on depth value non-linear transformation

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0048] The following is a detailed description of the embodiments of the present invention. This embodiment provides the detailed implementation and specific operation process of the technical solution of the present invention, but the protection scope of the present invention is not limited to the following embodiments.

[0049] Such as figure 1 As shown, the flow chart of the virtual viewpoint drawing method in the embodiment of the present invention includes the iterative processing of the depth map by using the edge filter, the processing of the depth map by the asymmetric Gaussian smoothing filter, the gray value of the pixel in the depth map and the Non-linear mapping of spatial depth and distance, using three-dimensional image transformation equations and axis-shifting algorithms to generate new viewpoint images, using edge information to fill holes, and finally generating virtual viewpoint images.

[0050] The size provided by Microsoft Research Asia is Taki...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a virtual viewpoint drawing method based on depth value non-linear transformation. The method comprises the following steps: firstly an adaptive edge-based pre-processing filter which is composed of an edge preservation filter and an asymmetrical Gauss smooth filter in series connection; using the edge filter to iteratively process a depth map, so that not only can the noise information be removed, but also the probability of hole in an object in a target image is reduced by smoothing continuous regions in the object; using the asymmetrical Gauss smooth filter to process the depth map and the object edge, avoiding the geometrical distortion in vertical direction while smoothing the horizontal gradient; after considering a human eye visual characteristic factor, carrying out non-linear mapping on a gray scale of the depth image and a space real distance to effectively reduce the hole in a target image background and enhance the three-dimensional viewing of a user; and finally filling the hole in the target image and eliminating all holes. The method provided by the invention is simple to realize, free from geometrical distortion and low in computation complexity.

Description

technical field [0001] The present invention relates to a method in the technical field of video image processing, in particular to a virtual viewpoint rendering method based on nonlinear transformation of depth values. Background technique [0002] The virtual viewpoint rendering technology starts from a series of reference images, and then generates new viewpoint images. Among them, depth image based rendering (Depth Image Based Rendering, DIBR) is a method that uses color images and their corresponding depth images to generate new viewpoint images. application. The core of DIBR technology is the three-dimensional image transformation (3D Image Warping) equation. Its principle is to map the pixels on the reference image to the target image according to the depth information corresponding to each pixel in the reference image. However, since the occlusion relationship between objects will change to a certain extent during the mapping process, it is inevitable that some hol...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T15/00H04N13/00
Inventor 周军王震
Owner SHANGHAI JIAO TONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products