Unlock instant, AI-driven research and patent intelligence for your innovation.

A method and device for real-time virtual viewpoint synthesis

A virtual viewpoint and viewpoint technology, which is applied in the field of virtual viewpoint synthesis and can solve the problem of voids in virtual viewpoints.

Active Publication Date: 2018-07-06
PEKING UNIV SHENZHEN GRADUATE SCHOOL
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the existing depth estimation algorithms are not mature enough, and high-precision depth maps are usually generated in a semi-automatic way by human interaction; in addition, due to the mutual occlusion of objects in the real scene, the virtual viewpoint synthesized based on the depth map will produce hollow
[0006] These issues limit DIBR to automatically generate content for multi-view 3D display devices in real time

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method and device for real-time virtual viewpoint synthesis
  • A method and device for real-time virtual viewpoint synthesis
  • A method and device for real-time virtual viewpoint synthesis

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0043] The present application discloses a method and device for real-time virtual viewpoint synthesis, which is based on the image domain deformation (IDW) technology. In the whole process of synthesizing virtual viewpoint images, it does not need to rely on the depth map as in the prior art, so it is effective Avoids the problems caused by depth map drawing technology, for example, it does not need to use dense depth maps, and it will not cause holes; in addition, we also use the powerful parallel computing capabilities of general-purpose graphics processors (GPGPU) to accelerate IDW algorithm to achieve real-time virtual viewpoint synthesis. The method for real-time virtual viewpoint synthesis of the present application comprises four steps:

[0044]First, extract sparse disparity data from the input left and right real viewpoint images. Sparse disparity is estimated by image local feature matching. The accuracy of feature matching is critical to the quality of subsequent...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a method and a device for real-time virtual viewpoint synthesis. In the whole synthesis process of an image of a virtual viewpoint, a depth map is not needed any more, so that problems caused by a depth map-based drawing technology are avoided effectively.

Description

technical field [0001] The present application relates to the field of virtual viewpoint synthesis, in particular to a method and device for real-time virtual viewpoint synthesis. Background technique [0002] Nowadays, 3D-related technologies are maturing day by day, and watching 3D TV at home has become a reality. However, having to wear 3D glasses for viewing has hindered the acceptance of it by home users. [0003] Multi-viewpoint 3D display devices make it possible to watch 3D videos with naked eyes. This device requires multiple video streams as input, and the number of video streams varies from device to device. One difficulty of multi-viewpoint 3D display device is how to generate multiple video streams. The easiest way is to directly shoot the corresponding video streams from various viewpoints, but this is the most unrealistic, because for multiple video streams, the cost of both shooting and transmission is very expensive, and different devices require differen...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): H04N13/00
CPCH04N13/122H04N13/128
Inventor 王荣刚罗佳佳姜秀宝高文
Owner PEKING UNIV SHENZHEN GRADUATE SCHOOL