Unlock instant, AI-driven research and patent intelligence for your innovation.

Method for synthesizing virtual viewpoints in free viewpoint television

A technology of virtual viewpoint and viewpoint synthesis, which is applied in the field of video and multimedia signal processing, and can solve problems affecting visual effects, etc.

Inactive Publication Date: 2015-03-04
SHANDONG UNIV
View PDF2 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Even if these two types of defects undergo image post-processing, such as neighborhood assignment and linear interpolation, the image will leave processed traces and affect the visual effect

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for synthesizing virtual viewpoints in free viewpoint television
  • Method for synthesizing virtual viewpoints in free viewpoint television
  • Method for synthesizing virtual viewpoints in free viewpoint television

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0038] The invention is experimented with the test video sequence "Breakdancer" provided by Microsoft Corporation. The video sequence collects videos from 8 viewpoints of a scene, and provides corresponding depth information as well as internal and external parameters of each camera. In the experiment, we selected the No. 4 viewpoint as the reference viewpoint, and the No. 3 viewpoint as the virtual viewpoint.

[0039] figure 1 Shown is the flowchart of the present invention, according to the flowchart, we introduce its specific implementation.

[0040] (1) 3D image transformation. The so-called 3D image transformation is to project the pixels in the reference viewpoint into the virtual viewpoint plane according to the camera projection principle. This process is mainly divided into two parts. First, the pixels in the reference viewpoint are projected into the 3D space, and then projected from the 3D space into the virtual viewpoint plane. figure 2 Color image and depth i...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a new method for synthesizing virtual viewpoints based on a depth map rendering technology. The method comprises the steps of: firstly, obtaining a depth image of a virtual viewpoint through 3D image transformation and optimizing the depth image; then performing converse 3D image transformation based on the depth image obtained through optimizing process to obtain a colorful image of the virtual viewpoint; and finally, performing hole filling through an depth information based image inpainting algorithm. Through the converse 3D image transformation, crack generated on the colorful image of the virtual viewpoint can be avoided, and quality of the virtual viewpoint image is increased; in addition, for an unshielded hole area in the virtual viewpoint image, the image inpainting method provided by the invention is adopted for filling to guarantee a rendered image to have an optimal display effect.

Description

technical field [0001] The invention relates to a method for synthesizing virtual viewpoints based on depth images, and belongs to the technical field of video and multimedia signal processing. Background technique [0002] After color TV and high-definition TV, three-dimensional stereo TV has become a research hotspot in the field of multimedia. Its biggest advantage is mainly reflected in that it can provide viewers with a vivid and lifelike visual experience. Free viewpoint TV is a further product of stereoscopic TV. With its powerful interactivity, it allows viewers to freely choose viewing angles, and can perform smooth viewpoint conversion as the viewer's position changes, so that the viewer can achieve immersive viewing angles. The feeling of its environment. [0003] Free Viewpoint TV requires multiple videos to be played on the playback side at the same time. Assuming that multiple video sources are sent from the video capture end at the same time, this undoubted...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): H04N13/00H04N15/00
Inventor 刘琚成聪元辉杨晓辉
Owner SHANDONG UNIV