Check patentability & draft patents in minutes with Patsnap Eureka AI!

Method and device for generating video sequence of virtual viewpoints

A virtual viewpoint and video sequence technology, applied in the field of computer vision, can solve problems such as the lack of a good processing method for empty pixels, and achieve the effect of small distortion

Active Publication Date: 2014-08-06
TSINGHUA UNIV
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, this method does not have a good treatment method for the hole pixels in the virtual viewpoint. Commonly used hole filling methods include interpolation, filtering, etc., and they often appear more or less unnatural in the virtual viewpoint. Distortion has always been the direction of scholars' efforts

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for generating video sequence of virtual viewpoints
  • Method and device for generating video sequence of virtual viewpoints

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0037] Embodiments of the present invention are described in detail below, examples of which are shown in the drawings, wherein the same or similar reference numerals designate the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the figures are exemplary only for explaining the present invention and should not be construed as limiting the present invention. On the contrary, the embodiments of the present invention include all changes, modifications and equivalents coming within the spirit and scope of the appended claims.

[0038] In the description of the present invention, it should be understood that the terms "first", "second" and so on are used for descriptive purposes only, and cannot be interpreted as indicating or implying relative importance. In the description of the present invention, it should be noted that unless otherwise specified and limited, the terms "connected" and "connect...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a method and a device for generating a video sequence of virtual viewpoints. The method comprises the following steps of: inputting a video sequence of a plurality of original viewpoints and a depth map sequence of the original viewpoints; recording a relative position between each original viewpoint and each virtual viewpoint; sequencing depth values of depth maps of the original viewpoints; performing migration and cave filling processing on color maps of the original viewpoints according to a sequencing result, and thus obtaining initial color maps of the virtual viewpoints; calculating an edge evaluation value according to edge information of the depth maps of the original viewpoints and edge information of the initial color maps of the virtual viewpoints; if the edge evaluation value is greater than a threshold value, correcting the edge evaluation value, and thus obtaining a smooth color map of each virtual viewpoint; synthesizing the smooth color maps of the virtual viewpoints corresponding to the original viewpoints into a final color map, and thus obtaining the video sequence of the virtual viewpoints. By the method, under the condition that the video sequence of any number of original viewpoints is supplied, the video sequence of the virtual viewpoints, which is relatively low in distortion, is generated with relatively high efficiency.

Description

technical field [0001] The present invention relates to the technical field of computer vision, in particular to a method and device for generating a virtual view point video sequence. Background technique [0002] Free-viewpoint video sequence processing is a very key component of stereoscopic video processing technology, and has a very wide range of applications. It can be applied to scenarios such as stereoscopic video appreciation, free-viewpoint multi-angle viewing, virtual reality, and stereoscopic games. On the basis of visual experience, it can also provide more information to the audience. [0003] For the free-viewpoint video sequence display, if all angles are collected by cameras, good video quality can be guaranteed, but a large amount of calculation will be generated. Therefore, on the basis of collecting video, through the way of stereoscopic video generation, the calculation speed is also improved on the basis of ensuring video quality-this is also the signi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): H04N13/02H04N15/00
Inventor 戴琼海徐琨曹汛王好谦
Owner TSINGHUA UNIV
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More