Generating free viewpoint video through stereo imaging

A stereoscopic image and stereoscopic technology, applied in stereoscopic systems, image analysis, image enhancement, etc., can solve problems such as limiting the utility of similar equipment

Inactive Publication Date: 2013-02-20
MICROSOFT TECH LICENSING LLC
View PDF4 Cites 17 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Despite the advantages of utilizing structured light technology, several issues limit the utility of similar devices in the creation of FVV

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Generating free viewpoint video through stereo imaging
  • Generating free viewpoint video through stereo imaging
  • Generating free viewpoint video through stereo imaging

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0021] As discussed above, Free Viewpoint Video (FVV) is a technology in which video playback of viewing perspective is dynamically controlled by a viewer. Unlike traditional video, which is captured by a single camera and is characterized by a fixed viewing angle, FVV capture utilizes an array of video cameras and related technologies to simultaneously record a video scene from multiple angles of view. Data from the video array is processed using 3D reconstruction methods to extract the texture-mapped geometry of the scene. Synthetic viewpoints are then generated at arbitrary viewpoints using image-based rendering methods. The texture-mapped geometry recovered at each time frame allows the viewer to control both the spatial and temporal position of the virtual camera or viewpoint, which is essentially FVV. In other words, virtual navigation through both space and time is achieved.

[0022] Embodiments disclosed herein illustrate methods and systems for generating FVV of a s...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses generating a free viewpoint video through stereo imaging generating. The invention provides a method and a system for generating the free viewpoint video through an active infrared (IR) stereo module. The method comprises a step of calculating (602) a scene depth map by using the active infrared IR stereo module. The scene depth map is calculated by the following steps: projecting an IR dot pattern on the scene; capturing a stereo image from each IR camera of two or more than two synchronous IR cameras; detecting the dots in the stereo image; calculating a feature descriptor corresponding to the dots in the stereo image; calculating a parallax map between the stereo images; and generating the depth map by using the parallax map. The method also comprises the step of generating (604) point clouds of the scene by the depth map, generating (606) a grid of the point clouds and generating (608) a projection texture map of the scene by the grid. The method furthermore comprises the step of generating (610) the video of the scene by the projection texture map.

Description

technical field [0001] The present invention relates to methods and systems for generating free viewpoint video. Background technique [0002] Free viewpoint video (FVV) is a video capture and playback technique for simultaneously capturing an entire scene from multiple angles, and wherein the viewing angle of view is dynamically controlled by the viewer during playback. Unlike traditional video, which is captured by a single camera and is characterized by a fixed viewing angle, FVV capture involves an array of video cameras and related techniques to simultaneously record a video scene from multiple angles of view. During playback, intermediate synthetic viewpoints between known true viewpoints are synthesized, allowing seamless spatial navigation within the camera array. In general, denser camera arrays with more video cameras produce more realistic results during FVV playback. When more real data is recorded in a dense camera array, image-based rendering methods for synt...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04N13/00H04N15/00
CPCH04N2013/0081G06T15/00G06T17/20H04N13/0011G06T7/0051H04N13/00H04N13/0271G06T15/04G06T2207/10021G06T2207/10024G06T2207/10048G06T2207/20228G06T7/521G06T7/593H04N13/111H04N13/271
Inventor 查尔斯·日特尼克辛·秉·康亚当·柯克帕特里克·斯威尼阿米特·米塔尔大卫·哈尼特大卫·埃雷克干尚·米特拉克斯图提斯·帕蒂耶尤纳斯亚龙·埃谢西蒙·温德
Owner MICROSOFT TECH LICENSING LLC
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap