Time-space jointed multi-view video interpolation and three-dimensional modeling method

Abstract

The invention belongs to the technical field of computer multimedia. In order to provide a simple and practical multi-view video interpolation and three-dimensional modeling method, the invention adopts the technical scheme that: a time-space jointed multi-view video interpolation and three-dimensional modeling method is provided, a plurality of camera arrays are grouped in a spacing manner, and the three-dimensional model of a scene at every moment is reconstructed. The time-space jointed multi-view video interpolation and three-dimensional modeling method specifically comprises the following steps of: (1) obtaining unacquired frames between two frames through interpolation; (2) obtaining an image of unacquired visual angles at this moment by using a model-assisted weighting method; (3) calculating and extracting key points; (4) describing the extracted key points by using shape context and solving by the Hungarian method; (5) obtaining final interpolated frames through solving the problem of Poisson editing and optimization; and (6) reconstructing and rendering the three-dimensional model of the scene. The time-space jointed multi-view video interpolation and three-dimensional modeling method is mainly applied to the design and the manufacture of antennae.

Description

technical field [0001] The invention belongs to the technical field of computer multimedia, and specifically relates to a time-space joint multi-view video interpolation and three-dimensional modeling method. Background technique [0002] For a long time, the acquisition, processing and communication of single-channel video have made important breakthroughs in key technologies, and have become mature and widely used in broadcast television, Internet video, intelligent transportation and other fields. However, the traditional single-camera acquisition method cannot bring a sense of depth, a sense of three-dimensionality, and a comprehensive understanding of objects (variable viewing angles). Multi-channel video acquisition and reconstruction of scene objects based on a multi-camera system can achieve a full range of visual experience, and related research has become a research hotspot since the mid-1990s. Real-time acquisition and reconstruction of 3D scenes based on multi-c...

AI Technical Summary

Problems solved by technology

However, the result of this method is limited to a single perspective, and images from multiple perspectives at each moment cannot be obtained, and thus the 3D model at each moment cannot be reconstructed.

The first inventor of the present invention once proposed a method (ZL200810103684.2) for modeling high-speed moving objects using a ring-shaped low frame rate camera array to achieve full-view 3D reconstruction, but this method only simply uses the visible shell model to calculate the intersection to perform interpolation and reconstruction, so the interpolation and reconstruction effects are general and not robust

Although the existing video interpolation and image fusion methods can be used to obtain unacquired multi-view videos, the results will have blurred or non-smooth areas

Images