Method for synthesizing continuous and smooth panoramic video in real time by using discrete cubic panoramas

A panoramic video and panorama technology, applied in image enhancement, image data processing, graphics and image conversion, etc., can solve problems such as errors in the joints of the six faces of the cube, cumbersome algorithms, etc.

Active Publication Date: 2013-05-01
TIANJIN UNIV
View PDF2 Cites 32 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Due to the consideration of sub-regions, the algorithm is cumbersome, and

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for synthesizing continuous and smooth panoramic video in real time by using discrete cubic panoramas
  • Method for synthesizing continuous and smooth panoramic video in real time by using discrete cubic panoramas
  • Method for synthesizing continuous and smooth panoramic video in real time by using discrete cubic panoramas

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0050] Specific embodiments of the present invention will be described in detail below in conjunction with the accompanying drawings. If there are exemplary contents in these embodiments, they should not be construed as limiting the present invention.

[0051] The invention relates to two parts, the preprocessing of the cube panorama and the real-time generation of the panorama sequence. The main process of the two parts is as follows figure 2 and image 3 shown.

[0052] Such as image 3 As shown, the preprocessing of the stereo panorama mainly includes the steps of panorama feature extraction, feature point matching, robust estimation of camera parameters, triangular meshing and occlusion processing. Enter less information.

[0053] Such as Figure 4 As shown, the real-time generation of the cube panorama sequence flow chart mainly completes the real-time interpolation of the cube panorama. The interpolation process mainly includes camera interpolation, scene point co...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method for synthesizing a continuous and smooth panoramic video in real time by using discrete cubic panoramas. The method comprises the following steps of: carrying out feature point detection and feature matching on two input continuous cubic panoramas to establish triangular mesh dissection of the cubic panoramas on a spherical domain so as to realize preprocessing of the cubic panoramas; and carrying out real-time interpolation on the cubic panoramas, estimating the composition of a triangular mesh to be interpolated in a new camera position on the basis of the existing triangular mesh correspondence, and carrying out color filling on the new perspective triangular mesh on the basis of a homography matrix. Compared with the prior art, the method disclosed by the invention has the advantages of projecting the cubic panoramas into the spherical domain, adopting a matching-triangulation-interpolation strategy in the spherical domain, simplifying the complexity of interpolation processing and effectively improving the visual effect of interpolation.

Description

technical field [0001] The invention belongs to the fields of computer graphics and computer vision, and in particular relates to an image interpolation technology for synthesizing continuous and smooth panoramic videos in real time by utilizing discrete cube panoramic images. Background technique [0002] With the development of image stitching technology and the birth of panoramic cameras, more and more cube panoramas are applied to online virtual reality and roaming navigation systems. However, due to network bandwidth limitations, service providers can only provide panoramas taken in hot spots, that is, discrete panorama data. Existing online virtual roaming systems usually only provide browsing of a single panorama, and the transition between two adjacent panoramas is realized by some form of superposition, and the effect presents obvious visual discontinuity. In order to improve the user experience of virtual browsing, a viewpoint interpolation method can be used. Ho...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T5/50G06T3/40
Inventor 万亮冯伟张加万赵强
Owner TIANJIN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap