Virtual view synthesis method based on homographic matrix partition

A homography matrix, virtual viewpoint technology, applied in the field of image processing, can solve problems such as poor real-time performance, difficult engineering implementation, and complex algorithms

Active Publication Date: 2015-07-29
SOUTH CHINA UNIV OF TECH
View PDF3 Cites 22 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] At present, the existing methods for synthesizing virtual images based on virtual viewpoint interpolation are relatively complicated, have poor real-time performance, and cannot guarantee stability. Some algorithms require special hardware support, which is difficult to implement and has low engineering practical value.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Virtual view synthesis method based on homographic matrix partition
  • Virtual view synthesis method based on homographic matrix partition
  • Virtual view synthesis method based on homographic matrix partition

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0054] Such as figure 1 As shown, the method for virtual view synthesis based on homography matrix segmentation of this embodiment includes the following steps:

[0055] 1) Use the external standard size checkerboard calibration method to calibrate the left and right adjacent viewing angle cameras, and obtain the internal parameter matrix K of the left and right adjacent viewing angle cameras l 、K r And the fundamental matrix F between the left and right adjacent view cameras, the essential matrix E is derived from the fundamental matrix F, and the essential matrix is ​​subjected to SVD (Sigular Value Decomposition) singular value decomposition to calculate the motion parameters between the left and right adjacent view cameras: rotation matrix R and translation matrix T, as follows:

[0056] 1.1) Aim the camera at the checkerboard and take at least three sets of checkerboard photos;

[0057] 1.2) Use the opencv calibration function or the matlab calibration toolbox to calib...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a virtual view synthesis method based on homographic matrix partition. The virtual view synthesis method based on homographic matrix partition comprises the following steps of 1) calibrating left and right neighboring view cameras to obtain the internal reference matrixes of the left and right neighboring view cameras and a basis matrix between the left and right neighboring view cameras, deriving an essential matrix from the basis matrix, performing singular value decomposition on the essential matrix, and computing the motion parameters including a rotation matrix and a translation matrix between the left and right neighboring view cameras; 2) performing interpolation division on the rotation matrix and the translation matrix to obtain sub homographic matrixes from left and right neighboring views to a middle virtual view; 3) applying the forward mapping technology to map two view images to a middle virtual view image respectively through the sub homographic matrixes, taking the mapping graph of one of the images as a reference coordinate system and performing interpolation fusion on the mapped two images to synthesize a middle virtual view image. The virtual view synthesis method based on the homographic matrix partition has the advantages of being high in synthesis speed, simple and effective in process and high in practical engineering value.

Description

technical field [0001] The invention relates to a method for synthesizing virtual viewpoints, in particular to a method for synthesizing virtual viewpoints based on homography matrix segmentation, and belongs to the technical field of image processing. Background technique [0002] Virtual viewpoint synthesis refers to the use of computers to synthesize viewpoint images that do not exist in the first place. Virtual viewpoint interpolation is given a camera array pre-arranged according to certain rules, taking multiple images at the same time, and using the corresponding viewpoint interpolation technology to calculate the intermediate image sequence between every two adjacent viewpoints. [0003] In recent years, with the high degree of cross-disciplines such as computer vision, image processing, and computer graphics. Virtual viewpoint synthesis is widely used in projects such as 3D reconstruction and panorama stitching. Viewpoint interpolation technology is widely used in...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/00H04N13/00
Inventor 冯颖张欣杜娟陈新开苏比哈什·如凯迦
Owner SOUTH CHINA UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap