A method of virtual viewpoint synthesis based on homography matrix segmentation
A homography matrix and virtual viewpoint technology, applied in the field of image processing, can solve problems such as low engineering practical value, unguaranteed stability, complex algorithms, etc., achieve high engineering practical value, improve real-time performance, and robustness high performance effect
Active Publication Date: 2018-01-05
SOUTH CHINA UNIV OF TECH
View PDF3 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0005] At present, the existing methods for synthesizing virtual images based on virtual viewpoint interpolation are relatively complicated, have poor real-time performance, and cannot guarantee stability. Some algorithms require special hardware support, which is difficult to implement and has low engineering practical value.
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment 1
[0054] Such as figure 1 As shown, the method for virtual view synthesis based on homography matrix segmentation of this embodiment includes the following steps:
[0055] 1) Use the external standard size checkerboard calibration method to calibrate the left and right adjacent viewing angle cameras, and obtain the internal parameter matrix K of the left and right adjacent viewing angle cameras l 、K r And the fundamental matrix F between the left and right adjacent view cameras, the essential matrix E is derived from the fundamental matrix F, and the essential matrix is subjected to SVD (Sigular Value Decomposition) singular value decomposition to calculate the motion parameters between the left and right adjacent view cameras: rotation matrix R and translation matrix T, as follows:
[0056] 1.1) Aim the camera at the checkerboard and take at least three sets of checkerboard photos;
[0057] 1.2) Use the opencv calibration function or the matlab calibration toolbox to calib...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention discloses a virtual viewpoint synthesis method based on homography matrix segmentation, which includes the following steps: 1) Calibrate the left and right adjacent viewing angle cameras, and obtain the internal reference matrix of the left and right adjacent viewing angle cameras and the difference between the left and right adjacent viewing angle cameras. The fundamental matrix between them is derived from the fundamental matrix, and the singular value decomposition is performed on the essential matrix to calculate the motion parameters between the left and right adjacent view cameras: rotation matrix and translation matrix; 2) interpolation and segmentation of the rotation matrix and translation matrix, Obtain the sub-homography matrix from the left and right adjacent viewpoints to the middle virtual viewpoint; 3) apply the forward mapping technology to map the two-view images to the middle virtual viewpoint image through the sub-homography matrix, and use the mapping map of one image as a reference Coordinate system, interpolation and fusion of the mapped two images to synthesize an intermediate virtual viewpoint image. The method of the invention has the advantages of fast synthesis speed, simple and effective process and high engineering practical value.
Description
technical field [0001] The invention relates to a method for synthesizing virtual viewpoints, in particular to a method for synthesizing virtual viewpoints based on homography matrix segmentation, and belongs to the technical field of image processing. Background technique [0002] Virtual viewpoint synthesis refers to the use of computers to synthesize viewpoint images that do not exist in the first place. Virtual viewpoint interpolation is given a camera array pre-arranged according to certain rules, taking multiple images at the same time, and using the corresponding viewpoint interpolation technology to calculate the intermediate image sequence between every two adjacent viewpoints. [0003] In recent years, with the high degree of cross-disciplines such as computer vision, image processing, and computer graphics. Virtual viewpoint synthesis is widely used in projects such as 3D reconstruction and panorama stitching. Viewpoint interpolation technology is widely used in...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): G06T7/80H04N13/00
Inventor 冯颖张欣杜娟陈新开苏比哈什·如凯迦
Owner SOUTH CHINA UNIV OF TECH