Panoramic splicing method based on multi-camera calibration, panoramic splicing system

A multi-camera and camera technology, applied in the field of panorama stitching, can solve problems such as slow algorithm processing speed, large calculation time consumption, and unrobust algorithm

Pending Publication Date: 2018-12-21
XIDIAN UNIV
View PDF6 Cites 46 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] To sum up, the problems existing in the existing technology are: the processing speed of the existing algorithm is slow, and the calculation is time-co

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Panoramic splicing method based on multi-camera calibration, panoramic splicing system
  • Panoramic splicing method based on multi-camera calibration, panoramic splicing system
  • Panoramic splicing method based on multi-camera calibration, panoramic splicing system

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0057] In order to make the objectives, technical solutions and advantages of the present invention clearer, the present invention will be further described in detail below with reference to the embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention, but not to limit the present invention.

[0058] Different from the splicing method based on feature point matching, the present invention directly calibrates the extrinsic parameter R between two cameras, and makes a splicing template. For a camera array with a fixed camera position, it can still achieve a better performance when there are very few feature points. Stitching effect; for the camera group with a large safety distance, a third auxiliary camera is placed between the two cameras offline to solve the positional relationship between the two cameras, and then the external parameter R and internal parameter matrix are also used to make a stitching t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention belongs to the technical field of panoramic splicing, and discloses a panoramic splicing method based on multi-camera calibration, a panoramic splicing system, which respectively performs internal reference calibration and distortion parameter estimation on each camera. Several pairs of checkerboard pictures with different positions and postures are simultaneously collected from twoadjacent cameras respectively. Corner detection and matching are carried out after distortion correction of the pair of checkerboard pictures. The initial homography matrix between two cameras is selected and estimated from the interior points. The initial homography matrix between the two cameras and the calibration matrix are used to calculate the initial rotation matrix between the two cameras.The initial rotation matrices of all camera pairs are optimized globally according to the minimum re-projection error. M algorithm updates the parameters to get the final optimization results. The invention utilizes a multi-camera calibration method to make a splicing template, avoids the process of feature point extraction and matching required for each splicing, and still obtains a better splicing effect under the condition of fewer feature points or low overlap rate.

Description

technical field [0001] The invention belongs to the technical field of panoramic stitching, and in particular relates to a multi-camera calibration-based panoramic stitching method and a panoramic stitching system. Background technique [0002] At present, the existing technologies commonly used in the industry are as follows: with the continuous development of virtual reality (VR), panoramic stitching has also become a research hotspot in the field of computer vision. Panorama technology, as the most intuitive and lowest-cost realization of virtual reality, has been widely used in many fields. For the image stitching algorithm, the stitching algorithm based on feature point detection and matching is still the mainstream algorithm. Through the feature point extraction and matching of image pairs, the image transformation model can be obtained according to the matching of feature points. The commonly used image transformation models include affine Transformation model, persp...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T3/40G06T7/80
CPCG06T3/4038G06T7/80
Inventor 贾媛任海蕾陈金皖宋锐李云松王养利
Owner XIDIAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap