Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Fast self-calibration method for fish-eye lens binocular camera

A fisheye lens, self-calibration technology, applied in image analysis, image data processing, instruments and other directions, can solve a large number of nonlinear optimization into local optimal, difficult to find the correct image matching point and so on, to achieve a wide range of research significance, The effect of improving accuracy

Pending Publication Date: 2019-09-20
NAT UNIV OF DEFENSE TECH
View PDF4 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, nonlinear optimization requires a large number of correct image matching point pairs
If the influence of radial distortion is ignored in the first step of estimating the geometric relationship between binocular cameras, it may be difficult to find a sufficient number of correct image matching point pairs, so that the second step of nonlinear optimization is likely to fall into a local optimum excellent

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Fast self-calibration method for fish-eye lens binocular camera
  • Fast self-calibration method for fish-eye lens binocular camera
  • Fast self-calibration method for fish-eye lens binocular camera

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0069] The self-calibration process of the fisheye lens binocular camera of the present invention is as follows:

[0070] 1) The binocular camera captures images of ordinary 3D scenes, and performs feature point extraction and matching;

[0071] 2) Use at least 9 image matching point pairs to simultaneously solve the focal length of the two cameras, the radial distortion parameters and the basic matrix between the two cameras, and combine RANSAC to eliminate the outliers in the image matching point set to determine the image matching internal point set;

[0072] 3) Obtain the rotation-translation relationship between the two camera coordinate systems through the camera focal length and fundamental matrix decomposition;

[0073] 4) Optimize the internal parameters and external parameters of the binocular camera according to the image matching internal point set determined by RANSAC;

[0074] 5) Through the joint optimization of multiple stereo image pairs, a more robust and a...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a fast self-calibration method for a fish-eye lens binocular camera. And internal parameters and external parameters of the fish-eye lens binocular camera are quickly calibrated by utilizing polar constraint provided by a common three-dimensional scene. Firstly, a fish-eye lens binocular camera synchronously shoots images of a common three-dimensional scene, and feature point extraction and matching are carried out. Secondly, focal lengths and radial distortion parameters of the two cameras and a basic matrix between the two cameras are solved at the same time by utilizing at least nine image matching point pairs, and an image matching inner point set is determined; and then a rotation translation relation between the coordinate systems of the two cameras is obtained through focal lengths of the cameras and basic matrix decomposition. And finally, the internal parameters and the external parameters of the binocular camera are optimized according to the image matching internal point set determined by the RANSAC. The fisheye lens binocular camera with serious radial distortion can be efficiently and accurately calibrated under the common three-dimensional scene condition, and the method is suitable for equipment with limited computing power such as a mobile phone and an unmanned aerial vehicle and has important research significance and wide application prospects.

Description

technical field [0001] The invention relates to a fast self-calibration method for a fisheye binocular camera, in particular to a method for calibrating internal parameters and external parameters of a fisheye binocular camera using epipolar constraints provided by a common three-dimensional scene. Background technique [0002] Binocular camera is a commonly used structural form in image measurement applications. Binocular camera can directly obtain the 3D geometric information of the target according to the parallax principle, so it is widely used in the fields of visual measurement, 3D reconstruction and robot navigation. Compared with conventional lenses, fisheye lenses have a larger field of view, and their imaging has greater distortion, and the closer to the edge of the image, the greater the image distortion. Therefore, before using the fisheye lens binocular camera for measurement, it must be calibrated with high precision, and the calibration accuracy directly affec...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/80
CPCG06T7/85
Inventor 关棒磊李璋尚洋于起峰
Owner NAT UNIV OF DEFENSE TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products