2D-3D image registration method based on contour coplanar four-point set

An image registration, 2D-3D technology, applied in the field of computer vision, can solve problems such as wrong matching point pairs, failure to satisfy automation, difficulty in finding matching primitives, etc.

Active Publication Date: 2017-11-24
XIDIAN UNIV
View PDF5 Cites 24 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Different types of point clouds and images select appropriate feature primitives for registration according to the characteristics of their data, and it is difficult to find a more general matching primitive; most traditional methods also need to know the approximate registration relationship between point clouds and images , project the point...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • 2D-3D image registration method based on contour coplanar four-point set
  • 2D-3D image registration method based on contour coplanar four-point set
  • 2D-3D image registration method based on contour coplanar four-point set

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0047] In order to make the object, technical solution and advantages of the present invention more clear, the present invention will be further described in detail below in conjunction with the examples. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0048] The technical solutions and effects of the present invention will be further described below in conjunction with the accompanying drawings.

[0049] The basic framework of the 2D-3D image registration method based on the contour coplanar four-point set of the present invention is as follows: figure 1 Shown, the inventive method comprises the following steps:

[0050] Step 1, input the image to be registered I 0 and point cloud P;

[0051] Step 2, use the pinhole imaging process of the OpenGL (OpenGraphicsLibrary) virtual camera to project the point cloud P from n different viewing angles to a two-dimensional plane...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a 2D-3D image registration method based on a contour coplanar four-point set, and belongs to the technical field of computer vision. The coplanar four-point set is used as a registration primitive. Firstly a point cloud is perspectively projected along multiple visual angles so as to form multiple images, and point cloud images close to the image photographing visual angle are searched; then when the corresponding points of the coplanar four points on the point cloud image contour are searched in the object image contour points, the similar triangles of the triangles formed by the three points are searched firstly and then the approximate position of the fourth point is searched according to affine transformation of the plane; and finally an image and point cloud transformation matrix is calculated by using the homography of the plane, and the optimal transformation matrix is selected according to the registration accuracy corresponding to registration of each transformation matrix so that 2D-3D initial registration can be completed. Compared with the methods in the prior art, the matching corresponding points are searched on the contour so that the method is relatively reliable and simple and great in overall degree of automation of the algorithm.

Description

technical field [0001] The invention belongs to the technical field of computer vision, and mainly relates to the registration of images and point cloud data, specifically a 2D-3D image registration method based on four point sets of coplanar contours, which can be used for rough registration of point clouds and images allow. Background technique [0002] The registration of point cloud and image mainly solves the coloring problem of laser point cloud. Through the registration of point cloud and image, information such as the color in the image can be added to the point cloud, making the point cloud model of the object more realistic and vivid; After point cloud and image registration, it can also assist point cloud registration from different perspectives. [0003] The relatively simple method of point cloud and image registration is to fix the position of the scanner and the camera that takes the image, and take the image at the same time when scanning the object to form ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T7/33
CPCG06T7/337G06T2207/10028
Inventor 钟桦胡葵
Owner XIDIAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products