RGB-D feature matching-based 3D point cloud registration and fusion method

An RGB-D, feature matching technology, applied in image data processing, instruments, computing, etc., can solve problems such as inability to obtain 3D point cloud data at one time, and registration algorithm degradation.

Active Publication Date: 2018-05-18
BEIJING INFORMATION SCI & TECH UNIV
View PDF2 Cites 30 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] Scene 3D reconstruction is an important research topic in the field of computer vision. In practical applications, the complete 3D point cloud data of the measured scene surface cannot be obtained at one time. The point cloud data can only be obtained through multi-viewpoint shooting or measurement, and then registered to a unified coordinate. Department
The commonly used method: relying on instrument registration to rotate and translate multiple point clouds into a unified coordinate system through the coordinate relationship between hardware, this m

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • RGB-D feature matching-based 3D point cloud registration and fusion method
  • RGB-D feature matching-based 3D point cloud registration and fusion method
  • RGB-D feature matching-based 3D point cloud registration and fusion method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0078] In the drawings, the same or similar reference numerals are used to denote the same or similar elements or elements having the same or similar functions. Embodiments of the present invention will be described in detail below in conjunction with the accompanying drawings.

[0079] The flow chart of the 3D point cloud splicing and fusion method based on RGB-D feature matching provided in this embodiment is as follows figure 1 shown, including:

[0080] Step 100, projecting the 3D point cloud data of the scene surface from different viewpoints to the RGB-D image for processing, so as to realize the dimensionality reduction calculation of the 3D point cloud down to 2D;

[0081] Step 200, extracting feature points in the RGB-D image, establishing a feature description of the RGB-D image, and matching RGB-D images from different viewpoints;

[0082] Step 300, solving the coordinate and depth transformation matrix, and stitching and fusing the RGB-D images;

[0083] Step 40...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an RGB-D feature matching-based 3D point cloud registration and fusion method. The method mainly comprises the following steps of: projecting scene surface 3D point cloud dataof different viewpoints to RGB-D images to carry out processing, so as to realize dimensionality reduction calculation from three-dimensional point cloud to two-dimensional point cloud; extracting feature points of the RGB-D images, establishing feature descriptions of the RGB-D images, and matching the RGB-D images of the different viewpoints; solving a coordinate and a depth transformation matrix, and registering and fusing the RGB-D images; and converting the fused RGB-D images into 3D point cloud data. Through the method provided by the invention, calculation of three-dimensional feature extraction and matching can be simplified, and the efficiency of three-dimensional point cloud registration and fusion can be improved. The method provided by the invention can be applied to scene reconstruction of 3D large fields of view and 3D full views.

Description

technical field [0001] The invention relates to the fields of computer vision and digital image processing, in particular to a 3D point cloud splicing and fusion method based on RGB-D feature matching. Background technique [0002] Scene 3D reconstruction is an important research topic in the field of computer vision. In practical applications, the complete 3D point cloud data of the surface of the measured scene cannot be obtained at one time. The point cloud data can only be obtained through multi-viewpoint shooting or measurement, and then registered to a unified coordinate. Department. The commonly used method: relying on instrument registration to rotate and translate multiple point clouds into a unified coordinate system through the coordinate relationship between hardware, this method does not require common features between point clouds, and the registration speed is fast, but requires hardware Accurate calibration or the assistance of marker points to obtain the co...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T3/40G06T5/50G06T7/33G06T7/90
CPCG06T3/4007G06T3/4038G06T5/50G06T2207/10024G06T2207/10028G06T2207/20221G06T7/33G06T7/90
Inventor 邱钧刘畅王媛吴丽娜
Owner BEIJING INFORMATION SCI & TECH UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products