Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Spectral domain graph convolution 3D point cloud classification method based on Fourier transform

A technology of Fourier transform and classification method, which is applied in image analysis, neural learning methods, image enhancement, etc., can solve the problems of lack, uneven distribution of point cloud density, etc., and achieve the effect of strong anti-noise ability and high calculation efficiency

Pending Publication Date: 2020-12-29
NANJING UNIV OF INFORMATION SCI & TECH
View PDF0 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In order to overcome the shortcomings of the existing technology and effectively solve the problem that the traditional 3D point cloud classification method is affected by the spatial relationship and uneven distribution of the point cloud, the present invention provides a spectral domain graph convolution 3D point cloud classification method based on Fourier transform. On the premise of not changing the spatial information of the point cloud, a new form of representation-graph is proposed. The graph structure effectively solves the problem of the adjacency relationship between points and points in most point cloud deep learning models, and retains the spatial geometric information. The graph is very suitable for different arrangement. Regular non-European data; deep learning lacks a lot of research work in the spectral domain. This model combines the method of spectral domain graph convolution in the 3D point cloud framework for the first time. Spectral domain convolution has a solid mathematical theoretical foundation, and graph convolution is more focused. The adjacency relationship between key points; the G-PointNet of the present invention makes great improvements in feature point acquisition and local area division, proposes geometric sampling preprocessing and designs a dynamic K-nearest neighbor graph construction method Dynamic KNN, effectively solves the problem of The problem of uneven distribution of point cloud density

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Spectral domain graph convolution 3D point cloud classification method based on Fourier transform
  • Spectral domain graph convolution 3D point cloud classification method based on Fourier transform
  • Spectral domain graph convolution 3D point cloud classification method based on Fourier transform

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0028] Embodiments of the present invention will be described below in conjunction with the accompanying drawings.

[0029] Such as figure 1 As shown, the present invention designs a 3D point cloud classification method based on Fourier transform-based spectral domain graph convolution. The process can be divided into three parts: geometric sampling, Dynamic KNN local graph construction, and Fourier transform-based spectral domain graph convolution. , including the following steps:

[0030] Step 1. Use the G-PointNet network model to perform geometric sampling processing on the input original point cloud. details as follows:

[0031] First, the G-PointNet network model of the present invention is obtained under the inspiration of the PointNet deep network model and the spectral domain graph convolution operation based on Fourier transform. The G-PointNet network model retains the spatial transformation network T-Net in PointNet. The G-PointNet network model directly uses p...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a spectral domain graph convolution 3D point cloud classification method based on Fourier transform, and the method comprises the steps: carrying out the geometric sampling ofan inputted original point cloud through a G-Point Net network model: setting an angle threshold value V, dividing points with neighborhood included angle values larger than an angle threshold V intoa geometric feature area G, and dividing the remaining points into other areas T; sampling to obtain point cloud of each area; introducing an expansion rate E based on a Dynamic KNN local graph construction method, and selectively establishing a local geometric graph every other E neighbor point clouds. Spectral domain graph convolution is carried out by using a spectral domain graph convolution method based on Fourier transform to obtain a plurality of pooled graph local features, global features are obtained through GPoint Net for classification, and a classification result is obtained. According to the method, the problem of non-uniform distribution of point cloud density is effectively solved, spatial geometric information is reserved, edge points of the point cloud can be efficientlydistinguished, meanwhile, noise points are separated, and the classification precision is improved.

Description

technical field [0001] The invention relates to a spectral domain map convolution 3D point cloud classification method based on Fourier transform, and belongs to the technical field of remote sensing image processing. Background technique [0002] With the contention of a hundred schools of thought in image processing technology, classification methods based on two-dimensional images emerge in an endless stream, and have made great achievements. However, the effect of deep learning processing methods based on 3D data is far inferior to that of 2D image classification. 3D data is typically represented as depth images, voxels, meshes, and point clouds. Compared with obtaining 3D data through RGB-D cameras or mainstream sensors, the 3D point cloud obtained by lidar can provide more reliable depth and contour information of 3D objects, and has been gradually applied to 3D object classification in recent years. [0003] In the previous work, most computer vision researchers use...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06K9/62G06N3/04G06N3/08G06T5/00G06T5/10G06T7/11
CPCG06T7/11G06T5/10G06N3/08G06T2207/10028G06T2207/20081G06T2207/20084G06N3/045G06F18/24143G06T5/70Y02A90/10
Inventor 陈苏婷陈怀新
Owner NANJING UNIV OF INFORMATION SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products