Label optimization point cloud instance segmentation method

A point cloud and label technology, applied in the field of label optimization of point cloud instance segmentation, can solve the problems that the model cannot be applied to other data, the amount of data is small, and overfitting, etc., to improve the effect of point cloud segmentation results.

Pending Publication Date: 2021-07-16
NORTHWEST UNIV(CN)
View PDF4 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The difficulty of solving the above problems and defects is: the scale of the data set is an unavoidable problem for deep learning, the small amount of data leads to overfitting, and the model cannot be applied to other data
The existing deep learning framework for segmenting point clouds restricts the upper limit of segmentation accuracy, and can only improve performance through various other optimization methods, and the improvement is limited

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Label optimization point cloud instance segmentation method
  • Label optimization point cloud instance segmentation method
  • Label optimization point cloud instance segmentation method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0088] The present invention designs a technique for instance segmentation of three-dimensional point clouds in large scenes, and in particular relates to an instance segmentation method based on an optimized label matrix as a supervised point cloud segmentation. The GCN-based point cloud feature extraction method provided by the embodiment of the present invention includes:

[0089] Step 1, for point cloud R={x 1 , x 2 ,...,x n}, kind of x u , use the nearest critical point algorithm to calculate the nearest k points as its adjacent points, and calculate the adjacent points of all points in the point cloud;

[0090] Step 2, for point cloud R mapping, the adjacency matrix A of point cloud R is established through the adjacency relationship between points in the point cloud obtained in step 1;

[0091] Step 3, calculate the degree matrix D of the adjacency matrix A, use the degree matrix and the adjacency matrix to calculate the Laplacian matrix L, and normalize the Laplaci...

Embodiment 2

[0100] The three-dimensional point cloud of the large scene described in the present invention is a concept commonly understood in the art, and the data format is a commonly used three-dimensional model data format. For example, the three-dimensional models with .ply, .pcd and .obj as suffixes are all point cloud models, The three-dimensional point cloud of the large scene described in the present invention represents a three-dimensional model modeled in an indoor or outdoor scene. Compared with the common three-dimensional model of a single object, the point cloud of the three-dimensional point cloud of the large scene is scattered and the scale of the point cloud is large. The characteristics increase the difficulty of point cloud segmentation.

[0101] Here is a brief description of the S3DIS dataset: the S3DIS dataset is a large-scale scene point cloud dataset for semantic segmentation, in 271 rooms in 6 regions, using a Matterport camera (combined with 3 structured light s...

Embodiment 3

[0109] The point cloud feature extraction method that the embodiment of the present invention provides is as follows:

[0110] First, do the following operations for each point in the point cloud, here is a point u in the point cloud as an example:

[0111] Sort the distances from other points of the point cloud to point u, and the order of the remaining points from the example point u is sorted from small to large:

[0112] u 1 , u 2 ,...,u k×d ;

[0113] After using Dilated K-NN to determine the Dilated coefficient d, the neighbor node corresponding to point u is u 1 , u 1+d , u 1+2d ,...,u 1+(k-1)d , by adjusting the size of d to determine the expansion distance of the point neighborhood.

[0114] The coefficient d=1 is given by default, and the adjacency matrix A is constructed according to the adjacency relationship between points in the point cloud calculated in the previous step. The construction method of the adjacency matrix A is:

[0115] For a point u, ther...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention belongs to the technical field of point cloud instance segmentation, and discloses a label optimization point cloud instance segmentation method. The method comprises the steps: firstly carrying out the feature extraction of a point cloud through a graph convolution neural network; establishing an instance label matrix for the training set, and performing label propagation on the instance label matrix by using a label propagation algorithm to obtain an optimized instance label matrix; and finally, performing instance segmentation on the point cloud by combining the label matrix and the optimized instance label matrix. According to the method, the similarity relationship of the points in the point cloud is fused, so that the supervision of the label matrix has better distinguishing representation, and a better segmentation result is obtained. According to the method, the global shape information and the local feature information of the large-scene point cloud model are considered, and the effect of integrating the global information is achieved; a label propagation algorithm is used for optimizing a label matrix, and the point cloud segmentation result is improved through the combined action of original data set labels and optimized labels.

Description

technical field [0001] The invention belongs to the technical field of point cloud instance segmentation, and in particular relates to a tag-optimized point cloud instance segmentation method. Background technique [0002] At present, the instance segmentation of point cloud refers to identifying the similarities and differences between different objects under a certain threshold range through the collection and integration of model features and the use of corresponding algorithms. Instance segmentation mainly includes two main tasks: feature extraction of point cloud and parameter adjustment of loss function for instance segmentation. However, in the existing point cloud instance segmentation methods, there are mainly three directions: the first is to voxelize the point cloud, and use the regularity of voxels in the three-dimensional space to perform convolution, but the disadvantage lies in the calculations consumed by voxelization. The volume is large, and the accuracy o...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/11G06K9/46G06N3/04G06N3/08
CPCG06T7/11G06N3/08G06T2207/10028G06V10/40G06N3/045
Inventor 耿国华董蕴泰李康马益飞
Owner NORTHWEST UNIV(CN)
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products