Point cloud semantic segmentation method based on point global context relation reasoning

A semantic segmentation and context technology, applied in the computer field, can solve problems such as the inability to capture long-distance context dependencies between points, insufficient consideration of PointNet++ category context information, and low segmentation accuracy

Pending Publication Date: 2020-05-22
SUN YAT SEN UNIV
View PDF2 Cites 26 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] Although PointNet++ can capture local fine-grained and global context information, it is still unable to capture the long-distance context dependencies between points because it uses stacked MLP layers to learn the features of point clouds.
In the segmentation results, some specific categories are eas

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Point cloud semantic segmentation method based on point global context relation reasoning
  • Point cloud semantic segmentation method based on point global context relation reasoning
  • Point cloud semantic segmentation method based on point global context relation reasoning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0037] The present invention will be further described below in conjunction with the accompanying drawings. It should be noted that the following examples are based on the technical solution, and provide detailed implementation and specific operation process, but the protection scope of the present invention is not limited to the present invention. Example.

[0038] The present invention is a point cloud semantic segmentation method based on point global context reasoning, the method comprising:

[0039] Step 1) Obtain training set T and test set V:

[0040] 1a) Download 3D point cloud data from S3DIS official website, including 3D point cloud data of 6 regions in 271 different rooms. We choose the 5th area as the test set V, and the remaining 5 areas as the training set T.

[0041] 1b) Randomly downsample L points from the point cloud training set T. where the point cloud is expressed as It contains a C 0 L points of the channel (including position features {x,y,z} and ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a point cloud semantic segmentation method based on point global context relation reasoning. The method comprises the steps of obtaining a training set T and a test set V; constructing a point cloud data semantic segmentation network of deep learning and global context reasoning; using a multi-classification cross entropy loss function as a loss function of the point cloudsemantic segmentation network; performing P rounds of supervised training on the point cloud data semantic segmentation network by using the training set; and inputting the test set into the trained network model for semantic segmentation to obtain a segmentation result of each point. The method has the beneficial effect that the problem of insufficient global information extraction of 3D point cloud semantic segmentation is solved by utilizing a method based on deep learning and global context reasoning. On the basis of deep learning, an added global context inference module models the relationship between feature channels by using a channel attention mechanism, global information of the relationship between the channels is further transmitted and aggregated through graph convolution, andthe global information can be obtained so as to refine the result of point cloud semantic segmentation.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to a point cloud semantic segmentation method based on point global context reasoning. Background technique [0002] In recent years, with the widespread application of depth cameras and LiDAR, a large amount of 3D point cloud data has become more and more accessible, and 3D vision tasks based on deep learning have attracted a lot of attention. 3D point cloud data is a collection of vector representations of scattered points in three-dimensional space. The vector can be composed of three-dimensional coordinates xyz, color information rgb, light intensity r and other information. These points are irregularly distributed and have the characteristics of disorder, unstructure, rotation invariance, etc., so it is impractical to directly extend the existing image segmentation methods to 3D point clouds. Applying deep learning methods to point cloud data faces many problems. [0003] ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T7/10G06N3/04G06N3/08
CPCG06T7/10G06N3/084G06T2207/10028G06T2207/20081G06T2207/20084G06N3/045
Inventor 郭裕兰马燕妮刘浩文贡坚
Owner SUN YAT SEN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products